Jul 16 22:11:40.637136 ip-10-0-141-47 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 16 22:11:40.637149 ip-10-0-141-47 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 16 22:11:40.637157 ip-10-0-141-47 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 16 22:11:40.637467 ip-10-0-141-47 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 16 22:11:50.705731 ip-10-0-141-47 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 16 22:11:50.705752 ip-10-0-141-47 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot f744e556a547421cb2c01f651cb16f43 --
Jul 16 22:13:44.405611 ip-10-0-141-47 systemd[1]: Starting Kubernetes Kubelet...
Jul 16 22:13:44.804173 ip-10-0-141-47 kubenswrapper[2552]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 16 22:13:44.804173 ip-10-0-141-47 kubenswrapper[2552]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 16 22:13:44.804173 ip-10-0-141-47 kubenswrapper[2552]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 16 22:13:44.804173 ip-10-0-141-47 kubenswrapper[2552]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 16 22:13:44.804173 ip-10-0-141-47 kubenswrapper[2552]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 16 22:13:44.804173 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.792927    2552 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 16 22:13:44.804173 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.796767    2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 22:13:44.804173 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.796777    2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 22:13:44.804173 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.796782    2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 22:13:44.804173 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.796785    2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 22:13:44.804173 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.796788    2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 22:13:44.804173 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.796792    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 22:13:44.804173 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.796795    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 22:13:44.804173 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.796797    2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 22:13:44.806550 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.796800    2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 22:13:44.806550 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.796803    2552 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 22:13:44.806550 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.796806    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 22:13:44.806550 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.796809    2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 22:13:44.806550 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.796811    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 22:13:44.806550 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.796813    2552 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 22:13:44.806550 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.796816    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 22:13:44.806550 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.796819    2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 22:13:44.806550 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.796821    2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 22:13:44.806550 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.796824    2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 22:13:44.806550 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.796827    2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 22:13:44.806550 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.796829    2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 22:13:44.806550 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.796832    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 22:13:44.806550 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.796835    2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 22:13:44.806550 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.796838    2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 22:13:44.806550 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.796840    2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 22:13:44.806550 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.796843    2552 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 22:13:44.806550 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.796845    2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 22:13:44.806550 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.796858    2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 22:13:44.806550 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.796861    2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 22:13:44.808323 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.796863    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 22:13:44.808323 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.796866    2552 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 22:13:44.808323 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.796868    2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 22:13:44.808323 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.796871    2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 22:13:44.808323 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.796874    2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 22:13:44.808323 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.796878    2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 22:13:44.808323 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.796882    2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 22:13:44.808323 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.796885    2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 22:13:44.808323 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.796888    2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 22:13:44.808323 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.796891    2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 22:13:44.808323 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.796893    2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 22:13:44.808323 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.796896    2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 22:13:44.808323 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.796898    2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 22:13:44.808323 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.796901    2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 22:13:44.808323 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.796904    2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 22:13:44.808323 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.796906    2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 22:13:44.808323 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.796909    2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 22:13:44.808323 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.796911    2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 22:13:44.808323 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.796914    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 22:13:44.810629 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.796918    2552 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 22:13:44.810629 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.796920    2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 22:13:44.810629 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.796923    2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 22:13:44.810629 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.796926    2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 22:13:44.810629 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.796929    2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 22:13:44.810629 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.796932    2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 22:13:44.810629 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.796936    2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 22:13:44.810629 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.796938    2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 22:13:44.810629 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.796941    2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 22:13:44.810629 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.796944    2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 22:13:44.810629 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.796946    2552 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 22:13:44.810629 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.796949    2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 22:13:44.810629 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.796953    2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 22:13:44.810629 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.796956    2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 22:13:44.810629 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.796959    2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 22:13:44.810629 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.796962    2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 22:13:44.810629 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.796965    2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 22:13:44.810629 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.796968    2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 22:13:44.810629 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.796970    2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 22:13:44.810629 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.796972    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 22:13:44.812472 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.796975    2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 22:13:44.812472 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.796978    2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 22:13:44.812472 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.796981    2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 22:13:44.812472 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.796983    2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 22:13:44.812472 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.796987    2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 22:13:44.812472 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.796990    2552 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 22:13:44.812472 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.796993    2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 22:13:44.812472 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.796996    2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 22:13:44.812472 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.796999    2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 22:13:44.812472 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.797002    2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 22:13:44.812472 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.797004    2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 22:13:44.812472 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.797007    2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 22:13:44.812472 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.797010    2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 22:13:44.812472 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.797013    2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 22:13:44.812472 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.797017    2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 22:13:44.812472 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.797021    2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 22:13:44.812472 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.797025    2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 22:13:44.812472 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.797028    2552 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 22:13:44.812472 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.797030    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 22:13:44.812472 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.797033    2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 22:13:44.814609 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.797036    2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 22:13:44.814609 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.797039    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 22:13:44.814609 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.797042    2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 22:13:44.814609 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.797044    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 22:13:44.814609 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.797047    2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 22:13:44.814609 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.797049    2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 22:13:44.814609 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.797052    2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 22:13:44.814609 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.797055    2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 22:13:44.814609 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.797058    2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 22:13:44.814609 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.797061    2552 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 22:13:44.814609 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.797065    2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 22:13:44.814609 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.797068    2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 22:13:44.814609 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.797738    2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 22:13:44.814609 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.797745    2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 22:13:44.814609 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.797748    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 22:13:44.814609 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.797751    2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 22:13:44.814609 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.797756    2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 22:13:44.814609 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.797759    2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 22:13:44.814609 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.797763    2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 22:13:44.816279 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.797766    2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 22:13:44.816279 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.797769    2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 22:13:44.816279 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.797771    2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 22:13:44.816279 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.797774    2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 22:13:44.816279 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.797777    2552 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 22:13:44.816279 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.797781    2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 22:13:44.816279 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.797785    2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 22:13:44.816279 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.797788    2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 22:13:44.816279 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.797791    2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 22:13:44.816279 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.797794    2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 22:13:44.816279 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.797797    2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 22:13:44.816279 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.797800    2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 22:13:44.816279 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.797803    2552 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 22:13:44.816279 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.797806    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 22:13:44.816279 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.797809    2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 22:13:44.816279 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.797811    2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 22:13:44.816279 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.797814    2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 22:13:44.816279 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.797817    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 22:13:44.816279 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.797819    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 22:13:44.818756 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.797822    2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 22:13:44.818756 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.797824    2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 22:13:44.818756 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.797827    2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 22:13:44.818756 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.797830    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 22:13:44.818756 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.797832    2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 22:13:44.818756 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.797835    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 22:13:44.818756 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.797838    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 22:13:44.818756 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.797840    2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 22:13:44.818756 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.797843    2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 22:13:44.818756 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.797845    2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 22:13:44.818756 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.797848    2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 22:13:44.818756 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.797851    2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 22:13:44.818756 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.797853    2552 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 22:13:44.818756 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.797856    2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 22:13:44.818756 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.797858    2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 22:13:44.818756 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.797861    2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 22:13:44.818756 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.797863    2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 22:13:44.818756 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.797866    2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 22:13:44.818756 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.797868    2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 22:13:44.818756 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.797872    2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 22:13:44.822751 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.797875    2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 22:13:44.822751 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.797878    2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 22:13:44.822751 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.797881    2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 22:13:44.822751 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.797883    2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 22:13:44.822751 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.797886    2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 22:13:44.822751 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.797888    2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 22:13:44.822751 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.797893    2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 22:13:44.822751 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.797896    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 22:13:44.822751 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.797900    2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 22:13:44.822751 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.797902    2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 22:13:44.822751 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.797905    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 22:13:44.822751 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.797907    2552 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 22:13:44.822751 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.797910    2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 22:13:44.822751 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.797914    2552 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 22:13:44.822751 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.797916    2552 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 22:13:44.822751 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.797919    2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 22:13:44.822751 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.797922    2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 22:13:44.822751 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.797924    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 22:13:44.822751 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.797927    2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 22:13:44.822751 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.797929    2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 22:13:44.981060 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.797932    2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 22:13:44.981060 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.797935    2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 22:13:44.981060 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.797937    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 22:13:44.981060 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.797940    2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 22:13:44.981060 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.797943    2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 22:13:44.981060 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.797945    2552 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 22:13:44.981060 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.797948    2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 22:13:44.981060 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.797950    2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 22:13:44.981060 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.797953    2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 22:13:44.981060 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.797955    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 22:13:44.981060 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.797957    2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 22:13:44.981060 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.797961    2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 22:13:44.981060 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.797964    2552 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 22:13:44.981060 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.797966    2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 22:13:44.981060 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.797970    2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 22:13:44.981060 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.797973    2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 22:13:44.981060 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.797976    2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 22:13:44.981060 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.797979    2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 22:13:44.981060 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.797981    2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 22:13:44.981060 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.797984    2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 22:13:44.858102 ip-10-0-141-47 systemd[1]: Started Kubernetes Kubelet.
Jul 16 22:13:44.993478 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.797987    2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 22:13:44.993478 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.797990    2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 22:13:44.993478 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.797993    2552 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 22:13:44.993478 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.797995    2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 22:13:44.993478 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.797998    2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 22:13:44.993478 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.798001    2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 22:13:44.993478 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.798003    2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 22:13:44.993478 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.798006    2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 22:13:44.993478 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.798008    2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 22:13:44.993478 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.798011    2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 22:13:44.993478 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.798013    2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 22:13:44.993478 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.798015    2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 22:13:44.993478 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.798018    2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 22:13:44.993478 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.798403    2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 22:13:44.993478 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.798409    2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 22:13:44.993478 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.798413    2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 22:13:44.993478 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.798416    2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 22:13:44.993478 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.798419    2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 22:13:44.993478 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.798421    2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 22:13:44.993478 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.798424    2552 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 22:13:44.994627 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.798427    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 22:13:44.994627 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.798429    2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 22:13:44.994627 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.798432    2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 22:13:44.994627 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.798436    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 22:13:44.994627 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.798438    2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 22:13:44.994627 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.798441    2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 22:13:44.994627 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.798444    2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 22:13:44.994627 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.798447    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 22:13:44.994627 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.798450    2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 22:13:44.994627 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.798452    2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 22:13:44.994627 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.798455    2552 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 22:13:44.994627 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.798457    2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 22:13:44.994627 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.798461    2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 22:13:44.994627 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.798465    2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 22:13:44.994627 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.798467    2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 22:13:44.994627 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.798470    2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 22:13:44.994627 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.798473    2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 22:13:44.994627 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.798475    2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 22:13:44.994627 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.798478    2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 22:13:44.995645 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.798480    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 22:13:44.995645 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.798484    2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 22:13:44.995645 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.798488    2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 22:13:44.995645 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.798491    2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 22:13:44.995645 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.798494    2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 22:13:44.995645 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.798497    2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 22:13:44.995645 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.798500    2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 22:13:44.995645 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.798502    2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 22:13:44.995645 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.798505    2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 22:13:44.995645 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.798507    2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 22:13:44.995645 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.798510    2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 22:13:44.995645 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.798512    2552 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 22:13:44.995645 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.798514    2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 22:13:44.995645 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.798517    2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 22:13:44.995645 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.798519    2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 22:13:44.995645 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.798522    2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 22:13:44.995645 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.798525    2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 22:13:44.995645 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.798528    2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 22:13:44.995645 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.798530    2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 22:13:44.996251 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.798533    2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 22:13:44.996251 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.798536    2552 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 22:13:44.996251 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.798539    2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 22:13:44.996251 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.798542    2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 22:13:44.996251 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.798544    2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 22:13:44.996251 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.798547    2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 22:13:44.996251 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.798551    2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 22:13:44.996251 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.798554    2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 22:13:44.996251 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.798558    2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 22:13:44.996251 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.798560    2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 22:13:44.996251 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.798563    2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 22:13:44.996251 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.798567    2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 22:13:44.996251 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.798570    2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 22:13:44.996251 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.798573    2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 22:13:44.996251 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.798575    2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 22:13:44.996251 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.798578    2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 22:13:44.996251 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.798583    2552 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 22:13:44.996251 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.798585    2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 22:13:44.996251 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.798588    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 22:13:44.996872 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.798590    2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 22:13:44.996872 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.798593    2552 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 22:13:44.996872 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.798595    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 22:13:44.996872 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.798598    2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 22:13:44.996872 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.798601    2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 22:13:44.996872 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.798603    2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 22:13:44.996872 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.798606    2552 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 22:13:44.996872 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.798608    2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 22:13:44.996872 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.798611    2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 22:13:44.996872 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.798613    2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 22:13:44.996872 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.798617    2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 22:13:44.996872 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.798619    2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 22:13:44.996872 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.798623    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 22:13:44.996872 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.798625    2552 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 22:13:44.996872 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.798628    2552 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 22:13:44.996872 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.798631    2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 22:13:44.996872 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.798634    2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 22:13:44.996872 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.798636    2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 22:13:44.996872 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.798639    2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 22:13:44.996872 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.798641    2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 22:13:44.997709 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.798644    2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 22:13:44.997709 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.798646    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 22:13:44.997709 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.798649    2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 22:13:44.997709 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.798651    2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 22:13:44.997709 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.798654    2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 22:13:44.997709 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.798656    2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 22:13:44.997709 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.798659    2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 22:13:44.997709 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.798662    2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 22:13:44.997709 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.798664    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 22:13:44.997709 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.798668    2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 22:13:44.997709 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.798671    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 22:13:44.997709 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.798673    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 22:13:44.997709 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.798676    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 22:13:44.997709 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.798678    2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 22:13:44.997709 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.798681    2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 22:13:44.997709 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.798755    2552 flags.go:64] FLAG: --address="0.0.0.0"
Jul 16 22:13:44.997709 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.798762    2552 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 16 22:13:44.997709 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.798768    2552 flags.go:64] FLAG: --anonymous-auth="true"
Jul 16 22:13:44.997709 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.798774    2552 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 16 22:13:44.997709 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.798780    2552 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 16 22:13:44.997709 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.798784    2552 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 16 22:13:45.000848 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.798790    2552 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 16 22:13:45.000848 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.798798    2552 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 16 22:13:45.000848 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.798801    2552 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 16 22:13:45.000848 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.798804    2552 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 16 22:13:45.000848 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.798808    2552 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 16 22:13:45.000848 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.798811    2552 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 16 22:13:45.000848 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.798814    2552 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 16 22:13:45.000848 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.798818    2552 flags.go:64] FLAG: --cgroup-root=""
Jul 16 22:13:45.000848 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.798821    2552 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 16 22:13:45.000848 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.798824    2552 flags.go:64] FLAG: --client-ca-file=""
Jul 16 22:13:45.000848 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.798827    2552 flags.go:64] FLAG: --cloud-provider="external"
Jul 16 22:13:45.000848 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.798830    2552 flags.go:64] FLAG: --cluster-dns="[]"
Jul 16 22:13:45.000848 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.798835    2552 flags.go:64] FLAG: --cluster-domain=""
Jul 16 22:13:45.000848 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.798837    2552 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 16 22:13:45.000848 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.798840    2552 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 16 22:13:45.000848 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.798844    2552 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 16 22:13:45.000848 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.798847    2552 flags.go:64] FLAG: --container-log-max-files="5"
Jul 16 22:13:45.000848 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.798850    2552 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 16 22:13:45.000848 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.798853    2552 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 16 22:13:45.000848 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.798856    2552 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 16 22:13:45.000848 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.798861    2552 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 16 22:13:45.000848 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.798863    2552 flags.go:64] FLAG: --contention-profiling="false"
Jul 16 22:13:45.000848 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.798866    2552 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 16 22:13:45.000848 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.798869    2552 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 16 22:13:45.002903 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.798872    2552 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 16 22:13:45.002903 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.798875    2552 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 16 22:13:45.002903 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.798894    2552 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 16 22:13:45.002903 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.798897    2552 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 16 22:13:45.002903 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.798900    2552 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 16 22:13:45.002903 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.798902    2552 flags.go:64] FLAG: --enable-load-reader="false"
Jul 16 22:13:45.002903 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.798905    2552 flags.go:64] FLAG: --enable-server="true"
Jul 16 22:13:45.002903 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.798908    2552 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 16 22:13:45.002903 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.798912    2552 flags.go:64] FLAG: --event-burst="100"
Jul 16 22:13:45.002903 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.798917    2552 flags.go:64] FLAG: --event-qps="50"
Jul 16 22:13:45.002903 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.798919    2552 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 16 22:13:45.002903 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.798922    2552 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 16 22:13:45.002903 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.798925    2552 flags.go:64] FLAG: --eviction-hard=""
Jul 16 22:13:45.002903 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.798928    2552 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 16 22:13:45.002903 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.798931    2552 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 16 22:13:45.002903 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.798934    2552 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 16 22:13:45.002903 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.798938    2552 flags.go:64] FLAG: --eviction-soft=""
Jul 16 22:13:45.002903 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.798941    2552 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 16 22:13:45.002903 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.798943    2552 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 16 22:13:45.002903 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.798946    2552 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 16 22:13:45.002903 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.798949    2552 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 16 22:13:45.002903 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.798952    2552 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 16 22:13:45.002903 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.798955    2552 flags.go:64] FLAG: --fail-swap-on="true"
Jul 16 22:13:45.002903 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.798957    2552 flags.go:64] FLAG: --feature-gates=""
Jul 16 22:13:45.002903 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.798961    2552 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 16 22:13:45.017388 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.798963    2552 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 16 22:13:45.017388 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.798966    2552 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 16 22:13:45.017388 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.798969    2552 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 16 22:13:45.017388 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.798974    2552 flags.go:64] FLAG: --healthz-port="10248"
Jul 16 22:13:45.017388 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.798977    2552 flags.go:64] FLAG: --help="false"
Jul 16 22:13:45.017388 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.798980    2552 flags.go:64] FLAG: --hostname-override="ip-10-0-141-47.ec2.internal"
Jul 16 22:13:45.017388 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.798983    2552 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 16 22:13:45.017388 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.798986    2552 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 16 22:13:45.017388 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.798989    2552 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 16 22:13:45.017388 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.798992    2552 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 16 22:13:45.017388 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.798995    2552 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 16 22:13:45.017388 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.798998    2552 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 16 22:13:45.017388 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.799001    2552 flags.go:64] FLAG: --image-service-endpoint=""
Jul 16 22:13:45.017388 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.799004    2552 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 16 22:13:45.017388 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.799007    2552 flags.go:64] FLAG: --kube-api-burst="100"
Jul 16 22:13:45.017388 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.799010    2552 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 16 22:13:45.017388 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.799014    2552 flags.go:64] FLAG: --kube-api-qps="50"
Jul 16 22:13:45.017388 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.799016    2552 flags.go:64] FLAG: --kube-reserved=""
Jul 16 22:13:45.017388 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.799019    2552 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 16 22:13:45.017388 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.799022    2552 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 16 22:13:45.017388 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.799025    2552 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 16 22:13:45.017388 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.799028    2552 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 16 22:13:45.017388 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.799030    2552 flags.go:64] FLAG: --lock-file=""
Jul 16 22:13:45.017388 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.799033    2552 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 16 22:13:45.018130 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.799038    2552 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 16 22:13:45.018130 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.799043    2552 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 16 22:13:45.018130 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.799050    2552 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 16 22:13:45.018130 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.799054    2552 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 16 22:13:45.018130 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.799056    2552 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 16 22:13:45.018130 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.799059    2552 flags.go:64] FLAG: --logging-format="text"
Jul 16 22:13:45.018130 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.799062    2552 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 16 22:13:45.018130 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.799065    2552 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 16 22:13:45.018130 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.799068    2552 flags.go:64] FLAG: --manifest-url=""
Jul 16 22:13:45.018130 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.799071    2552 flags.go:64] FLAG: --manifest-url-header=""
Jul 16 22:13:45.018130 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.799075    2552 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 16 22:13:45.018130 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.799080    2552 flags.go:64] FLAG: --max-open-files="1000000"
Jul 16 22:13:45.018130 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.799084    2552 flags.go:64] FLAG: --max-pods="110"
Jul 16 22:13:45.018130 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.799087    2552 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 16 22:13:45.018130 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.799090    2552 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 16 22:13:45.018130 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.799092    2552 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 16 22:13:45.018130 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.799095    2552 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 16 22:13:45.018130 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.799098    2552 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 16 22:13:45.018130 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.799101    2552 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 16 22:13:45.018130 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.799104    2552 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 16 22:13:45.018130 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.799111    2552 flags.go:64] FLAG: --node-status-max-images="50"
Jul 16 22:13:45.018130 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.799114    2552 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 16 22:13:45.018130 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.799116    2552 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 16 22:13:45.018130 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.799119    2552 flags.go:64] FLAG: --pod-cidr=""
Jul 16 22:13:45.018963 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.799123    2552 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 16 22:13:45.018963 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.799129    2552 flags.go:64] FLAG: --pod-manifest-path=""
Jul 16 22:13:45.018963 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.799132    2552 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 16 22:13:45.018963 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.799135    2552 flags.go:64] FLAG: --pods-per-core="0"
Jul 16 22:13:45.018963 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.799137    2552 flags.go:64] FLAG: --port="10250"
Jul 16 22:13:45.018963 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.799140    2552 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 16 22:13:45.018963 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.799143    2552 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0fcbe7e2dbd2eeb1d"
Jul 16 22:13:45.018963 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.799146    2552 flags.go:64] FLAG: --qos-reserved=""
Jul 16 22:13:45.018963 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.799149    2552 flags.go:64] FLAG: --read-only-port="10255"
Jul 16 22:13:45.018963 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.799153    2552 flags.go:64] FLAG: --register-node="true"
Jul 16 22:13:45.018963 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.799155    2552 flags.go:64] FLAG: --register-with-taints=""
Jul 16 22:13:45.018963 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.799159    2552 flags.go:64] FLAG: --registry-burst="10"
Jul 16 22:13:45.018963 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.799161    2552 flags.go:64] FLAG: --registry-qps="5"
Jul 16 22:13:45.018963 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.799164    2552 flags.go:64] FLAG: --reserved-cpus=""
Jul 16 22:13:45.018963 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.799167    2552 flags.go:64] FLAG: --reserved-memory=""
Jul 16 22:13:45.018963 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.799170    2552 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 16 22:13:45.018963 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.799173    2552 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 16 22:13:45.018963 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.799176    2552 flags.go:64] FLAG: --rotate-certificates="false"
Jul 16 22:13:45.018963 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.799179    2552 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 16 22:13:45.018963 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.799182    2552 flags.go:64] FLAG: --runonce="false"
Jul 16 22:13:45.018963 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.799187    2552 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 16 22:13:45.018963 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.799190    2552 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 16 22:13:45.018963 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.799193    2552 flags.go:64] FLAG: --seccomp-default="false"
Jul 16 22:13:45.018963 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.799195    2552 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 16 22:13:45.018963 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.799198    2552 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 16 22:13:45.019790 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.799201    2552 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 16 22:13:45.019790 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.799204    2552 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 16 22:13:45.019790 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.799207    2552 flags.go:64] FLAG: --storage-driver-password="root"
Jul 16 22:13:45.019790 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.799210    2552 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 16 22:13:45.019790 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.799213    2552 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 16 22:13:45.019790 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.799215    2552 flags.go:64] FLAG: --storage-driver-user="root"
Jul 16 22:13:45.019790 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.799218    2552 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 16 22:13:45.019790 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.799222    2552 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 16 22:13:45.019790 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.799225    2552 flags.go:64] FLAG: --system-cgroups=""
Jul 16 22:13:45.019790 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.799228    2552 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 16 22:13:45.019790 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.799233    2552 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 16 22:13:45.019790 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.799235    2552 flags.go:64] FLAG: --tls-cert-file=""
Jul 16 22:13:45.019790 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.799238    2552 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 16 22:13:45.019790 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.799242    2552 flags.go:64] FLAG: --tls-min-version=""
Jul 16 22:13:45.019790 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.799245    2552 flags.go:64] FLAG: --tls-private-key-file=""
Jul 16 22:13:45.019790 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.799248    2552 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 16 22:13:45.019790 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.799250    2552 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 16 22:13:45.019790 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.799254    2552 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 16 22:13:45.019790 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.799257    2552 flags.go:64] FLAG: --v="2"
Jul 16 22:13:45.019790 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.799260    2552 flags.go:64] FLAG: --version="false"
Jul 16 22:13:45.019790 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.799264    2552 flags.go:64] FLAG: --vmodule=""
Jul 16 22:13:45.019790 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.799267    2552 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 16 22:13:45.019790 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.799270    2552 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 16 22:13:45.019790 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.799395    2552 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 22:13:45.019790 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.799399    2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 22:13:45.020566 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.799402    2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 22:13:45.020566 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.799405    2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 22:13:45.020566 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.799410    2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 22:13:45.020566 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.799413    2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 22:13:45.020566 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.799416    2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 22:13:45.020566 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.799419    2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 22:13:45.020566 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.799423    2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 22:13:45.020566 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.799426    2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 22:13:45.020566 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.799428    2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 22:13:45.020566 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.799431    2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 22:13:45.020566 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.799434    2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 22:13:45.020566 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.799437    2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 22:13:45.020566 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.799440    2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 22:13:45.020566 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.799442    2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 22:13:45.020566 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.799446    2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 22:13:45.020566 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.799449    2552 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 22:13:45.020566 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.799451    2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 22:13:45.020566 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.799454    2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 22:13:45.020566 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.799456    2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 22:13:45.021193 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.799459    2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 22:13:45.021193 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.799462    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 22:13:45.021193 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.799464    2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 22:13:45.021193 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.799467    2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 22:13:45.021193 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.799469    2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 22:13:45.021193 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.799472    2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 22:13:45.021193 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.799476    2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 22:13:45.021193 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.799480    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 22:13:45.021193 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.799482    2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 22:13:45.021193 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.799486    2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 22:13:45.021193 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.799488    2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 22:13:45.021193 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.799491    2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 22:13:45.021193 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.799494    2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 22:13:45.021193 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.799496    2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 22:13:45.021193 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.799499    2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 22:13:45.021193 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.799502    2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 22:13:45.021193 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.799506    2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 22:13:45.021193 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.799509    2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 22:13:45.021193 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.799512    2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 22:13:45.021813 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.799515    2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 22:13:45.021813 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.799517    2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 22:13:45.021813 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.799520    2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 22:13:45.021813 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.799523    2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 22:13:45.021813 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.799526    2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 22:13:45.021813 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.799528    2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 22:13:45.021813 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.799531    2552 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 22:13:45.021813 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.799534    2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 22:13:45.021813 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.799537    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 22:13:45.021813 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.799540    2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 22:13:45.021813 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.799542    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 22:13:45.021813 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.799545    2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 22:13:45.021813 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.799547    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 22:13:45.021813 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.799550    2552 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 22:13:45.021813 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.799552    2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 22:13:45.021813 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.799554    2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 22:13:45.021813 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.799557    2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 22:13:45.021813 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.799560    2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 22:13:45.021813 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.799562    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 22:13:45.021813 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.799564    2552 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 22:13:45.022658 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.799567    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 22:13:45.022658 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.799570    2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 22:13:45.022658 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.799572    2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 22:13:45.022658 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.799575    2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 22:13:45.022658 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.799579    2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 22:13:45.022658 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.799582    2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 22:13:45.022658 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.799585    2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 22:13:45.022658 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.799588    2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 22:13:45.022658 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.799592    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 22:13:45.022658 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.799595    2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 22:13:45.022658 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.799597    2552 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 22:13:45.022658 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.799600    2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 22:13:45.022658 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.799603    2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 22:13:45.022658 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.799605    2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 22:13:45.022658 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.799608    2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 22:13:45.022658 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.799610    2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 22:13:45.022658 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.799613    2552 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 22:13:45.022658 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.799616    2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 22:13:45.022658 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.799618    2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 22:13:45.022658 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.799621    2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 22:13:45.023301 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.799625    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 22:13:45.023301 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.799628    2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 22:13:45.023301 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.799630    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 22:13:45.023301 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.799633    2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 22:13:45.023301 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.799636    2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 22:13:45.023301 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.799638    2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 22:13:45.023301 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.799641    2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 22:13:45.023301 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.799643    2552 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 22:13:45.023301 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.799646    2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 22:13:45.023301 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.799648    2552 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 22:13:45.023301 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.799651    2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 22:13:45.023301 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.799653    2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 22:13:45.023301 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.799656    2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 22:13:45.023301 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.799658    2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 22:13:45.023301 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.799661    2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 22:13:45.023301 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.799663    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 22:13:45.023301 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.799666    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 22:13:45.023301 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.799668    2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 22:13:45.023301 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.799671    2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 22:13:45.023866 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.801320    2552 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 16 22:13:45.023866 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.808686    2552 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 16 22:13:45.023866 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.808699    2552 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 16 22:13:45.023866 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.808712    2552 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 16 22:13:45.023866 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.808720    2552 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 16 22:13:45.023866 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.808778    2552 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 22:13:45.023866 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.808784    2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 22:13:45.023866 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.808787    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 22:13:45.023866 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.808790    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 22:13:45.023866 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.808793    2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 22:13:45.023866 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.808797    2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 22:13:45.023866 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.808800    2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 22:13:45.023866 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.808802    2552 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 22:13:45.023866 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.808805    2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 22:13:45.023866 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.808808    2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 22:13:45.024334 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.808811    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 22:13:45.024334 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.808814    2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 22:13:45.024334 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.808816    2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 22:13:45.024334 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.808819    2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 22:13:45.024334 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.808822    2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 22:13:45.024334 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.808825    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 22:13:45.024334 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.808827    2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 22:13:45.024334 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.808830    2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 22:13:45.024334 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.808833    2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 22:13:45.024334 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.808835    2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 22:13:45.024334 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.808838    2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 22:13:45.024334 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.808841    2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 22:13:45.024334 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.808844    2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 22:13:45.024334 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.808846    2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 22:13:45.024334 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.808849    2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 22:13:45.024334 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.808851    2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 22:13:45.024334 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.808854    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 22:13:45.024334 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.808857    2552 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 22:13:45.024334 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.808859    2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 22:13:45.024334 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.808862    2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 22:13:45.144744 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.808864    2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 22:13:45.144744 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.808867    2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 22:13:45.144744 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.808869    2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 22:13:45.144744 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.808872    2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 22:13:45.144744 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.808874    2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 22:13:45.144744 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.808877    2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 22:13:45.144744 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.808880    2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 22:13:45.144744 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.808882    2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 22:13:45.144744 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.808885    2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 22:13:45.144744 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.808887    2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 22:13:45.144744 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.808891    2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 22:13:45.144744 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.808895    2552 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 22:13:45.144744 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.808899    2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 22:13:45.144744 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.808903    2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 22:13:45.144744 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.808907    2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 22:13:45.144744 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.808911    2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 22:13:45.144744 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.808916    2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 22:13:45.144744 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.808921    2552 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 22:13:45.144744 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.808925    2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 22:13:45.145732 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.808928    2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 22:13:45.145732 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.808932    2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 22:13:45.145732 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.808935    2552 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 22:13:45.145732 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.808939    2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 22:13:45.145732 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.808942    2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 22:13:45.145732 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.808946    2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 22:13:45.145732 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.808950    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 22:13:45.145732 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.808954    2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 22:13:45.145732 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.808957    2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 22:13:45.145732 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.808960    2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 22:13:45.145732 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.808964    2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 22:13:45.145732 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.808967    2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 22:13:45.145732 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.808970    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 22:13:45.145732 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.808973    2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 22:13:45.145732 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.808976    2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 22:13:45.145732 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.808980    2552 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 22:13:45.145732 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.808983    2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 22:13:45.145732 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.808986    2552 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 22:13:45.145732 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.808991    2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 22:13:45.146342 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.808995    2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 22:13:45.146342 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.808999    2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 22:13:45.146342 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.809002    2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 22:13:45.146342 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.809006    2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 22:13:45.146342 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.809009    2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 22:13:45.146342 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.809013    2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 22:13:45.146342 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.809021    2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 22:13:45.146342 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.809025    2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 22:13:45.146342 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.809029    2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 22:13:45.146342 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.809033    2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 22:13:45.146342 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.809037    2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 22:13:45.146342 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.809040    2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 22:13:45.146342 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.809045    2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 22:13:45.146342 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.809050    2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 22:13:45.146342 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.809053    2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 22:13:45.146342 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.809056    2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 22:13:45.146342 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.809060    2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 22:13:45.146342 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.809063    2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 22:13:45.146342 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.809066    2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 22:13:45.146956 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.809075    2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 22:13:45.146956 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.809079    2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 22:13:45.146956 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.809083    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 22:13:45.146956 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.809087    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 22:13:45.146956 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.809091    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 22:13:45.146956 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.809095    2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 22:13:45.146956 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.809098    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 22:13:45.146956 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.809103    2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 22:13:45.146956 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.809107    2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 22:13:45.146956 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.809111    2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 22:13:45.146956 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.809114    2552 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 22:13:45.146956 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.809118    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 22:13:45.146956 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.809125    2552 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 16 22:13:45.146956 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.809298    2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 22:13:45.146956 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.809304    2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 22:13:45.147574 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.809308    2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 22:13:45.147574 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.809312    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 22:13:45.147574 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.809316    2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 22:13:45.147574 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.809320    2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 22:13:45.147574 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.809324    2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 22:13:45.147574 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.809328    2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 22:13:45.147574 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.809332    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 22:13:45.147574 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.809335    2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 22:13:45.147574 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.809340    2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 22:13:45.147574 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.809343    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 22:13:45.147574 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.809348    2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 22:13:45.147574 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.809353    2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 22:13:45.147574 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.809358    2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 22:13:45.147574 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.809363    2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 22:13:45.147574 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.809381    2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 22:13:45.147574 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.809385    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 22:13:45.147574 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.809389    2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 22:13:45.147574 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.809393    2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 22:13:45.147574 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.809407    2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 22:13:45.148186 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.809411    2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 22:13:45.148186 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.809415    2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 22:13:45.148186 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.809419    2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 22:13:45.148186 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.809423    2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 22:13:45.148186 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.809427    2552 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 22:13:45.148186 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.809431    2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 22:13:45.148186 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.809435    2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 22:13:45.148186 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.809439    2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 22:13:45.148186 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.809442    2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 22:13:45.148186 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.809446    2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 22:13:45.148186 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.809450    2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 22:13:45.148186 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.809454    2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 22:13:45.148186 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.809458    2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 22:13:45.148186 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.809462    2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 22:13:45.148186 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.809466    2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 22:13:45.148186 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.809470    2552 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 22:13:45.148186 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.809474    2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 22:13:45.148186 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.809478    2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 22:13:45.148186 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.809482    2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 22:13:45.148186 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.809486    2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 22:13:45.148777 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.809489    2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 22:13:45.148777 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.809493    2552 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 22:13:45.148777 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.809497    2552 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 22:13:45.148777 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.809500    2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 22:13:45.148777 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.809504    2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 22:13:45.148777 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.809508    2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 22:13:45.148777 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.809512    2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 22:13:45.148777 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.809520    2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 22:13:45.148777 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.809525    2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 22:13:45.148777 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.809530    2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 22:13:45.148777 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.809534    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 22:13:45.148777 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.809538    2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 22:13:45.148777 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.809549    2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 22:13:45.148777 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.809553    2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 22:13:45.148777 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.809557    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 22:13:45.148777 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.809561    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 22:13:45.148777 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.809564    2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 22:13:45.148777 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.809568    2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 22:13:45.148777 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.809572    2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 22:13:45.149272 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.809575    2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 22:13:45.149272 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.809579    2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 22:13:45.149272 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.809583    2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 22:13:45.149272 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.809586    2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 22:13:45.149272 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.809590    2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 22:13:45.149272 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.809593    2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 22:13:45.149272 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.809597    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 22:13:45.149272 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.809602    2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 22:13:45.149272 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.809606    2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 22:13:45.149272 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.809610    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 22:13:45.149272 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.809614    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 22:13:45.149272 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.809617    2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 22:13:45.149272 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.809621    2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 22:13:45.149272 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.809625    2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 22:13:45.149272 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.809629    2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 22:13:45.149272 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.809633    2552 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 22:13:45.149272 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.809636    2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 22:13:45.149272 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.809640    2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 22:13:45.149272 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.809645    2552 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 22:13:45.149272 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.809648    2552 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 22:13:45.149900 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.809653    2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 22:13:45.149900 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.809657    2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 22:13:45.149900 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.809660    2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 22:13:45.149900 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.809664    2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 22:13:45.149900 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.809667    2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 22:13:45.149900 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.809671    2552 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 22:13:45.149900 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.809685    2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 22:13:45.149900 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.809689    2552 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 22:13:45.149900 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.809693    2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 22:13:45.149900 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.809696    2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 22:13:45.149900 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.809700    2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 22:13:45.149900 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.809703    2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 22:13:45.149900 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.809708    2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 22:13:45.149900 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.809712    2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 22:13:45.149900 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.809717    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 22:13:45.149900 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.809721    2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 22:13:45.149900 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.809725    2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 22:13:45.149900 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.809729    2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 22:13:45.149900 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:44.809733    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 22:13:45.150664 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.809740    2552 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 16 22:13:45.150664 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.809873    2552 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 16 22:13:45.150664 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.812859    2552 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 16 22:13:45.150664 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.814379    2552 server.go:1019] "Starting client certificate rotation"
Jul 16 22:13:45.150664 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.814667    2552 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 16 22:13:45.150664 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.814699    2552 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 16 22:13:45.150664 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.816900    2552 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 16 22:13:45.150664 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.819019    2552 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 16 22:13:45.150664 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.828631    2552 log.go:25] "Validated CRI v1 runtime API"
Jul 16 22:13:45.150664 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.832811    2552 log.go:25] "Validated CRI v1 image API"
Jul 16 22:13:45.150664 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.833683    2552 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 16 22:13:45.150664 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.835963    2552 fs.go:135] Filesystem UUIDs: map[70fe65ce-4b26-4ca4-bb44-88a83f382078:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 a3d54172-e929-409d-b52c-aaf10a9e3cfa:/dev/nvme0n1p4]
Jul 16 22:13:45.151087 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.835977    2552 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 16 22:13:45.151237 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.839898    2552 manager.go:216] Machine: {Timestamp:2026-07-16 22:13:44.839447856 +0000 UTC m=+0.318557874 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100555 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec24aa258e95e3c4054162c9fa1d88de SystemUUID:ec24aa25-8e95-e3c4-0541-62c9fa1d88de BootID:f744e556-a547-421c-b2c0-1f651cb16f43 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:63:14:98:bd:93 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:63:14:98:bd:93 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ba:ea:17:d1:7b:7f Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 16 22:13:45.151237 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.839992    2552 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 16 22:13:45.151237 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.840055    2552 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 16 22:13:45.151237 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.842922    2552 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 16 22:13:45.151237 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.842947    2552 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-47.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 16 22:13:45.151237 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.843719    2552 topology_manager.go:138] "Creating topology manager with none policy"
Jul 16 22:13:45.151237 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.843731    2552 container_manager_linux.go:309] "Creating device plugin manager"
Jul 16 22:13:45.151237 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.843741    2552 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 16 22:13:45.151525 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.843757    2552 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 16 22:13:45.151525 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.844814    2552 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 16 22:13:45.151525 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.845046    2552 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 16 22:13:45.151525 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.848234    2552 state_mem.go:36] "Initialized new in-memory state store"
Jul 16 22:13:45.151525 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.848362    2552 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 16 22:13:45.151525 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.848411    2552 kubelet.go:486] "Attempting to sync node with API server"
Jul 16 22:13:45.151525 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.848423    2552 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 16 22:13:45.151525 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.848442    2552 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 16 22:13:45.151525 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.848455    2552 kubelet.go:398] "Adding apiserver pod source"
Jul 16 22:13:45.151525 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.848466    2552 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 16 22:13:45.151525 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.848843    2552 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 16 22:13:45.151525 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.848863    2552 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 16 22:13:45.151525 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.850920    2552 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 16 22:13:45.151525 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.852874    2552 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 16 22:13:45.151525 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.852902    2552 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 16 22:13:45.151525 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.854234    2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 16 22:13:45.151525 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.854247    2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 16 22:13:45.151525 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.854253    2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 16 22:13:45.151525 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.854263    2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 16 22:13:45.151525 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.854272    2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 16 22:13:45.151525 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.854278    2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 16 22:13:45.151525 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.854286    2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 16 22:13:45.151525 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.854298    2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 16 22:13:45.151525 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.854304    2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 16 22:13:45.151525 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.854310    2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 16 22:13:45.151525 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.854321    2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 16 22:13:45.151525 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.854326    2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 16 22:13:45.151525 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.854346    2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 16 22:13:45.151525 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.854351    2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 16 22:13:45.151525 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.857261    2552 server.go:1268] "Started kubelet"
Jul 16 22:13:45.151525 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.857331    2552 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 16 22:13:45.151525 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.858299    2552 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 16 22:13:45.151525 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.858352    2552 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 16 22:13:45.151525 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.861361    2552 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 16 22:13:45.151525 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:13:44.861687    2552 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 16 22:13:45.151525 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:13:44.861746    2552 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-47.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 16 22:13:45.151525 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.862125    2552 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-47.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 16 22:13:45.151525 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.862647    2552 server.go:310] "Adding debug handlers to kubelet server"
Jul 16 22:13:45.151525 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:13:44.863145    2552 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 16 22:13:45.152618 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.867963    2552 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 16 22:13:45.152618 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.867990    2552 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 16 22:13:45.152618 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:13:44.868068    2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-47.ec2.internal\" not found"
Jul 16 22:13:45.152618 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:13:44.867893    2552 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-47.ec2.internal.18c2e4d96ba64acb  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-47.ec2.internal,UID:ip-10-0-141-47.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-47.ec2.internal,},FirstTimestamp:2026-07-16 22:13:44.857234123 +0000 UTC m=+0.336344149,LastTimestamp:2026-07-16 22:13:44.857234123 +0000 UTC m=+0.336344149,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-47.ec2.internal,}"
Jul 16 22:13:45.152618 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.868744    2552 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 16 22:13:45.152618 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.868963    2552 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 16 22:13:45.152618 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.868977    2552 factory.go:55] Registering systemd factory
Jul 16 22:13:45.152618 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.868987    2552 factory.go:223] Registration of the systemd container factory successfully
Jul 16 22:13:45.152618 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.869240    2552 factory.go:153] Registering CRI-O factory
Jul 16 22:13:45.152618 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.869251    2552 factory.go:223] Registration of the crio container factory successfully
Jul 16 22:13:45.152618 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.869282    2552 factory.go:103] Registering Raw factory
Jul 16 22:13:45.152618 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.869307    2552 manager.go:1196] Started watching for new ooms in manager
Jul 16 22:13:45.152618 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.869412    2552 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 16 22:13:45.152618 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.869431    2552 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 16 22:13:45.152618 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.869596    2552 reconstruct.go:97] "Volume reconstruction finished"
Jul 16 22:13:45.152618 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.869606    2552 reconciler.go:29] "Reconciler: start to sync state"
Jul 16 22:13:45.152618 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.869719    2552 manager.go:349] Starting recovery of all containers
Jul 16 22:13:45.152618 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:13:44.875879    2552 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-47.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 16 22:13:45.152618 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:13:44.875973    2552 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 16 22:13:45.152618 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.880442    2552 manager.go:354] Recovery completed
Jul 16 22:13:45.152618 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.884878    2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 22:13:45.152618 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.887092    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-47.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 22:13:45.152618 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.887117    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-47.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 22:13:45.152618 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.887128    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-47.ec2.internal" event="NodeHasSufficientPID"
Jul 16 22:13:45.152618 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.887595    2552 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 16 22:13:45.152618 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.887604    2552 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 16 22:13:45.152618 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.887608    2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 22:13:45.152618 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.887618    2552 state_mem.go:36] "Initialized new in-memory state store"
Jul 16 22:13:45.152618 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.888287    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-47.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 22:13:45.152618 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.888309    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-47.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 22:13:45.152618 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.888326    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-47.ec2.internal" event="NodeHasSufficientPID"
Jul 16 22:13:45.153443 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:13:44.888717    2552 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-47.ec2.internal.18c2e4d96d6e106a  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-47.ec2.internal,UID:ip-10-0-141-47.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-141-47.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-141-47.ec2.internal,},FirstTimestamp:2026-07-16 22:13:44.887103594 +0000 UTC m=+0.366213613,LastTimestamp:2026-07-16 22:13:44.887103594 +0000 UTC m=+0.366213613,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-47.ec2.internal,}"
Jul 16 22:13:45.153443 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.888805    2552 policy_none.go:49] "None policy: Start"
Jul 16 22:13:45.153443 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.888817    2552 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 16 22:13:45.153443 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.888844    2552 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 16 22:13:45.153443 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.889937    2552 policy_none.go:47] "Start"
Jul 16 22:13:45.153443 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.898278    2552 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9wh7l"
Jul 16 22:13:45.153443 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:13:44.897709    2552 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-47.ec2.internal.18c2e4d96d6e57b7  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-47.ec2.internal,UID:ip-10-0-141-47.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-141-47.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-141-47.ec2.internal,},FirstTimestamp:2026-07-16 22:13:44.887121847 +0000 UTC m=+0.366231865,LastTimestamp:2026-07-16 22:13:44.887121847 +0000 UTC m=+0.366231865,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-47.ec2.internal,}"
Jul 16 22:13:45.153443 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.906910    2552 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9wh7l"
Jul 16 22:13:45.153443 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:13:44.910944    2552 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-47.ec2.internal.18c2e4d96d6e7d7a  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-47.ec2.internal,UID:ip-10-0-141-47.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-141-47.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-141-47.ec2.internal,},FirstTimestamp:2026-07-16 22:13:44.887131514 +0000 UTC m=+0.366241533,LastTimestamp:2026-07-16 22:13:44.887131514 +0000 UTC m=+0.366241533,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-47.ec2.internal,}"
Jul 16 22:13:45.153443 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.922866    2552 manager.go:337] "Starting Device Plugin manager"
Jul 16 22:13:45.153443 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:13:44.922906    2552 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 16 22:13:45.153443 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.922918    2552 server.go:87] "Starting device plugin registration server"
Jul 16 22:13:45.153443 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.923129    2552 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 16 22:13:45.153443 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.923139    2552 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 16 22:13:45.153443 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.923303    2552 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 16 22:13:45.153443 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.923386    2552 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 16 22:13:45.153443 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:44.923395    2552 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 16 22:13:45.153443 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:13:44.923754    2552 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 16 22:13:45.153443 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:13:44.923810    2552 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-47.ec2.internal\" not found"
Jul 16 22:13:45.153443 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:45.003923    2552 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 16 22:13:45.153443 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:45.005260    2552 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 16 22:13:45.284410 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:45.005295    2552 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 16 22:13:45.284410 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:45.005318    2552 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 16 22:13:45.284410 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:13:45.005356    2552 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 16 22:13:45.284410 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:45.007386    2552 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 16 22:13:45.284410 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:45.023977    2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 22:13:45.284410 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:45.024667    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-47.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 22:13:45.284410 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:45.024690    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-47.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 22:13:45.284410 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:45.024699    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-47.ec2.internal" event="NodeHasSufficientPID"
Jul 16 22:13:45.284410 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:45.024721    2552 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-47.ec2.internal"
Jul 16 22:13:45.284410 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:45.037672    2552 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-47.ec2.internal"
Jul 16 22:13:45.284410 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:13:45.037687    2552 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-47.ec2.internal\": node \"ip-10-0-141-47.ec2.internal\" not found"
Jul 16 22:13:45.284410 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:13:45.077406    2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-47.ec2.internal\" not found"
Jul 16 22:13:45.284410 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:45.105638    2552 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-47.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-47.ec2.internal"]
Jul 16 22:13:45.284410 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:45.105685    2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 22:13:45.284410 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:45.107362    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-47.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 22:13:45.284410 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:45.107400    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-47.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 22:13:45.284410 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:45.107409    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-47.ec2.internal" event="NodeHasSufficientPID"
Jul 16 22:13:45.284410 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:45.108547    2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 22:13:45.284410 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:45.108695    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-47.ec2.internal"
Jul 16 22:13:45.284410 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:45.108721    2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 22:13:45.284410 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:45.109311    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-47.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 22:13:45.284410 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:45.109317    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-47.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 22:13:45.284410 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:45.109333    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-47.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 22:13:45.284410 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:45.109338    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-47.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 22:13:45.284410 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:45.109346    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-47.ec2.internal" event="NodeHasSufficientPID"
Jul 16 22:13:45.284410 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:45.109352    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-47.ec2.internal" event="NodeHasSufficientPID"
Jul 16 22:13:45.284410 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:45.110517    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-47.ec2.internal"
Jul 16 22:13:45.284410 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:45.110544    2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 22:13:45.284410 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:45.111169    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-47.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 22:13:45.284410 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:45.111193    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-47.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 22:13:45.284410 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:45.111205    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-47.ec2.internal" event="NodeHasSufficientPID"
Jul 16 22:13:45.284410 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:13:45.154945    2552 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-47.ec2.internal\" not found" node="ip-10-0-141-47.ec2.internal"
Jul 16 22:13:45.284410 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:13:45.159249    2552 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-47.ec2.internal\" not found" node="ip-10-0-141-47.ec2.internal"
Jul 16 22:13:45.285439 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:45.171061    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/47c2f0a7b828edb1ad6c13dbbda696f8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-47.ec2.internal\" (UID: \"47c2f0a7b828edb1ad6c13dbbda696f8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-47.ec2.internal"
Jul 16 22:13:45.285439 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:45.171082    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/47c2f0a7b828edb1ad6c13dbbda696f8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-47.ec2.internal\" (UID: \"47c2f0a7b828edb1ad6c13dbbda696f8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-47.ec2.internal"
Jul 16 22:13:45.285439 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:45.171098    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/155d0342127b71289839856a25f3be3f-config\") pod \"kube-apiserver-proxy-ip-10-0-141-47.ec2.internal\" (UID: \"155d0342127b71289839856a25f3be3f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-47.ec2.internal"
Jul 16 22:13:45.285439 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:13:45.178347    2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-47.ec2.internal\" not found"
Jul 16 22:13:45.285439 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:45.272201    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/47c2f0a7b828edb1ad6c13dbbda696f8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-47.ec2.internal\" (UID: \"47c2f0a7b828edb1ad6c13dbbda696f8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-47.ec2.internal"
Jul 16 22:13:45.285439 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:45.272224    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/47c2f0a7b828edb1ad6c13dbbda696f8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-47.ec2.internal\" (UID: \"47c2f0a7b828edb1ad6c13dbbda696f8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-47.ec2.internal"
Jul 16 22:13:45.285439 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:45.272239    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/155d0342127b71289839856a25f3be3f-config\") pod \"kube-apiserver-proxy-ip-10-0-141-47.ec2.internal\" (UID: \"155d0342127b71289839856a25f3be3f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-47.ec2.internal"
Jul 16 22:13:45.285439 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:45.272272    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/155d0342127b71289839856a25f3be3f-config\") pod \"kube-apiserver-proxy-ip-10-0-141-47.ec2.internal\" (UID: \"155d0342127b71289839856a25f3be3f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-47.ec2.internal"
Jul 16 22:13:45.285439 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:45.272288    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/47c2f0a7b828edb1ad6c13dbbda696f8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-47.ec2.internal\" (UID: \"47c2f0a7b828edb1ad6c13dbbda696f8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-47.ec2.internal"
Jul 16 22:13:45.285439 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:45.272308    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/47c2f0a7b828edb1ad6c13dbbda696f8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-47.ec2.internal\" (UID: \"47c2f0a7b828edb1ad6c13dbbda696f8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-47.ec2.internal"
Jul 16 22:13:45.285439 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:13:45.279300    2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-47.ec2.internal\" not found"
Jul 16 22:13:45.403576 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:13:45.380101    2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-47.ec2.internal\" not found"
Jul 16 22:13:45.522478 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:45.458279    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-47.ec2.internal"
Jul 16 22:13:45.522478 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:45.462415    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-47.ec2.internal"
Jul 16 22:13:45.522478 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:13:45.480299    2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-47.ec2.internal\" not found"
Jul 16 22:13:46.910518 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:13:46.845144    2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-47.ec2.internal\" not found"
Jul 16 22:13:47.010611 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:13:46.945578    2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-47.ec2.internal\" not found"
Jul 16 22:13:47.129275 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:13:47.046575    2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-47.ec2.internal\" not found"
Jul 16 22:13:47.129275 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:47.077736    2552 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 16 22:13:47.129275 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:47.077828    2552 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 16 22:13:47.229492 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:13:47.147290    2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-47.ec2.internal\" not found"
Jul 16 22:13:47.229492 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:47.167420    2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 22:13:47.229492 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:47.169129    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-47.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 22:13:47.229492 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:47.169153    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-47.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 22:13:47.229492 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:47.169164    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-47.ec2.internal" event="NodeHasSufficientPID"
Jul 16 22:13:47.229492 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:47.176129    2552 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-15 22:08:46 +0000 UTC" deadline="2028-02-26 03:00:51.248499622 +0000 UTC"
Jul 16 22:13:47.229492 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:47.176158    2552 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14140h47m4.072346681s"
Jul 16 22:13:47.229492 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:47.221652    2552 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 16 22:13:47.345027 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:47.233290    2552 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-47.ec2.internal"
Jul 16 22:13:47.345027 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:47.246199    2552 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 16 22:13:47.345027 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:47.247885    2552 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-47.ec2.internal"
Jul 16 22:13:47.345027 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:47.257039    2552 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 16 22:13:47.476775 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:47.425309    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod155d0342127b71289839856a25f3be3f.slice/crio-4057029e215a71547fd48b909daec4a1584b91e78aa60bfdcbbdca09ed466532 WatchSource:0}: Error finding container 4057029e215a71547fd48b909daec4a1584b91e78aa60bfdcbbdca09ed466532: Status 404 returned error can't find the container with id 4057029e215a71547fd48b909daec4a1584b91e78aa60bfdcbbdca09ed466532
Jul 16 22:13:47.476775 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:47.425867    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47c2f0a7b828edb1ad6c13dbbda696f8.slice/crio-46792d44077c890024c1807566cb268bfde3dcfd4c5a8837ce070e8c296e2212 WatchSource:0}: Error finding container 46792d44077c890024c1807566cb268bfde3dcfd4c5a8837ce070e8c296e2212: Status 404 returned error can't find the container with id 46792d44077c890024c1807566cb268bfde3dcfd4c5a8837ce070e8c296e2212
Jul 16 22:13:47.476775 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:47.430447    2552 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 16 22:13:47.608308 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:47.578772    2552 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 16 22:13:47.730548 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:47.611242    2552 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 16 22:13:47.893015 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:47.892991    2552 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 16 22:13:48.114076 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.113954    2552 apiserver.go:52] "Watching apiserver"
Jul 16 22:13:48.123194 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.123165    2552 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 16 22:13:48.126317 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.126279    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-141-47.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fxwgc","openshift-dns/node-resolver-8zcnq","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-47.ec2.internal","openshift-network-diagnostics/network-check-target-xr6qc","openshift-cluster-node-tuning-operator/tuned-znw8p","openshift-image-registry/node-ca-t8d4l","openshift-multus/multus-additional-cni-plugins-zfb6b","openshift-multus/multus-xsv9t","openshift-multus/network-metrics-daemon-zr4k5","openshift-network-operator/iptables-alerter-2fbj7","openshift-ovn-kubernetes/ovnkube-node-69j5k","kube-system/global-pull-secret-syncer-qz9r8","kube-system/konnectivity-agent-j7ltc"]
Jul 16 22:13:48.128815 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.128793    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zr4k5"
Jul 16 22:13:48.128907 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:13:48.128876    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zr4k5" podUID="0dea03c6-7be0-48e6-ad97-b245cbb3e76f"
Jul 16 22:13:48.130957 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.130938    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qz9r8"
Jul 16 22:13:48.131547 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:13:48.131003    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qz9r8" podUID="cf1b7d07-96ed-44e0-bbb0-aa6bb66378dd"
Jul 16 22:13:48.133026 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.133001    2552 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 16 22:13:48.133173 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.133149    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8zcnq"
Jul 16 22:13:48.135940 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.135918    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-j7ltc"
Jul 16 22:13:48.136037 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.135969    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 16 22:13:48.136098 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.135919    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-cwl7z\""
Jul 16 22:13:48.136250 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.136232    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 16 22:13:48.138010 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.137970    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xr6qc"
Jul 16 22:13:48.138110 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:13:48.138025    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xr6qc" podUID="fa659f3f-b7af-4c2e-979a-6ef27bd503aa"
Jul 16 22:13:48.138269 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.138249    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 16 22:13:48.138356 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.138286    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-5jmd6\""
Jul 16 22:13:48.138356 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.138338    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 16 22:13:48.140204 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.140185    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-znw8p"
Jul 16 22:13:48.142890 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.142715    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 16 22:13:48.142890 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.142861    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-snqzb\""
Jul 16 22:13:48.143200 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.143181    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 16 22:13:48.144570 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.144550    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xsv9t"
Jul 16 22:13:48.147023 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.147004    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-t8d4l"
Jul 16 22:13:48.148449 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.147917    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 16 22:13:48.148449 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.147934    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 16 22:13:48.148449 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.148101    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-xmdp5\""
Jul 16 22:13:48.148449 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.148307    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 16 22:13:48.148449 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.148373    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 16 22:13:48.150123 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.149632    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fxwgc"
Jul 16 22:13:48.150123 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.149891    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 16 22:13:48.150123 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.149918    2552 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 16 22:13:48.150123 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.150116    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 16 22:13:48.150364 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.150172    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-25dc4\""
Jul 16 22:13:48.150364 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.150237    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 16 22:13:48.152122 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.152105    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-zfb6b"
Jul 16 22:13:48.152122 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.152113    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 16 22:13:48.152944 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.152924    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 16 22:13:48.153049 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.153025    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-mvgh7\""
Jul 16 22:13:48.153049 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.153029    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 16 22:13:48.154344 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.154326    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-2fbj7"
Jul 16 22:13:48.154433 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.154347    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 16 22:13:48.155324 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.155279    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 16 22:13:48.156175 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.155980    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-rlxgn\""
Jul 16 22:13:48.157510 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.156768    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-69j5k"
Jul 16 22:13:48.157510 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.156994    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 16 22:13:48.157510 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.157343    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 16 22:13:48.157774 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.157568    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-dpdxv\""
Jul 16 22:13:48.157774 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.157626    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 16 22:13:48.162261 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.162239    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/cf1b7d07-96ed-44e0-bbb0-aa6bb66378dd-kubelet-config\") pod \"global-pull-secret-syncer-qz9r8\" (UID: \"cf1b7d07-96ed-44e0-bbb0-aa6bb66378dd\") " pod="kube-system/global-pull-secret-syncer-qz9r8"
Jul 16 22:13:48.162357 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.162276    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cf1b7d07-96ed-44e0-bbb0-aa6bb66378dd-original-pull-secret\") pod \"global-pull-secret-syncer-qz9r8\" (UID: \"cf1b7d07-96ed-44e0-bbb0-aa6bb66378dd\") " pod="kube-system/global-pull-secret-syncer-qz9r8"
Jul 16 22:13:48.162357 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.162331    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b0bc3969-f63b-4d8d-9616-bfc554866e8f-hosts-file\") pod \"node-resolver-8zcnq\" (UID: \"b0bc3969-f63b-4d8d-9616-bfc554866e8f\") " pod="openshift-dns/node-resolver-8zcnq"
Jul 16 22:13:48.162459 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.162358    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mdjd\" (UniqueName: \"kubernetes.io/projected/b0bc3969-f63b-4d8d-9616-bfc554866e8f-kube-api-access-4mdjd\") pod \"node-resolver-8zcnq\" (UID: \"b0bc3969-f63b-4d8d-9616-bfc554866e8f\") " pod="openshift-dns/node-resolver-8zcnq"
Jul 16 22:13:48.162459 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.162384    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0dea03c6-7be0-48e6-ad97-b245cbb3e76f-metrics-certs\") pod \"network-metrics-daemon-zr4k5\" (UID: \"0dea03c6-7be0-48e6-ad97-b245cbb3e76f\") " pod="openshift-multus/network-metrics-daemon-zr4k5"
Jul 16 22:13:48.162459 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.162405    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/cf1b7d07-96ed-44e0-bbb0-aa6bb66378dd-dbus\") pod \"global-pull-secret-syncer-qz9r8\" (UID: \"cf1b7d07-96ed-44e0-bbb0-aa6bb66378dd\") " pod="kube-system/global-pull-secret-syncer-qz9r8"
Jul 16 22:13:48.162459 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.162429    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b0bc3969-f63b-4d8d-9616-bfc554866e8f-tmp-dir\") pod \"node-resolver-8zcnq\" (UID: \"b0bc3969-f63b-4d8d-9616-bfc554866e8f\") " pod="openshift-dns/node-resolver-8zcnq"
Jul 16 22:13:48.162459 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.162451    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/52a402e0-019f-4e46-8dfa-591613eff6d1-agent-certs\") pod \"konnectivity-agent-j7ltc\" (UID: \"52a402e0-019f-4e46-8dfa-591613eff6d1\") " pod="kube-system/konnectivity-agent-j7ltc"
Jul 16 22:13:48.162711 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.162490    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/52a402e0-019f-4e46-8dfa-591613eff6d1-konnectivity-ca\") pod \"konnectivity-agent-j7ltc\" (UID: \"52a402e0-019f-4e46-8dfa-591613eff6d1\") " pod="kube-system/konnectivity-agent-j7ltc"
Jul 16 22:13:48.162711 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.162516    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gnqdg\" (UniqueName: \"kubernetes.io/projected/0dea03c6-7be0-48e6-ad97-b245cbb3e76f-kube-api-access-gnqdg\") pod \"network-metrics-daemon-zr4k5\" (UID: \"0dea03c6-7be0-48e6-ad97-b245cbb3e76f\") " pod="openshift-multus/network-metrics-daemon-zr4k5"
Jul 16 22:13:48.162711 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.162585    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 16 22:13:48.163156 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.162907    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 16 22:13:48.163156 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.163129    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 16 22:13:48.163291 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.163165    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-wkd68\""
Jul 16 22:13:48.163568 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.163550    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 16 22:13:48.163636 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.163624    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 16 22:13:48.164513 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.164310    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 16 22:13:48.177778 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.177757    2552 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-hrqw6"
Jul 16 22:13:48.187178 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.187157    2552 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-hrqw6"
Jul 16 22:13:48.234104 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.234042    2552 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 16 22:13:48.263814 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.263592    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a648734f-4a13-4389-af8e-9f2c09dfafbf-host-run-netns\") pod \"ovnkube-node-69j5k\" (UID: \"a648734f-4a13-4389-af8e-9f2c09dfafbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-69j5k"
Jul 16 22:13:48.263814 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.263624    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a648734f-4a13-4389-af8e-9f2c09dfafbf-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-69j5k\" (UID: \"a648734f-4a13-4389-af8e-9f2c09dfafbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-69j5k"
Jul 16 22:13:48.263814 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.263649    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a648734f-4a13-4389-af8e-9f2c09dfafbf-ovnkube-script-lib\") pod \"ovnkube-node-69j5k\" (UID: \"a648734f-4a13-4389-af8e-9f2c09dfafbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-69j5k"
Jul 16 22:13:48.263814 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.263673    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b8273adb-26b5-4a5b-a20f-afd1f257772d-lib-modules\") pod \"tuned-znw8p\" (UID: \"b8273adb-26b5-4a5b-a20f-afd1f257772d\") " pod="openshift-cluster-node-tuning-operator/tuned-znw8p"
Jul 16 22:13:48.263814 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.263708    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e5d08c24-5eb1-4b19-bc6d-1bc2e0e5107d-iptables-alerter-script\") pod \"iptables-alerter-2fbj7\" (UID: \"e5d08c24-5eb1-4b19-bc6d-1bc2e0e5107d\") " pod="openshift-network-operator/iptables-alerter-2fbj7"
Jul 16 22:13:48.263814 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.263732    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a648734f-4a13-4389-af8e-9f2c09dfafbf-run-systemd\") pod \"ovnkube-node-69j5k\" (UID: \"a648734f-4a13-4389-af8e-9f2c09dfafbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-69j5k"
Jul 16 22:13:48.263814 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.263754    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a648734f-4a13-4389-af8e-9f2c09dfafbf-run-openvswitch\") pod \"ovnkube-node-69j5k\" (UID: \"a648734f-4a13-4389-af8e-9f2c09dfafbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-69j5k"
Jul 16 22:13:48.263814 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.263777    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b8273adb-26b5-4a5b-a20f-afd1f257772d-etc-sysctl-d\") pod \"tuned-znw8p\" (UID: \"b8273adb-26b5-4a5b-a20f-afd1f257772d\") " pod="openshift-cluster-node-tuning-operator/tuned-znw8p"
Jul 16 22:13:48.263814 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.263799    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b8273adb-26b5-4a5b-a20f-afd1f257772d-etc-tuned\") pod \"tuned-znw8p\" (UID: \"b8273adb-26b5-4a5b-a20f-afd1f257772d\") " pod="openshift-cluster-node-tuning-operator/tuned-znw8p"
Jul 16 22:13:48.263814 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.263820    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/580d8b18-0719-4d69-943a-f0ee07f74ce7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fxwgc\" (UID: \"580d8b18-0719-4d69-943a-f0ee07f74ce7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fxwgc"
Jul 16 22:13:48.264347 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.263849    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rwd8\" (UniqueName: \"kubernetes.io/projected/580d8b18-0719-4d69-943a-f0ee07f74ce7-kube-api-access-2rwd8\") pod \"aws-ebs-csi-driver-node-fxwgc\" (UID: \"580d8b18-0719-4d69-943a-f0ee07f74ce7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fxwgc"
Jul 16 22:13:48.264347 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.263888    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s97z2\" (UniqueName: \"kubernetes.io/projected/fa659f3f-b7af-4c2e-979a-6ef27bd503aa-kube-api-access-s97z2\") pod \"network-check-target-xr6qc\" (UID: \"fa659f3f-b7af-4c2e-979a-6ef27bd503aa\") " pod="openshift-network-diagnostics/network-check-target-xr6qc"
Jul 16 22:13:48.264347 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.263917    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c08cebd5-f417-43a8-a8b8-1919f944bb78-multus-conf-dir\") pod \"multus-xsv9t\" (UID: \"c08cebd5-f417-43a8-a8b8-1919f944bb78\") " pod="openshift-multus/multus-xsv9t"
Jul 16 22:13:48.264347 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.263947    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b0bc3969-f63b-4d8d-9616-bfc554866e8f-hosts-file\") pod \"node-resolver-8zcnq\" (UID: \"b0bc3969-f63b-4d8d-9616-bfc554866e8f\") " pod="openshift-dns/node-resolver-8zcnq"
Jul 16 22:13:48.264347 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.263967    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mdjd\" (UniqueName: \"kubernetes.io/projected/b0bc3969-f63b-4d8d-9616-bfc554866e8f-kube-api-access-4mdjd\") pod \"node-resolver-8zcnq\" (UID: \"b0bc3969-f63b-4d8d-9616-bfc554866e8f\") " pod="openshift-dns/node-resolver-8zcnq"
Jul 16 22:13:48.264347 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.263982    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/580d8b18-0719-4d69-943a-f0ee07f74ce7-socket-dir\") pod \"aws-ebs-csi-driver-node-fxwgc\" (UID: \"580d8b18-0719-4d69-943a-f0ee07f74ce7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fxwgc"
Jul 16 22:13:48.264347 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.263998    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a648734f-4a13-4389-af8e-9f2c09dfafbf-node-log\") pod \"ovnkube-node-69j5k\" (UID: \"a648734f-4a13-4389-af8e-9f2c09dfafbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-69j5k"
Jul 16 22:13:48.264347 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.264019    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a648734f-4a13-4389-af8e-9f2c09dfafbf-log-socket\") pod \"ovnkube-node-69j5k\" (UID: \"a648734f-4a13-4389-af8e-9f2c09dfafbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-69j5k"
Jul 16 22:13:48.264347 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.264041    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a648734f-4a13-4389-af8e-9f2c09dfafbf-host-cni-netd\") pod \"ovnkube-node-69j5k\" (UID: \"a648734f-4a13-4389-af8e-9f2c09dfafbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-69j5k"
Jul 16 22:13:48.264347 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.264089    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b0bc3969-f63b-4d8d-9616-bfc554866e8f-hosts-file\") pod \"node-resolver-8zcnq\" (UID: \"b0bc3969-f63b-4d8d-9616-bfc554866e8f\") " pod="openshift-dns/node-resolver-8zcnq"
Jul 16 22:13:48.264347 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.264118    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c08cebd5-f417-43a8-a8b8-1919f944bb78-multus-cni-dir\") pod \"multus-xsv9t\" (UID: \"c08cebd5-f417-43a8-a8b8-1919f944bb78\") " pod="openshift-multus/multus-xsv9t"
Jul 16 22:13:48.264347 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.264142    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c08cebd5-f417-43a8-a8b8-1919f944bb78-cnibin\") pod \"multus-xsv9t\" (UID: \"c08cebd5-f417-43a8-a8b8-1919f944bb78\") " pod="openshift-multus/multus-xsv9t"
Jul 16 22:13:48.264347 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.264164    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c08cebd5-f417-43a8-a8b8-1919f944bb78-hostroot\") pod \"multus-xsv9t\" (UID: \"c08cebd5-f417-43a8-a8b8-1919f944bb78\") " pod="openshift-multus/multus-xsv9t"
Jul 16 22:13:48.264347 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.264192    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a648734f-4a13-4389-af8e-9f2c09dfafbf-systemd-units\") pod \"ovnkube-node-69j5k\" (UID: \"a648734f-4a13-4389-af8e-9f2c09dfafbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-69j5k"
Jul 16 22:13:48.265024 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.264209    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a648734f-4a13-4389-af8e-9f2c09dfafbf-var-lib-openvswitch\") pod \"ovnkube-node-69j5k\" (UID: \"a648734f-4a13-4389-af8e-9f2c09dfafbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-69j5k"
Jul 16 22:13:48.265024 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.264226    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b8273adb-26b5-4a5b-a20f-afd1f257772d-etc-modprobe-d\") pod \"tuned-znw8p\" (UID: \"b8273adb-26b5-4a5b-a20f-afd1f257772d\") " pod="openshift-cluster-node-tuning-operator/tuned-znw8p"
Jul 16 22:13:48.265024 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.264246    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/80266fce-9ecb-495e-b7ca-fdc237aaa783-serviceca\") pod \"node-ca-t8d4l\" (UID: \"80266fce-9ecb-495e-b7ca-fdc237aaa783\") " pod="openshift-image-registry/node-ca-t8d4l"
Jul 16 22:13:48.265024 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.264268    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/580d8b18-0719-4d69-943a-f0ee07f74ce7-etc-selinux\") pod \"aws-ebs-csi-driver-node-fxwgc\" (UID: \"580d8b18-0719-4d69-943a-f0ee07f74ce7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fxwgc"
Jul 16 22:13:48.265024 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.264308    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/52a402e0-019f-4e46-8dfa-591613eff6d1-agent-certs\") pod \"konnectivity-agent-j7ltc\" (UID: \"52a402e0-019f-4e46-8dfa-591613eff6d1\") " pod="kube-system/konnectivity-agent-j7ltc"
Jul 16 22:13:48.265024 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.264335    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a648734f-4a13-4389-af8e-9f2c09dfafbf-host-run-ovn-kubernetes\") pod \"ovnkube-node-69j5k\" (UID: \"a648734f-4a13-4389-af8e-9f2c09dfafbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-69j5k"
Jul 16 22:13:48.265024 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.264359    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b8273adb-26b5-4a5b-a20f-afd1f257772d-sys\") pod \"tuned-znw8p\" (UID: \"b8273adb-26b5-4a5b-a20f-afd1f257772d\") " pod="openshift-cluster-node-tuning-operator/tuned-znw8p"
Jul 16 22:13:48.265024 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.264374    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c08cebd5-f417-43a8-a8b8-1919f944bb78-host-var-lib-kubelet\") pod \"multus-xsv9t\" (UID: \"c08cebd5-f417-43a8-a8b8-1919f944bb78\") " pod="openshift-multus/multus-xsv9t"
Jul 16 22:13:48.265024 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.264491    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/70a8a28d-dadb-459e-bcc5-a0a5cc107c84-system-cni-dir\") pod \"multus-additional-cni-plugins-zfb6b\" (UID: \"70a8a28d-dadb-459e-bcc5-a0a5cc107c84\") " pod="openshift-multus/multus-additional-cni-plugins-zfb6b"
Jul 16 22:13:48.265024 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.264518    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/70a8a28d-dadb-459e-bcc5-a0a5cc107c84-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zfb6b\" (UID: \"70a8a28d-dadb-459e-bcc5-a0a5cc107c84\") " pod="openshift-multus/multus-additional-cni-plugins-zfb6b"
Jul 16 22:13:48.265024 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.264556    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/cf1b7d07-96ed-44e0-bbb0-aa6bb66378dd-kubelet-config\") pod \"global-pull-secret-syncer-qz9r8\" (UID: \"cf1b7d07-96ed-44e0-bbb0-aa6bb66378dd\") " pod="kube-system/global-pull-secret-syncer-qz9r8"
Jul 16 22:13:48.265024 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.264580    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a648734f-4a13-4389-af8e-9f2c09dfafbf-etc-openvswitch\") pod \"ovnkube-node-69j5k\" (UID: \"a648734f-4a13-4389-af8e-9f2c09dfafbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-69j5k"
Jul 16 22:13:48.265024 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.264603    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a648734f-4a13-4389-af8e-9f2c09dfafbf-run-ovn\") pod \"ovnkube-node-69j5k\" (UID: \"a648734f-4a13-4389-af8e-9f2c09dfafbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-69j5k"
Jul 16 22:13:48.265024 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.264638    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c08cebd5-f417-43a8-a8b8-1919f944bb78-multus-socket-dir-parent\") pod \"multus-xsv9t\" (UID: \"c08cebd5-f417-43a8-a8b8-1919f944bb78\") " pod="openshift-multus/multus-xsv9t"
Jul 16 22:13:48.265659 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.264674    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c08cebd5-f417-43a8-a8b8-1919f944bb78-host-run-netns\") pod \"multus-xsv9t\" (UID: \"c08cebd5-f417-43a8-a8b8-1919f944bb78\") " pod="openshift-multus/multus-xsv9t"
Jul 16 22:13:48.265659 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.264727    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c08cebd5-f417-43a8-a8b8-1919f944bb78-multus-daemon-config\") pod \"multus-xsv9t\" (UID: \"c08cebd5-f417-43a8-a8b8-1919f944bb78\") " pod="openshift-multus/multus-xsv9t"
Jul 16 22:13:48.265659 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.264733    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/cf1b7d07-96ed-44e0-bbb0-aa6bb66378dd-kubelet-config\") pod \"global-pull-secret-syncer-qz9r8\" (UID: \"cf1b7d07-96ed-44e0-bbb0-aa6bb66378dd\") " pod="kube-system/global-pull-secret-syncer-qz9r8"
Jul 16 22:13:48.265659 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.264725    2552 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 16 22:13:48.265659 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.264764    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c08cebd5-f417-43a8-a8b8-1919f944bb78-host-run-multus-certs\") pod \"multus-xsv9t\" (UID: \"c08cebd5-f417-43a8-a8b8-1919f944bb78\") " pod="openshift-multus/multus-xsv9t"
Jul 16 22:13:48.265659 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.264806    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/52a402e0-019f-4e46-8dfa-591613eff6d1-konnectivity-ca\") pod \"konnectivity-agent-j7ltc\" (UID: \"52a402e0-019f-4e46-8dfa-591613eff6d1\") " pod="kube-system/konnectivity-agent-j7ltc"
Jul 16 22:13:48.265659 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.264833    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c08cebd5-f417-43a8-a8b8-1919f944bb78-os-release\") pod \"multus-xsv9t\" (UID: \"c08cebd5-f417-43a8-a8b8-1919f944bb78\") " pod="openshift-multus/multus-xsv9t"
Jul 16 22:13:48.265659 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.264856    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/70a8a28d-dadb-459e-bcc5-a0a5cc107c84-os-release\") pod \"multus-additional-cni-plugins-zfb6b\" (UID: \"70a8a28d-dadb-459e-bcc5-a0a5cc107c84\") " pod="openshift-multus/multus-additional-cni-plugins-zfb6b"
Jul 16 22:13:48.265659 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.264960    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b8273adb-26b5-4a5b-a20f-afd1f257772d-var-lib-kubelet\") pod \"tuned-znw8p\" (UID: \"b8273adb-26b5-4a5b-a20f-afd1f257772d\") " pod="openshift-cluster-node-tuning-operator/tuned-znw8p"
Jul 16 22:13:48.265659 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.265003    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c08cebd5-f417-43a8-a8b8-1919f944bb78-host-var-lib-cni-multus\") pod \"multus-xsv9t\" (UID: \"c08cebd5-f417-43a8-a8b8-1919f944bb78\") " pod="openshift-multus/multus-xsv9t"
Jul 16 22:13:48.265659 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.265029    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bpbdf\" (UniqueName: \"kubernetes.io/projected/a648734f-4a13-4389-af8e-9f2c09dfafbf-kube-api-access-bpbdf\") pod \"ovnkube-node-69j5k\" (UID: \"a648734f-4a13-4389-af8e-9f2c09dfafbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-69j5k"
Jul 16 22:13:48.265659 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.265052    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b8273adb-26b5-4a5b-a20f-afd1f257772d-etc-sysctl-conf\") pod \"tuned-znw8p\" (UID: \"b8273adb-26b5-4a5b-a20f-afd1f257772d\") " pod="openshift-cluster-node-tuning-operator/tuned-znw8p"
Jul 16 22:13:48.265659 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.265075    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b8273adb-26b5-4a5b-a20f-afd1f257772d-run\") pod \"tuned-znw8p\" (UID: \"b8273adb-26b5-4a5b-a20f-afd1f257772d\") " pod="openshift-cluster-node-tuning-operator/tuned-znw8p"
Jul 16 22:13:48.265659 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.265114    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/580d8b18-0719-4d69-943a-f0ee07f74ce7-device-dir\") pod \"aws-ebs-csi-driver-node-fxwgc\" (UID: \"580d8b18-0719-4d69-943a-f0ee07f74ce7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fxwgc"
Jul 16 22:13:48.266356 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.265140    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c08cebd5-f417-43a8-a8b8-1919f944bb78-host-var-lib-cni-bin\") pod \"multus-xsv9t\" (UID: \"c08cebd5-f417-43a8-a8b8-1919f944bb78\") " pod="openshift-multus/multus-xsv9t"
Jul 16 22:13:48.266356 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.265171    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/70a8a28d-dadb-459e-bcc5-a0a5cc107c84-cnibin\") pod \"multus-additional-cni-plugins-zfb6b\" (UID: \"70a8a28d-dadb-459e-bcc5-a0a5cc107c84\") " pod="openshift-multus/multus-additional-cni-plugins-zfb6b"
Jul 16 22:13:48.266356 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.265208    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cf1b7d07-96ed-44e0-bbb0-aa6bb66378dd-original-pull-secret\") pod \"global-pull-secret-syncer-qz9r8\" (UID: \"cf1b7d07-96ed-44e0-bbb0-aa6bb66378dd\") " pod="kube-system/global-pull-secret-syncer-qz9r8"
Jul 16 22:13:48.266356 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.265231    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a648734f-4a13-4389-af8e-9f2c09dfafbf-ovn-node-metrics-cert\") pod \"ovnkube-node-69j5k\" (UID: \"a648734f-4a13-4389-af8e-9f2c09dfafbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-69j5k"
Jul 16 22:13:48.266356 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:13:48.265295    2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 22:13:48.266356 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.265336    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b8273adb-26b5-4a5b-a20f-afd1f257772d-etc-kubernetes\") pod \"tuned-znw8p\" (UID: \"b8273adb-26b5-4a5b-a20f-afd1f257772d\") " pod="openshift-cluster-node-tuning-operator/tuned-znw8p"
Jul 16 22:13:48.266356 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:13:48.265362    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf1b7d07-96ed-44e0-bbb0-aa6bb66378dd-original-pull-secret podName:cf1b7d07-96ed-44e0-bbb0-aa6bb66378dd nodeName:}" failed. No retries permitted until 2026-07-16 22:13:48.765335174 +0000 UTC m=+2.980116316 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cf1b7d07-96ed-44e0-bbb0-aa6bb66378dd-original-pull-secret") pod "global-pull-secret-syncer-qz9r8" (UID: "cf1b7d07-96ed-44e0-bbb0-aa6bb66378dd") : object "kube-system"/"original-pull-secret" not registered
Jul 16 22:13:48.266356 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.265421    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b8273adb-26b5-4a5b-a20f-afd1f257772d-tmp\") pod \"tuned-znw8p\" (UID: \"b8273adb-26b5-4a5b-a20f-afd1f257772d\") " pod="openshift-cluster-node-tuning-operator/tuned-znw8p"
Jul 16 22:13:48.266356 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.265455    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-stsqk\" (UniqueName: \"kubernetes.io/projected/80266fce-9ecb-495e-b7ca-fdc237aaa783-kube-api-access-stsqk\") pod \"node-ca-t8d4l\" (UID: \"80266fce-9ecb-495e-b7ca-fdc237aaa783\") " pod="openshift-image-registry/node-ca-t8d4l"
Jul 16 22:13:48.266356 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.265422    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/52a402e0-019f-4e46-8dfa-591613eff6d1-konnectivity-ca\") pod \"konnectivity-agent-j7ltc\" (UID: \"52a402e0-019f-4e46-8dfa-591613eff6d1\") " pod="kube-system/konnectivity-agent-j7ltc"
Jul 16 22:13:48.266356 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.265484    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c08cebd5-f417-43a8-a8b8-1919f944bb78-etc-kubernetes\") pod \"multus-xsv9t\" (UID: \"c08cebd5-f417-43a8-a8b8-1919f944bb78\") " pod="openshift-multus/multus-xsv9t"
Jul 16 22:13:48.266356 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.265525    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0dea03c6-7be0-48e6-ad97-b245cbb3e76f-metrics-certs\") pod \"network-metrics-daemon-zr4k5\" (UID: \"0dea03c6-7be0-48e6-ad97-b245cbb3e76f\") " pod="openshift-multus/network-metrics-daemon-zr4k5"
Jul 16 22:13:48.266356 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.265565    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a648734f-4a13-4389-af8e-9f2c09dfafbf-host-kubelet\") pod \"ovnkube-node-69j5k\" (UID: \"a648734f-4a13-4389-af8e-9f2c09dfafbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-69j5k"
Jul 16 22:13:48.266356 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.265590    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a648734f-4a13-4389-af8e-9f2c09dfafbf-env-overrides\") pod \"ovnkube-node-69j5k\" (UID: \"a648734f-4a13-4389-af8e-9f2c09dfafbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-69j5k"
Jul 16 22:13:48.267077 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:13:48.265649    2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 22:13:48.267077 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.265685    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b8273adb-26b5-4a5b-a20f-afd1f257772d-etc-systemd\") pod \"tuned-znw8p\" (UID: \"b8273adb-26b5-4a5b-a20f-afd1f257772d\") " pod="openshift-cluster-node-tuning-operator/tuned-znw8p"
Jul 16 22:13:48.267077 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:13:48.265727    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0dea03c6-7be0-48e6-ad97-b245cbb3e76f-metrics-certs podName:0dea03c6-7be0-48e6-ad97-b245cbb3e76f nodeName:}" failed. No retries permitted until 2026-07-16 22:13:48.76571044 +0000 UTC m=+2.980491595 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0dea03c6-7be0-48e6-ad97-b245cbb3e76f-metrics-certs") pod "network-metrics-daemon-zr4k5" (UID: "0dea03c6-7be0-48e6-ad97-b245cbb3e76f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 22:13:48.267077 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.265760    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/80266fce-9ecb-495e-b7ca-fdc237aaa783-host\") pod \"node-ca-t8d4l\" (UID: \"80266fce-9ecb-495e-b7ca-fdc237aaa783\") " pod="openshift-image-registry/node-ca-t8d4l"
Jul 16 22:13:48.267077 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.265789    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/580d8b18-0719-4d69-943a-f0ee07f74ce7-registration-dir\") pod \"aws-ebs-csi-driver-node-fxwgc\" (UID: \"580d8b18-0719-4d69-943a-f0ee07f74ce7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fxwgc"
Jul 16 22:13:48.267077 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.265811    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c08cebd5-f417-43a8-a8b8-1919f944bb78-cni-binary-copy\") pod \"multus-xsv9t\" (UID: \"c08cebd5-f417-43a8-a8b8-1919f944bb78\") " pod="openshift-multus/multus-xsv9t"
Jul 16 22:13:48.267077 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.265837    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/70a8a28d-dadb-459e-bcc5-a0a5cc107c84-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zfb6b\" (UID: \"70a8a28d-dadb-459e-bcc5-a0a5cc107c84\") " pod="openshift-multus/multus-additional-cni-plugins-zfb6b"
Jul 16 22:13:48.267077 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.265862    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e5d08c24-5eb1-4b19-bc6d-1bc2e0e5107d-host-slash\") pod \"iptables-alerter-2fbj7\" (UID: \"e5d08c24-5eb1-4b19-bc6d-1bc2e0e5107d\") " pod="openshift-network-operator/iptables-alerter-2fbj7"
Jul 16 22:13:48.267077 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.265905    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a648734f-4a13-4389-af8e-9f2c09dfafbf-ovnkube-config\") pod \"ovnkube-node-69j5k\" (UID: \"a648734f-4a13-4389-af8e-9f2c09dfafbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-69j5k"
Jul 16 22:13:48.267077 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.265938    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b8273adb-26b5-4a5b-a20f-afd1f257772d-host\") pod \"tuned-znw8p\" (UID: \"b8273adb-26b5-4a5b-a20f-afd1f257772d\") " pod="openshift-cluster-node-tuning-operator/tuned-znw8p"
Jul 16 22:13:48.267077 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.265961    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c08cebd5-f417-43a8-a8b8-1919f944bb78-system-cni-dir\") pod \"multus-xsv9t\" (UID: \"c08cebd5-f417-43a8-a8b8-1919f944bb78\") " pod="openshift-multus/multus-xsv9t"
Jul 16 22:13:48.267077 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.265986    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c08cebd5-f417-43a8-a8b8-1919f944bb78-host-run-k8s-cni-cncf-io\") pod \"multus-xsv9t\" (UID: \"c08cebd5-f417-43a8-a8b8-1919f944bb78\") " pod="openshift-multus/multus-xsv9t"
Jul 16 22:13:48.267077 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.266010    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbph9\" (UniqueName: \"kubernetes.io/projected/c08cebd5-f417-43a8-a8b8-1919f944bb78-kube-api-access-pbph9\") pod \"multus-xsv9t\" (UID: \"c08cebd5-f417-43a8-a8b8-1919f944bb78\") " pod="openshift-multus/multus-xsv9t"
Jul 16 22:13:48.267684 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.266033    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/70a8a28d-dadb-459e-bcc5-a0a5cc107c84-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zfb6b\" (UID: \"70a8a28d-dadb-459e-bcc5-a0a5cc107c84\") " pod="openshift-multus/multus-additional-cni-plugins-zfb6b"
Jul 16 22:13:48.267684 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.266087    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8db9\" (UniqueName: \"kubernetes.io/projected/e5d08c24-5eb1-4b19-bc6d-1bc2e0e5107d-kube-api-access-p8db9\") pod \"iptables-alerter-2fbj7\" (UID: \"e5d08c24-5eb1-4b19-bc6d-1bc2e0e5107d\") " pod="openshift-network-operator/iptables-alerter-2fbj7"
Jul 16 22:13:48.267684 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.266115    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gnqdg\" (UniqueName: \"kubernetes.io/projected/0dea03c6-7be0-48e6-ad97-b245cbb3e76f-kube-api-access-gnqdg\") pod \"network-metrics-daemon-zr4k5\" (UID: \"0dea03c6-7be0-48e6-ad97-b245cbb3e76f\") " pod="openshift-multus/network-metrics-daemon-zr4k5"
Jul 16 22:13:48.267684 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.266146    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a648734f-4a13-4389-af8e-9f2c09dfafbf-host-slash\") pod \"ovnkube-node-69j5k\" (UID: \"a648734f-4a13-4389-af8e-9f2c09dfafbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-69j5k"
Jul 16 22:13:48.267684 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.266164    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a648734f-4a13-4389-af8e-9f2c09dfafbf-host-cni-bin\") pod \"ovnkube-node-69j5k\" (UID: \"a648734f-4a13-4389-af8e-9f2c09dfafbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-69j5k"
Jul 16 22:13:48.267684 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.266179    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/70a8a28d-dadb-459e-bcc5-a0a5cc107c84-cni-binary-copy\") pod \"multus-additional-cni-plugins-zfb6b\" (UID: \"70a8a28d-dadb-459e-bcc5-a0a5cc107c84\") " pod="openshift-multus/multus-additional-cni-plugins-zfb6b"
Jul 16 22:13:48.267684 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.266202    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4d57r\" (UniqueName: \"kubernetes.io/projected/70a8a28d-dadb-459e-bcc5-a0a5cc107c84-kube-api-access-4d57r\") pod \"multus-additional-cni-plugins-zfb6b\" (UID: \"70a8a28d-dadb-459e-bcc5-a0a5cc107c84\") " pod="openshift-multus/multus-additional-cni-plugins-zfb6b"
Jul 16 22:13:48.267684 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.266226    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/cf1b7d07-96ed-44e0-bbb0-aa6bb66378dd-dbus\") pod \"global-pull-secret-syncer-qz9r8\" (UID: \"cf1b7d07-96ed-44e0-bbb0-aa6bb66378dd\") " pod="kube-system/global-pull-secret-syncer-qz9r8"
Jul 16 22:13:48.267684 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.266243    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b0bc3969-f63b-4d8d-9616-bfc554866e8f-tmp-dir\") pod \"node-resolver-8zcnq\" (UID: \"b0bc3969-f63b-4d8d-9616-bfc554866e8f\") " pod="openshift-dns/node-resolver-8zcnq"
Jul 16 22:13:48.267684 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.266257    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b8273adb-26b5-4a5b-a20f-afd1f257772d-etc-sysconfig\") pod \"tuned-znw8p\" (UID: \"b8273adb-26b5-4a5b-a20f-afd1f257772d\") " pod="openshift-cluster-node-tuning-operator/tuned-znw8p"
Jul 16 22:13:48.267684 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.266278    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvgrg\" (UniqueName: \"kubernetes.io/projected/b8273adb-26b5-4a5b-a20f-afd1f257772d-kube-api-access-xvgrg\") pod \"tuned-znw8p\" (UID: \"b8273adb-26b5-4a5b-a20f-afd1f257772d\") " pod="openshift-cluster-node-tuning-operator/tuned-znw8p"
Jul 16 22:13:48.267684 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.266298    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/580d8b18-0719-4d69-943a-f0ee07f74ce7-sys-fs\") pod \"aws-ebs-csi-driver-node-fxwgc\" (UID: \"580d8b18-0719-4d69-943a-f0ee07f74ce7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fxwgc"
Jul 16 22:13:48.267684 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.266431    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/cf1b7d07-96ed-44e0-bbb0-aa6bb66378dd-dbus\") pod \"global-pull-secret-syncer-qz9r8\" (UID: \"cf1b7d07-96ed-44e0-bbb0-aa6bb66378dd\") " pod="kube-system/global-pull-secret-syncer-qz9r8"
Jul 16 22:13:48.267684 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.266617    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b0bc3969-f63b-4d8d-9616-bfc554866e8f-tmp-dir\") pod \"node-resolver-8zcnq\" (UID: \"b0bc3969-f63b-4d8d-9616-bfc554866e8f\") " pod="openshift-dns/node-resolver-8zcnq"
Jul 16 22:13:48.269309 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.269242    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/52a402e0-019f-4e46-8dfa-591613eff6d1-agent-certs\") pod \"konnectivity-agent-j7ltc\" (UID: \"52a402e0-019f-4e46-8dfa-591613eff6d1\") " pod="kube-system/konnectivity-agent-j7ltc"
Jul 16 22:13:48.272666 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.272610    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mdjd\" (UniqueName: \"kubernetes.io/projected/b0bc3969-f63b-4d8d-9616-bfc554866e8f-kube-api-access-4mdjd\") pod \"node-resolver-8zcnq\" (UID: \"b0bc3969-f63b-4d8d-9616-bfc554866e8f\") " pod="openshift-dns/node-resolver-8zcnq"
Jul 16 22:13:48.277080 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.277030    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-47.ec2.internal" event={"ID":"47c2f0a7b828edb1ad6c13dbbda696f8","Type":"ContainerStarted","Data":"46792d44077c890024c1807566cb268bfde3dcfd4c5a8837ce070e8c296e2212"}
Jul 16 22:13:48.277940 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.277898    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gnqdg\" (UniqueName: \"kubernetes.io/projected/0dea03c6-7be0-48e6-ad97-b245cbb3e76f-kube-api-access-gnqdg\") pod \"network-metrics-daemon-zr4k5\" (UID: \"0dea03c6-7be0-48e6-ad97-b245cbb3e76f\") " pod="openshift-multus/network-metrics-daemon-zr4k5"
Jul 16 22:13:48.279817 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.279792    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-47.ec2.internal" event={"ID":"155d0342127b71289839856a25f3be3f","Type":"ContainerStarted","Data":"4057029e215a71547fd48b909daec4a1584b91e78aa60bfdcbbdca09ed466532"}
Jul 16 22:13:48.367234 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.367153    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a648734f-4a13-4389-af8e-9f2c09dfafbf-node-log\") pod \"ovnkube-node-69j5k\" (UID: \"a648734f-4a13-4389-af8e-9f2c09dfafbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-69j5k"
Jul 16 22:13:48.367234 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.367195    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a648734f-4a13-4389-af8e-9f2c09dfafbf-log-socket\") pod \"ovnkube-node-69j5k\" (UID: \"a648734f-4a13-4389-af8e-9f2c09dfafbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-69j5k"
Jul 16 22:13:48.367234 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.367226    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a648734f-4a13-4389-af8e-9f2c09dfafbf-host-cni-netd\") pod \"ovnkube-node-69j5k\" (UID: \"a648734f-4a13-4389-af8e-9f2c09dfafbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-69j5k"
Jul 16 22:13:48.367466 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.367250    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c08cebd5-f417-43a8-a8b8-1919f944bb78-multus-cni-dir\") pod \"multus-xsv9t\" (UID: \"c08cebd5-f417-43a8-a8b8-1919f944bb78\") " pod="openshift-multus/multus-xsv9t"
Jul 16 22:13:48.367466 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.367264    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a648734f-4a13-4389-af8e-9f2c09dfafbf-node-log\") pod \"ovnkube-node-69j5k\" (UID: \"a648734f-4a13-4389-af8e-9f2c09dfafbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-69j5k"
Jul 16 22:13:48.367466 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.367287    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a648734f-4a13-4389-af8e-9f2c09dfafbf-log-socket\") pod \"ovnkube-node-69j5k\" (UID: \"a648734f-4a13-4389-af8e-9f2c09dfafbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-69j5k"
Jul 16 22:13:48.367466 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.367273    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c08cebd5-f417-43a8-a8b8-1919f944bb78-cnibin\") pod \"multus-xsv9t\" (UID: \"c08cebd5-f417-43a8-a8b8-1919f944bb78\") " pod="openshift-multus/multus-xsv9t"
Jul 16 22:13:48.367466 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.367328    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a648734f-4a13-4389-af8e-9f2c09dfafbf-host-cni-netd\") pod \"ovnkube-node-69j5k\" (UID: \"a648734f-4a13-4389-af8e-9f2c09dfafbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-69j5k"
Jul 16 22:13:48.367466 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.367342    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c08cebd5-f417-43a8-a8b8-1919f944bb78-hostroot\") pod \"multus-xsv9t\" (UID: \"c08cebd5-f417-43a8-a8b8-1919f944bb78\") " pod="openshift-multus/multus-xsv9t"
Jul 16 22:13:48.367466 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.367345    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c08cebd5-f417-43a8-a8b8-1919f944bb78-multus-cni-dir\") pod \"multus-xsv9t\" (UID: \"c08cebd5-f417-43a8-a8b8-1919f944bb78\") " pod="openshift-multus/multus-xsv9t"
Jul 16 22:13:48.367466 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.367335    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c08cebd5-f417-43a8-a8b8-1919f944bb78-cnibin\") pod \"multus-xsv9t\" (UID: \"c08cebd5-f417-43a8-a8b8-1919f944bb78\") " pod="openshift-multus/multus-xsv9t"
Jul 16 22:13:48.367466 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.367374    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a648734f-4a13-4389-af8e-9f2c09dfafbf-systemd-units\") pod \"ovnkube-node-69j5k\" (UID: \"a648734f-4a13-4389-af8e-9f2c09dfafbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-69j5k"
Jul 16 22:13:48.367466 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.367400    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a648734f-4a13-4389-af8e-9f2c09dfafbf-var-lib-openvswitch\") pod \"ovnkube-node-69j5k\" (UID: \"a648734f-4a13-4389-af8e-9f2c09dfafbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-69j5k"
Jul 16 22:13:48.367466 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.367376    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c08cebd5-f417-43a8-a8b8-1919f944bb78-hostroot\") pod \"multus-xsv9t\" (UID: \"c08cebd5-f417-43a8-a8b8-1919f944bb78\") " pod="openshift-multus/multus-xsv9t"
Jul 16 22:13:48.367466 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.367418    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b8273adb-26b5-4a5b-a20f-afd1f257772d-etc-modprobe-d\") pod \"tuned-znw8p\" (UID: \"b8273adb-26b5-4a5b-a20f-afd1f257772d\") " pod="openshift-cluster-node-tuning-operator/tuned-znw8p"
Jul 16 22:13:48.367466 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.367433    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/80266fce-9ecb-495e-b7ca-fdc237aaa783-serviceca\") pod \"node-ca-t8d4l\" (UID: \"80266fce-9ecb-495e-b7ca-fdc237aaa783\") " pod="openshift-image-registry/node-ca-t8d4l"
Jul 16 22:13:48.367466 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.367442    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a648734f-4a13-4389-af8e-9f2c09dfafbf-systemd-units\") pod \"ovnkube-node-69j5k\" (UID: \"a648734f-4a13-4389-af8e-9f2c09dfafbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-69j5k"
Jul 16 22:13:48.367466 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.367450    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/580d8b18-0719-4d69-943a-f0ee07f74ce7-etc-selinux\") pod \"aws-ebs-csi-driver-node-fxwgc\" (UID: \"580d8b18-0719-4d69-943a-f0ee07f74ce7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fxwgc"
Jul 16 22:13:48.368191 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.367460    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a648734f-4a13-4389-af8e-9f2c09dfafbf-var-lib-openvswitch\") pod \"ovnkube-node-69j5k\" (UID: \"a648734f-4a13-4389-af8e-9f2c09dfafbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-69j5k"
Jul 16 22:13:48.368191 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.367489    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a648734f-4a13-4389-af8e-9f2c09dfafbf-host-run-ovn-kubernetes\") pod \"ovnkube-node-69j5k\" (UID: \"a648734f-4a13-4389-af8e-9f2c09dfafbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-69j5k"
Jul 16 22:13:48.368191 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.367514    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b8273adb-26b5-4a5b-a20f-afd1f257772d-sys\") pod \"tuned-znw8p\" (UID: \"b8273adb-26b5-4a5b-a20f-afd1f257772d\") " pod="openshift-cluster-node-tuning-operator/tuned-znw8p"
Jul 16 22:13:48.368191 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.367529    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c08cebd5-f417-43a8-a8b8-1919f944bb78-host-var-lib-kubelet\") pod \"multus-xsv9t\" (UID: \"c08cebd5-f417-43a8-a8b8-1919f944bb78\") " pod="openshift-multus/multus-xsv9t"
Jul 16 22:13:48.368191 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.367533    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b8273adb-26b5-4a5b-a20f-afd1f257772d-etc-modprobe-d\") pod \"tuned-znw8p\" (UID: \"b8273adb-26b5-4a5b-a20f-afd1f257772d\") " pod="openshift-cluster-node-tuning-operator/tuned-znw8p"
Jul 16 22:13:48.368191 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.367546    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/70a8a28d-dadb-459e-bcc5-a0a5cc107c84-system-cni-dir\") pod \"multus-additional-cni-plugins-zfb6b\" (UID: \"70a8a28d-dadb-459e-bcc5-a0a5cc107c84\") " pod="openshift-multus/multus-additional-cni-plugins-zfb6b"
Jul 16 22:13:48.368191 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.367562    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/70a8a28d-dadb-459e-bcc5-a0a5cc107c84-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zfb6b\" (UID: \"70a8a28d-dadb-459e-bcc5-a0a5cc107c84\") " pod="openshift-multus/multus-additional-cni-plugins-zfb6b"
Jul 16 22:13:48.368191 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.367579    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a648734f-4a13-4389-af8e-9f2c09dfafbf-etc-openvswitch\") pod \"ovnkube-node-69j5k\" (UID: \"a648734f-4a13-4389-af8e-9f2c09dfafbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-69j5k"
Jul 16 22:13:48.368191 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.367582    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b8273adb-26b5-4a5b-a20f-afd1f257772d-sys\") pod \"tuned-znw8p\" (UID: \"b8273adb-26b5-4a5b-a20f-afd1f257772d\") " pod="openshift-cluster-node-tuning-operator/tuned-znw8p"
Jul 16 22:13:48.368191 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.367593    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a648734f-4a13-4389-af8e-9f2c09dfafbf-run-ovn\") pod \"ovnkube-node-69j5k\" (UID: \"a648734f-4a13-4389-af8e-9f2c09dfafbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-69j5k"
Jul 16 22:13:48.368191 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.367608    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c08cebd5-f417-43a8-a8b8-1919f944bb78-multus-socket-dir-parent\") pod \"multus-xsv9t\" (UID: \"c08cebd5-f417-43a8-a8b8-1919f944bb78\") " pod="openshift-multus/multus-xsv9t"
Jul 16 22:13:48.368191 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.367622    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c08cebd5-f417-43a8-a8b8-1919f944bb78-host-run-netns\") pod \"multus-xsv9t\" (UID: \"c08cebd5-f417-43a8-a8b8-1919f944bb78\") " pod="openshift-multus/multus-xsv9t"
Jul 16 22:13:48.368191 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.367628    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/70a8a28d-dadb-459e-bcc5-a0a5cc107c84-system-cni-dir\") pod \"multus-additional-cni-plugins-zfb6b\" (UID: \"70a8a28d-dadb-459e-bcc5-a0a5cc107c84\") " pod="openshift-multus/multus-additional-cni-plugins-zfb6b"
Jul 16 22:13:48.368191 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.367637    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c08cebd5-f417-43a8-a8b8-1919f944bb78-multus-daemon-config\") pod \"multus-xsv9t\" (UID: \"c08cebd5-f417-43a8-a8b8-1919f944bb78\") " pod="openshift-multus/multus-xsv9t"
Jul 16 22:13:48.368892 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.367561    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a648734f-4a13-4389-af8e-9f2c09dfafbf-host-run-ovn-kubernetes\") pod \"ovnkube-node-69j5k\" (UID: \"a648734f-4a13-4389-af8e-9f2c09dfafbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-69j5k"
Jul 16 22:13:48.368892 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.367665    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c08cebd5-f417-43a8-a8b8-1919f944bb78-host-run-multus-certs\") pod \"multus-xsv9t\" (UID: \"c08cebd5-f417-43a8-a8b8-1919f944bb78\") " pod="openshift-multus/multus-xsv9t"
Jul 16 22:13:48.368892 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.367683    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a648734f-4a13-4389-af8e-9f2c09dfafbf-etc-openvswitch\") pod \"ovnkube-node-69j5k\" (UID: \"a648734f-4a13-4389-af8e-9f2c09dfafbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-69j5k"
Jul 16 22:13:48.368892 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.367691    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c08cebd5-f417-43a8-a8b8-1919f944bb78-os-release\") pod \"multus-xsv9t\" (UID: \"c08cebd5-f417-43a8-a8b8-1919f944bb78\") " pod="openshift-multus/multus-xsv9t"
Jul 16 22:13:48.368892 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.367730    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/70a8a28d-dadb-459e-bcc5-a0a5cc107c84-os-release\") pod \"multus-additional-cni-plugins-zfb6b\" (UID: \"70a8a28d-dadb-459e-bcc5-a0a5cc107c84\") " pod="openshift-multus/multus-additional-cni-plugins-zfb6b"
Jul 16 22:13:48.368892 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.367739    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a648734f-4a13-4389-af8e-9f2c09dfafbf-run-ovn\") pod \"ovnkube-node-69j5k\" (UID: \"a648734f-4a13-4389-af8e-9f2c09dfafbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-69j5k"
Jul 16 22:13:48.368892 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.367592    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c08cebd5-f417-43a8-a8b8-1919f944bb78-host-var-lib-kubelet\") pod \"multus-xsv9t\" (UID: \"c08cebd5-f417-43a8-a8b8-1919f944bb78\") " pod="openshift-multus/multus-xsv9t"
Jul 16 22:13:48.368892 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.367757    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b8273adb-26b5-4a5b-a20f-afd1f257772d-var-lib-kubelet\") pod \"tuned-znw8p\" (UID: \"b8273adb-26b5-4a5b-a20f-afd1f257772d\") " pod="openshift-cluster-node-tuning-operator/tuned-znw8p"
Jul 16 22:13:48.368892 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.367781    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c08cebd5-f417-43a8-a8b8-1919f944bb78-host-var-lib-cni-multus\") pod \"multus-xsv9t\" (UID: \"c08cebd5-f417-43a8-a8b8-1919f944bb78\") " pod="openshift-multus/multus-xsv9t"
Jul 16 22:13:48.368892 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.367801    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c08cebd5-f417-43a8-a8b8-1919f944bb78-multus-socket-dir-parent\") pod \"multus-xsv9t\" (UID: \"c08cebd5-f417-43a8-a8b8-1919f944bb78\") " pod="openshift-multus/multus-xsv9t"
Jul 16 22:13:48.368892 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.367817    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bpbdf\" (UniqueName: \"kubernetes.io/projected/a648734f-4a13-4389-af8e-9f2c09dfafbf-kube-api-access-bpbdf\") pod \"ovnkube-node-69j5k\" (UID: \"a648734f-4a13-4389-af8e-9f2c09dfafbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-69j5k"
Jul 16 22:13:48.368892 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.367822    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c08cebd5-f417-43a8-a8b8-1919f944bb78-host-run-netns\") pod \"multus-xsv9t\" (UID: \"c08cebd5-f417-43a8-a8b8-1919f944bb78\") " pod="openshift-multus/multus-xsv9t"
Jul 16 22:13:48.368892 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.367839    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b8273adb-26b5-4a5b-a20f-afd1f257772d-etc-sysctl-conf\") pod \"tuned-znw8p\" (UID: \"b8273adb-26b5-4a5b-a20f-afd1f257772d\") " pod="openshift-cluster-node-tuning-operator/tuned-znw8p"
Jul 16 22:13:48.368892 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.367854    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c08cebd5-f417-43a8-a8b8-1919f944bb78-os-release\") pod \"multus-xsv9t\" (UID: \"c08cebd5-f417-43a8-a8b8-1919f944bb78\") " pod="openshift-multus/multus-xsv9t"
Jul 16 22:13:48.368892 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.367865    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b8273adb-26b5-4a5b-a20f-afd1f257772d-run\") pod \"tuned-znw8p\" (UID: \"b8273adb-26b5-4a5b-a20f-afd1f257772d\") " pod="openshift-cluster-node-tuning-operator/tuned-znw8p"
Jul 16 22:13:48.369756 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.367888    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/580d8b18-0719-4d69-943a-f0ee07f74ce7-device-dir\") pod \"aws-ebs-csi-driver-node-fxwgc\" (UID: \"580d8b18-0719-4d69-943a-f0ee07f74ce7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fxwgc"
Jul 16 22:13:48.369756 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.367899    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/80266fce-9ecb-495e-b7ca-fdc237aaa783-serviceca\") pod \"node-ca-t8d4l\" (UID: \"80266fce-9ecb-495e-b7ca-fdc237aaa783\") " pod="openshift-image-registry/node-ca-t8d4l"
Jul 16 22:13:48.369756 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.367896    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b8273adb-26b5-4a5b-a20f-afd1f257772d-var-lib-kubelet\") pod \"tuned-znw8p\" (UID: \"b8273adb-26b5-4a5b-a20f-afd1f257772d\") " pod="openshift-cluster-node-tuning-operator/tuned-znw8p"
Jul 16 22:13:48.369756 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.367913    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c08cebd5-f417-43a8-a8b8-1919f944bb78-host-var-lib-cni-bin\") pod \"multus-xsv9t\" (UID: \"c08cebd5-f417-43a8-a8b8-1919f944bb78\") " pod="openshift-multus/multus-xsv9t"
Jul 16 22:13:48.369756 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.367936    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/70a8a28d-dadb-459e-bcc5-a0a5cc107c84-cnibin\") pod \"multus-additional-cni-plugins-zfb6b\" (UID: \"70a8a28d-dadb-459e-bcc5-a0a5cc107c84\") " pod="openshift-multus/multus-additional-cni-plugins-zfb6b"
Jul 16 22:13:48.369756 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.367976    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c08cebd5-f417-43a8-a8b8-1919f944bb78-host-run-multus-certs\") pod \"multus-xsv9t\" (UID: \"c08cebd5-f417-43a8-a8b8-1919f944bb78\") " pod="openshift-multus/multus-xsv9t"
Jul 16 22:13:48.369756 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.368003    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/580d8b18-0719-4d69-943a-f0ee07f74ce7-etc-selinux\") pod \"aws-ebs-csi-driver-node-fxwgc\" (UID: \"580d8b18-0719-4d69-943a-f0ee07f74ce7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fxwgc"
Jul 16 22:13:48.369756 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.368016    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a648734f-4a13-4389-af8e-9f2c09dfafbf-ovn-node-metrics-cert\") pod \"ovnkube-node-69j5k\" (UID: \"a648734f-4a13-4389-af8e-9f2c09dfafbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-69j5k"
Jul 16 22:13:48.369756 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.368039    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b8273adb-26b5-4a5b-a20f-afd1f257772d-etc-kubernetes\") pod \"tuned-znw8p\" (UID: \"b8273adb-26b5-4a5b-a20f-afd1f257772d\") " pod="openshift-cluster-node-tuning-operator/tuned-znw8p"
Jul 16 22:13:48.369756 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.368048    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/70a8a28d-dadb-459e-bcc5-a0a5cc107c84-cnibin\") pod \"multus-additional-cni-plugins-zfb6b\" (UID: \"70a8a28d-dadb-459e-bcc5-a0a5cc107c84\") " pod="openshift-multus/multus-additional-cni-plugins-zfb6b"
Jul 16 22:13:48.369756 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.368061    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b8273adb-26b5-4a5b-a20f-afd1f257772d-tmp\") pod \"tuned-znw8p\" (UID: \"b8273adb-26b5-4a5b-a20f-afd1f257772d\") " pod="openshift-cluster-node-tuning-operator/tuned-znw8p"
Jul 16 22:13:48.369756 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.368084    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-stsqk\" (UniqueName: \"kubernetes.io/projected/80266fce-9ecb-495e-b7ca-fdc237aaa783-kube-api-access-stsqk\") pod \"node-ca-t8d4l\" (UID: \"80266fce-9ecb-495e-b7ca-fdc237aaa783\") " pod="openshift-image-registry/node-ca-t8d4l"
Jul 16 22:13:48.369756 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.368086    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/70a8a28d-dadb-459e-bcc5-a0a5cc107c84-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zfb6b\" (UID: \"70a8a28d-dadb-459e-bcc5-a0a5cc107c84\") " pod="openshift-multus/multus-additional-cni-plugins-zfb6b"
Jul 16 22:13:48.369756 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.368122    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b8273adb-26b5-4a5b-a20f-afd1f257772d-etc-kubernetes\") pod \"tuned-znw8p\" (UID: \"b8273adb-26b5-4a5b-a20f-afd1f257772d\") " pod="openshift-cluster-node-tuning-operator/tuned-znw8p"
Jul 16 22:13:48.369756 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.368128    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c08cebd5-f417-43a8-a8b8-1919f944bb78-etc-kubernetes\") pod \"multus-xsv9t\" (UID: \"c08cebd5-f417-43a8-a8b8-1919f944bb78\") " pod="openshift-multus/multus-xsv9t"
Jul 16 22:13:48.370549 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.368207    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a648734f-4a13-4389-af8e-9f2c09dfafbf-host-kubelet\") pod \"ovnkube-node-69j5k\" (UID: \"a648734f-4a13-4389-af8e-9f2c09dfafbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-69j5k"
Jul 16 22:13:48.370549 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.368228    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a648734f-4a13-4389-af8e-9f2c09dfafbf-env-overrides\") pod \"ovnkube-node-69j5k\" (UID: \"a648734f-4a13-4389-af8e-9f2c09dfafbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-69j5k"
Jul 16 22:13:48.370549 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.368253    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b8273adb-26b5-4a5b-a20f-afd1f257772d-etc-systemd\") pod \"tuned-znw8p\" (UID: \"b8273adb-26b5-4a5b-a20f-afd1f257772d\") " pod="openshift-cluster-node-tuning-operator/tuned-znw8p"
Jul 16 22:13:48.370549 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.368261    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b8273adb-26b5-4a5b-a20f-afd1f257772d-etc-sysctl-conf\") pod \"tuned-znw8p\" (UID: \"b8273adb-26b5-4a5b-a20f-afd1f257772d\") " pod="openshift-cluster-node-tuning-operator/tuned-znw8p"
Jul 16 22:13:48.370549 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.368275    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/80266fce-9ecb-495e-b7ca-fdc237aaa783-host\") pod \"node-ca-t8d4l\" (UID: \"80266fce-9ecb-495e-b7ca-fdc237aaa783\") " pod="openshift-image-registry/node-ca-t8d4l"
Jul 16 22:13:48.370549 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.368297    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/580d8b18-0719-4d69-943a-f0ee07f74ce7-registration-dir\") pod \"aws-ebs-csi-driver-node-fxwgc\" (UID: \"580d8b18-0719-4d69-943a-f0ee07f74ce7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fxwgc"
Jul 16 22:13:48.370549 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.368307    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b8273adb-26b5-4a5b-a20f-afd1f257772d-run\") pod \"tuned-znw8p\" (UID: \"b8273adb-26b5-4a5b-a20f-afd1f257772d\") " pod="openshift-cluster-node-tuning-operator/tuned-znw8p"
Jul 16 22:13:48.370549 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.368314    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c08cebd5-f417-43a8-a8b8-1919f944bb78-multus-daemon-config\") pod \"multus-xsv9t\" (UID: \"c08cebd5-f417-43a8-a8b8-1919f944bb78\") " pod="openshift-multus/multus-xsv9t"
Jul 16 22:13:48.370549 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.368334    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c08cebd5-f417-43a8-a8b8-1919f944bb78-cni-binary-copy\") pod \"multus-xsv9t\" (UID: \"c08cebd5-f417-43a8-a8b8-1919f944bb78\") " pod="openshift-multus/multus-xsv9t"
Jul 16 22:13:48.370549 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.368380    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c08cebd5-f417-43a8-a8b8-1919f944bb78-host-var-lib-cni-bin\") pod \"multus-xsv9t\" (UID: \"c08cebd5-f417-43a8-a8b8-1919f944bb78\") " pod="openshift-multus/multus-xsv9t"
Jul 16 22:13:48.370549 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.368400    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/70a8a28d-dadb-459e-bcc5-a0a5cc107c84-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zfb6b\" (UID: \"70a8a28d-dadb-459e-bcc5-a0a5cc107c84\") " pod="openshift-multus/multus-additional-cni-plugins-zfb6b"
Jul 16 22:13:48.370549 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.368427    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e5d08c24-5eb1-4b19-bc6d-1bc2e0e5107d-host-slash\") pod \"iptables-alerter-2fbj7\" (UID: \"e5d08c24-5eb1-4b19-bc6d-1bc2e0e5107d\") " pod="openshift-network-operator/iptables-alerter-2fbj7"
Jul 16 22:13:48.370549 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.368437    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/70a8a28d-dadb-459e-bcc5-a0a5cc107c84-os-release\") pod \"multus-additional-cni-plugins-zfb6b\" (UID: \"70a8a28d-dadb-459e-bcc5-a0a5cc107c84\") " pod="openshift-multus/multus-additional-cni-plugins-zfb6b"
Jul 16 22:13:48.370549 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.368451    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a648734f-4a13-4389-af8e-9f2c09dfafbf-ovnkube-config\") pod \"ovnkube-node-69j5k\" (UID: \"a648734f-4a13-4389-af8e-9f2c09dfafbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-69j5k"
Jul 16 22:13:48.370549 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.368478    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c08cebd5-f417-43a8-a8b8-1919f944bb78-etc-kubernetes\") pod \"multus-xsv9t\" (UID: \"c08cebd5-f417-43a8-a8b8-1919f944bb78\") " pod="openshift-multus/multus-xsv9t"
Jul 16 22:13:48.371184 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.368085    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c08cebd5-f417-43a8-a8b8-1919f944bb78-host-var-lib-cni-multus\") pod \"multus-xsv9t\" (UID: \"c08cebd5-f417-43a8-a8b8-1919f944bb78\") " pod="openshift-multus/multus-xsv9t"
Jul 16 22:13:48.371184 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.368482    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/580d8b18-0719-4d69-943a-f0ee07f74ce7-registration-dir\") pod \"aws-ebs-csi-driver-node-fxwgc\" (UID: \"580d8b18-0719-4d69-943a-f0ee07f74ce7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fxwgc"
Jul 16 22:13:48.371184 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.368473    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b8273adb-26b5-4a5b-a20f-afd1f257772d-host\") pod \"tuned-znw8p\" (UID: \"b8273adb-26b5-4a5b-a20f-afd1f257772d\") " pod="openshift-cluster-node-tuning-operator/tuned-znw8p"
Jul 16 22:13:48.371184 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.368526    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/80266fce-9ecb-495e-b7ca-fdc237aaa783-host\") pod \"node-ca-t8d4l\" (UID: \"80266fce-9ecb-495e-b7ca-fdc237aaa783\") " pod="openshift-image-registry/node-ca-t8d4l"
Jul 16 22:13:48.371184 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.368349    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/580d8b18-0719-4d69-943a-f0ee07f74ce7-device-dir\") pod \"aws-ebs-csi-driver-node-fxwgc\" (UID: \"580d8b18-0719-4d69-943a-f0ee07f74ce7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fxwgc"
Jul 16 22:13:48.371184 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.368532    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c08cebd5-f417-43a8-a8b8-1919f944bb78-system-cni-dir\") pod \"multus-xsv9t\" (UID: \"c08cebd5-f417-43a8-a8b8-1919f944bb78\") " pod="openshift-multus/multus-xsv9t"
Jul 16 22:13:48.371184 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.368570    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e5d08c24-5eb1-4b19-bc6d-1bc2e0e5107d-host-slash\") pod \"iptables-alerter-2fbj7\" (UID: \"e5d08c24-5eb1-4b19-bc6d-1bc2e0e5107d\") " pod="openshift-network-operator/iptables-alerter-2fbj7"
Jul 16 22:13:48.371184 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.368587    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a648734f-4a13-4389-af8e-9f2c09dfafbf-env-overrides\") pod \"ovnkube-node-69j5k\" (UID: \"a648734f-4a13-4389-af8e-9f2c09dfafbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-69j5k"
Jul 16 22:13:48.371184 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.368596    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c08cebd5-f417-43a8-a8b8-1919f944bb78-host-run-k8s-cni-cncf-io\") pod \"multus-xsv9t\" (UID: \"c08cebd5-f417-43a8-a8b8-1919f944bb78\") " pod="openshift-multus/multus-xsv9t"
Jul 16 22:13:48.371184 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.368623    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pbph9\" (UniqueName: \"kubernetes.io/projected/c08cebd5-f417-43a8-a8b8-1919f944bb78-kube-api-access-pbph9\") pod \"multus-xsv9t\" (UID: \"c08cebd5-f417-43a8-a8b8-1919f944bb78\") " pod="openshift-multus/multus-xsv9t"
Jul 16 22:13:48.371184 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.368861    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a648734f-4a13-4389-af8e-9f2c09dfafbf-host-kubelet\") pod \"ovnkube-node-69j5k\" (UID: \"a648734f-4a13-4389-af8e-9f2c09dfafbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-69j5k"
Jul 16 22:13:48.371184 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.368900    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c08cebd5-f417-43a8-a8b8-1919f944bb78-host-run-k8s-cni-cncf-io\") pod \"multus-xsv9t\" (UID: \"c08cebd5-f417-43a8-a8b8-1919f944bb78\") " pod="openshift-multus/multus-xsv9t"
Jul 16 22:13:48.371184 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.368933    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/70a8a28d-dadb-459e-bcc5-a0a5cc107c84-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zfb6b\" (UID: \"70a8a28d-dadb-459e-bcc5-a0a5cc107c84\") " pod="openshift-multus/multus-additional-cni-plugins-zfb6b"
Jul 16 22:13:48.371184 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.368970    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p8db9\" (UniqueName: \"kubernetes.io/projected/e5d08c24-5eb1-4b19-bc6d-1bc2e0e5107d-kube-api-access-p8db9\") pod \"iptables-alerter-2fbj7\" (UID: \"e5d08c24-5eb1-4b19-bc6d-1bc2e0e5107d\") " pod="openshift-network-operator/iptables-alerter-2fbj7"
Jul 16 22:13:48.371877 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.368979    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/70a8a28d-dadb-459e-bcc5-a0a5cc107c84-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zfb6b\" (UID: \"70a8a28d-dadb-459e-bcc5-a0a5cc107c84\") " pod="openshift-multus/multus-additional-cni-plugins-zfb6b"
Jul 16 22:13:48.371877 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.369031    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a648734f-4a13-4389-af8e-9f2c09dfafbf-ovnkube-config\") pod \"ovnkube-node-69j5k\" (UID: \"a648734f-4a13-4389-af8e-9f2c09dfafbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-69j5k"
Jul 16 22:13:48.371877 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.369031    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c08cebd5-f417-43a8-a8b8-1919f944bb78-cni-binary-copy\") pod \"multus-xsv9t\" (UID: \"c08cebd5-f417-43a8-a8b8-1919f944bb78\") " pod="openshift-multus/multus-xsv9t"
Jul 16 22:13:48.371877 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.369089    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b8273adb-26b5-4a5b-a20f-afd1f257772d-etc-systemd\") pod \"tuned-znw8p\" (UID: \"b8273adb-26b5-4a5b-a20f-afd1f257772d\") " pod="openshift-cluster-node-tuning-operator/tuned-znw8p"
Jul 16 22:13:48.371877 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.369109    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b8273adb-26b5-4a5b-a20f-afd1f257772d-host\") pod \"tuned-znw8p\" (UID: \"b8273adb-26b5-4a5b-a20f-afd1f257772d\") " pod="openshift-cluster-node-tuning-operator/tuned-znw8p"
Jul 16 22:13:48.371877 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.369114    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/70a8a28d-dadb-459e-bcc5-a0a5cc107c84-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zfb6b\" (UID: \"70a8a28d-dadb-459e-bcc5-a0a5cc107c84\") " pod="openshift-multus/multus-additional-cni-plugins-zfb6b"
Jul 16 22:13:48.371877 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.369131    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a648734f-4a13-4389-af8e-9f2c09dfafbf-host-slash\") pod \"ovnkube-node-69j5k\" (UID: \"a648734f-4a13-4389-af8e-9f2c09dfafbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-69j5k"
Jul 16 22:13:48.371877 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.369132    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c08cebd5-f417-43a8-a8b8-1919f944bb78-system-cni-dir\") pod \"multus-xsv9t\" (UID: \"c08cebd5-f417-43a8-a8b8-1919f944bb78\") " pod="openshift-multus/multus-xsv9t"
Jul 16 22:13:48.371877 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.369151    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a648734f-4a13-4389-af8e-9f2c09dfafbf-host-cni-bin\") pod \"ovnkube-node-69j5k\" (UID: \"a648734f-4a13-4389-af8e-9f2c09dfafbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-69j5k"
Jul 16 22:13:48.371877 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.369161    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a648734f-4a13-4389-af8e-9f2c09dfafbf-host-slash\") pod \"ovnkube-node-69j5k\" (UID: \"a648734f-4a13-4389-af8e-9f2c09dfafbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-69j5k"
Jul 16 22:13:48.371877 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.369172    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a648734f-4a13-4389-af8e-9f2c09dfafbf-host-cni-bin\") pod \"ovnkube-node-69j5k\" (UID: \"a648734f-4a13-4389-af8e-9f2c09dfafbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-69j5k"
Jul 16 22:13:48.371877 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.369180    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/70a8a28d-dadb-459e-bcc5-a0a5cc107c84-cni-binary-copy\") pod \"multus-additional-cni-plugins-zfb6b\" (UID: \"70a8a28d-dadb-459e-bcc5-a0a5cc107c84\") " pod="openshift-multus/multus-additional-cni-plugins-zfb6b"
Jul 16 22:13:48.371877 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.369208    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4d57r\" (UniqueName: \"kubernetes.io/projected/70a8a28d-dadb-459e-bcc5-a0a5cc107c84-kube-api-access-4d57r\") pod \"multus-additional-cni-plugins-zfb6b\" (UID: \"70a8a28d-dadb-459e-bcc5-a0a5cc107c84\") " pod="openshift-multus/multus-additional-cni-plugins-zfb6b"
Jul 16 22:13:48.371877 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.369236    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b8273adb-26b5-4a5b-a20f-afd1f257772d-etc-sysconfig\") pod \"tuned-znw8p\" (UID: \"b8273adb-26b5-4a5b-a20f-afd1f257772d\") " pod="openshift-cluster-node-tuning-operator/tuned-znw8p"
Jul 16 22:13:48.372419 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.369263    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvgrg\" (UniqueName: \"kubernetes.io/projected/b8273adb-26b5-4a5b-a20f-afd1f257772d-kube-api-access-xvgrg\") pod \"tuned-znw8p\" (UID: \"b8273adb-26b5-4a5b-a20f-afd1f257772d\") " pod="openshift-cluster-node-tuning-operator/tuned-znw8p"
Jul 16 22:13:48.372419 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.369287    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/580d8b18-0719-4d69-943a-f0ee07f74ce7-sys-fs\") pod \"aws-ebs-csi-driver-node-fxwgc\" (UID: \"580d8b18-0719-4d69-943a-f0ee07f74ce7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fxwgc"
Jul 16 22:13:48.372419 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.369311    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a648734f-4a13-4389-af8e-9f2c09dfafbf-host-run-netns\") pod \"ovnkube-node-69j5k\" (UID: \"a648734f-4a13-4389-af8e-9f2c09dfafbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-69j5k"
Jul 16 22:13:48.372419 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.369333    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a648734f-4a13-4389-af8e-9f2c09dfafbf-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-69j5k\" (UID: \"a648734f-4a13-4389-af8e-9f2c09dfafbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-69j5k"
Jul 16 22:13:48.372419 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.369357    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a648734f-4a13-4389-af8e-9f2c09dfafbf-ovnkube-script-lib\") pod \"ovnkube-node-69j5k\" (UID: \"a648734f-4a13-4389-af8e-9f2c09dfafbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-69j5k"
Jul 16 22:13:48.372419 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.369379    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b8273adb-26b5-4a5b-a20f-afd1f257772d-lib-modules\") pod \"tuned-znw8p\" (UID: \"b8273adb-26b5-4a5b-a20f-afd1f257772d\") " pod="openshift-cluster-node-tuning-operator/tuned-znw8p"
Jul 16 22:13:48.372419 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.369402    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e5d08c24-5eb1-4b19-bc6d-1bc2e0e5107d-iptables-alerter-script\") pod \"iptables-alerter-2fbj7\" (UID: \"e5d08c24-5eb1-4b19-bc6d-1bc2e0e5107d\") " pod="openshift-network-operator/iptables-alerter-2fbj7"
Jul 16 22:13:48.372419 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.369431    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a648734f-4a13-4389-af8e-9f2c09dfafbf-run-systemd\") pod \"ovnkube-node-69j5k\" (UID: \"a648734f-4a13-4389-af8e-9f2c09dfafbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-69j5k"
Jul 16 22:13:48.372419 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.369454    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a648734f-4a13-4389-af8e-9f2c09dfafbf-run-openvswitch\") pod \"ovnkube-node-69j5k\" (UID: \"a648734f-4a13-4389-af8e-9f2c09dfafbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-69j5k"
Jul 16 22:13:48.372419 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.369466    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a648734f-4a13-4389-af8e-9f2c09dfafbf-host-run-netns\") pod \"ovnkube-node-69j5k\" (UID: \"a648734f-4a13-4389-af8e-9f2c09dfafbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-69j5k"
Jul 16 22:13:48.372419 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.369476    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b8273adb-26b5-4a5b-a20f-afd1f257772d-etc-sysctl-d\") pod \"tuned-znw8p\" (UID: \"b8273adb-26b5-4a5b-a20f-afd1f257772d\") " pod="openshift-cluster-node-tuning-operator/tuned-znw8p"
Jul 16 22:13:48.372419 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.369500    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b8273adb-26b5-4a5b-a20f-afd1f257772d-etc-tuned\") pod \"tuned-znw8p\" (UID: \"b8273adb-26b5-4a5b-a20f-afd1f257772d\") " pod="openshift-cluster-node-tuning-operator/tuned-znw8p"
Jul 16 22:13:48.372419 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.369521    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b8273adb-26b5-4a5b-a20f-afd1f257772d-etc-sysconfig\") pod \"tuned-znw8p\" (UID: \"b8273adb-26b5-4a5b-a20f-afd1f257772d\") " pod="openshift-cluster-node-tuning-operator/tuned-znw8p"
Jul 16 22:13:48.372419 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.369522    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/580d8b18-0719-4d69-943a-f0ee07f74ce7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fxwgc\" (UID: \"580d8b18-0719-4d69-943a-f0ee07f74ce7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fxwgc"
Jul 16 22:13:48.373031 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.369560    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rwd8\" (UniqueName: \"kubernetes.io/projected/580d8b18-0719-4d69-943a-f0ee07f74ce7-kube-api-access-2rwd8\") pod \"aws-ebs-csi-driver-node-fxwgc\" (UID: \"580d8b18-0719-4d69-943a-f0ee07f74ce7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fxwgc"
Jul 16 22:13:48.373031 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.369574    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/580d8b18-0719-4d69-943a-f0ee07f74ce7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fxwgc\" (UID: \"580d8b18-0719-4d69-943a-f0ee07f74ce7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fxwgc"
Jul 16 22:13:48.373031 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.369638    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/70a8a28d-dadb-459e-bcc5-a0a5cc107c84-cni-binary-copy\") pod \"multus-additional-cni-plugins-zfb6b\" (UID: \"70a8a28d-dadb-459e-bcc5-a0a5cc107c84\") " pod="openshift-multus/multus-additional-cni-plugins-zfb6b"
Jul 16 22:13:48.373031 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.369776    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a648734f-4a13-4389-af8e-9f2c09dfafbf-run-openvswitch\") pod \"ovnkube-node-69j5k\" (UID: \"a648734f-4a13-4389-af8e-9f2c09dfafbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-69j5k"
Jul 16 22:13:48.373031 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.369784    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a648734f-4a13-4389-af8e-9f2c09dfafbf-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-69j5k\" (UID: \"a648734f-4a13-4389-af8e-9f2c09dfafbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-69j5k"
Jul 16 22:13:48.373031 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.369818    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a648734f-4a13-4389-af8e-9f2c09dfafbf-run-systemd\") pod \"ovnkube-node-69j5k\" (UID: \"a648734f-4a13-4389-af8e-9f2c09dfafbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-69j5k"
Jul 16 22:13:48.373031 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.369865    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/580d8b18-0719-4d69-943a-f0ee07f74ce7-sys-fs\") pod \"aws-ebs-csi-driver-node-fxwgc\" (UID: \"580d8b18-0719-4d69-943a-f0ee07f74ce7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fxwgc"
Jul 16 22:13:48.373031 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.369964    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b8273adb-26b5-4a5b-a20f-afd1f257772d-lib-modules\") pod \"tuned-znw8p\" (UID: \"b8273adb-26b5-4a5b-a20f-afd1f257772d\") " pod="openshift-cluster-node-tuning-operator/tuned-znw8p"
Jul 16 22:13:48.373031 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.369586    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s97z2\" (UniqueName: \"kubernetes.io/projected/fa659f3f-b7af-4c2e-979a-6ef27bd503aa-kube-api-access-s97z2\") pod \"network-check-target-xr6qc\" (UID: \"fa659f3f-b7af-4c2e-979a-6ef27bd503aa\") " pod="openshift-network-diagnostics/network-check-target-xr6qc"
Jul 16 22:13:48.373031 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.370005    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c08cebd5-f417-43a8-a8b8-1919f944bb78-multus-conf-dir\") pod \"multus-xsv9t\" (UID: \"c08cebd5-f417-43a8-a8b8-1919f944bb78\") " pod="openshift-multus/multus-xsv9t"
Jul 16 22:13:48.373031 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.370031    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/580d8b18-0719-4d69-943a-f0ee07f74ce7-socket-dir\") pod \"aws-ebs-csi-driver-node-fxwgc\" (UID: \"580d8b18-0719-4d69-943a-f0ee07f74ce7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fxwgc"
Jul 16 22:13:48.373031 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.370152    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/580d8b18-0719-4d69-943a-f0ee07f74ce7-socket-dir\") pod \"aws-ebs-csi-driver-node-fxwgc\" (UID: \"580d8b18-0719-4d69-943a-f0ee07f74ce7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fxwgc"
Jul 16 22:13:48.373031 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.370193    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c08cebd5-f417-43a8-a8b8-1919f944bb78-multus-conf-dir\") pod \"multus-xsv9t\" (UID: \"c08cebd5-f417-43a8-a8b8-1919f944bb78\") " pod="openshift-multus/multus-xsv9t"
Jul 16 22:13:48.373031 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.370295    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b8273adb-26b5-4a5b-a20f-afd1f257772d-etc-sysctl-d\") pod \"tuned-znw8p\" (UID: \"b8273adb-26b5-4a5b-a20f-afd1f257772d\") " pod="openshift-cluster-node-tuning-operator/tuned-znw8p"
Jul 16 22:13:48.373745 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.370354    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e5d08c24-5eb1-4b19-bc6d-1bc2e0e5107d-iptables-alerter-script\") pod \"iptables-alerter-2fbj7\" (UID: \"e5d08c24-5eb1-4b19-bc6d-1bc2e0e5107d\") " pod="openshift-network-operator/iptables-alerter-2fbj7"
Jul 16 22:13:48.373745 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.370689    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b8273adb-26b5-4a5b-a20f-afd1f257772d-tmp\") pod \"tuned-znw8p\" (UID: \"b8273adb-26b5-4a5b-a20f-afd1f257772d\") " pod="openshift-cluster-node-tuning-operator/tuned-znw8p"
Jul 16 22:13:48.373745 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.370757    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a648734f-4a13-4389-af8e-9f2c09dfafbf-ovnkube-script-lib\") pod \"ovnkube-node-69j5k\" (UID: \"a648734f-4a13-4389-af8e-9f2c09dfafbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-69j5k"
Jul 16 22:13:48.373745 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.372355    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b8273adb-26b5-4a5b-a20f-afd1f257772d-etc-tuned\") pod \"tuned-znw8p\" (UID: \"b8273adb-26b5-4a5b-a20f-afd1f257772d\") " pod="openshift-cluster-node-tuning-operator/tuned-znw8p"
Jul 16 22:13:48.373745 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.372580    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a648734f-4a13-4389-af8e-9f2c09dfafbf-ovn-node-metrics-cert\") pod \"ovnkube-node-69j5k\" (UID: \"a648734f-4a13-4389-af8e-9f2c09dfafbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-69j5k"
Jul 16 22:13:48.379635 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.379613    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-stsqk\" (UniqueName: \"kubernetes.io/projected/80266fce-9ecb-495e-b7ca-fdc237aaa783-kube-api-access-stsqk\") pod \"node-ca-t8d4l\" (UID: \"80266fce-9ecb-495e-b7ca-fdc237aaa783\") " pod="openshift-image-registry/node-ca-t8d4l"
Jul 16 22:13:48.380824 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:13:48.380708    2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 22:13:48.380824 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:13:48.380732    2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 22:13:48.380824 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:13:48.380745    2552 projected.go:196] Error preparing data for projected volume kube-api-access-s97z2 for pod openshift-network-diagnostics/network-check-target-xr6qc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 22:13:48.380824 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:13:48.380802    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fa659f3f-b7af-4c2e-979a-6ef27bd503aa-kube-api-access-s97z2 podName:fa659f3f-b7af-4c2e-979a-6ef27bd503aa nodeName:}" failed. No retries permitted until 2026-07-16 22:13:48.880785101 +0000 UTC m=+3.095566256 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-s97z2" (UniqueName: "kubernetes.io/projected/fa659f3f-b7af-4c2e-979a-6ef27bd503aa-kube-api-access-s97z2") pod "network-check-target-xr6qc" (UID: "fa659f3f-b7af-4c2e-979a-6ef27bd503aa") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 22:13:48.383460 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.383319    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvgrg\" (UniqueName: \"kubernetes.io/projected/b8273adb-26b5-4a5b-a20f-afd1f257772d-kube-api-access-xvgrg\") pod \"tuned-znw8p\" (UID: \"b8273adb-26b5-4a5b-a20f-afd1f257772d\") " pod="openshift-cluster-node-tuning-operator/tuned-znw8p"
Jul 16 22:13:48.383460 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.383331    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8db9\" (UniqueName: \"kubernetes.io/projected/e5d08c24-5eb1-4b19-bc6d-1bc2e0e5107d-kube-api-access-p8db9\") pod \"iptables-alerter-2fbj7\" (UID: \"e5d08c24-5eb1-4b19-bc6d-1bc2e0e5107d\") " pod="openshift-network-operator/iptables-alerter-2fbj7"
Jul 16 22:13:48.384621 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.384594    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rwd8\" (UniqueName: \"kubernetes.io/projected/580d8b18-0719-4d69-943a-f0ee07f74ce7-kube-api-access-2rwd8\") pod \"aws-ebs-csi-driver-node-fxwgc\" (UID: \"580d8b18-0719-4d69-943a-f0ee07f74ce7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fxwgc"
Jul 16 22:13:48.385494 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.385458    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbph9\" (UniqueName: \"kubernetes.io/projected/c08cebd5-f417-43a8-a8b8-1919f944bb78-kube-api-access-pbph9\") pod \"multus-xsv9t\" (UID: \"c08cebd5-f417-43a8-a8b8-1919f944bb78\") " pod="openshift-multus/multus-xsv9t"
Jul 16 22:13:48.385924 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.385903    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bpbdf\" (UniqueName: \"kubernetes.io/projected/a648734f-4a13-4389-af8e-9f2c09dfafbf-kube-api-access-bpbdf\") pod \"ovnkube-node-69j5k\" (UID: \"a648734f-4a13-4389-af8e-9f2c09dfafbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-69j5k"
Jul 16 22:13:48.387684 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.387660    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4d57r\" (UniqueName: \"kubernetes.io/projected/70a8a28d-dadb-459e-bcc5-a0a5cc107c84-kube-api-access-4d57r\") pod \"multus-additional-cni-plugins-zfb6b\" (UID: \"70a8a28d-dadb-459e-bcc5-a0a5cc107c84\") " pod="openshift-multus/multus-additional-cni-plugins-zfb6b"
Jul 16 22:13:48.444582 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.444559    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8zcnq"
Jul 16 22:13:48.454033 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.454012    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-j7ltc"
Jul 16 22:13:48.463650 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.463632    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-znw8p"
Jul 16 22:13:48.470380 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.470278    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xsv9t"
Jul 16 22:13:48.477304 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.477286    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-t8d4l"
Jul 16 22:13:48.485963 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.485943    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fxwgc"
Jul 16 22:13:48.494516 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.494495    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-zfb6b"
Jul 16 22:13:48.502992 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.502976    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-2fbj7"
Jul 16 22:13:48.515558 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.515543    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-69j5k"
Jul 16 22:13:48.773062 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.772990    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cf1b7d07-96ed-44e0-bbb0-aa6bb66378dd-original-pull-secret\") pod \"global-pull-secret-syncer-qz9r8\" (UID: \"cf1b7d07-96ed-44e0-bbb0-aa6bb66378dd\") " pod="kube-system/global-pull-secret-syncer-qz9r8"
Jul 16 22:13:48.773062 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.773026    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0dea03c6-7be0-48e6-ad97-b245cbb3e76f-metrics-certs\") pod \"network-metrics-daemon-zr4k5\" (UID: \"0dea03c6-7be0-48e6-ad97-b245cbb3e76f\") " pod="openshift-multus/network-metrics-daemon-zr4k5"
Jul 16 22:13:48.773267 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:13:48.773140    2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 22:13:48.773267 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:13:48.773148    2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 22:13:48.773267 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:13:48.773192    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0dea03c6-7be0-48e6-ad97-b245cbb3e76f-metrics-certs podName:0dea03c6-7be0-48e6-ad97-b245cbb3e76f nodeName:}" failed. No retries permitted until 2026-07-16 22:13:49.773179019 +0000 UTC m=+3.987960157 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0dea03c6-7be0-48e6-ad97-b245cbb3e76f-metrics-certs") pod "network-metrics-daemon-zr4k5" (UID: "0dea03c6-7be0-48e6-ad97-b245cbb3e76f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 22:13:48.773267 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:13:48.773205    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf1b7d07-96ed-44e0-bbb0-aa6bb66378dd-original-pull-secret podName:cf1b7d07-96ed-44e0-bbb0-aa6bb66378dd nodeName:}" failed. No retries permitted until 2026-07-16 22:13:49.773198955 +0000 UTC m=+3.987980093 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cf1b7d07-96ed-44e0-bbb0-aa6bb66378dd-original-pull-secret") pod "global-pull-secret-syncer-qz9r8" (UID: "cf1b7d07-96ed-44e0-bbb0-aa6bb66378dd") : object "kube-system"/"original-pull-secret" not registered
Jul 16 22:13:48.974163 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:48.974134    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s97z2\" (UniqueName: \"kubernetes.io/projected/fa659f3f-b7af-4c2e-979a-6ef27bd503aa-kube-api-access-s97z2\") pod \"network-check-target-xr6qc\" (UID: \"fa659f3f-b7af-4c2e-979a-6ef27bd503aa\") " pod="openshift-network-diagnostics/network-check-target-xr6qc"
Jul 16 22:13:48.974315 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:13:48.974270    2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 22:13:48.974315 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:13:48.974290    2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 22:13:48.974315 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:13:48.974301    2552 projected.go:196] Error preparing data for projected volume kube-api-access-s97z2 for pod openshift-network-diagnostics/network-check-target-xr6qc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 22:13:48.974426 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:13:48.974354    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fa659f3f-b7af-4c2e-979a-6ef27bd503aa-kube-api-access-s97z2 podName:fa659f3f-b7af-4c2e-979a-6ef27bd503aa nodeName:}" failed. No retries permitted until 2026-07-16 22:13:49.974340383 +0000 UTC m=+4.189121520 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-s97z2" (UniqueName: "kubernetes.io/projected/fa659f3f-b7af-4c2e-979a-6ef27bd503aa-kube-api-access-s97z2") pod "network-check-target-xr6qc" (UID: "fa659f3f-b7af-4c2e-979a-6ef27bd503aa") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 22:13:49.191043 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:49.190957    2552 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-15 22:08:48 +0000 UTC" deadline="2028-02-28 12:40:20.570947076 +0000 UTC"
Jul 16 22:13:49.191043 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:49.190994    2552 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14198h26m31.379957122s"
Jul 16 22:13:49.357831 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:49.357792    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52a402e0_019f_4e46_8dfa_591613eff6d1.slice/crio-758212434b274eaf51fcb2ef40f2739d7145917a9261c9070388d45620ecd875 WatchSource:0}: Error finding container 758212434b274eaf51fcb2ef40f2739d7145917a9261c9070388d45620ecd875: Status 404 returned error can't find the container with id 758212434b274eaf51fcb2ef40f2739d7145917a9261c9070388d45620ecd875
Jul 16 22:13:49.358774 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:49.358752    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda648734f_4a13_4389_af8e_9f2c09dfafbf.slice/crio-834f663df508609e7c50848ab18be63a9de9caaf44f54e9ead0e0e0bea01ff2f WatchSource:0}: Error finding container 834f663df508609e7c50848ab18be63a9de9caaf44f54e9ead0e0e0bea01ff2f: Status 404 returned error can't find the container with id 834f663df508609e7c50848ab18be63a9de9caaf44f54e9ead0e0e0bea01ff2f
Jul 16 22:13:49.360086 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:49.360064    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70a8a28d_dadb_459e_bcc5_a0a5cc107c84.slice/crio-7972391aacd95d79cbe1d739069f47b5659f16d1c848152c4313572e5c40c392 WatchSource:0}: Error finding container 7972391aacd95d79cbe1d739069f47b5659f16d1c848152c4313572e5c40c392: Status 404 returned error can't find the container with id 7972391aacd95d79cbe1d739069f47b5659f16d1c848152c4313572e5c40c392
Jul 16 22:13:49.361987 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:49.361007    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5d08c24_5eb1_4b19_bc6d_1bc2e0e5107d.slice/crio-79baa656a44223224e58c4e4fb348cf048516d5ada18343d211878f9ea04cdff WatchSource:0}: Error finding container 79baa656a44223224e58c4e4fb348cf048516d5ada18343d211878f9ea04cdff: Status 404 returned error can't find the container with id 79baa656a44223224e58c4e4fb348cf048516d5ada18343d211878f9ea04cdff
Jul 16 22:13:49.361987 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:49.361743    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod580d8b18_0719_4d69_943a_f0ee07f74ce7.slice/crio-523243dc0d6b561c8451a2c390df821c338ed1899602c69b7a614cdd685deac0 WatchSource:0}: Error finding container 523243dc0d6b561c8451a2c390df821c338ed1899602c69b7a614cdd685deac0: Status 404 returned error can't find the container with id 523243dc0d6b561c8451a2c390df821c338ed1899602c69b7a614cdd685deac0
Jul 16 22:13:49.365139 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:49.365035    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8273adb_26b5_4a5b_a20f_afd1f257772d.slice/crio-9dcd5069be8c0772f1f0319755dae25ae9525be23db3056c4d3547b037212678 WatchSource:0}: Error finding container 9dcd5069be8c0772f1f0319755dae25ae9525be23db3056c4d3547b037212678: Status 404 returned error can't find the container with id 9dcd5069be8c0772f1f0319755dae25ae9525be23db3056c4d3547b037212678
Jul 16 22:13:49.366231 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:49.366206    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80266fce_9ecb_495e_b7ca_fdc237aaa783.slice/crio-307f5d99c059b93126dff748709ed3154cae34074ceff43b0778a27b434408b0 WatchSource:0}: Error finding container 307f5d99c059b93126dff748709ed3154cae34074ceff43b0778a27b434408b0: Status 404 returned error can't find the container with id 307f5d99c059b93126dff748709ed3154cae34074ceff43b0778a27b434408b0
Jul 16 22:13:49.367763 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:49.367660    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc08cebd5_f417_43a8_a8b8_1919f944bb78.slice/crio-e9a4254e010ed637aa53a18bcf875d5b3ea6118d63bb63280ef54a14cd3342ff WatchSource:0}: Error finding container e9a4254e010ed637aa53a18bcf875d5b3ea6118d63bb63280ef54a14cd3342ff: Status 404 returned error can't find the container with id e9a4254e010ed637aa53a18bcf875d5b3ea6118d63bb63280ef54a14cd3342ff
Jul 16 22:13:49.368869 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:13:49.368846    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0bc3969_f63b_4d8d_9616_bfc554866e8f.slice/crio-46e4ed9ccad5e0deb94ec215bfad6243aa05761b4c60c42065bc00254f1b8363 WatchSource:0}: Error finding container 46e4ed9ccad5e0deb94ec215bfad6243aa05761b4c60c42065bc00254f1b8363: Status 404 returned error can't find the container with id 46e4ed9ccad5e0deb94ec215bfad6243aa05761b4c60c42065bc00254f1b8363
Jul 16 22:13:49.781438 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:49.781238    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cf1b7d07-96ed-44e0-bbb0-aa6bb66378dd-original-pull-secret\") pod \"global-pull-secret-syncer-qz9r8\" (UID: \"cf1b7d07-96ed-44e0-bbb0-aa6bb66378dd\") " pod="kube-system/global-pull-secret-syncer-qz9r8"
Jul 16 22:13:49.781438 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:13:49.781392    2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 22:13:49.781438 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:49.781408    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0dea03c6-7be0-48e6-ad97-b245cbb3e76f-metrics-certs\") pod \"network-metrics-daemon-zr4k5\" (UID: \"0dea03c6-7be0-48e6-ad97-b245cbb3e76f\") " pod="openshift-multus/network-metrics-daemon-zr4k5"
Jul 16 22:13:49.781655 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:13:49.781452    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf1b7d07-96ed-44e0-bbb0-aa6bb66378dd-original-pull-secret podName:cf1b7d07-96ed-44e0-bbb0-aa6bb66378dd nodeName:}" failed. No retries permitted until 2026-07-16 22:13:51.781431713 +0000 UTC m=+5.996212856 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cf1b7d07-96ed-44e0-bbb0-aa6bb66378dd-original-pull-secret") pod "global-pull-secret-syncer-qz9r8" (UID: "cf1b7d07-96ed-44e0-bbb0-aa6bb66378dd") : object "kube-system"/"original-pull-secret" not registered
Jul 16 22:13:49.781655 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:13:49.781489    2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 22:13:49.781655 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:13:49.781525    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0dea03c6-7be0-48e6-ad97-b245cbb3e76f-metrics-certs podName:0dea03c6-7be0-48e6-ad97-b245cbb3e76f nodeName:}" failed. No retries permitted until 2026-07-16 22:13:51.781512474 +0000 UTC m=+5.996293615 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0dea03c6-7be0-48e6-ad97-b245cbb3e76f-metrics-certs") pod "network-metrics-daemon-zr4k5" (UID: "0dea03c6-7be0-48e6-ad97-b245cbb3e76f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 22:13:49.983794 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:49.983159    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s97z2\" (UniqueName: \"kubernetes.io/projected/fa659f3f-b7af-4c2e-979a-6ef27bd503aa-kube-api-access-s97z2\") pod \"network-check-target-xr6qc\" (UID: \"fa659f3f-b7af-4c2e-979a-6ef27bd503aa\") " pod="openshift-network-diagnostics/network-check-target-xr6qc"
Jul 16 22:13:49.983794 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:13:49.983373    2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 22:13:49.983794 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:13:49.983397    2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 22:13:49.983794 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:13:49.983411    2552 projected.go:196] Error preparing data for projected volume kube-api-access-s97z2 for pod openshift-network-diagnostics/network-check-target-xr6qc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 22:13:49.983794 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:13:49.983470    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fa659f3f-b7af-4c2e-979a-6ef27bd503aa-kube-api-access-s97z2 podName:fa659f3f-b7af-4c2e-979a-6ef27bd503aa nodeName:}" failed. No retries permitted until 2026-07-16 22:13:51.983451645 +0000 UTC m=+6.198232803 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-s97z2" (UniqueName: "kubernetes.io/projected/fa659f3f-b7af-4c2e-979a-6ef27bd503aa-kube-api-access-s97z2") pod "network-check-target-xr6qc" (UID: "fa659f3f-b7af-4c2e-979a-6ef27bd503aa") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 22:13:50.194274 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:50.194186    2552 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-15 22:08:48 +0000 UTC" deadline="2027-12-20 18:28:41.282756983 +0000 UTC"
Jul 16 22:13:50.194274 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:50.194226    2552 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12524h14m51.088535695s"
Jul 16 22:13:50.280031 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:50.278847    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zr4k5"
Jul 16 22:13:50.280031 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:13:50.279017    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zr4k5" podUID="0dea03c6-7be0-48e6-ad97-b245cbb3e76f"
Jul 16 22:13:50.280031 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:50.279573    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qz9r8"
Jul 16 22:13:50.280031 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:13:50.279734    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qz9r8" podUID="cf1b7d07-96ed-44e0-bbb0-aa6bb66378dd"
Jul 16 22:13:50.280031 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:50.279811    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xr6qc"
Jul 16 22:13:50.280031 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:13:50.279955    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xr6qc" podUID="fa659f3f-b7af-4c2e-979a-6ef27bd503aa"
Jul 16 22:13:50.303297 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:50.303236    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-znw8p" event={"ID":"b8273adb-26b5-4a5b-a20f-afd1f257772d","Type":"ContainerStarted","Data":"9dcd5069be8c0772f1f0319755dae25ae9525be23db3056c4d3547b037212678"}
Jul 16 22:13:50.308565 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:50.307799    2552 generic.go:356] "Generic (PLEG): container finished" podID="47c2f0a7b828edb1ad6c13dbbda696f8" containerID="94b90a6ca8e840f83636702dfb429607a15b32fd9aaea02d8528734088b72d77" exitCode=0
Jul 16 22:13:50.308565 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:50.308395    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-47.ec2.internal" event={"ID":"47c2f0a7b828edb1ad6c13dbbda696f8","Type":"ContainerDied","Data":"94b90a6ca8e840f83636702dfb429607a15b32fd9aaea02d8528734088b72d77"}
Jul 16 22:13:50.318968 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:50.318940    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-t8d4l" event={"ID":"80266fce-9ecb-495e-b7ca-fdc237aaa783","Type":"ContainerStarted","Data":"307f5d99c059b93126dff748709ed3154cae34074ceff43b0778a27b434408b0"}
Jul 16 22:13:50.332498 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:50.332403    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-69j5k" event={"ID":"a648734f-4a13-4389-af8e-9f2c09dfafbf","Type":"ContainerStarted","Data":"834f663df508609e7c50848ab18be63a9de9caaf44f54e9ead0e0e0bea01ff2f"}
Jul 16 22:13:50.346454 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:50.346427    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fxwgc" event={"ID":"580d8b18-0719-4d69-943a-f0ee07f74ce7","Type":"ContainerStarted","Data":"523243dc0d6b561c8451a2c390df821c338ed1899602c69b7a614cdd685deac0"}
Jul 16 22:13:50.354959 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:50.354933    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-2fbj7" event={"ID":"e5d08c24-5eb1-4b19-bc6d-1bc2e0e5107d","Type":"ContainerStarted","Data":"79baa656a44223224e58c4e4fb348cf048516d5ada18343d211878f9ea04cdff"}
Jul 16 22:13:50.366830 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:50.366806    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zfb6b" event={"ID":"70a8a28d-dadb-459e-bcc5-a0a5cc107c84","Type":"ContainerStarted","Data":"7972391aacd95d79cbe1d739069f47b5659f16d1c848152c4313572e5c40c392"}
Jul 16 22:13:50.376613 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:50.376541    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-j7ltc" event={"ID":"52a402e0-019f-4e46-8dfa-591613eff6d1","Type":"ContainerStarted","Data":"758212434b274eaf51fcb2ef40f2739d7145917a9261c9070388d45620ecd875"}
Jul 16 22:13:50.393618 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:50.393036    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-47.ec2.internal" event={"ID":"155d0342127b71289839856a25f3be3f","Type":"ContainerStarted","Data":"930d6e9d522c8e68240343256fbd80bbd14c316131f2dd98f1443e09efb64daf"}
Jul 16 22:13:50.409000 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:50.408973    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xsv9t" event={"ID":"c08cebd5-f417-43a8-a8b8-1919f944bb78","Type":"ContainerStarted","Data":"e9a4254e010ed637aa53a18bcf875d5b3ea6118d63bb63280ef54a14cd3342ff"}
Jul 16 22:13:50.419685 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:50.419661    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8zcnq" event={"ID":"b0bc3969-f63b-4d8d-9616-bfc554866e8f","Type":"ContainerStarted","Data":"46e4ed9ccad5e0deb94ec215bfad6243aa05761b4c60c42065bc00254f1b8363"}
Jul 16 22:13:51.443487 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:51.443449    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-47.ec2.internal" event={"ID":"47c2f0a7b828edb1ad6c13dbbda696f8","Type":"ContainerStarted","Data":"4d6e366e8a94656b1576823852c381768073ba187a73a2a414c6dd6ae8ff11cb"}
Jul 16 22:13:51.460264 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:51.460157    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-47.ec2.internal" podStartSLOduration=4.460141963 podStartE2EDuration="4.460141963s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 22:13:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:13:50.412350196 +0000 UTC m=+4.627131357" watchObservedRunningTime="2026-07-16 22:13:51.460141963 +0000 UTC m=+5.674923122"
Jul 16 22:13:51.460421 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:51.460324    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-47.ec2.internal" podStartSLOduration=4.460315931 podStartE2EDuration="4.460315931s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 22:13:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:13:51.45940301 +0000 UTC m=+5.674184171" watchObservedRunningTime="2026-07-16 22:13:51.460315931 +0000 UTC m=+5.675097092"
Jul 16 22:13:51.802468 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:51.801688    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cf1b7d07-96ed-44e0-bbb0-aa6bb66378dd-original-pull-secret\") pod \"global-pull-secret-syncer-qz9r8\" (UID: \"cf1b7d07-96ed-44e0-bbb0-aa6bb66378dd\") " pod="kube-system/global-pull-secret-syncer-qz9r8"
Jul 16 22:13:51.802468 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:51.801751    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0dea03c6-7be0-48e6-ad97-b245cbb3e76f-metrics-certs\") pod \"network-metrics-daemon-zr4k5\" (UID: \"0dea03c6-7be0-48e6-ad97-b245cbb3e76f\") " pod="openshift-multus/network-metrics-daemon-zr4k5"
Jul 16 22:13:51.802468 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:13:51.801908    2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 22:13:51.802468 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:13:51.801962    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0dea03c6-7be0-48e6-ad97-b245cbb3e76f-metrics-certs podName:0dea03c6-7be0-48e6-ad97-b245cbb3e76f nodeName:}" failed. No retries permitted until 2026-07-16 22:13:55.801944928 +0000 UTC m=+10.016726069 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0dea03c6-7be0-48e6-ad97-b245cbb3e76f-metrics-certs") pod "network-metrics-daemon-zr4k5" (UID: "0dea03c6-7be0-48e6-ad97-b245cbb3e76f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 22:13:51.802468 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:13:51.802340    2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 22:13:51.802468 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:13:51.802388    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf1b7d07-96ed-44e0-bbb0-aa6bb66378dd-original-pull-secret podName:cf1b7d07-96ed-44e0-bbb0-aa6bb66378dd nodeName:}" failed. No retries permitted until 2026-07-16 22:13:55.80237225 +0000 UTC m=+10.017153395 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cf1b7d07-96ed-44e0-bbb0-aa6bb66378dd-original-pull-secret") pod "global-pull-secret-syncer-qz9r8" (UID: "cf1b7d07-96ed-44e0-bbb0-aa6bb66378dd") : object "kube-system"/"original-pull-secret" not registered
Jul 16 22:13:52.003414 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:52.003377    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s97z2\" (UniqueName: \"kubernetes.io/projected/fa659f3f-b7af-4c2e-979a-6ef27bd503aa-kube-api-access-s97z2\") pod \"network-check-target-xr6qc\" (UID: \"fa659f3f-b7af-4c2e-979a-6ef27bd503aa\") " pod="openshift-network-diagnostics/network-check-target-xr6qc"
Jul 16 22:13:52.003607 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:13:52.003589    2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 22:13:52.003672 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:13:52.003617    2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 22:13:52.003672 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:13:52.003631    2552 projected.go:196] Error preparing data for projected volume kube-api-access-s97z2 for pod openshift-network-diagnostics/network-check-target-xr6qc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 22:13:52.003825 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:13:52.003707    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fa659f3f-b7af-4c2e-979a-6ef27bd503aa-kube-api-access-s97z2 podName:fa659f3f-b7af-4c2e-979a-6ef27bd503aa nodeName:}" failed. No retries permitted until 2026-07-16 22:13:56.003674688 +0000 UTC m=+10.218455827 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-s97z2" (UniqueName: "kubernetes.io/projected/fa659f3f-b7af-4c2e-979a-6ef27bd503aa-kube-api-access-s97z2") pod "network-check-target-xr6qc" (UID: "fa659f3f-b7af-4c2e-979a-6ef27bd503aa") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 22:13:52.270527 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:52.270444    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qz9r8"
Jul 16 22:13:52.270723 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:13:52.270581    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qz9r8" podUID="cf1b7d07-96ed-44e0-bbb0-aa6bb66378dd"
Jul 16 22:13:52.270986 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:52.270968    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xr6qc"
Jul 16 22:13:52.271105 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:13:52.271071    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xr6qc" podUID="fa659f3f-b7af-4c2e-979a-6ef27bd503aa"
Jul 16 22:13:52.271165 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:52.271126    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zr4k5"
Jul 16 22:13:52.271226 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:13:52.271206    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zr4k5" podUID="0dea03c6-7be0-48e6-ad97-b245cbb3e76f"
Jul 16 22:13:54.270284 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:54.270245    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xr6qc"
Jul 16 22:13:54.270688 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:13:54.270365    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xr6qc" podUID="fa659f3f-b7af-4c2e-979a-6ef27bd503aa"
Jul 16 22:13:54.270688 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:54.270405    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zr4k5"
Jul 16 22:13:54.270688 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:13:54.270535    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zr4k5" podUID="0dea03c6-7be0-48e6-ad97-b245cbb3e76f"
Jul 16 22:13:54.270688 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:54.270568    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qz9r8"
Jul 16 22:13:54.270688 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:13:54.270644    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qz9r8" podUID="cf1b7d07-96ed-44e0-bbb0-aa6bb66378dd"
Jul 16 22:13:55.837262 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:55.837229    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0dea03c6-7be0-48e6-ad97-b245cbb3e76f-metrics-certs\") pod \"network-metrics-daemon-zr4k5\" (UID: \"0dea03c6-7be0-48e6-ad97-b245cbb3e76f\") " pod="openshift-multus/network-metrics-daemon-zr4k5"
Jul 16 22:13:55.837732 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:55.837322    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cf1b7d07-96ed-44e0-bbb0-aa6bb66378dd-original-pull-secret\") pod \"global-pull-secret-syncer-qz9r8\" (UID: \"cf1b7d07-96ed-44e0-bbb0-aa6bb66378dd\") " pod="kube-system/global-pull-secret-syncer-qz9r8"
Jul 16 22:13:55.837732 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:13:55.837390    2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 22:13:55.837732 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:13:55.837427    2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 22:13:55.837732 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:13:55.837463    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0dea03c6-7be0-48e6-ad97-b245cbb3e76f-metrics-certs podName:0dea03c6-7be0-48e6-ad97-b245cbb3e76f nodeName:}" failed. No retries permitted until 2026-07-16 22:14:03.837439274 +0000 UTC m=+18.052220418 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0dea03c6-7be0-48e6-ad97-b245cbb3e76f-metrics-certs") pod "network-metrics-daemon-zr4k5" (UID: "0dea03c6-7be0-48e6-ad97-b245cbb3e76f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 22:13:55.837732 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:13:55.837487    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf1b7d07-96ed-44e0-bbb0-aa6bb66378dd-original-pull-secret podName:cf1b7d07-96ed-44e0-bbb0-aa6bb66378dd nodeName:}" failed. No retries permitted until 2026-07-16 22:14:03.837476572 +0000 UTC m=+18.052257716 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cf1b7d07-96ed-44e0-bbb0-aa6bb66378dd-original-pull-secret") pod "global-pull-secret-syncer-qz9r8" (UID: "cf1b7d07-96ed-44e0-bbb0-aa6bb66378dd") : object "kube-system"/"original-pull-secret" not registered
Jul 16 22:13:56.038455 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:56.038416    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s97z2\" (UniqueName: \"kubernetes.io/projected/fa659f3f-b7af-4c2e-979a-6ef27bd503aa-kube-api-access-s97z2\") pod \"network-check-target-xr6qc\" (UID: \"fa659f3f-b7af-4c2e-979a-6ef27bd503aa\") " pod="openshift-network-diagnostics/network-check-target-xr6qc"
Jul 16 22:13:56.038654 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:13:56.038629    2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 22:13:56.038654 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:13:56.038656    2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 22:13:56.038862 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:13:56.038668    2552 projected.go:196] Error preparing data for projected volume kube-api-access-s97z2 for pod openshift-network-diagnostics/network-check-target-xr6qc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 22:13:56.038862 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:13:56.038747    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fa659f3f-b7af-4c2e-979a-6ef27bd503aa-kube-api-access-s97z2 podName:fa659f3f-b7af-4c2e-979a-6ef27bd503aa nodeName:}" failed. No retries permitted until 2026-07-16 22:14:04.038728302 +0000 UTC m=+18.253509460 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-s97z2" (UniqueName: "kubernetes.io/projected/fa659f3f-b7af-4c2e-979a-6ef27bd503aa-kube-api-access-s97z2") pod "network-check-target-xr6qc" (UID: "fa659f3f-b7af-4c2e-979a-6ef27bd503aa") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 22:13:56.271391 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:56.271315    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zr4k5"
Jul 16 22:13:56.271541 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:56.271418    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qz9r8"
Jul 16 22:13:56.271541 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:13:56.271421    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zr4k5" podUID="0dea03c6-7be0-48e6-ad97-b245cbb3e76f"
Jul 16 22:13:56.271541 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:56.271445    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xr6qc"
Jul 16 22:13:56.271541 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:13:56.271518    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qz9r8" podUID="cf1b7d07-96ed-44e0-bbb0-aa6bb66378dd"
Jul 16 22:13:56.271772 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:13:56.271605    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xr6qc" podUID="fa659f3f-b7af-4c2e-979a-6ef27bd503aa"
Jul 16 22:13:58.270790 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:58.270760    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zr4k5"
Jul 16 22:13:58.271218 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:58.270800    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qz9r8"
Jul 16 22:13:58.271218 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:13:58.270892    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zr4k5" podUID="0dea03c6-7be0-48e6-ad97-b245cbb3e76f"
Jul 16 22:13:58.271218 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:13:58.270946    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qz9r8" podUID="cf1b7d07-96ed-44e0-bbb0-aa6bb66378dd"
Jul 16 22:13:58.271218 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:13:58.270974    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xr6qc"
Jul 16 22:13:58.271218 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:13:58.271034    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xr6qc" podUID="fa659f3f-b7af-4c2e-979a-6ef27bd503aa"
Jul 16 22:14:00.270824 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:00.270473    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zr4k5"
Jul 16 22:14:00.270824 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:00.270509    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xr6qc"
Jul 16 22:14:00.270824 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:00.270483    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qz9r8"
Jul 16 22:14:00.270824 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:14:00.270616    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zr4k5" podUID="0dea03c6-7be0-48e6-ad97-b245cbb3e76f"
Jul 16 22:14:00.270824 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:14:00.270682    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qz9r8" podUID="cf1b7d07-96ed-44e0-bbb0-aa6bb66378dd"
Jul 16 22:14:00.270824 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:14:00.270800    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xr6qc" podUID="fa659f3f-b7af-4c2e-979a-6ef27bd503aa"
Jul 16 22:14:02.270299 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:02.269879    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zr4k5"
Jul 16 22:14:02.270299 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:02.269917    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xr6qc"
Jul 16 22:14:02.270299 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:02.269879    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qz9r8"
Jul 16 22:14:02.270299 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:14:02.270003    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zr4k5" podUID="0dea03c6-7be0-48e6-ad97-b245cbb3e76f"
Jul 16 22:14:02.270299 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:14:02.270079    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qz9r8" podUID="cf1b7d07-96ed-44e0-bbb0-aa6bb66378dd"
Jul 16 22:14:02.270299 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:14:02.270187    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xr6qc" podUID="fa659f3f-b7af-4c2e-979a-6ef27bd503aa"
Jul 16 22:14:03.895602 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:03.895570    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cf1b7d07-96ed-44e0-bbb0-aa6bb66378dd-original-pull-secret\") pod \"global-pull-secret-syncer-qz9r8\" (UID: \"cf1b7d07-96ed-44e0-bbb0-aa6bb66378dd\") " pod="kube-system/global-pull-secret-syncer-qz9r8"
Jul 16 22:14:03.895602 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:03.895610    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0dea03c6-7be0-48e6-ad97-b245cbb3e76f-metrics-certs\") pod \"network-metrics-daemon-zr4k5\" (UID: \"0dea03c6-7be0-48e6-ad97-b245cbb3e76f\") " pod="openshift-multus/network-metrics-daemon-zr4k5"
Jul 16 22:14:03.896082 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:14:03.895730    2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 22:14:03.896082 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:14:03.895754    2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 22:14:03.896082 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:14:03.895796    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf1b7d07-96ed-44e0-bbb0-aa6bb66378dd-original-pull-secret podName:cf1b7d07-96ed-44e0-bbb0-aa6bb66378dd nodeName:}" failed. No retries permitted until 2026-07-16 22:14:19.895779292 +0000 UTC m=+34.110560450 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cf1b7d07-96ed-44e0-bbb0-aa6bb66378dd-original-pull-secret") pod "global-pull-secret-syncer-qz9r8" (UID: "cf1b7d07-96ed-44e0-bbb0-aa6bb66378dd") : object "kube-system"/"original-pull-secret" not registered
Jul 16 22:14:03.896082 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:14:03.895816    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0dea03c6-7be0-48e6-ad97-b245cbb3e76f-metrics-certs podName:0dea03c6-7be0-48e6-ad97-b245cbb3e76f nodeName:}" failed. No retries permitted until 2026-07-16 22:14:19.895805948 +0000 UTC m=+34.110587086 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0dea03c6-7be0-48e6-ad97-b245cbb3e76f-metrics-certs") pod "network-metrics-daemon-zr4k5" (UID: "0dea03c6-7be0-48e6-ad97-b245cbb3e76f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 22:14:04.096806 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:04.096756    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s97z2\" (UniqueName: \"kubernetes.io/projected/fa659f3f-b7af-4c2e-979a-6ef27bd503aa-kube-api-access-s97z2\") pod \"network-check-target-xr6qc\" (UID: \"fa659f3f-b7af-4c2e-979a-6ef27bd503aa\") " pod="openshift-network-diagnostics/network-check-target-xr6qc"
Jul 16 22:14:04.096989 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:14:04.096953    2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 22:14:04.096989 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:14:04.096979    2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 22:14:04.097100 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:14:04.096992    2552 projected.go:196] Error preparing data for projected volume kube-api-access-s97z2 for pod openshift-network-diagnostics/network-check-target-xr6qc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 22:14:04.097100 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:14:04.097057    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fa659f3f-b7af-4c2e-979a-6ef27bd503aa-kube-api-access-s97z2 podName:fa659f3f-b7af-4c2e-979a-6ef27bd503aa nodeName:}" failed. No retries permitted until 2026-07-16 22:14:20.097038988 +0000 UTC m=+34.311820138 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-s97z2" (UniqueName: "kubernetes.io/projected/fa659f3f-b7af-4c2e-979a-6ef27bd503aa-kube-api-access-s97z2") pod "network-check-target-xr6qc" (UID: "fa659f3f-b7af-4c2e-979a-6ef27bd503aa") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 22:14:04.270740 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:04.270637    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zr4k5"
Jul 16 22:14:04.270740 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:04.270637    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qz9r8"
Jul 16 22:14:04.270740 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:04.270637    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xr6qc"
Jul 16 22:14:04.271005 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:14:04.270796    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zr4k5" podUID="0dea03c6-7be0-48e6-ad97-b245cbb3e76f"
Jul 16 22:14:04.271005 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:14:04.270888    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qz9r8" podUID="cf1b7d07-96ed-44e0-bbb0-aa6bb66378dd"
Jul 16 22:14:04.271005 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:14:04.270986    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xr6qc" podUID="fa659f3f-b7af-4c2e-979a-6ef27bd503aa"
Jul 16 22:14:06.271035 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:06.271000    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xr6qc"
Jul 16 22:14:06.271480 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:06.271107    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zr4k5"
Jul 16 22:14:06.271480 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:14:06.271175    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xr6qc" podUID="fa659f3f-b7af-4c2e-979a-6ef27bd503aa"
Jul 16 22:14:06.271480 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:14:06.271196    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zr4k5" podUID="0dea03c6-7be0-48e6-ad97-b245cbb3e76f"
Jul 16 22:14:06.271480 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:06.271220    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qz9r8"
Jul 16 22:14:06.271480 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:14:06.271293    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qz9r8" podUID="cf1b7d07-96ed-44e0-bbb0-aa6bb66378dd"
Jul 16 22:14:08.271027 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:08.270856    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xr6qc"
Jul 16 22:14:08.271610 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:08.270854    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zr4k5"
Jul 16 22:14:08.271610 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:14:08.271105    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xr6qc" podUID="fa659f3f-b7af-4c2e-979a-6ef27bd503aa"
Jul 16 22:14:08.271610 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:14:08.271192    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zr4k5" podUID="0dea03c6-7be0-48e6-ad97-b245cbb3e76f"
Jul 16 22:14:08.271610 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:08.270856    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qz9r8"
Jul 16 22:14:08.271610 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:14:08.271269    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qz9r8" podUID="cf1b7d07-96ed-44e0-bbb0-aa6bb66378dd"
Jul 16 22:14:08.476734 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:08.476678    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-t8d4l" event={"ID":"80266fce-9ecb-495e-b7ca-fdc237aaa783","Type":"ContainerStarted","Data":"4ddaac754c8010753b389112fc3cb5b4cdf761ecafe6853e9aa505785ffc7917"}
Jul 16 22:14:08.480255 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:08.480225    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-69j5k" event={"ID":"a648734f-4a13-4389-af8e-9f2c09dfafbf","Type":"ContainerStarted","Data":"616cbe1d94dcbb93642cfa5a4d1879ad720c52569dd72a9e726d2c372b6213dd"}
Jul 16 22:14:08.480373 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:08.480309    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-69j5k" event={"ID":"a648734f-4a13-4389-af8e-9f2c09dfafbf","Type":"ContainerStarted","Data":"7c9e0c79a92b5325db6d274e3cbbffb3e53c314d045849849fc4ec8ac5529689"}
Jul 16 22:14:08.480422 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:08.480371    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-69j5k" event={"ID":"a648734f-4a13-4389-af8e-9f2c09dfafbf","Type":"ContainerStarted","Data":"349b37de5644413b72761d9ca9d2170005baeaf0033c3f14e92ff1dc8a52dcd7"}
Jul 16 22:14:08.480460 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:08.480421    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-69j5k" event={"ID":"a648734f-4a13-4389-af8e-9f2c09dfafbf","Type":"ContainerStarted","Data":"0cc6f8c22b6784161071cd217b9ea05ac990fc590d8c257ab5d92a40dbb9a6d7"}
Jul 16 22:14:08.480510 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:08.480472    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-69j5k" event={"ID":"a648734f-4a13-4389-af8e-9f2c09dfafbf","Type":"ContainerStarted","Data":"5d831c0ffd1977f806cef5fc9fbe12fd75f68510b993db4318f9f30c1cef03c3"}
Jul 16 22:14:08.480546 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:08.480518    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-69j5k" event={"ID":"a648734f-4a13-4389-af8e-9f2c09dfafbf","Type":"ContainerStarted","Data":"3861c4c5d1643ec89cb9057e812d6bd01c4a21e5da4214e0620aede9168d2841"}
Jul 16 22:14:08.481964 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:08.481941    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fxwgc" event={"ID":"580d8b18-0719-4d69-943a-f0ee07f74ce7","Type":"ContainerStarted","Data":"54f20a47d883321135546db72a3aadd9b2d9e35c6c361c01576bbe01fce8e6da"}
Jul 16 22:14:08.483662 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:08.483635    2552 generic.go:356] "Generic (PLEG): container finished" podID="70a8a28d-dadb-459e-bcc5-a0a5cc107c84" containerID="5a7ebee034371c0f77ac5b31ab728d1b11fe60d3f7abd635b8f29985a8d39d6b" exitCode=0
Jul 16 22:14:08.483797 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:08.483735    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zfb6b" event={"ID":"70a8a28d-dadb-459e-bcc5-a0a5cc107c84","Type":"ContainerDied","Data":"5a7ebee034371c0f77ac5b31ab728d1b11fe60d3f7abd635b8f29985a8d39d6b"}
Jul 16 22:14:08.485466 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:08.485332    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-j7ltc" event={"ID":"52a402e0-019f-4e46-8dfa-591613eff6d1","Type":"ContainerStarted","Data":"372d08b4750814824460a341f9b2fd72b6174cbe74851f3704b90374616c522d"}
Jul 16 22:14:08.487458 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:08.487311    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xsv9t" event={"ID":"c08cebd5-f417-43a8-a8b8-1919f944bb78","Type":"ContainerStarted","Data":"8afd6d53dce737fba8190f44f14982c3490c688307f123d60b688ad352717851"}
Jul 16 22:14:08.489184 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:08.489151    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8zcnq" event={"ID":"b0bc3969-f63b-4d8d-9616-bfc554866e8f","Type":"ContainerStarted","Data":"152ab01f486fc55d90d8475b45945f925e0e61a786117979e53f5aa006e87ba1"}
Jul 16 22:14:08.490805 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:08.490785    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-znw8p" event={"ID":"b8273adb-26b5-4a5b-a20f-afd1f257772d","Type":"ContainerStarted","Data":"20913d3e55cdb0b810af2e8d01367ab1541aa34719e9d7f61a2bf796af13d6b5"}
Jul 16 22:14:08.492431 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:08.492387    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-t8d4l" podStartSLOduration=8.513058481 podStartE2EDuration="22.492369768s" totalImagesPullingTime="13.979311287s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 22:13:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:14:08.491895932 +0000 UTC m=+22.706677111" watchObservedRunningTime="2026-07-16 22:14:08.492369768 +0000 UTC m=+22.707150929"
Jul 16 22:14:08.506948 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:08.506876    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-j7ltc" podStartSLOduration=4.134852862 podStartE2EDuration="22.50686324s" totalImagesPullingTime="18.372010378s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:13:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:14:08.506215378 +0000 UTC m=+22.720996539" watchObservedRunningTime="2026-07-16 22:14:08.50686324 +0000 UTC m=+22.721644399"
Jul 16 22:14:08.528555 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:08.528518    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-8zcnq" podStartSLOduration=4.167550502 podStartE2EDuration="22.528500344s" totalImagesPullingTime="18.360949842s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 22:13:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:14:08.528496732 +0000 UTC m=+22.743277893" watchObservedRunningTime="2026-07-16 22:14:08.528500344 +0000 UTC m=+22.743281503"
Jul 16 22:14:08.544960 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:08.544917    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-znw8p" podStartSLOduration=4.178754952 podStartE2EDuration="22.544901971s" totalImagesPullingTime="18.366147019s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 22:13:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:14:08.544842863 +0000 UTC m=+22.759624024" watchObservedRunningTime="2026-07-16 22:14:08.544901971 +0000 UTC m=+22.759683132"
Jul 16 22:14:08.604881 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:08.604839    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-xsv9t" podStartSLOduration=4.186584981 podStartE2EDuration="22.604824009s" totalImagesPullingTime="18.418239028s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 22:13:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:14:08.565159392 +0000 UTC m=+22.779940553" watchObservedRunningTime="2026-07-16 22:14:08.604824009 +0000 UTC m=+22.819605169"
Jul 16 22:14:09.358677 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:09.358635    2552 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 16 22:14:09.494758 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:09.494725    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fxwgc" event={"ID":"580d8b18-0719-4d69-943a-f0ee07f74ce7","Type":"ContainerStarted","Data":"672653e912ea5c9f9cfe06f6500331b527991926ae04d4b6fb05cf41504f26f4"}
Jul 16 22:14:09.496266 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:09.496237    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-2fbj7" event={"ID":"e5d08c24-5eb1-4b19-bc6d-1bc2e0e5107d","Type":"ContainerStarted","Data":"67fd5bf731612b3cc7882725cf2d5342c0d6a227698cd0489981989d80f4f83e"}
Jul 16 22:14:09.512002 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:09.511923    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-2fbj7" podStartSLOduration=5.143739475 podStartE2EDuration="23.511909467s" totalImagesPullingTime="18.368169992s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 22:13:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:14:09.511498585 +0000 UTC m=+23.726279750" watchObservedRunningTime="2026-07-16 22:14:09.511909467 +0000 UTC m=+23.726690627"
Jul 16 22:14:10.206931 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:10.206822    2552 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-16T22:14:09.358659895Z","UUID":"44037a6d-e07d-459b-ac49-ed47922cfbee","Handler":null,"Name":"","Endpoint":""}
Jul 16 22:14:10.208427 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:10.208406    2552 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 16 22:14:10.208536 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:10.208478    2552 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 16 22:14:10.270217 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:10.270187    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qz9r8"
Jul 16 22:14:10.270372 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:10.270187    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xr6qc"
Jul 16 22:14:10.270372 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:14:10.270315    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qz9r8" podUID="cf1b7d07-96ed-44e0-bbb0-aa6bb66378dd"
Jul 16 22:14:10.270486 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:10.270190    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zr4k5"
Jul 16 22:14:10.270486 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:14:10.270375    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xr6qc" podUID="fa659f3f-b7af-4c2e-979a-6ef27bd503aa"
Jul 16 22:14:10.270605 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:14:10.270505    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zr4k5" podUID="0dea03c6-7be0-48e6-ad97-b245cbb3e76f"
Jul 16 22:14:11.504155 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:11.503943    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-69j5k" event={"ID":"a648734f-4a13-4389-af8e-9f2c09dfafbf","Type":"ContainerStarted","Data":"eca194633fb91108ba11767077ea4a1532844e947805478c30c710e72911a506"}
Jul 16 22:14:11.506318 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:11.506288    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fxwgc" event={"ID":"580d8b18-0719-4d69-943a-f0ee07f74ce7","Type":"ContainerStarted","Data":"a4808f7af916568e4ef6df82075265154228d13ad68f255b10166a872e4f16f5"}
Jul 16 22:14:11.525991 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:11.525953    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fxwgc" podStartSLOduration=4.570758766 podStartE2EDuration="25.525940348s" totalImagesPullingTime="20.955181582s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 22:13:46 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:14:11.525564534 +0000 UTC m=+25.740345695" watchObservedRunningTime="2026-07-16 22:14:11.525940348 +0000 UTC m=+25.740721507"
Jul 16 22:14:12.270804 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:12.270773    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zr4k5"
Jul 16 22:14:12.270979 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:12.270811    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xr6qc"
Jul 16 22:14:12.270979 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:12.270782    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qz9r8"
Jul 16 22:14:12.270979 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:14:12.270909    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zr4k5" podUID="0dea03c6-7be0-48e6-ad97-b245cbb3e76f"
Jul 16 22:14:12.271133 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:14:12.271017    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xr6qc" podUID="fa659f3f-b7af-4c2e-979a-6ef27bd503aa"
Jul 16 22:14:12.271189 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:14:12.271128    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qz9r8" podUID="cf1b7d07-96ed-44e0-bbb0-aa6bb66378dd"
Jul 16 22:14:13.419186 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:13.419145    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-j7ltc"
Jul 16 22:14:13.419948 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:13.419734    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-j7ltc"
Jul 16 22:14:13.514266 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:13.514229    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-69j5k" event={"ID":"a648734f-4a13-4389-af8e-9f2c09dfafbf","Type":"ContainerStarted","Data":"554ac916e8b2b12786cc76e42a9a5f3c9c3864533b4d2feda7650367b7f4a914"}
Jul 16 22:14:13.514626 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:13.514566    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-j7ltc"
Jul 16 22:14:13.515160 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:13.515142    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-j7ltc"
Jul 16 22:14:13.546348 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:13.546305    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-69j5k" podStartSLOduration=9.113947189 podStartE2EDuration="27.546290701s" totalImagesPullingTime="18.432343512s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 22:13:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:14:13.545192116 +0000 UTC m=+27.759973278" watchObservedRunningTime="2026-07-16 22:14:13.546290701 +0000 UTC m=+27.761071859"
Jul 16 22:14:14.270502 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:14.270448    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qz9r8"
Jul 16 22:14:14.270684 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:14.270448    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xr6qc"
Jul 16 22:14:14.270684 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:14:14.270602    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qz9r8" podUID="cf1b7d07-96ed-44e0-bbb0-aa6bb66378dd"
Jul 16 22:14:14.270684 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:14.270632    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zr4k5"
Jul 16 22:14:14.270859 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:14:14.270775    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xr6qc" podUID="fa659f3f-b7af-4c2e-979a-6ef27bd503aa"
Jul 16 22:14:14.270912 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:14:14.270869    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zr4k5" podUID="0dea03c6-7be0-48e6-ad97-b245cbb3e76f"
Jul 16 22:14:14.517045 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:14.517001    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-69j5k"
Jul 16 22:14:14.517474 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:14.517102    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-69j5k"
Jul 16 22:14:14.517474 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:14.517152    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-69j5k"
Jul 16 22:14:14.533819 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:14.533799    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-69j5k"
Jul 16 22:14:14.535043 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:14.535022    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-69j5k"
Jul 16 22:14:15.104126 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:15.104052    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qz9r8"]
Jul 16 22:14:15.104273 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:15.104196    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qz9r8"
Jul 16 22:14:15.104329 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:14:15.104297    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qz9r8" podUID="cf1b7d07-96ed-44e0-bbb0-aa6bb66378dd"
Jul 16 22:14:15.107231 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:15.107203    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-xr6qc"]
Jul 16 22:14:15.107334 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:15.107307    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xr6qc"
Jul 16 22:14:15.108040 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:14:15.107423    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xr6qc" podUID="fa659f3f-b7af-4c2e-979a-6ef27bd503aa"
Jul 16 22:14:15.108040 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:15.107999    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zr4k5"]
Jul 16 22:14:15.108194 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:15.108118    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zr4k5"
Jul 16 22:14:15.108257 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:14:15.108224    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zr4k5" podUID="0dea03c6-7be0-48e6-ad97-b245cbb3e76f"
Jul 16 22:14:15.520204 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:15.520175    2552 generic.go:356] "Generic (PLEG): container finished" podID="70a8a28d-dadb-459e-bcc5-a0a5cc107c84" containerID="54ae7fe19200f294b29ef86d50759f827334ce8e49e53c6b04fc4e275410556d" exitCode=0
Jul 16 22:14:15.520577 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:15.520264    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zfb6b" event={"ID":"70a8a28d-dadb-459e-bcc5-a0a5cc107c84","Type":"ContainerDied","Data":"54ae7fe19200f294b29ef86d50759f827334ce8e49e53c6b04fc4e275410556d"}
Jul 16 22:14:16.524526 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:16.524498    2552 generic.go:356] "Generic (PLEG): container finished" podID="70a8a28d-dadb-459e-bcc5-a0a5cc107c84" containerID="a69952132d9a386ac56a7b7950e8a6759b12d1178a8a0707b16d58f334265ec0" exitCode=0
Jul 16 22:14:16.524900 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:16.524583    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zfb6b" event={"ID":"70a8a28d-dadb-459e-bcc5-a0a5cc107c84","Type":"ContainerDied","Data":"a69952132d9a386ac56a7b7950e8a6759b12d1178a8a0707b16d58f334265ec0"}
Jul 16 22:14:17.270378 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:17.270157    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xr6qc"
Jul 16 22:14:17.270458 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:17.270213    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zr4k5"
Jul 16 22:14:17.270503 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:14:17.270481    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xr6qc" podUID="fa659f3f-b7af-4c2e-979a-6ef27bd503aa"
Jul 16 22:14:17.270556 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:17.270213    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qz9r8"
Jul 16 22:14:17.270615 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:14:17.270557    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zr4k5" podUID="0dea03c6-7be0-48e6-ad97-b245cbb3e76f"
Jul 16 22:14:17.270679 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:14:17.270660    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qz9r8" podUID="cf1b7d07-96ed-44e0-bbb0-aa6bb66378dd"
Jul 16 22:14:17.529905 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:17.529878    2552 generic.go:356] "Generic (PLEG): container finished" podID="70a8a28d-dadb-459e-bcc5-a0a5cc107c84" containerID="cb7f6bc0bd8c04bf02d78a0d114caaaeb626ac87a294a7907e4a7b6ead84bdb7" exitCode=0
Jul 16 22:14:17.530285 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:17.529917    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zfb6b" event={"ID":"70a8a28d-dadb-459e-bcc5-a0a5cc107c84","Type":"ContainerDied","Data":"cb7f6bc0bd8c04bf02d78a0d114caaaeb626ac87a294a7907e4a7b6ead84bdb7"}
Jul 16 22:14:19.270751 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:19.270721    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qz9r8"
Jul 16 22:14:19.271261 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:19.270721    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zr4k5"
Jul 16 22:14:19.271261 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:14:19.270829    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qz9r8" podUID="cf1b7d07-96ed-44e0-bbb0-aa6bb66378dd"
Jul 16 22:14:19.271261 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:19.270721    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xr6qc"
Jul 16 22:14:19.271261 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:14:19.270951    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zr4k5" podUID="0dea03c6-7be0-48e6-ad97-b245cbb3e76f"
Jul 16 22:14:19.271261 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:14:19.271017    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xr6qc" podUID="fa659f3f-b7af-4c2e-979a-6ef27bd503aa"
Jul 16 22:14:19.920276 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:19.920242    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cf1b7d07-96ed-44e0-bbb0-aa6bb66378dd-original-pull-secret\") pod \"global-pull-secret-syncer-qz9r8\" (UID: \"cf1b7d07-96ed-44e0-bbb0-aa6bb66378dd\") " pod="kube-system/global-pull-secret-syncer-qz9r8"
Jul 16 22:14:19.920276 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:19.920281    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0dea03c6-7be0-48e6-ad97-b245cbb3e76f-metrics-certs\") pod \"network-metrics-daemon-zr4k5\" (UID: \"0dea03c6-7be0-48e6-ad97-b245cbb3e76f\") " pod="openshift-multus/network-metrics-daemon-zr4k5"
Jul 16 22:14:19.920490 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:14:19.920400    2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 22:14:19.920490 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:14:19.920462    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf1b7d07-96ed-44e0-bbb0-aa6bb66378dd-original-pull-secret podName:cf1b7d07-96ed-44e0-bbb0-aa6bb66378dd nodeName:}" failed. No retries permitted until 2026-07-16 22:14:51.920447104 +0000 UTC m=+66.135228245 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cf1b7d07-96ed-44e0-bbb0-aa6bb66378dd-original-pull-secret") pod "global-pull-secret-syncer-qz9r8" (UID: "cf1b7d07-96ed-44e0-bbb0-aa6bb66378dd") : object "kube-system"/"original-pull-secret" not registered
Jul 16 22:14:19.920490 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:14:19.920404    2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 22:14:19.920604 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:14:19.920534    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0dea03c6-7be0-48e6-ad97-b245cbb3e76f-metrics-certs podName:0dea03c6-7be0-48e6-ad97-b245cbb3e76f nodeName:}" failed. No retries permitted until 2026-07-16 22:14:51.920517068 +0000 UTC m=+66.135298208 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0dea03c6-7be0-48e6-ad97-b245cbb3e76f-metrics-certs") pod "network-metrics-daemon-zr4k5" (UID: "0dea03c6-7be0-48e6-ad97-b245cbb3e76f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 22:14:20.123080 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:20.122685    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s97z2\" (UniqueName: \"kubernetes.io/projected/fa659f3f-b7af-4c2e-979a-6ef27bd503aa-kube-api-access-s97z2\") pod \"network-check-target-xr6qc\" (UID: \"fa659f3f-b7af-4c2e-979a-6ef27bd503aa\") " pod="openshift-network-diagnostics/network-check-target-xr6qc"
Jul 16 22:14:20.123080 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:14:20.122877    2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 22:14:20.123080 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:14:20.122895    2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 22:14:20.123080 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:14:20.122908    2552 projected.go:196] Error preparing data for projected volume kube-api-access-s97z2 for pod openshift-network-diagnostics/network-check-target-xr6qc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 22:14:20.123080 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:14:20.122976    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fa659f3f-b7af-4c2e-979a-6ef27bd503aa-kube-api-access-s97z2 podName:fa659f3f-b7af-4c2e-979a-6ef27bd503aa nodeName:}" failed. No retries permitted until 2026-07-16 22:14:52.122947988 +0000 UTC m=+66.337729141 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-s97z2" (UniqueName: "kubernetes.io/projected/fa659f3f-b7af-4c2e-979a-6ef27bd503aa-kube-api-access-s97z2") pod "network-check-target-xr6qc" (UID: "fa659f3f-b7af-4c2e-979a-6ef27bd503aa") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 22:14:21.270006 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:21.269978    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xr6qc"
Jul 16 22:14:21.270730 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:21.270093    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zr4k5"
Jul 16 22:14:21.270730 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:21.270107    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qz9r8"
Jul 16 22:14:21.270730 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:14:21.270103    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xr6qc" podUID="fa659f3f-b7af-4c2e-979a-6ef27bd503aa"
Jul 16 22:14:21.270730 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:14:21.270213    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zr4k5" podUID="0dea03c6-7be0-48e6-ad97-b245cbb3e76f"
Jul 16 22:14:21.270730 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:14:21.270293    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qz9r8" podUID="cf1b7d07-96ed-44e0-bbb0-aa6bb66378dd"
Jul 16 22:14:21.568785 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:21.568679    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-47.ec2.internal" event="NodeReady"
Jul 16 22:14:21.568949 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:21.568837    2552 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 16 22:14:21.614834 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:21.614802    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-564fbd977f-49gxl"]
Jul 16 22:14:21.645351 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:21.645319    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8648d96ddb-qq8gr"]
Jul 16 22:14:21.646172 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:21.645760    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-564fbd977f-49gxl"
Jul 16 22:14:21.652851 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:21.652772    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 16 22:14:21.652851 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:21.652785    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 16 22:14:21.653688 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:21.653668    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-jdxhv\""
Jul 16 22:14:21.654936 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:21.654917    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 16 22:14:21.661580 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:21.661563    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-f62bz"]
Jul 16 22:14:21.661810 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:21.661677    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8648d96ddb-qq8gr"
Jul 16 22:14:21.665403 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:21.665005    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 16 22:14:21.665403 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:21.665104    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 16 22:14:21.665403 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:21.665121    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 16 22:14:21.665403 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:21.665213    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 16 22:14:21.665403 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:21.665370    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-c2ggv\""
Jul 16 22:14:21.680406 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:21.680371    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65775f88f-vrh7f"]
Jul 16 22:14:21.680842 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:21.680816    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-f62bz"
Jul 16 22:14:21.680940 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:21.680895    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 16 22:14:21.683888 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:21.683868    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 16 22:14:21.684164 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:21.684115    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-6hmsj\""
Jul 16 22:14:21.684913 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:21.684894    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 16 22:14:21.706380 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:21.706356    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-86bdb8d5c6-kdd8l"]
Jul 16 22:14:21.706478 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:21.706410    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65775f88f-vrh7f"
Jul 16 22:14:21.709328 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:21.709307    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 16 22:14:21.709328 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:21.709317    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 16 22:14:21.709328 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:21.709318    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 16 22:14:21.709328 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:21.709586    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 16 22:14:21.716313 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:21.716296    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-564fbd977f-49gxl"]
Jul 16 22:14:21.716396 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:21.716331    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-st98p"]
Jul 16 22:14:21.716441 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:21.716403    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86bdb8d5c6-kdd8l"
Jul 16 22:14:21.719001 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:21.718985    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 16 22:14:21.732652 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:21.732575    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-92c7g"]
Jul 16 22:14:21.732822 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:21.732803    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-st98p"
Jul 16 22:14:21.735294 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:21.735277    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 16 22:14:21.735462 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:21.735445    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-gpmss\""
Jul 16 22:14:21.735815 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:21.735792    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c527g\" (UniqueName: \"kubernetes.io/projected/3bb158ab-7979-4010-aa22-e13370e73d78-kube-api-access-c527g\") pod \"image-registry-564fbd977f-49gxl\" (UID: \"3bb158ab-7979-4010-aa22-e13370e73d78\") " pod="openshift-image-registry/image-registry-564fbd977f-49gxl"
Jul 16 22:14:21.735900 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:21.735837    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vt6vr\" (UniqueName: \"kubernetes.io/projected/6dba2385-55b2-4b81-a603-3f6e433dd4ea-kube-api-access-vt6vr\") pod \"cluster-proxy-proxy-agent-65775f88f-vrh7f\" (UID: \"6dba2385-55b2-4b81-a603-3f6e433dd4ea\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65775f88f-vrh7f"
Jul 16 22:14:21.735900 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:21.735870    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 16 22:14:21.736006 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:21.735872    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3bb158ab-7979-4010-aa22-e13370e73d78-trusted-ca\") pod \"image-registry-564fbd977f-49gxl\" (UID: \"3bb158ab-7979-4010-aa22-e13370e73d78\") " pod="openshift-image-registry/image-registry-564fbd977f-49gxl"
Jul 16 22:14:21.736006 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:21.735932    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3bb158ab-7979-4010-aa22-e13370e73d78-bound-sa-token\") pod \"image-registry-564fbd977f-49gxl\" (UID: \"3bb158ab-7979-4010-aa22-e13370e73d78\") " pod="openshift-image-registry/image-registry-564fbd977f-49gxl"
Jul 16 22:14:21.736006 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:21.735954    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/6dba2385-55b2-4b81-a603-3f6e433dd4ea-ca\") pod \"cluster-proxy-proxy-agent-65775f88f-vrh7f\" (UID: \"6dba2385-55b2-4b81-a603-3f6e433dd4ea\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65775f88f-vrh7f"
Jul 16 22:14:21.736006 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:21.735983    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ff4f63ba-2036-4f92-a692-4be32674de91-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-f62bz\" (UID: \"ff4f63ba-2036-4f92-a692-4be32674de91\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-f62bz"
Jul 16 22:14:21.736207 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:21.736006    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3bb158ab-7979-4010-aa22-e13370e73d78-registry-tls\") pod \"image-registry-564fbd977f-49gxl\" (UID: \"3bb158ab-7979-4010-aa22-e13370e73d78\") " pod="openshift-image-registry/image-registry-564fbd977f-49gxl"
Jul 16 22:14:21.736207 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:21.736055    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-npn7v\" (UniqueName: \"kubernetes.io/projected/153b8695-f585-4876-9a14-3489c3f9fa58-kube-api-access-npn7v\") pod \"managed-serviceaccount-addon-agent-8648d96ddb-qq8gr\" (UID: \"153b8695-f585-4876-9a14-3489c3f9fa58\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8648d96ddb-qq8gr"
Jul 16 22:14:21.736207 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:21.736092    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/6dba2385-55b2-4b81-a603-3f6e433dd4ea-hub\") pod \"cluster-proxy-proxy-agent-65775f88f-vrh7f\" (UID: \"6dba2385-55b2-4b81-a603-3f6e433dd4ea\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65775f88f-vrh7f"
Jul 16 22:14:21.736207 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:21.736124    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/7efa7b74-0fd5-458b-89b3-ad1fc3b1493a-klusterlet-config\") pod \"klusterlet-addon-workmgr-86bdb8d5c6-kdd8l\" (UID: \"7efa7b74-0fd5-458b-89b3-ad1fc3b1493a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86bdb8d5c6-kdd8l"
Jul 16 22:14:21.736207 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:21.736151    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xd77\" (UniqueName: \"kubernetes.io/projected/7efa7b74-0fd5-458b-89b3-ad1fc3b1493a-kube-api-access-2xd77\") pod \"klusterlet-addon-workmgr-86bdb8d5c6-kdd8l\" (UID: \"7efa7b74-0fd5-458b-89b3-ad1fc3b1493a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86bdb8d5c6-kdd8l"
Jul 16 22:14:21.736207 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:21.736193    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3bb158ab-7979-4010-aa22-e13370e73d78-ca-trust-extracted\") pod \"image-registry-564fbd977f-49gxl\" (UID: \"3bb158ab-7979-4010-aa22-e13370e73d78\") " pod="openshift-image-registry/image-registry-564fbd977f-49gxl"
Jul 16 22:14:21.736456 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:21.736246    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/6dba2385-55b2-4b81-a603-3f6e433dd4ea-additional-service-ca\") pod \"cluster-proxy-proxy-agent-65775f88f-vrh7f\" (UID: \"6dba2385-55b2-4b81-a603-3f6e433dd4ea\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65775f88f-vrh7f"
Jul 16 22:14:21.736456 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:21.736296    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/153b8695-f585-4876-9a14-3489c3f9fa58-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-8648d96ddb-qq8gr\" (UID: \"153b8695-f585-4876-9a14-3489c3f9fa58\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8648d96ddb-qq8gr"
Jul 16 22:14:21.736456 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:21.736332    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ff4f63ba-2036-4f92-a692-4be32674de91-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-f62bz\" (UID: \"ff4f63ba-2036-4f92-a692-4be32674de91\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-f62bz"
Jul 16 22:14:21.736456 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:21.736364    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3bb158ab-7979-4010-aa22-e13370e73d78-image-registry-private-configuration\") pod \"image-registry-564fbd977f-49gxl\" (UID: \"3bb158ab-7979-4010-aa22-e13370e73d78\") " pod="openshift-image-registry/image-registry-564fbd977f-49gxl"
Jul 16 22:14:21.736456 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:21.736394    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3bb158ab-7979-4010-aa22-e13370e73d78-installation-pull-secrets\") pod \"image-registry-564fbd977f-49gxl\" (UID: \"3bb158ab-7979-4010-aa22-e13370e73d78\") " pod="openshift-image-registry/image-registry-564fbd977f-49gxl"
Jul 16 22:14:21.736456 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:21.736417    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6dba2385-55b2-4b81-a603-3f6e433dd4ea-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-65775f88f-vrh7f\" (UID: \"6dba2385-55b2-4b81-a603-3f6e433dd4ea\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65775f88f-vrh7f"
Jul 16 22:14:21.736456 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:21.736445    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3bb158ab-7979-4010-aa22-e13370e73d78-registry-certificates\") pod \"image-registry-564fbd977f-49gxl\" (UID: \"3bb158ab-7979-4010-aa22-e13370e73d78\") " pod="openshift-image-registry/image-registry-564fbd977f-49gxl"
Jul 16 22:14:21.736828 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:21.736469    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/6dba2385-55b2-4b81-a603-3f6e433dd4ea-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-65775f88f-vrh7f\" (UID: \"6dba2385-55b2-4b81-a603-3f6e433dd4ea\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65775f88f-vrh7f"
Jul 16 22:14:21.736828 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:21.736494    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7efa7b74-0fd5-458b-89b3-ad1fc3b1493a-tmp\") pod \"klusterlet-addon-workmgr-86bdb8d5c6-kdd8l\" (UID: \"7efa7b74-0fd5-458b-89b3-ad1fc3b1493a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86bdb8d5c6-kdd8l"
Jul 16 22:14:21.742797 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:21.742776    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-f62bz"]
Jul 16 22:14:21.742892 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:21.742811    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8648d96ddb-qq8gr"]
Jul 16 22:14:21.742892 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:21.742831    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65775f88f-vrh7f"]
Jul 16 22:14:21.742892 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:21.742852    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-st98p"]
Jul 16 22:14:21.742892 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:21.742876    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-92c7g"]
Jul 16 22:14:21.743085 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:21.742894    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-86bdb8d5c6-kdd8l"]
Jul 16 22:14:21.743085 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:21.742894    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-92c7g"
Jul 16 22:14:21.745597 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:21.745578    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 16 22:14:21.745897 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:21.745882    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 16 22:14:21.746229 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:21.746205    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 16 22:14:21.746324 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:21.746263    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-7zbvf\""
Jul 16 22:14:21.837116 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:21.837036    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1309634f-5fad-4855-9795-889d92d5bc67-cert\") pod \"ingress-canary-92c7g\" (UID: \"1309634f-5fad-4855-9795-889d92d5bc67\") " pod="openshift-ingress-canary/ingress-canary-92c7g"
Jul 16 22:14:21.837116 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:21.837088    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ff4f63ba-2036-4f92-a692-4be32674de91-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-f62bz\" (UID: \"ff4f63ba-2036-4f92-a692-4be32674de91\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-f62bz"
Jul 16 22:14:21.837323 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:21.837125    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/6dba2385-55b2-4b81-a603-3f6e433dd4ea-hub\") pod \"cluster-proxy-proxy-agent-65775f88f-vrh7f\" (UID: \"6dba2385-55b2-4b81-a603-3f6e433dd4ea\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65775f88f-vrh7f"
Jul 16 22:14:21.837323 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:21.837187    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4jb8\" (UniqueName: \"kubernetes.io/projected/1309634f-5fad-4855-9795-889d92d5bc67-kube-api-access-c4jb8\") pod \"ingress-canary-92c7g\" (UID: \"1309634f-5fad-4855-9795-889d92d5bc67\") " pod="openshift-ingress-canary/ingress-canary-92c7g"
Jul 16 22:14:21.837323 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:21.837245    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3bb158ab-7979-4010-aa22-e13370e73d78-ca-trust-extracted\") pod \"image-registry-564fbd977f-49gxl\" (UID: \"3bb158ab-7979-4010-aa22-e13370e73d78\") " pod="openshift-image-registry/image-registry-564fbd977f-49gxl"
Jul 16 22:14:21.837323 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:21.837273    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0d79e411-5d34-4159-b507-be3b54b5865f-metrics-tls\") pod \"dns-default-st98p\" (UID: \"0d79e411-5d34-4159-b507-be3b54b5865f\") " pod="openshift-dns/dns-default-st98p"
Jul 16 22:14:21.837533 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:21.837334    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/6dba2385-55b2-4b81-a603-3f6e433dd4ea-additional-service-ca\") pod \"cluster-proxy-proxy-agent-65775f88f-vrh7f\" (UID: \"6dba2385-55b2-4b81-a603-3f6e433dd4ea\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65775f88f-vrh7f"
Jul 16 22:14:21.837533 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:21.837371    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/153b8695-f585-4876-9a14-3489c3f9fa58-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-8648d96ddb-qq8gr\" (UID: \"153b8695-f585-4876-9a14-3489c3f9fa58\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8648d96ddb-qq8gr"
Jul 16 22:14:21.837533 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:21.837424    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3bb158ab-7979-4010-aa22-e13370e73d78-installation-pull-secrets\") pod \"image-registry-564fbd977f-49gxl\" (UID: \"3bb158ab-7979-4010-aa22-e13370e73d78\") " pod="openshift-image-registry/image-registry-564fbd977f-49gxl"
Jul 16 22:14:21.837533 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:21.837456    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3bb158ab-7979-4010-aa22-e13370e73d78-registry-certificates\") pod \"image-registry-564fbd977f-49gxl\" (UID: \"3bb158ab-7979-4010-aa22-e13370e73d78\") " pod="openshift-image-registry/image-registry-564fbd977f-49gxl"
Jul 16 22:14:21.837533 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:21.837481    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/6dba2385-55b2-4b81-a603-3f6e433dd4ea-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-65775f88f-vrh7f\" (UID: \"6dba2385-55b2-4b81-a603-3f6e433dd4ea\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65775f88f-vrh7f"
Jul 16 22:14:21.837533 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:21.837529    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xd77\" (UniqueName: \"kubernetes.io/projected/7efa7b74-0fd5-458b-89b3-ad1fc3b1493a-kube-api-access-2xd77\") pod \"klusterlet-addon-workmgr-86bdb8d5c6-kdd8l\" (UID: \"7efa7b74-0fd5-458b-89b3-ad1fc3b1493a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86bdb8d5c6-kdd8l"
Jul 16 22:14:21.837834 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:21.837558    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0d79e411-5d34-4159-b507-be3b54b5865f-tmp-dir\") pod \"dns-default-st98p\" (UID: \"0d79e411-5d34-4159-b507-be3b54b5865f\") " pod="openshift-dns/dns-default-st98p"
Jul 16 22:14:21.837834 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:21.837587    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3bb158ab-7979-4010-aa22-e13370e73d78-bound-sa-token\") pod \"image-registry-564fbd977f-49gxl\" (UID: \"3bb158ab-7979-4010-aa22-e13370e73d78\") " pod="openshift-image-registry/image-registry-564fbd977f-49gxl"
Jul 16 22:14:21.837834 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:21.837613    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-npn7v\" (UniqueName: \"kubernetes.io/projected/153b8695-f585-4876-9a14-3489c3f9fa58-kube-api-access-npn7v\") pod \"managed-serviceaccount-addon-agent-8648d96ddb-qq8gr\" (UID: \"153b8695-f585-4876-9a14-3489c3f9fa58\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8648d96ddb-qq8gr"
Jul 16 22:14:21.837834 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:21.837639    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3bb158ab-7979-4010-aa22-e13370e73d78-registry-tls\") pod \"image-registry-564fbd977f-49gxl\" (UID: \"3bb158ab-7979-4010-aa22-e13370e73d78\") " pod="openshift-image-registry/image-registry-564fbd977f-49gxl"
Jul 16 22:14:21.837834 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:21.837692    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ff4f63ba-2036-4f92-a692-4be32674de91-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-f62bz\" (UID: \"ff4f63ba-2036-4f92-a692-4be32674de91\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-f62bz"
Jul 16 22:14:21.837834 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:21.837740    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3bb158ab-7979-4010-aa22-e13370e73d78-image-registry-private-configuration\") pod \"image-registry-564fbd977f-49gxl\" (UID: \"3bb158ab-7979-4010-aa22-e13370e73d78\") " pod="openshift-image-registry/image-registry-564fbd977f-49gxl"
Jul 16 22:14:21.837834 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:21.837776    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6dba2385-55b2-4b81-a603-3f6e433dd4ea-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-65775f88f-vrh7f\" (UID: \"6dba2385-55b2-4b81-a603-3f6e433dd4ea\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65775f88f-vrh7f"
Jul 16 22:14:21.837834 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:21.837811    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7efa7b74-0fd5-458b-89b3-ad1fc3b1493a-tmp\") pod \"klusterlet-addon-workmgr-86bdb8d5c6-kdd8l\" (UID: \"7efa7b74-0fd5-458b-89b3-ad1fc3b1493a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86bdb8d5c6-kdd8l"
Jul 16 22:14:21.838190 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:21.837844    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c527g\" (UniqueName: \"kubernetes.io/projected/3bb158ab-7979-4010-aa22-e13370e73d78-kube-api-access-c527g\") pod \"image-registry-564fbd977f-49gxl\" (UID: \"3bb158ab-7979-4010-aa22-e13370e73d78\") " pod="openshift-image-registry/image-registry-564fbd977f-49gxl"
Jul 16 22:14:21.838190 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:21.837874    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vt6vr\" (UniqueName: \"kubernetes.io/projected/6dba2385-55b2-4b81-a603-3f6e433dd4ea-kube-api-access-vt6vr\") pod \"cluster-proxy-proxy-agent-65775f88f-vrh7f\" (UID: \"6dba2385-55b2-4b81-a603-3f6e433dd4ea\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65775f88f-vrh7f"
Jul 16 22:14:21.838190 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:21.837906    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3bb158ab-7979-4010-aa22-e13370e73d78-trusted-ca\") pod \"image-registry-564fbd977f-49gxl\" (UID: \"3bb158ab-7979-4010-aa22-e13370e73d78\") " pod="openshift-image-registry/image-registry-564fbd977f-49gxl"
Jul 16 22:14:21.838190 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:21.837930    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/7efa7b74-0fd5-458b-89b3-ad1fc3b1493a-klusterlet-config\") pod \"klusterlet-addon-workmgr-86bdb8d5c6-kdd8l\" (UID: \"7efa7b74-0fd5-458b-89b3-ad1fc3b1493a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86bdb8d5c6-kdd8l"
Jul 16 22:14:21.838190 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:21.837955    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0d79e411-5d34-4159-b507-be3b54b5865f-config-volume\") pod \"dns-default-st98p\" (UID: \"0d79e411-5d34-4159-b507-be3b54b5865f\") " pod="openshift-dns/dns-default-st98p"
Jul 16 22:14:21.838190 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:21.837978    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6zbxf\" (UniqueName: \"kubernetes.io/projected/0d79e411-5d34-4159-b507-be3b54b5865f-kube-api-access-6zbxf\") pod \"dns-default-st98p\" (UID: \"0d79e411-5d34-4159-b507-be3b54b5865f\") " pod="openshift-dns/dns-default-st98p"
Jul 16 22:14:21.838190 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:21.838008    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/6dba2385-55b2-4b81-a603-3f6e433dd4ea-ca\") pod \"cluster-proxy-proxy-agent-65775f88f-vrh7f\" (UID: \"6dba2385-55b2-4b81-a603-3f6e433dd4ea\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65775f88f-vrh7f"
Jul 16 22:14:21.838190 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:21.838081    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ff4f63ba-2036-4f92-a692-4be32674de91-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-f62bz\" (UID: \"ff4f63ba-2036-4f92-a692-4be32674de91\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-f62bz"
Jul 16 22:14:21.838190 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:21.838189    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/6dba2385-55b2-4b81-a603-3f6e433dd4ea-additional-service-ca\") pod \"cluster-proxy-proxy-agent-65775f88f-vrh7f\" (UID: \"6dba2385-55b2-4b81-a603-3f6e433dd4ea\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65775f88f-vrh7f"
Jul 16 22:14:21.838908 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:21.838794    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3bb158ab-7979-4010-aa22-e13370e73d78-registry-certificates\") pod \"image-registry-564fbd977f-49gxl\" (UID: \"3bb158ab-7979-4010-aa22-e13370e73d78\") " pod="openshift-image-registry/image-registry-564fbd977f-49gxl"
Jul 16 22:14:21.839106 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:21.839083    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3bb158ab-7979-4010-aa22-e13370e73d78-trusted-ca\") pod \"image-registry-564fbd977f-49gxl\" (UID: \"3bb158ab-7979-4010-aa22-e13370e73d78\") " pod="openshift-image-registry/image-registry-564fbd977f-49gxl"
Jul 16 22:14:21.839190 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:14:21.839095    2552 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 16 22:14:21.839190 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:14:21.839159    2552 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 16 22:14:21.839190 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:14:21.839179    2552 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-564fbd977f-49gxl: secret "image-registry-tls" not found
Jul 16 22:14:21.839350 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:21.837930    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3bb158ab-7979-4010-aa22-e13370e73d78-ca-trust-extracted\") pod \"image-registry-564fbd977f-49gxl\" (UID: \"3bb158ab-7979-4010-aa22-e13370e73d78\") " pod="openshift-image-registry/image-registry-564fbd977f-49gxl"
Jul 16 22:14:21.839350 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:14:21.839165    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff4f63ba-2036-4f92-a692-4be32674de91-networking-console-plugin-cert podName:ff4f63ba-2036-4f92-a692-4be32674de91 nodeName:}" failed. No retries permitted until 2026-07-16 22:14:22.33914814 +0000 UTC m=+36.553929278 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ff4f63ba-2036-4f92-a692-4be32674de91-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-f62bz" (UID: "ff4f63ba-2036-4f92-a692-4be32674de91") : secret "networking-console-plugin-cert" not found
Jul 16 22:14:21.839350 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:14:21.839256    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3bb158ab-7979-4010-aa22-e13370e73d78-registry-tls podName:3bb158ab-7979-4010-aa22-e13370e73d78 nodeName:}" failed. No retries permitted until 2026-07-16 22:14:22.339237482 +0000 UTC m=+36.554018620 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3bb158ab-7979-4010-aa22-e13370e73d78-registry-tls") pod "image-registry-564fbd977f-49gxl" (UID: "3bb158ab-7979-4010-aa22-e13370e73d78") : secret "image-registry-tls" not found
Jul 16 22:14:21.839854 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:21.839824    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7efa7b74-0fd5-458b-89b3-ad1fc3b1493a-tmp\") pod \"klusterlet-addon-workmgr-86bdb8d5c6-kdd8l\" (UID: \"7efa7b74-0fd5-458b-89b3-ad1fc3b1493a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86bdb8d5c6-kdd8l"
Jul 16 22:14:21.842971 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:21.842949    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/6dba2385-55b2-4b81-a603-3f6e433dd4ea-ca\") pod \"cluster-proxy-proxy-agent-65775f88f-vrh7f\" (UID: \"6dba2385-55b2-4b81-a603-3f6e433dd4ea\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65775f88f-vrh7f"
Jul 16 22:14:21.843597 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:21.843015    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/6dba2385-55b2-4b81-a603-3f6e433dd4ea-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-65775f88f-vrh7f\" (UID: \"6dba2385-55b2-4b81-a603-3f6e433dd4ea\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65775f88f-vrh7f"
Jul 16 22:14:21.843597 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:21.843066    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/7efa7b74-0fd5-458b-89b3-ad1fc3b1493a-klusterlet-config\") pod \"klusterlet-addon-workmgr-86bdb8d5c6-kdd8l\" (UID: \"7efa7b74-0fd5-458b-89b3-ad1fc3b1493a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86bdb8d5c6-kdd8l"
Jul 16 22:14:21.843597 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:21.843084    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3bb158ab-7979-4010-aa22-e13370e73d78-installation-pull-secrets\") pod \"image-registry-564fbd977f-49gxl\" (UID: \"3bb158ab-7979-4010-aa22-e13370e73d78\") " pod="openshift-image-registry/image-registry-564fbd977f-49gxl"
Jul 16 22:14:21.843597 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:21.843206    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/153b8695-f585-4876-9a14-3489c3f9fa58-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-8648d96ddb-qq8gr\" (UID: \"153b8695-f585-4876-9a14-3489c3f9fa58\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8648d96ddb-qq8gr"
Jul 16 22:14:21.843597 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:21.843249    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6dba2385-55b2-4b81-a603-3f6e433dd4ea-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-65775f88f-vrh7f\" (UID: \"6dba2385-55b2-4b81-a603-3f6e433dd4ea\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65775f88f-vrh7f"
Jul 16 22:14:21.843946 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:21.843740    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/6dba2385-55b2-4b81-a603-3f6e433dd4ea-hub\") pod \"cluster-proxy-proxy-agent-65775f88f-vrh7f\" (UID: \"6dba2385-55b2-4b81-a603-3f6e433dd4ea\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65775f88f-vrh7f"
Jul 16 22:14:21.844616 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:21.844598    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3bb158ab-7979-4010-aa22-e13370e73d78-image-registry-private-configuration\") pod \"image-registry-564fbd977f-49gxl\" (UID: \"3bb158ab-7979-4010-aa22-e13370e73d78\") " pod="openshift-image-registry/image-registry-564fbd977f-49gxl"
Jul 16 22:14:21.849145 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:21.849110    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-npn7v\" (UniqueName: \"kubernetes.io/projected/153b8695-f585-4876-9a14-3489c3f9fa58-kube-api-access-npn7v\") pod \"managed-serviceaccount-addon-agent-8648d96ddb-qq8gr\" (UID: \"153b8695-f585-4876-9a14-3489c3f9fa58\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8648d96ddb-qq8gr"
Jul 16 22:14:21.849443 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:21.849423    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3bb158ab-7979-4010-aa22-e13370e73d78-bound-sa-token\") pod \"image-registry-564fbd977f-49gxl\" (UID: \"3bb158ab-7979-4010-aa22-e13370e73d78\") " pod="openshift-image-registry/image-registry-564fbd977f-49gxl"
Jul 16 22:14:21.849833 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:21.849800    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xd77\" (UniqueName: \"kubernetes.io/projected/7efa7b74-0fd5-458b-89b3-ad1fc3b1493a-kube-api-access-2xd77\") pod \"klusterlet-addon-workmgr-86bdb8d5c6-kdd8l\" (UID: \"7efa7b74-0fd5-458b-89b3-ad1fc3b1493a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86bdb8d5c6-kdd8l"
Jul 16 22:14:21.850349 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:21.850318    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vt6vr\" (UniqueName: \"kubernetes.io/projected/6dba2385-55b2-4b81-a603-3f6e433dd4ea-kube-api-access-vt6vr\") pod \"cluster-proxy-proxy-agent-65775f88f-vrh7f\" (UID: \"6dba2385-55b2-4b81-a603-3f6e433dd4ea\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65775f88f-vrh7f"
Jul 16 22:14:21.850945 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:21.850926    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c527g\" (UniqueName: \"kubernetes.io/projected/3bb158ab-7979-4010-aa22-e13370e73d78-kube-api-access-c527g\") pod \"image-registry-564fbd977f-49gxl\" (UID: \"3bb158ab-7979-4010-aa22-e13370e73d78\") " pod="openshift-image-registry/image-registry-564fbd977f-49gxl"
Jul 16 22:14:21.939051 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:21.939023    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0d79e411-5d34-4159-b507-be3b54b5865f-config-volume\") pod \"dns-default-st98p\" (UID: \"0d79e411-5d34-4159-b507-be3b54b5865f\") " pod="openshift-dns/dns-default-st98p"
Jul 16 22:14:21.939051 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:21.939055    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zbxf\" (UniqueName: \"kubernetes.io/projected/0d79e411-5d34-4159-b507-be3b54b5865f-kube-api-access-6zbxf\") pod \"dns-default-st98p\" (UID: \"0d79e411-5d34-4159-b507-be3b54b5865f\") " pod="openshift-dns/dns-default-st98p"
Jul 16 22:14:21.939260 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:21.939073    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1309634f-5fad-4855-9795-889d92d5bc67-cert\") pod \"ingress-canary-92c7g\" (UID: \"1309634f-5fad-4855-9795-889d92d5bc67\") " pod="openshift-ingress-canary/ingress-canary-92c7g"
Jul 16 22:14:21.939260 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:21.939098    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4jb8\" (UniqueName: \"kubernetes.io/projected/1309634f-5fad-4855-9795-889d92d5bc67-kube-api-access-c4jb8\") pod \"ingress-canary-92c7g\" (UID: \"1309634f-5fad-4855-9795-889d92d5bc67\") " pod="openshift-ingress-canary/ingress-canary-92c7g"
Jul 16 22:14:21.939260 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:21.939121    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0d79e411-5d34-4159-b507-be3b54b5865f-metrics-tls\") pod \"dns-default-st98p\" (UID: \"0d79e411-5d34-4159-b507-be3b54b5865f\") " pod="openshift-dns/dns-default-st98p"
Jul 16 22:14:21.939417 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:21.939354    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0d79e411-5d34-4159-b507-be3b54b5865f-tmp-dir\") pod \"dns-default-st98p\" (UID: \"0d79e411-5d34-4159-b507-be3b54b5865f\") " pod="openshift-dns/dns-default-st98p"
Jul 16 22:14:21.939417 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:14:21.939375    2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 22:14:21.939517 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:14:21.939443    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d79e411-5d34-4159-b507-be3b54b5865f-metrics-tls podName:0d79e411-5d34-4159-b507-be3b54b5865f nodeName:}" failed. No retries permitted until 2026-07-16 22:14:22.439423233 +0000 UTC m=+36.654204402 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0d79e411-5d34-4159-b507-be3b54b5865f-metrics-tls") pod "dns-default-st98p" (UID: "0d79e411-5d34-4159-b507-be3b54b5865f") : secret "dns-default-metrics-tls" not found
Jul 16 22:14:21.939685 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:21.939656    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0d79e411-5d34-4159-b507-be3b54b5865f-tmp-dir\") pod \"dns-default-st98p\" (UID: \"0d79e411-5d34-4159-b507-be3b54b5865f\") " pod="openshift-dns/dns-default-st98p"
Jul 16 22:14:21.939776 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:21.939656    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0d79e411-5d34-4159-b507-be3b54b5865f-config-volume\") pod \"dns-default-st98p\" (UID: \"0d79e411-5d34-4159-b507-be3b54b5865f\") " pod="openshift-dns/dns-default-st98p"
Jul 16 22:14:21.941501 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:21.941482    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1309634f-5fad-4855-9795-889d92d5bc67-cert\") pod \"ingress-canary-92c7g\" (UID: \"1309634f-5fad-4855-9795-889d92d5bc67\") " pod="openshift-ingress-canary/ingress-canary-92c7g"
Jul 16 22:14:21.949715 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:21.949680    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zbxf\" (UniqueName: \"kubernetes.io/projected/0d79e411-5d34-4159-b507-be3b54b5865f-kube-api-access-6zbxf\") pod \"dns-default-st98p\" (UID: \"0d79e411-5d34-4159-b507-be3b54b5865f\") " pod="openshift-dns/dns-default-st98p"
Jul 16 22:14:21.950050 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:21.950031    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4jb8\" (UniqueName: \"kubernetes.io/projected/1309634f-5fad-4855-9795-889d92d5bc67-kube-api-access-c4jb8\") pod \"ingress-canary-92c7g\" (UID: \"1309634f-5fad-4855-9795-889d92d5bc67\") " pod="openshift-ingress-canary/ingress-canary-92c7g"
Jul 16 22:14:21.983852 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:21.983818    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8648d96ddb-qq8gr"
Jul 16 22:14:22.015987 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:22.015966    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65775f88f-vrh7f"
Jul 16 22:14:22.041885 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:22.041858    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86bdb8d5c6-kdd8l"
Jul 16 22:14:22.054086 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:22.054058    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-92c7g"
Jul 16 22:14:22.342228 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:22.342200    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ff4f63ba-2036-4f92-a692-4be32674de91-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-f62bz\" (UID: \"ff4f63ba-2036-4f92-a692-4be32674de91\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-f62bz"
Jul 16 22:14:22.342735 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:22.342376    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3bb158ab-7979-4010-aa22-e13370e73d78-registry-tls\") pod \"image-registry-564fbd977f-49gxl\" (UID: \"3bb158ab-7979-4010-aa22-e13370e73d78\") " pod="openshift-image-registry/image-registry-564fbd977f-49gxl"
Jul 16 22:14:22.342735 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:14:22.342382    2552 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 16 22:14:22.342735 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:14:22.342472    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff4f63ba-2036-4f92-a692-4be32674de91-networking-console-plugin-cert podName:ff4f63ba-2036-4f92-a692-4be32674de91 nodeName:}" failed. No retries permitted until 2026-07-16 22:14:23.342458146 +0000 UTC m=+37.557239287 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ff4f63ba-2036-4f92-a692-4be32674de91-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-f62bz" (UID: "ff4f63ba-2036-4f92-a692-4be32674de91") : secret "networking-console-plugin-cert" not found
Jul 16 22:14:22.342735 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:14:22.342471    2552 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 16 22:14:22.342735 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:14:22.342490    2552 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-564fbd977f-49gxl: secret "image-registry-tls" not found
Jul 16 22:14:22.342735 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:14:22.342551    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3bb158ab-7979-4010-aa22-e13370e73d78-registry-tls podName:3bb158ab-7979-4010-aa22-e13370e73d78 nodeName:}" failed. No retries permitted until 2026-07-16 22:14:23.342531852 +0000 UTC m=+37.557312993 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3bb158ab-7979-4010-aa22-e13370e73d78-registry-tls") pod "image-registry-564fbd977f-49gxl" (UID: "3bb158ab-7979-4010-aa22-e13370e73d78") : secret "image-registry-tls" not found
Jul 16 22:14:22.443525 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:22.443326    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0d79e411-5d34-4159-b507-be3b54b5865f-metrics-tls\") pod \"dns-default-st98p\" (UID: \"0d79e411-5d34-4159-b507-be3b54b5865f\") " pod="openshift-dns/dns-default-st98p"
Jul 16 22:14:22.443673 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:14:22.443471    2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 22:14:22.443673 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:14:22.443650    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d79e411-5d34-4159-b507-be3b54b5865f-metrics-tls podName:0d79e411-5d34-4159-b507-be3b54b5865f nodeName:}" failed. No retries permitted until 2026-07-16 22:14:23.443634269 +0000 UTC m=+37.658415423 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0d79e411-5d34-4159-b507-be3b54b5865f-metrics-tls") pod "dns-default-st98p" (UID: "0d79e411-5d34-4159-b507-be3b54b5865f") : secret "dns-default-metrics-tls" not found
Jul 16 22:14:22.575741 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:22.575673    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-92c7g"]
Jul 16 22:14:22.579781 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:22.579725    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-86bdb8d5c6-kdd8l"]
Jul 16 22:14:22.584013 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:22.583957    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65775f88f-vrh7f"]
Jul 16 22:14:22.591892 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:22.591872    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8648d96ddb-qq8gr"]
Jul 16 22:14:22.594239 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:14:22.594215    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1309634f_5fad_4855_9795_889d92d5bc67.slice/crio-f35bc3df911e2f38f868ae9d2c7028e206f4e55127dc05d5ce464bf04cdfe9db WatchSource:0}: Error finding container f35bc3df911e2f38f868ae9d2c7028e206f4e55127dc05d5ce464bf04cdfe9db: Status 404 returned error can't find the container with id f35bc3df911e2f38f868ae9d2c7028e206f4e55127dc05d5ce464bf04cdfe9db
Jul 16 22:14:22.594986 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:14:22.594879    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7efa7b74_0fd5_458b_89b3_ad1fc3b1493a.slice/crio-4a6faf6994c72bc74951c2fe3ce5308e2b3993936880d8eb4778fe424fd63427 WatchSource:0}: Error finding container 4a6faf6994c72bc74951c2fe3ce5308e2b3993936880d8eb4778fe424fd63427: Status 404 returned error can't find the container with id 4a6faf6994c72bc74951c2fe3ce5308e2b3993936880d8eb4778fe424fd63427
Jul 16 22:14:22.595654 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:14:22.595630    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6dba2385_55b2_4b81_a603_3f6e433dd4ea.slice/crio-7f9c97ce32c7f9e1ccefc352665e5939f9fc7c4e6f5cef6d03f4c9eb8a189801 WatchSource:0}: Error finding container 7f9c97ce32c7f9e1ccefc352665e5939f9fc7c4e6f5cef6d03f4c9eb8a189801: Status 404 returned error can't find the container with id 7f9c97ce32c7f9e1ccefc352665e5939f9fc7c4e6f5cef6d03f4c9eb8a189801
Jul 16 22:14:22.596289 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:14:22.596265    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod153b8695_f585_4876_9a14_3489c3f9fa58.slice/crio-84af8f421a8388bc43915e5d84afbfb956996369c9eb15ab1107c60272952599 WatchSource:0}: Error finding container 84af8f421a8388bc43915e5d84afbfb956996369c9eb15ab1107c60272952599: Status 404 returned error can't find the container with id 84af8f421a8388bc43915e5d84afbfb956996369c9eb15ab1107c60272952599
Jul 16 22:14:23.270459 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:23.270428    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zr4k5"
Jul 16 22:14:23.270634 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:23.270470    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qz9r8"
Jul 16 22:14:23.270634 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:23.270470    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xr6qc"
Jul 16 22:14:23.274618 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:23.274596    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 16 22:14:23.274618 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:23.274607    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 16 22:14:23.274812 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:23.274673    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 16 22:14:23.274812 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:23.274598    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-kkg55\""
Jul 16 22:14:23.274915 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:23.274878    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-7sbmm\""
Jul 16 22:14:23.275091 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:23.275075    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 16 22:14:23.352890 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:23.351639    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3bb158ab-7979-4010-aa22-e13370e73d78-registry-tls\") pod \"image-registry-564fbd977f-49gxl\" (UID: \"3bb158ab-7979-4010-aa22-e13370e73d78\") " pod="openshift-image-registry/image-registry-564fbd977f-49gxl"
Jul 16 22:14:23.352890 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:23.351716    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ff4f63ba-2036-4f92-a692-4be32674de91-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-f62bz\" (UID: \"ff4f63ba-2036-4f92-a692-4be32674de91\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-f62bz"
Jul 16 22:14:23.352890 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:14:23.352414    2552 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 16 22:14:23.352890 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:14:23.352432    2552 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-564fbd977f-49gxl: secret "image-registry-tls" not found
Jul 16 22:14:23.352890 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:14:23.352488    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3bb158ab-7979-4010-aa22-e13370e73d78-registry-tls podName:3bb158ab-7979-4010-aa22-e13370e73d78 nodeName:}" failed. No retries permitted until 2026-07-16 22:14:25.352468527 +0000 UTC m=+39.567249678 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3bb158ab-7979-4010-aa22-e13370e73d78-registry-tls") pod "image-registry-564fbd977f-49gxl" (UID: "3bb158ab-7979-4010-aa22-e13370e73d78") : secret "image-registry-tls" not found
Jul 16 22:14:23.352890 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:14:23.352541    2552 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 16 22:14:23.352890 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:14:23.352592    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff4f63ba-2036-4f92-a692-4be32674de91-networking-console-plugin-cert podName:ff4f63ba-2036-4f92-a692-4be32674de91 nodeName:}" failed. No retries permitted until 2026-07-16 22:14:25.352580281 +0000 UTC m=+39.567361424 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ff4f63ba-2036-4f92-a692-4be32674de91-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-f62bz" (UID: "ff4f63ba-2036-4f92-a692-4be32674de91") : secret "networking-console-plugin-cert" not found
Jul 16 22:14:23.453173 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:23.453118    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0d79e411-5d34-4159-b507-be3b54b5865f-metrics-tls\") pod \"dns-default-st98p\" (UID: \"0d79e411-5d34-4159-b507-be3b54b5865f\") " pod="openshift-dns/dns-default-st98p"
Jul 16 22:14:23.453326 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:14:23.453282    2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 22:14:23.453398 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:14:23.453342    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d79e411-5d34-4159-b507-be3b54b5865f-metrics-tls podName:0d79e411-5d34-4159-b507-be3b54b5865f nodeName:}" failed. No retries permitted until 2026-07-16 22:14:25.453324191 +0000 UTC m=+39.668105328 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0d79e411-5d34-4159-b507-be3b54b5865f-metrics-tls") pod "dns-default-st98p" (UID: "0d79e411-5d34-4159-b507-be3b54b5865f") : secret "dns-default-metrics-tls" not found
Jul 16 22:14:23.553106 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:23.551898    2552 generic.go:356] "Generic (PLEG): container finished" podID="70a8a28d-dadb-459e-bcc5-a0a5cc107c84" containerID="01f2d98dfbbf5a2611a70589f6bcc6a48bd5abb8750807817f46ebec5a42947b" exitCode=0
Jul 16 22:14:23.553106 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:23.552726    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zfb6b" event={"ID":"70a8a28d-dadb-459e-bcc5-a0a5cc107c84","Type":"ContainerDied","Data":"01f2d98dfbbf5a2611a70589f6bcc6a48bd5abb8750807817f46ebec5a42947b"}
Jul 16 22:14:23.558991 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:23.558955    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8648d96ddb-qq8gr" event={"ID":"153b8695-f585-4876-9a14-3489c3f9fa58","Type":"ContainerStarted","Data":"84af8f421a8388bc43915e5d84afbfb956996369c9eb15ab1107c60272952599"}
Jul 16 22:14:23.562056 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:23.562004    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65775f88f-vrh7f" event={"ID":"6dba2385-55b2-4b81-a603-3f6e433dd4ea","Type":"ContainerStarted","Data":"7f9c97ce32c7f9e1ccefc352665e5939f9fc7c4e6f5cef6d03f4c9eb8a189801"}
Jul 16 22:14:23.571118 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:23.571089    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-92c7g" event={"ID":"1309634f-5fad-4855-9795-889d92d5bc67","Type":"ContainerStarted","Data":"f35bc3df911e2f38f868ae9d2c7028e206f4e55127dc05d5ce464bf04cdfe9db"}
Jul 16 22:14:23.589393 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:23.589370    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86bdb8d5c6-kdd8l" event={"ID":"7efa7b74-0fd5-458b-89b3-ad1fc3b1493a","Type":"ContainerStarted","Data":"4a6faf6994c72bc74951c2fe3ce5308e2b3993936880d8eb4778fe424fd63427"}
Jul 16 22:14:24.635052 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:24.634722    2552 generic.go:356] "Generic (PLEG): container finished" podID="70a8a28d-dadb-459e-bcc5-a0a5cc107c84" containerID="641ae909187b5511ebb74c6e4bf00a87bbb6598e02d79eeef588778803c9b9e9" exitCode=0
Jul 16 22:14:24.635482 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:24.635071    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zfb6b" event={"ID":"70a8a28d-dadb-459e-bcc5-a0a5cc107c84","Type":"ContainerDied","Data":"641ae909187b5511ebb74c6e4bf00a87bbb6598e02d79eeef588778803c9b9e9"}
Jul 16 22:14:25.372452 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:25.372098    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ff4f63ba-2036-4f92-a692-4be32674de91-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-f62bz\" (UID: \"ff4f63ba-2036-4f92-a692-4be32674de91\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-f62bz"
Jul 16 22:14:25.372452 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:25.372233    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3bb158ab-7979-4010-aa22-e13370e73d78-registry-tls\") pod \"image-registry-564fbd977f-49gxl\" (UID: \"3bb158ab-7979-4010-aa22-e13370e73d78\") " pod="openshift-image-registry/image-registry-564fbd977f-49gxl"
Jul 16 22:14:25.372452 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:14:25.372293    2552 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 16 22:14:25.372452 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:14:25.372352    2552 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 16 22:14:25.372452 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:14:25.372368    2552 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-564fbd977f-49gxl: secret "image-registry-tls" not found
Jul 16 22:14:25.372452 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:14:25.372369    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff4f63ba-2036-4f92-a692-4be32674de91-networking-console-plugin-cert podName:ff4f63ba-2036-4f92-a692-4be32674de91 nodeName:}" failed. No retries permitted until 2026-07-16 22:14:29.372348242 +0000 UTC m=+43.587129394 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ff4f63ba-2036-4f92-a692-4be32674de91-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-f62bz" (UID: "ff4f63ba-2036-4f92-a692-4be32674de91") : secret "networking-console-plugin-cert" not found
Jul 16 22:14:25.372452 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:14:25.372428    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3bb158ab-7979-4010-aa22-e13370e73d78-registry-tls podName:3bb158ab-7979-4010-aa22-e13370e73d78 nodeName:}" failed. No retries permitted until 2026-07-16 22:14:29.372411889 +0000 UTC m=+43.587193033 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3bb158ab-7979-4010-aa22-e13370e73d78-registry-tls") pod "image-registry-564fbd977f-49gxl" (UID: "3bb158ab-7979-4010-aa22-e13370e73d78") : secret "image-registry-tls" not found
Jul 16 22:14:25.474225 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:25.473608    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0d79e411-5d34-4159-b507-be3b54b5865f-metrics-tls\") pod \"dns-default-st98p\" (UID: \"0d79e411-5d34-4159-b507-be3b54b5865f\") " pod="openshift-dns/dns-default-st98p"
Jul 16 22:14:25.474225 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:14:25.473803    2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 22:14:25.474225 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:14:25.473867    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d79e411-5d34-4159-b507-be3b54b5865f-metrics-tls podName:0d79e411-5d34-4159-b507-be3b54b5865f nodeName:}" failed. No retries permitted until 2026-07-16 22:14:29.473848544 +0000 UTC m=+43.688629688 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0d79e411-5d34-4159-b507-be3b54b5865f-metrics-tls") pod "dns-default-st98p" (UID: "0d79e411-5d34-4159-b507-be3b54b5865f") : secret "dns-default-metrics-tls" not found
Jul 16 22:14:25.643631 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:25.643138    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zfb6b" event={"ID":"70a8a28d-dadb-459e-bcc5-a0a5cc107c84","Type":"ContainerStarted","Data":"b68ee384904cf0ca5a3624d196210d4bb8970102e342c92fcc23c74a3a3fe00b"}
Jul 16 22:14:25.670055 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:25.669972    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-zfb6b" podStartSLOduration=16.259076731 podStartE2EDuration="39.669952095s" totalImagesPullingTime="23.410875364s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 22:13:46 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:14:25.668159092 +0000 UTC m=+39.882940250" watchObservedRunningTime="2026-07-16 22:14:25.669952095 +0000 UTC m=+39.884733254"
Jul 16 22:14:29.404711 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:29.404656    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3bb158ab-7979-4010-aa22-e13370e73d78-registry-tls\") pod \"image-registry-564fbd977f-49gxl\" (UID: \"3bb158ab-7979-4010-aa22-e13370e73d78\") " pod="openshift-image-registry/image-registry-564fbd977f-49gxl"
Jul 16 22:14:29.405174 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:29.404740    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ff4f63ba-2036-4f92-a692-4be32674de91-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-f62bz\" (UID: \"ff4f63ba-2036-4f92-a692-4be32674de91\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-f62bz"
Jul 16 22:14:29.405174 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:14:29.404840    2552 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 16 22:14:29.405174 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:14:29.404857    2552 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 16 22:14:29.405174 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:14:29.404866    2552 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-564fbd977f-49gxl: secret "image-registry-tls" not found
Jul 16 22:14:29.405174 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:14:29.404933    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff4f63ba-2036-4f92-a692-4be32674de91-networking-console-plugin-cert podName:ff4f63ba-2036-4f92-a692-4be32674de91 nodeName:}" failed. No retries permitted until 2026-07-16 22:14:37.404913442 +0000 UTC m=+51.619694603 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ff4f63ba-2036-4f92-a692-4be32674de91-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-f62bz" (UID: "ff4f63ba-2036-4f92-a692-4be32674de91") : secret "networking-console-plugin-cert" not found
Jul 16 22:14:29.405174 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:14:29.404978    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3bb158ab-7979-4010-aa22-e13370e73d78-registry-tls podName:3bb158ab-7979-4010-aa22-e13370e73d78 nodeName:}" failed. No retries permitted until 2026-07-16 22:14:37.404960219 +0000 UTC m=+51.619741377 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3bb158ab-7979-4010-aa22-e13370e73d78-registry-tls") pod "image-registry-564fbd977f-49gxl" (UID: "3bb158ab-7979-4010-aa22-e13370e73d78") : secret "image-registry-tls" not found
Jul 16 22:14:29.505658 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:29.505593    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0d79e411-5d34-4159-b507-be3b54b5865f-metrics-tls\") pod \"dns-default-st98p\" (UID: \"0d79e411-5d34-4159-b507-be3b54b5865f\") " pod="openshift-dns/dns-default-st98p"
Jul 16 22:14:29.505841 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:14:29.505771    2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 22:14:29.505841 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:14:29.505839    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d79e411-5d34-4159-b507-be3b54b5865f-metrics-tls podName:0d79e411-5d34-4159-b507-be3b54b5865f nodeName:}" failed. No retries permitted until 2026-07-16 22:14:37.505824246 +0000 UTC m=+51.720605383 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0d79e411-5d34-4159-b507-be3b54b5865f-metrics-tls") pod "dns-default-st98p" (UID: "0d79e411-5d34-4159-b507-be3b54b5865f") : secret "dns-default-metrics-tls" not found
Jul 16 22:14:31.660497 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:31.660463    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65775f88f-vrh7f" event={"ID":"6dba2385-55b2-4b81-a603-3f6e433dd4ea","Type":"ContainerStarted","Data":"c328c20ee9c56158bad3d9d94d0aefd594a9fb4e21ea7fe355d2bcb0fc012cc1"}
Jul 16 22:14:31.660497 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:31.660506    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65775f88f-vrh7f" event={"ID":"6dba2385-55b2-4b81-a603-3f6e433dd4ea","Type":"ContainerStarted","Data":"23ad87c60a1f0df4c68e00e40262e7047e862fff0c07fdfd2a38a6fa7ff993f5"}
Jul 16 22:14:31.661081 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:31.660522    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65775f88f-vrh7f" event={"ID":"6dba2385-55b2-4b81-a603-3f6e433dd4ea","Type":"ContainerStarted","Data":"85aca97e5a9a49aacbcddf8dd6ac3e26a71919877f3a447e708b471aedc1d44a"}
Jul 16 22:14:31.661977 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:31.661954    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-92c7g" event={"ID":"1309634f-5fad-4855-9795-889d92d5bc67","Type":"ContainerStarted","Data":"4db248563d1dd849e0ac2cfba41265bd32c7dea143d3745daedfc5343ef090cf"}
Jul 16 22:14:31.663296 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:31.663276    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86bdb8d5c6-kdd8l" event={"ID":"7efa7b74-0fd5-458b-89b3-ad1fc3b1493a","Type":"ContainerStarted","Data":"aafaa0476cf52535352feffadcc79cc6b83e08a4c9b1eefcff44f7506d176e73"}
Jul 16 22:14:31.663501 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:31.663480    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86bdb8d5c6-kdd8l"
Jul 16 22:14:31.664688 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:31.664663    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8648d96ddb-qq8gr" event={"ID":"153b8695-f585-4876-9a14-3489c3f9fa58","Type":"ContainerStarted","Data":"ebfade0f0838d886df020ce493c34b4903b4681d370363fed6da066204ac43f8"}
Jul 16 22:14:31.665384 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:31.665366    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86bdb8d5c6-kdd8l"
Jul 16 22:14:31.680602 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:31.680567    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65775f88f-vrh7f" podStartSLOduration=10.443435063999999 podStartE2EDuration="18.680555057s" totalImagesPullingTime="8.237119993s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:14:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:14:31.678979045 +0000 UTC m=+45.893760205" watchObservedRunningTime="2026-07-16 22:14:31.680555057 +0000 UTC m=+45.895336216"
Jul 16 22:14:31.694079 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:31.694036    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8648d96ddb-qq8gr" podStartSLOduration=10.457157769 podStartE2EDuration="18.694020207s" totalImagesPullingTime="8.236862438s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:14:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:14:31.693884735 +0000 UTC m=+45.908665896" watchObservedRunningTime="2026-07-16 22:14:31.694020207 +0000 UTC m=+45.908801368"
Jul 16 22:14:31.710247 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:31.710211    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86bdb8d5c6-kdd8l" podStartSLOduration=10.456469193 podStartE2EDuration="18.710200916s" totalImagesPullingTime="8.253731723s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:14:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:14:31.709741384 +0000 UTC m=+45.924522545" watchObservedRunningTime="2026-07-16 22:14:31.710200916 +0000 UTC m=+45.924982096"
Jul 16 22:14:31.724761 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:31.724730    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-92c7g" podStartSLOduration=2.487466049 podStartE2EDuration="10.724720213s" totalImagesPullingTime="8.237254164s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:14:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:14:31.724141865 +0000 UTC m=+45.938923025" watchObservedRunningTime="2026-07-16 22:14:31.724720213 +0000 UTC m=+45.939501373"
Jul 16 22:14:37.466838 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:37.466810    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3bb158ab-7979-4010-aa22-e13370e73d78-registry-tls\") pod \"image-registry-564fbd977f-49gxl\" (UID: \"3bb158ab-7979-4010-aa22-e13370e73d78\") " pod="openshift-image-registry/image-registry-564fbd977f-49gxl"
Jul 16 22:14:37.467275 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:37.466853    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ff4f63ba-2036-4f92-a692-4be32674de91-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-f62bz\" (UID: \"ff4f63ba-2036-4f92-a692-4be32674de91\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-f62bz"
Jul 16 22:14:37.467275 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:14:37.466959    2552 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 16 22:14:37.467275 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:14:37.466963    2552 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 16 22:14:37.467275 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:14:37.466982    2552 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-564fbd977f-49gxl: secret "image-registry-tls" not found
Jul 16 22:14:37.467275 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:14:37.467009    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff4f63ba-2036-4f92-a692-4be32674de91-networking-console-plugin-cert podName:ff4f63ba-2036-4f92-a692-4be32674de91 nodeName:}" failed. No retries permitted until 2026-07-16 22:14:53.466996166 +0000 UTC m=+67.681777304 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ff4f63ba-2036-4f92-a692-4be32674de91-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-f62bz" (UID: "ff4f63ba-2036-4f92-a692-4be32674de91") : secret "networking-console-plugin-cert" not found
Jul 16 22:14:37.467275 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:14:37.467034    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3bb158ab-7979-4010-aa22-e13370e73d78-registry-tls podName:3bb158ab-7979-4010-aa22-e13370e73d78 nodeName:}" failed. No retries permitted until 2026-07-16 22:14:53.467021573 +0000 UTC m=+67.681802710 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3bb158ab-7979-4010-aa22-e13370e73d78-registry-tls") pod "image-registry-564fbd977f-49gxl" (UID: "3bb158ab-7979-4010-aa22-e13370e73d78") : secret "image-registry-tls" not found
Jul 16 22:14:37.567887 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:37.567857    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0d79e411-5d34-4159-b507-be3b54b5865f-metrics-tls\") pod \"dns-default-st98p\" (UID: \"0d79e411-5d34-4159-b507-be3b54b5865f\") " pod="openshift-dns/dns-default-st98p"
Jul 16 22:14:37.568007 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:14:37.567981    2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 22:14:37.568045 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:14:37.568025    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d79e411-5d34-4159-b507-be3b54b5865f-metrics-tls podName:0d79e411-5d34-4159-b507-be3b54b5865f nodeName:}" failed. No retries permitted until 2026-07-16 22:14:53.568013945 +0000 UTC m=+67.782795086 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0d79e411-5d34-4159-b507-be3b54b5865f-metrics-tls") pod "dns-default-st98p" (UID: "0d79e411-5d34-4159-b507-be3b54b5865f") : secret "dns-default-metrics-tls" not found
Jul 16 22:14:46.543449 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:46.543420    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-69j5k"
Jul 16 22:14:51.973424 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:51.973385    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cf1b7d07-96ed-44e0-bbb0-aa6bb66378dd-original-pull-secret\") pod \"global-pull-secret-syncer-qz9r8\" (UID: \"cf1b7d07-96ed-44e0-bbb0-aa6bb66378dd\") " pod="kube-system/global-pull-secret-syncer-qz9r8"
Jul 16 22:14:51.973894 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:51.973454    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0dea03c6-7be0-48e6-ad97-b245cbb3e76f-metrics-certs\") pod \"network-metrics-daemon-zr4k5\" (UID: \"0dea03c6-7be0-48e6-ad97-b245cbb3e76f\") " pod="openshift-multus/network-metrics-daemon-zr4k5"
Jul 16 22:14:51.976237 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:51.976214    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 16 22:14:51.976305 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:51.976241    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 16 22:14:51.984576 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:14:51.984554    2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 16 22:14:51.984667 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:14:51.984623    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0dea03c6-7be0-48e6-ad97-b245cbb3e76f-metrics-certs podName:0dea03c6-7be0-48e6-ad97-b245cbb3e76f nodeName:}" failed. No retries permitted until 2026-07-16 22:15:55.984603934 +0000 UTC m=+130.199385073 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0dea03c6-7be0-48e6-ad97-b245cbb3e76f-metrics-certs") pod "network-metrics-daemon-zr4k5" (UID: "0dea03c6-7be0-48e6-ad97-b245cbb3e76f") : secret "metrics-daemon-secret" not found
Jul 16 22:14:51.988281 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:51.988261    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cf1b7d07-96ed-44e0-bbb0-aa6bb66378dd-original-pull-secret\") pod \"global-pull-secret-syncer-qz9r8\" (UID: \"cf1b7d07-96ed-44e0-bbb0-aa6bb66378dd\") " pod="kube-system/global-pull-secret-syncer-qz9r8"
Jul 16 22:14:52.099824 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:52.099803    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qz9r8"
Jul 16 22:14:52.175221 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:52.175185    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s97z2\" (UniqueName: \"kubernetes.io/projected/fa659f3f-b7af-4c2e-979a-6ef27bd503aa-kube-api-access-s97z2\") pod \"network-check-target-xr6qc\" (UID: \"fa659f3f-b7af-4c2e-979a-6ef27bd503aa\") " pod="openshift-network-diagnostics/network-check-target-xr6qc"
Jul 16 22:14:52.178441 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:52.178420    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 16 22:14:52.188979 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:52.188935    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 16 22:14:52.198649 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:52.198623    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s97z2\" (UniqueName: \"kubernetes.io/projected/fa659f3f-b7af-4c2e-979a-6ef27bd503aa-kube-api-access-s97z2\") pod \"network-check-target-xr6qc\" (UID: \"fa659f3f-b7af-4c2e-979a-6ef27bd503aa\") " pod="openshift-network-diagnostics/network-check-target-xr6qc"
Jul 16 22:14:52.218565 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:52.218539    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qz9r8"]
Jul 16 22:14:52.221969 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:14:52.221942    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf1b7d07_96ed_44e0_bbb0_aa6bb66378dd.slice/crio-f92d92133000187ff311ed6f8de3d83942736d8c5a31aca07b708abb957a45ae WatchSource:0}: Error finding container f92d92133000187ff311ed6f8de3d83942736d8c5a31aca07b708abb957a45ae: Status 404 returned error can't find the container with id f92d92133000187ff311ed6f8de3d83942736d8c5a31aca07b708abb957a45ae
Jul 16 22:14:52.395815 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:52.395795    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-kkg55\""
Jul 16 22:14:52.403034 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:52.403014    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xr6qc"
Jul 16 22:14:52.525422 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:52.525395    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-xr6qc"]
Jul 16 22:14:52.527904 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:14:52.527878    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa659f3f_b7af_4c2e_979a_6ef27bd503aa.slice/crio-c945ad6948ae97000b579635b66ec32fd942a57f8e36de1cb7c3943d5f2bc323 WatchSource:0}: Error finding container c945ad6948ae97000b579635b66ec32fd942a57f8e36de1cb7c3943d5f2bc323: Status 404 returned error can't find the container with id c945ad6948ae97000b579635b66ec32fd942a57f8e36de1cb7c3943d5f2bc323
Jul 16 22:14:52.724775 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:52.724747    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-xr6qc" event={"ID":"fa659f3f-b7af-4c2e-979a-6ef27bd503aa","Type":"ContainerStarted","Data":"c945ad6948ae97000b579635b66ec32fd942a57f8e36de1cb7c3943d5f2bc323"}
Jul 16 22:14:52.725797 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:52.725774    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qz9r8" event={"ID":"cf1b7d07-96ed-44e0-bbb0-aa6bb66378dd","Type":"ContainerStarted","Data":"f92d92133000187ff311ed6f8de3d83942736d8c5a31aca07b708abb957a45ae"}
Jul 16 22:14:53.484618 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:53.484581    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3bb158ab-7979-4010-aa22-e13370e73d78-registry-tls\") pod \"image-registry-564fbd977f-49gxl\" (UID: \"3bb158ab-7979-4010-aa22-e13370e73d78\") " pod="openshift-image-registry/image-registry-564fbd977f-49gxl"
Jul 16 22:14:53.485108 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:53.484635    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ff4f63ba-2036-4f92-a692-4be32674de91-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-f62bz\" (UID: \"ff4f63ba-2036-4f92-a692-4be32674de91\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-f62bz"
Jul 16 22:14:53.485108 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:14:53.484726    2552 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 16 22:14:53.485108 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:14:53.484737    2552 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 16 22:14:53.485108 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:14:53.484744    2552 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-564fbd977f-49gxl: secret "image-registry-tls" not found
Jul 16 22:14:53.485108 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:14:53.484798    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3bb158ab-7979-4010-aa22-e13370e73d78-registry-tls podName:3bb158ab-7979-4010-aa22-e13370e73d78 nodeName:}" failed. No retries permitted until 2026-07-16 22:15:25.484782343 +0000 UTC m=+99.699563484 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3bb158ab-7979-4010-aa22-e13370e73d78-registry-tls") pod "image-registry-564fbd977f-49gxl" (UID: "3bb158ab-7979-4010-aa22-e13370e73d78") : secret "image-registry-tls" not found
Jul 16 22:14:53.485108 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:14:53.484817    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff4f63ba-2036-4f92-a692-4be32674de91-networking-console-plugin-cert podName:ff4f63ba-2036-4f92-a692-4be32674de91 nodeName:}" failed. No retries permitted until 2026-07-16 22:15:25.484808328 +0000 UTC m=+99.699589467 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ff4f63ba-2036-4f92-a692-4be32674de91-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-f62bz" (UID: "ff4f63ba-2036-4f92-a692-4be32674de91") : secret "networking-console-plugin-cert" not found
Jul 16 22:14:53.585976 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:53.585943    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0d79e411-5d34-4159-b507-be3b54b5865f-metrics-tls\") pod \"dns-default-st98p\" (UID: \"0d79e411-5d34-4159-b507-be3b54b5865f\") " pod="openshift-dns/dns-default-st98p"
Jul 16 22:14:53.586122 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:14:53.586101    2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 22:14:53.586184 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:14:53.586173    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d79e411-5d34-4159-b507-be3b54b5865f-metrics-tls podName:0d79e411-5d34-4159-b507-be3b54b5865f nodeName:}" failed. No retries permitted until 2026-07-16 22:15:25.586154677 +0000 UTC m=+99.800935831 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0d79e411-5d34-4159-b507-be3b54b5865f-metrics-tls") pod "dns-default-st98p" (UID: "0d79e411-5d34-4159-b507-be3b54b5865f") : secret "dns-default-metrics-tls" not found
Jul 16 22:14:57.744485 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:57.744450    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-xr6qc" event={"ID":"fa659f3f-b7af-4c2e-979a-6ef27bd503aa","Type":"ContainerStarted","Data":"34de6b3116a939d947df675d0ab92f18e197681b098f6053216cff7b04bcc9c3"}
Jul 16 22:14:57.744928 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:57.744526    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-xr6qc"
Jul 16 22:14:57.745861 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:57.745838    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qz9r8" event={"ID":"cf1b7d07-96ed-44e0-bbb0-aa6bb66378dd","Type":"ContainerStarted","Data":"250532c0fce64f46f8830feeefad5c2ebc5ec62183649e7f9212025ceb482c81"}
Jul 16 22:14:57.761998 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:57.761959    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-xr6qc" podStartSLOduration=67.23407753 podStartE2EDuration="1m11.761946203s" totalImagesPullingTime="4.527868673s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:13:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:14:57.760563707 +0000 UTC m=+71.975344867" watchObservedRunningTime="2026-07-16 22:14:57.761946203 +0000 UTC m=+71.976727340"
Jul 16 22:14:57.776071 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:14:57.776036    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-qz9r8" podStartSLOduration=66.937894974 podStartE2EDuration="1m11.776025094s" totalImagesPullingTime="4.83813012s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 22:13:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:14:57.775526718 +0000 UTC m=+71.990307879" watchObservedRunningTime="2026-07-16 22:14:57.776025094 +0000 UTC m=+71.990806254"
Jul 16 22:15:25.497188 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:15:25.497154    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3bb158ab-7979-4010-aa22-e13370e73d78-registry-tls\") pod \"image-registry-564fbd977f-49gxl\" (UID: \"3bb158ab-7979-4010-aa22-e13370e73d78\") " pod="openshift-image-registry/image-registry-564fbd977f-49gxl"
Jul 16 22:15:25.497605 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:15:25.497197    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ff4f63ba-2036-4f92-a692-4be32674de91-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-f62bz\" (UID: \"ff4f63ba-2036-4f92-a692-4be32674de91\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-f62bz"
Jul 16 22:15:25.497605 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:15:25.497303    2552 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 16 22:15:25.497605 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:15:25.497307    2552 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 16 22:15:25.497605 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:15:25.497324    2552 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-564fbd977f-49gxl: secret "image-registry-tls" not found
Jul 16 22:15:25.497605 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:15:25.497376    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff4f63ba-2036-4f92-a692-4be32674de91-networking-console-plugin-cert podName:ff4f63ba-2036-4f92-a692-4be32674de91 nodeName:}" failed. No retries permitted until 2026-07-16 22:16:29.497358615 +0000 UTC m=+163.712139753 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ff4f63ba-2036-4f92-a692-4be32674de91-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-f62bz" (UID: "ff4f63ba-2036-4f92-a692-4be32674de91") : secret "networking-console-plugin-cert" not found
Jul 16 22:15:25.497882 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:15:25.497677    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3bb158ab-7979-4010-aa22-e13370e73d78-registry-tls podName:3bb158ab-7979-4010-aa22-e13370e73d78 nodeName:}" failed. No retries permitted until 2026-07-16 22:16:29.497383533 +0000 UTC m=+163.712164671 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3bb158ab-7979-4010-aa22-e13370e73d78-registry-tls") pod "image-registry-564fbd977f-49gxl" (UID: "3bb158ab-7979-4010-aa22-e13370e73d78") : secret "image-registry-tls" not found
Jul 16 22:15:25.598060 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:15:25.598033    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0d79e411-5d34-4159-b507-be3b54b5865f-metrics-tls\") pod \"dns-default-st98p\" (UID: \"0d79e411-5d34-4159-b507-be3b54b5865f\") " pod="openshift-dns/dns-default-st98p"
Jul 16 22:15:25.598185 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:15:25.598168    2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 22:15:25.598235 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:15:25.598225    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d79e411-5d34-4159-b507-be3b54b5865f-metrics-tls podName:0d79e411-5d34-4159-b507-be3b54b5865f nodeName:}" failed. No retries permitted until 2026-07-16 22:16:29.598210756 +0000 UTC m=+163.812991911 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0d79e411-5d34-4159-b507-be3b54b5865f-metrics-tls") pod "dns-default-st98p" (UID: "0d79e411-5d34-4159-b507-be3b54b5865f") : secret "dns-default-metrics-tls" not found
Jul 16 22:15:28.750972 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:15:28.750943    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-xr6qc"
Jul 16 22:15:55.999292 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:15:55.999251    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0dea03c6-7be0-48e6-ad97-b245cbb3e76f-metrics-certs\") pod \"network-metrics-daemon-zr4k5\" (UID: \"0dea03c6-7be0-48e6-ad97-b245cbb3e76f\") " pod="openshift-multus/network-metrics-daemon-zr4k5"
Jul 16 22:15:55.999687 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:15:55.999389    2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 16 22:15:55.999687 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:15:55.999447    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0dea03c6-7be0-48e6-ad97-b245cbb3e76f-metrics-certs podName:0dea03c6-7be0-48e6-ad97-b245cbb3e76f nodeName:}" failed. No retries permitted until 2026-07-16 22:17:57.999432625 +0000 UTC m=+252.214213763 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0dea03c6-7be0-48e6-ad97-b245cbb3e76f-metrics-certs") pod "network-metrics-daemon-zr4k5" (UID: "0dea03c6-7be0-48e6-ad97-b245cbb3e76f") : secret "metrics-daemon-secret" not found
Jul 16 22:16:24.659019 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:16:24.658975    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-564fbd977f-49gxl" podUID="3bb158ab-7979-4010-aa22-e13370e73d78"
Jul 16 22:16:24.692190 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:16:24.692167    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-f62bz" podUID="ff4f63ba-2036-4f92-a692-4be32674de91"
Jul 16 22:16:24.748847 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:16:24.748817    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-st98p" podUID="0d79e411-5d34-4159-b507-be3b54b5865f"
Jul 16 22:16:24.978750 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:16:24.978718    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-f62bz"
Jul 16 22:16:24.978932 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:16:24.978718    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-st98p"
Jul 16 22:16:24.978932 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:16:24.978717    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-564fbd977f-49gxl"
Jul 16 22:16:26.283870 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:16:26.283833    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-zr4k5" podUID="0dea03c6-7be0-48e6-ad97-b245cbb3e76f"
Jul 16 22:16:29.539121 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:16:29.539077    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3bb158ab-7979-4010-aa22-e13370e73d78-registry-tls\") pod \"image-registry-564fbd977f-49gxl\" (UID: \"3bb158ab-7979-4010-aa22-e13370e73d78\") " pod="openshift-image-registry/image-registry-564fbd977f-49gxl"
Jul 16 22:16:29.539121 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:16:29.539128    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ff4f63ba-2036-4f92-a692-4be32674de91-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-f62bz\" (UID: \"ff4f63ba-2036-4f92-a692-4be32674de91\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-f62bz"
Jul 16 22:16:29.539616 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:16:29.539257    2552 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 16 22:16:29.539616 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:16:29.539280    2552 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 16 22:16:29.539616 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:16:29.539351    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff4f63ba-2036-4f92-a692-4be32674de91-networking-console-plugin-cert podName:ff4f63ba-2036-4f92-a692-4be32674de91 nodeName:}" failed. No retries permitted until 2026-07-16 22:18:31.539333919 +0000 UTC m=+285.754115057 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ff4f63ba-2036-4f92-a692-4be32674de91-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-f62bz" (UID: "ff4f63ba-2036-4f92-a692-4be32674de91") : secret "networking-console-plugin-cert" not found
Jul 16 22:16:29.539616 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:16:29.539284    2552 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-564fbd977f-49gxl: secret "image-registry-tls" not found
Jul 16 22:16:29.539616 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:16:29.539436    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3bb158ab-7979-4010-aa22-e13370e73d78-registry-tls podName:3bb158ab-7979-4010-aa22-e13370e73d78 nodeName:}" failed. No retries permitted until 2026-07-16 22:18:31.539418504 +0000 UTC m=+285.754199644 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3bb158ab-7979-4010-aa22-e13370e73d78-registry-tls") pod "image-registry-564fbd977f-49gxl" (UID: "3bb158ab-7979-4010-aa22-e13370e73d78") : secret "image-registry-tls" not found
Jul 16 22:16:29.639670 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:16:29.639640    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0d79e411-5d34-4159-b507-be3b54b5865f-metrics-tls\") pod \"dns-default-st98p\" (UID: \"0d79e411-5d34-4159-b507-be3b54b5865f\") " pod="openshift-dns/dns-default-st98p"
Jul 16 22:16:29.639785 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:16:29.639754    2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 22:16:29.639827 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:16:29.639807    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d79e411-5d34-4159-b507-be3b54b5865f-metrics-tls podName:0d79e411-5d34-4159-b507-be3b54b5865f nodeName:}" failed. No retries permitted until 2026-07-16 22:18:31.639794911 +0000 UTC m=+285.854576050 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0d79e411-5d34-4159-b507-be3b54b5865f-metrics-tls") pod "dns-default-st98p" (UID: "0d79e411-5d34-4159-b507-be3b54b5865f") : secret "dns-default-metrics-tls" not found
Jul 16 22:16:31.664063 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:16:31.664014    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86bdb8d5c6-kdd8l" podUID="7efa7b74-0fd5-458b-89b3-ad1fc3b1493a" containerName="acm-agent" probeResult="failure" output="Get \"http://10.132.0.12:8000/readyz\": dial tcp 10.132.0.12:8000: connect: connection refused"
Jul 16 22:16:31.984915 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:16:31.984866    2552 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8648d96ddb-qq8gr" podUID="153b8695-f585-4876-9a14-3489c3f9fa58" containerName="addon-agent" probeResult="failure" output="Get \"http://10.132.0.7:8000/healthz\": dial tcp 10.132.0.7:8000: connect: connection refused"
Jul 16 22:16:31.998819 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:16:31.998788    2552 generic.go:356] "Generic (PLEG): container finished" podID="153b8695-f585-4876-9a14-3489c3f9fa58" containerID="ebfade0f0838d886df020ce493c34b4903b4681d370363fed6da066204ac43f8" exitCode=255
Jul 16 22:16:31.998953 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:16:31.998860    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8648d96ddb-qq8gr" event={"ID":"153b8695-f585-4876-9a14-3489c3f9fa58","Type":"ContainerDied","Data":"ebfade0f0838d886df020ce493c34b4903b4681d370363fed6da066204ac43f8"}
Jul 16 22:16:31.999187 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:16:31.999171    2552 scope.go:117] "RemoveContainer" containerID="ebfade0f0838d886df020ce493c34b4903b4681d370363fed6da066204ac43f8"
Jul 16 22:16:32.000495 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:16:32.000476    2552 generic.go:356] "Generic (PLEG): container finished" podID="7efa7b74-0fd5-458b-89b3-ad1fc3b1493a" containerID="aafaa0476cf52535352feffadcc79cc6b83e08a4c9b1eefcff44f7506d176e73" exitCode=1
Jul 16 22:16:32.000569 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:16:32.000515    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86bdb8d5c6-kdd8l" event={"ID":"7efa7b74-0fd5-458b-89b3-ad1fc3b1493a","Type":"ContainerDied","Data":"aafaa0476cf52535352feffadcc79cc6b83e08a4c9b1eefcff44f7506d176e73"}
Jul 16 22:16:32.000823 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:16:32.000808    2552 scope.go:117] "RemoveContainer" containerID="aafaa0476cf52535352feffadcc79cc6b83e08a4c9b1eefcff44f7506d176e73"
Jul 16 22:16:32.041962 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:16:32.041942    2552 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86bdb8d5c6-kdd8l"
Jul 16 22:16:33.004482 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:16:33.004442    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8648d96ddb-qq8gr" event={"ID":"153b8695-f585-4876-9a14-3489c3f9fa58","Type":"ContainerStarted","Data":"f14cf28c51ba39347c3ba3088aeb7faa8d9cfa296c08524cdcf3021078b137a7"}
Jul 16 22:16:33.005999 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:16:33.005977    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86bdb8d5c6-kdd8l" event={"ID":"7efa7b74-0fd5-458b-89b3-ad1fc3b1493a","Type":"ContainerStarted","Data":"f4f5a53a9c9afdc623265376a6496832accc0803450c60631ff046467d651bd5"}
Jul 16 22:16:33.006148 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:16:33.006126    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86bdb8d5c6-kdd8l"
Jul 16 22:16:33.007060 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:16:33.007043    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86bdb8d5c6-kdd8l"
Jul 16 22:16:37.270378 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:16:37.270345    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zr4k5"
Jul 16 22:17:58.007598 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:17:58.007566    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0dea03c6-7be0-48e6-ad97-b245cbb3e76f-metrics-certs\") pod \"network-metrics-daemon-zr4k5\" (UID: \"0dea03c6-7be0-48e6-ad97-b245cbb3e76f\") " pod="openshift-multus/network-metrics-daemon-zr4k5"
Jul 16 22:17:58.008077 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:17:58.007676    2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 16 22:17:58.008077 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:17:58.007750    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0dea03c6-7be0-48e6-ad97-b245cbb3e76f-metrics-certs podName:0dea03c6-7be0-48e6-ad97-b245cbb3e76f nodeName:}" failed. No retries permitted until 2026-07-16 22:20:00.007736743 +0000 UTC m=+374.222517880 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0dea03c6-7be0-48e6-ad97-b245cbb3e76f-metrics-certs") pod "network-metrics-daemon-zr4k5" (UID: "0dea03c6-7be0-48e6-ad97-b245cbb3e76f") : secret "metrics-daemon-secret" not found
Jul 16 22:18:11.434800 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:11.434767    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-j246p"]
Jul 16 22:18:11.437578 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:11.437562    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-j246p"
Jul 16 22:18:11.440387 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:11.440369    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 16 22:18:11.441462 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:11.441442    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 16 22:18:11.441583 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:11.441475    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-5nldq\""
Jul 16 22:18:11.441583 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:11.441480    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 16 22:18:11.441583 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:11.441477    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 16 22:18:11.450648 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:11.450629    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-j246p"]
Jul 16 22:18:11.495626 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:11.495600    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/dcd379a6-d615-4c6e-ba6d-ef0b93a174ff-crio-socket\") pod \"insights-runtime-extractor-j246p\" (UID: \"dcd379a6-d615-4c6e-ba6d-ef0b93a174ff\") " pod="openshift-insights/insights-runtime-extractor-j246p"
Jul 16 22:18:11.495759 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:11.495652    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/dcd379a6-d615-4c6e-ba6d-ef0b93a174ff-data-volume\") pod \"insights-runtime-extractor-j246p\" (UID: \"dcd379a6-d615-4c6e-ba6d-ef0b93a174ff\") " pod="openshift-insights/insights-runtime-extractor-j246p"
Jul 16 22:18:11.495759 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:11.495669    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dcd379a6-d615-4c6e-ba6d-ef0b93a174ff-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j246p\" (UID: \"dcd379a6-d615-4c6e-ba6d-ef0b93a174ff\") " pod="openshift-insights/insights-runtime-extractor-j246p"
Jul 16 22:18:11.495759 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:11.495734    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmqcj\" (UniqueName: \"kubernetes.io/projected/dcd379a6-d615-4c6e-ba6d-ef0b93a174ff-kube-api-access-jmqcj\") pod \"insights-runtime-extractor-j246p\" (UID: \"dcd379a6-d615-4c6e-ba6d-ef0b93a174ff\") " pod="openshift-insights/insights-runtime-extractor-j246p"
Jul 16 22:18:11.495914 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:11.495826    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dcd379a6-d615-4c6e-ba6d-ef0b93a174ff-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j246p\" (UID: \"dcd379a6-d615-4c6e-ba6d-ef0b93a174ff\") " pod="openshift-insights/insights-runtime-extractor-j246p"
Jul 16 22:18:11.596551 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:11.596524    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/dcd379a6-d615-4c6e-ba6d-ef0b93a174ff-crio-socket\") pod \"insights-runtime-extractor-j246p\" (UID: \"dcd379a6-d615-4c6e-ba6d-ef0b93a174ff\") " pod="openshift-insights/insights-runtime-extractor-j246p"
Jul 16 22:18:11.596673 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:11.596572    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/dcd379a6-d615-4c6e-ba6d-ef0b93a174ff-data-volume\") pod \"insights-runtime-extractor-j246p\" (UID: \"dcd379a6-d615-4c6e-ba6d-ef0b93a174ff\") " pod="openshift-insights/insights-runtime-extractor-j246p"
Jul 16 22:18:11.596673 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:11.596590    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dcd379a6-d615-4c6e-ba6d-ef0b93a174ff-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j246p\" (UID: \"dcd379a6-d615-4c6e-ba6d-ef0b93a174ff\") " pod="openshift-insights/insights-runtime-extractor-j246p"
Jul 16 22:18:11.596673 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:11.596608    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jmqcj\" (UniqueName: \"kubernetes.io/projected/dcd379a6-d615-4c6e-ba6d-ef0b93a174ff-kube-api-access-jmqcj\") pod \"insights-runtime-extractor-j246p\" (UID: \"dcd379a6-d615-4c6e-ba6d-ef0b93a174ff\") " pod="openshift-insights/insights-runtime-extractor-j246p"
Jul 16 22:18:11.596673 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:11.596649    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dcd379a6-d615-4c6e-ba6d-ef0b93a174ff-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j246p\" (UID: \"dcd379a6-d615-4c6e-ba6d-ef0b93a174ff\") " pod="openshift-insights/insights-runtime-extractor-j246p"
Jul 16 22:18:11.596673 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:11.596648    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/dcd379a6-d615-4c6e-ba6d-ef0b93a174ff-crio-socket\") pod \"insights-runtime-extractor-j246p\" (UID: \"dcd379a6-d615-4c6e-ba6d-ef0b93a174ff\") " pod="openshift-insights/insights-runtime-extractor-j246p"
Jul 16 22:18:11.596673 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:18:11.596663    2552 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 16 22:18:11.596922 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:18:11.596770    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/dcd379a6-d615-4c6e-ba6d-ef0b93a174ff-kube-rbac-proxy-cm podName:dcd379a6-d615-4c6e-ba6d-ef0b93a174ff nodeName:}" failed. No retries permitted until 2026-07-16 22:18:12.096754482 +0000 UTC m=+266.311535621 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/dcd379a6-d615-4c6e-ba6d-ef0b93a174ff-kube-rbac-proxy-cm") pod "insights-runtime-extractor-j246p" (UID: "dcd379a6-d615-4c6e-ba6d-ef0b93a174ff") : configmap "kube-rbac-proxy" not found
Jul 16 22:18:11.596922 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:18:11.596770    2552 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 16 22:18:11.596922 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:18:11.596799    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dcd379a6-d615-4c6e-ba6d-ef0b93a174ff-insights-runtime-extractor-tls podName:dcd379a6-d615-4c6e-ba6d-ef0b93a174ff nodeName:}" failed. No retries permitted until 2026-07-16 22:18:12.096793232 +0000 UTC m=+266.311574370 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/dcd379a6-d615-4c6e-ba6d-ef0b93a174ff-insights-runtime-extractor-tls") pod "insights-runtime-extractor-j246p" (UID: "dcd379a6-d615-4c6e-ba6d-ef0b93a174ff") : secret "insights-runtime-extractor-tls" not found
Jul 16 22:18:11.596922 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:11.596918    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/dcd379a6-d615-4c6e-ba6d-ef0b93a174ff-data-volume\") pod \"insights-runtime-extractor-j246p\" (UID: \"dcd379a6-d615-4c6e-ba6d-ef0b93a174ff\") " pod="openshift-insights/insights-runtime-extractor-j246p"
Jul 16 22:18:11.605293 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:11.605275    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmqcj\" (UniqueName: \"kubernetes.io/projected/dcd379a6-d615-4c6e-ba6d-ef0b93a174ff-kube-api-access-jmqcj\") pod \"insights-runtime-extractor-j246p\" (UID: \"dcd379a6-d615-4c6e-ba6d-ef0b93a174ff\") " pod="openshift-insights/insights-runtime-extractor-j246p"
Jul 16 22:18:12.100442 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:12.100411    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dcd379a6-d615-4c6e-ba6d-ef0b93a174ff-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j246p\" (UID: \"dcd379a6-d615-4c6e-ba6d-ef0b93a174ff\") " pod="openshift-insights/insights-runtime-extractor-j246p"
Jul 16 22:18:12.100594 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:12.100505    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dcd379a6-d615-4c6e-ba6d-ef0b93a174ff-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j246p\" (UID: \"dcd379a6-d615-4c6e-ba6d-ef0b93a174ff\") " pod="openshift-insights/insights-runtime-extractor-j246p"
Jul 16 22:18:12.100594 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:18:12.100569    2552 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 16 22:18:12.100672 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:18:12.100614    2552 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 16 22:18:12.100672 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:18:12.100618    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dcd379a6-d615-4c6e-ba6d-ef0b93a174ff-insights-runtime-extractor-tls podName:dcd379a6-d615-4c6e-ba6d-ef0b93a174ff nodeName:}" failed. No retries permitted until 2026-07-16 22:18:13.100607048 +0000 UTC m=+267.315388189 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/dcd379a6-d615-4c6e-ba6d-ef0b93a174ff-insights-runtime-extractor-tls") pod "insights-runtime-extractor-j246p" (UID: "dcd379a6-d615-4c6e-ba6d-ef0b93a174ff") : secret "insights-runtime-extractor-tls" not found
Jul 16 22:18:12.100774 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:18:12.100682    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/dcd379a6-d615-4c6e-ba6d-ef0b93a174ff-kube-rbac-proxy-cm podName:dcd379a6-d615-4c6e-ba6d-ef0b93a174ff nodeName:}" failed. No retries permitted until 2026-07-16 22:18:13.100669318 +0000 UTC m=+267.315450457 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/dcd379a6-d615-4c6e-ba6d-ef0b93a174ff-kube-rbac-proxy-cm") pod "insights-runtime-extractor-j246p" (UID: "dcd379a6-d615-4c6e-ba6d-ef0b93a174ff") : configmap "kube-rbac-proxy" not found
Jul 16 22:18:13.107325 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:13.107293    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dcd379a6-d615-4c6e-ba6d-ef0b93a174ff-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j246p\" (UID: \"dcd379a6-d615-4c6e-ba6d-ef0b93a174ff\") " pod="openshift-insights/insights-runtime-extractor-j246p"
Jul 16 22:18:13.107764 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:13.107348    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dcd379a6-d615-4c6e-ba6d-ef0b93a174ff-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j246p\" (UID: \"dcd379a6-d615-4c6e-ba6d-ef0b93a174ff\") " pod="openshift-insights/insights-runtime-extractor-j246p"
Jul 16 22:18:13.107764 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:18:13.107406    2552 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 16 22:18:13.107764 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:18:13.107449    2552 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 16 22:18:13.107764 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:18:13.107464    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/dcd379a6-d615-4c6e-ba6d-ef0b93a174ff-kube-rbac-proxy-cm podName:dcd379a6-d615-4c6e-ba6d-ef0b93a174ff nodeName:}" failed. No retries permitted until 2026-07-16 22:18:15.107449963 +0000 UTC m=+269.322231101 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/dcd379a6-d615-4c6e-ba6d-ef0b93a174ff-kube-rbac-proxy-cm") pod "insights-runtime-extractor-j246p" (UID: "dcd379a6-d615-4c6e-ba6d-ef0b93a174ff") : configmap "kube-rbac-proxy" not found
Jul 16 22:18:13.107764 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:18:13.107496    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dcd379a6-d615-4c6e-ba6d-ef0b93a174ff-insights-runtime-extractor-tls podName:dcd379a6-d615-4c6e-ba6d-ef0b93a174ff nodeName:}" failed. No retries permitted until 2026-07-16 22:18:15.107485337 +0000 UTC m=+269.322266477 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/dcd379a6-d615-4c6e-ba6d-ef0b93a174ff-insights-runtime-extractor-tls") pod "insights-runtime-extractor-j246p" (UID: "dcd379a6-d615-4c6e-ba6d-ef0b93a174ff") : secret "insights-runtime-extractor-tls" not found
Jul 16 22:18:13.276352 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:13.276327    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8zcnq_b0bc3969-f63b-4d8d-9616-bfc554866e8f/dns-node-resolver/0.log"
Jul 16 22:18:14.675841 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:14.675812    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-t8d4l_80266fce-9ecb-495e-b7ca-fdc237aaa783/node-ca/0.log"
Jul 16 22:18:15.078230 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:15.078201    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-92c7g_1309634f-5fad-4855-9795-889d92d5bc67/serve-healthcheck-canary/0.log"
Jul 16 22:18:15.125773 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:15.125743    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dcd379a6-d615-4c6e-ba6d-ef0b93a174ff-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j246p\" (UID: \"dcd379a6-d615-4c6e-ba6d-ef0b93a174ff\") " pod="openshift-insights/insights-runtime-extractor-j246p"
Jul 16 22:18:15.125897 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:15.125812    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dcd379a6-d615-4c6e-ba6d-ef0b93a174ff-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j246p\" (UID: \"dcd379a6-d615-4c6e-ba6d-ef0b93a174ff\") " pod="openshift-insights/insights-runtime-extractor-j246p"
Jul 16 22:18:15.125897 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:18:15.125875    2552 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 16 22:18:15.125897 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:18:15.125878    2552 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 16 22:18:15.125999 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:18:15.125922    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/dcd379a6-d615-4c6e-ba6d-ef0b93a174ff-kube-rbac-proxy-cm podName:dcd379a6-d615-4c6e-ba6d-ef0b93a174ff nodeName:}" failed. No retries permitted until 2026-07-16 22:18:19.125909913 +0000 UTC m=+273.340691051 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/dcd379a6-d615-4c6e-ba6d-ef0b93a174ff-kube-rbac-proxy-cm") pod "insights-runtime-extractor-j246p" (UID: "dcd379a6-d615-4c6e-ba6d-ef0b93a174ff") : configmap "kube-rbac-proxy" not found
Jul 16 22:18:15.125999 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:18:15.125949    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dcd379a6-d615-4c6e-ba6d-ef0b93a174ff-insights-runtime-extractor-tls podName:dcd379a6-d615-4c6e-ba6d-ef0b93a174ff nodeName:}" failed. No retries permitted until 2026-07-16 22:18:19.125936831 +0000 UTC m=+273.340717972 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/dcd379a6-d615-4c6e-ba6d-ef0b93a174ff-insights-runtime-extractor-tls") pod "insights-runtime-extractor-j246p" (UID: "dcd379a6-d615-4c6e-ba6d-ef0b93a174ff") : secret "insights-runtime-extractor-tls" not found
Jul 16 22:18:19.156431 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:19.156397    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dcd379a6-d615-4c6e-ba6d-ef0b93a174ff-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j246p\" (UID: \"dcd379a6-d615-4c6e-ba6d-ef0b93a174ff\") " pod="openshift-insights/insights-runtime-extractor-j246p"
Jul 16 22:18:19.156907 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:19.156471    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dcd379a6-d615-4c6e-ba6d-ef0b93a174ff-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j246p\" (UID: \"dcd379a6-d615-4c6e-ba6d-ef0b93a174ff\") " pod="openshift-insights/insights-runtime-extractor-j246p"
Jul 16 22:18:19.156907 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:18:19.156532    2552 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 16 22:18:19.156907 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:18:19.156551    2552 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 16 22:18:19.156907 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:18:19.156605    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dcd379a6-d615-4c6e-ba6d-ef0b93a174ff-insights-runtime-extractor-tls podName:dcd379a6-d615-4c6e-ba6d-ef0b93a174ff nodeName:}" failed. No retries permitted until 2026-07-16 22:18:27.156589142 +0000 UTC m=+281.371370284 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/dcd379a6-d615-4c6e-ba6d-ef0b93a174ff-insights-runtime-extractor-tls") pod "insights-runtime-extractor-j246p" (UID: "dcd379a6-d615-4c6e-ba6d-ef0b93a174ff") : secret "insights-runtime-extractor-tls" not found
Jul 16 22:18:19.156907 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:18:19.156622    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/dcd379a6-d615-4c6e-ba6d-ef0b93a174ff-kube-rbac-proxy-cm podName:dcd379a6-d615-4c6e-ba6d-ef0b93a174ff nodeName:}" failed. No retries permitted until 2026-07-16 22:18:27.156614371 +0000 UTC m=+281.371395509 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/dcd379a6-d615-4c6e-ba6d-ef0b93a174ff-kube-rbac-proxy-cm") pod "insights-runtime-extractor-j246p" (UID: "dcd379a6-d615-4c6e-ba6d-ef0b93a174ff") : configmap "kube-rbac-proxy" not found
Jul 16 22:18:27.223350 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:27.223299    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dcd379a6-d615-4c6e-ba6d-ef0b93a174ff-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j246p\" (UID: \"dcd379a6-d615-4c6e-ba6d-ef0b93a174ff\") " pod="openshift-insights/insights-runtime-extractor-j246p"
Jul 16 22:18:27.223877 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:27.223465    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dcd379a6-d615-4c6e-ba6d-ef0b93a174ff-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j246p\" (UID: \"dcd379a6-d615-4c6e-ba6d-ef0b93a174ff\") " pod="openshift-insights/insights-runtime-extractor-j246p"
Jul 16 22:18:27.223993 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:27.223975    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dcd379a6-d615-4c6e-ba6d-ef0b93a174ff-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j246p\" (UID: \"dcd379a6-d615-4c6e-ba6d-ef0b93a174ff\") " pod="openshift-insights/insights-runtime-extractor-j246p"
Jul 16 22:18:27.225663 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:27.225644    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dcd379a6-d615-4c6e-ba6d-ef0b93a174ff-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j246p\" (UID: \"dcd379a6-d615-4c6e-ba6d-ef0b93a174ff\") " pod="openshift-insights/insights-runtime-extractor-j246p"
Jul 16 22:18:27.346247 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:27.346198    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-j246p"
Jul 16 22:18:27.463767 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:27.463684    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-j246p"]
Jul 16 22:18:27.466158 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:18:27.466133    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddcd379a6_d615_4c6e_ba6d_ef0b93a174ff.slice/crio-ce70b847a969379774c325dda062222b1f5c6b90312853b94adf503279585701 WatchSource:0}: Error finding container ce70b847a969379774c325dda062222b1f5c6b90312853b94adf503279585701: Status 404 returned error can't find the container with id ce70b847a969379774c325dda062222b1f5c6b90312853b94adf503279585701
Jul 16 22:18:27.980006 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:18:27.979964    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-f62bz" podUID="ff4f63ba-2036-4f92-a692-4be32674de91"
Jul 16 22:18:27.980006 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:18:27.979999    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-564fbd977f-49gxl" podUID="3bb158ab-7979-4010-aa22-e13370e73d78"
Jul 16 22:18:27.980213 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:18:27.979964    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-st98p" podUID="0d79e411-5d34-4159-b507-be3b54b5865f"
Jul 16 22:18:28.318849 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:28.318775    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-st98p"
Jul 16 22:18:28.319290 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:28.319111    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-j246p" event={"ID":"dcd379a6-d615-4c6e-ba6d-ef0b93a174ff","Type":"ContainerStarted","Data":"ce70b847a969379774c325dda062222b1f5c6b90312853b94adf503279585701"}
Jul 16 22:18:28.319290 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:28.319188    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-f62bz"
Jul 16 22:18:28.319412 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:28.319397    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-564fbd977f-49gxl"
Jul 16 22:18:31.562546 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:31.562509    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3bb158ab-7979-4010-aa22-e13370e73d78-registry-tls\") pod \"image-registry-564fbd977f-49gxl\" (UID: \"3bb158ab-7979-4010-aa22-e13370e73d78\") " pod="openshift-image-registry/image-registry-564fbd977f-49gxl"
Jul 16 22:18:31.563096 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:31.562638    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ff4f63ba-2036-4f92-a692-4be32674de91-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-f62bz\" (UID: \"ff4f63ba-2036-4f92-a692-4be32674de91\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-f62bz"
Jul 16 22:18:31.565360 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:31.565330    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ff4f63ba-2036-4f92-a692-4be32674de91-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-f62bz\" (UID: \"ff4f63ba-2036-4f92-a692-4be32674de91\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-f62bz"
Jul 16 22:18:31.565476 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:31.565330    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3bb158ab-7979-4010-aa22-e13370e73d78-registry-tls\") pod \"image-registry-564fbd977f-49gxl\" (UID: \"3bb158ab-7979-4010-aa22-e13370e73d78\") " pod="openshift-image-registry/image-registry-564fbd977f-49gxl"
Jul 16 22:18:31.623517 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:31.623483    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-6hmsj\""
Jul 16 22:18:31.623678 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:31.623483    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-jdxhv\""
Jul 16 22:18:31.630638 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:31.630618    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-f62bz"
Jul 16 22:18:31.630769 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:31.630754    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-564fbd977f-49gxl"
Jul 16 22:18:31.663639 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:31.663162    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0d79e411-5d34-4159-b507-be3b54b5865f-metrics-tls\") pod \"dns-default-st98p\" (UID: \"0d79e411-5d34-4159-b507-be3b54b5865f\") " pod="openshift-dns/dns-default-st98p"
Jul 16 22:18:31.665914 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:31.665889    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0d79e411-5d34-4159-b507-be3b54b5865f-metrics-tls\") pod \"dns-default-st98p\" (UID: \"0d79e411-5d34-4159-b507-be3b54b5865f\") " pod="openshift-dns/dns-default-st98p"
Jul 16 22:18:31.922033 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:31.921966    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-gpmss\""
Jul 16 22:18:31.930312 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:31.930286    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-st98p"
Jul 16 22:18:32.334950 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:32.334910    2552 generic.go:356] "Generic (PLEG): container finished" podID="7efa7b74-0fd5-458b-89b3-ad1fc3b1493a" containerID="f4f5a53a9c9afdc623265376a6496832accc0803450c60631ff046467d651bd5" exitCode=1
Jul 16 22:18:32.335123 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:32.334987    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86bdb8d5c6-kdd8l" event={"ID":"7efa7b74-0fd5-458b-89b3-ad1fc3b1493a","Type":"ContainerDied","Data":"f4f5a53a9c9afdc623265376a6496832accc0803450c60631ff046467d651bd5"}
Jul 16 22:18:32.335123 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:32.335047    2552 scope.go:117] "RemoveContainer" containerID="aafaa0476cf52535352feffadcc79cc6b83e08a4c9b1eefcff44f7506d176e73"
Jul 16 22:18:32.335384 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:32.335366    2552 scope.go:117] "RemoveContainer" containerID="f4f5a53a9c9afdc623265376a6496832accc0803450c60631ff046467d651bd5"
Jul 16 22:18:32.335605 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:18:32.335578    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-86bdb8d5c6-kdd8l_open-cluster-management-agent-addon(7efa7b74-0fd5-458b-89b3-ad1fc3b1493a)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86bdb8d5c6-kdd8l" podUID="7efa7b74-0fd5-458b-89b3-ad1fc3b1493a"
Jul 16 22:18:32.661115 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:32.661093    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-564fbd977f-49gxl"]
Jul 16 22:18:32.664004 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:18:32.663981    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bb158ab_7979_4010_aa22_e13370e73d78.slice/crio-5ac97677158d58d51d6e203ef8fb2596da9f7046c502b45fef3487b28a3ea0fc WatchSource:0}: Error finding container 5ac97677158d58d51d6e203ef8fb2596da9f7046c502b45fef3487b28a3ea0fc: Status 404 returned error can't find the container with id 5ac97677158d58d51d6e203ef8fb2596da9f7046c502b45fef3487b28a3ea0fc
Jul 16 22:18:32.878650 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:32.878559    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-f62bz"]
Jul 16 22:18:32.881638 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:32.881604    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-st98p"]
Jul 16 22:18:32.881759 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:18:32.881682    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff4f63ba_2036_4f92_a692_4be32674de91.slice/crio-e97d0e6c0a4e279d27508f343acde75fbb03c651de937358384d783d60e706b6 WatchSource:0}: Error finding container e97d0e6c0a4e279d27508f343acde75fbb03c651de937358384d783d60e706b6: Status 404 returned error can't find the container with id e97d0e6c0a4e279d27508f343acde75fbb03c651de937358384d783d60e706b6
Jul 16 22:18:32.885047 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:18:32.885026    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d79e411_5d34_4159_b507_be3b54b5865f.slice/crio-70ef74c1547f1bf8af51bf6beeb9b5d1c15695828e00233e3d86423618af3bc2 WatchSource:0}: Error finding container 70ef74c1547f1bf8af51bf6beeb9b5d1c15695828e00233e3d86423618af3bc2: Status 404 returned error can't find the container with id 70ef74c1547f1bf8af51bf6beeb9b5d1c15695828e00233e3d86423618af3bc2
Jul 16 22:18:33.006183 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:33.006150    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86bdb8d5c6-kdd8l"
Jul 16 22:18:33.340921 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:33.340893    2552 scope.go:117] "RemoveContainer" containerID="f4f5a53a9c9afdc623265376a6496832accc0803450c60631ff046467d651bd5"
Jul 16 22:18:33.341114 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:18:33.341092    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-86bdb8d5c6-kdd8l_open-cluster-management-agent-addon(7efa7b74-0fd5-458b-89b3-ad1fc3b1493a)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86bdb8d5c6-kdd8l" podUID="7efa7b74-0fd5-458b-89b3-ad1fc3b1493a"
Jul 16 22:18:33.342078 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:33.342047    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-f62bz" event={"ID":"ff4f63ba-2036-4f92-a692-4be32674de91","Type":"ContainerStarted","Data":"e97d0e6c0a4e279d27508f343acde75fbb03c651de937358384d783d60e706b6"}
Jul 16 22:18:33.344298 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:33.344277    2552 generic.go:356] "Generic (PLEG): container finished" podID="153b8695-f585-4876-9a14-3489c3f9fa58" containerID="f14cf28c51ba39347c3ba3088aeb7faa8d9cfa296c08524cdcf3021078b137a7" exitCode=255
Jul 16 22:18:33.344403 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:33.344350    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8648d96ddb-qq8gr" event={"ID":"153b8695-f585-4876-9a14-3489c3f9fa58","Type":"ContainerDied","Data":"f14cf28c51ba39347c3ba3088aeb7faa8d9cfa296c08524cdcf3021078b137a7"}
Jul 16 22:18:33.344403 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:33.344388    2552 scope.go:117] "RemoveContainer" containerID="ebfade0f0838d886df020ce493c34b4903b4681d370363fed6da066204ac43f8"
Jul 16 22:18:33.344723 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:33.344669    2552 scope.go:117] "RemoveContainer" containerID="f14cf28c51ba39347c3ba3088aeb7faa8d9cfa296c08524cdcf3021078b137a7"
Jul 16 22:18:33.344880 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:18:33.344839    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-8648d96ddb-qq8gr_open-cluster-management-agent-addon(153b8695-f585-4876-9a14-3489c3f9fa58)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8648d96ddb-qq8gr" podUID="153b8695-f585-4876-9a14-3489c3f9fa58"
Jul 16 22:18:33.347086 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:33.347061    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-j246p" event={"ID":"dcd379a6-d615-4c6e-ba6d-ef0b93a174ff","Type":"ContainerStarted","Data":"2f35b957d75c6bd888f138c4120ed785fd60d2c63ebc2d419d66503bca2ec76f"}
Jul 16 22:18:33.348802 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:33.348748    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-564fbd977f-49gxl" event={"ID":"3bb158ab-7979-4010-aa22-e13370e73d78","Type":"ContainerStarted","Data":"783d64e244a263439aedc53fb8b1f485a634b751a74f2bc02f09c6ccc8825b56"}
Jul 16 22:18:33.348802 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:33.348794    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-564fbd977f-49gxl" event={"ID":"3bb158ab-7979-4010-aa22-e13370e73d78","Type":"ContainerStarted","Data":"5ac97677158d58d51d6e203ef8fb2596da9f7046c502b45fef3487b28a3ea0fc"}
Jul 16 22:18:33.349017 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:33.348820    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-564fbd977f-49gxl"
Jul 16 22:18:33.350585 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:33.350560    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-st98p" event={"ID":"0d79e411-5d34-4159-b507-be3b54b5865f","Type":"ContainerStarted","Data":"70ef74c1547f1bf8af51bf6beeb9b5d1c15695828e00233e3d86423618af3bc2"}
Jul 16 22:18:33.395827 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:33.395203    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-564fbd977f-49gxl" podStartSLOduration=287.395180632 podStartE2EDuration="4m47.395180632s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:13:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:18:33.378739498 +0000 UTC m=+287.593520658" watchObservedRunningTime="2026-07-16 22:18:33.395180632 +0000 UTC m=+287.609961793"
Jul 16 22:18:37.366725 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:37.366669    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-f62bz" event={"ID":"ff4f63ba-2036-4f92-a692-4be32674de91","Type":"ContainerStarted","Data":"8595edbe64f75f8df9749e73c57a9b490b1394af05105f47a5ba33a41f8ca3a9"}
Jul 16 22:18:37.369128 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:37.369097    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-j246p" event={"ID":"dcd379a6-d615-4c6e-ba6d-ef0b93a174ff","Type":"ContainerStarted","Data":"8afee0c2c0ab3ad54bcd3bd6a3fee4cc1d89148016fb11527547e1899c8f5828"}
Jul 16 22:18:37.371031 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:37.371004    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-st98p" event={"ID":"0d79e411-5d34-4159-b507-be3b54b5865f","Type":"ContainerStarted","Data":"43bb742eead557bc20d362774b035755c6dea299424a0549df72993105c36a13"}
Jul 16 22:18:37.371157 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:37.371052    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-st98p" event={"ID":"0d79e411-5d34-4159-b507-be3b54b5865f","Type":"ContainerStarted","Data":"b368ca5b7990b8017d8f67218eca5422676204cd40e99bc708c024e16cbe3299"}
Jul 16 22:18:37.371235 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:37.371207    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-st98p"
Jul 16 22:18:37.387964 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:37.387895    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-f62bz" podStartSLOduration=266.55325006 podStartE2EDuration="4m30.387881475s" totalImagesPullingTime="3.834631415s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:14:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:18:37.38691376 +0000 UTC m=+291.601694919" watchObservedRunningTime="2026-07-16 22:18:37.387881475 +0000 UTC m=+291.602662672"
Jul 16 22:18:37.407567 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:37.407522    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-st98p" podStartSLOduration=252.566826846 podStartE2EDuration="4m16.407509606s" totalImagesPullingTime="3.84068276s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:14:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:18:37.406647881 +0000 UTC m=+291.621429062" watchObservedRunningTime="2026-07-16 22:18:37.407509606 +0000 UTC m=+291.622290767"
Jul 16 22:18:40.271052 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:18:40.271007    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-zr4k5" podUID="0dea03c6-7be0-48e6-ad97-b245cbb3e76f"
Jul 16 22:18:41.388059 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:41.388021    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-j246p" event={"ID":"dcd379a6-d615-4c6e-ba6d-ef0b93a174ff","Type":"ContainerStarted","Data":"3390022e870cab5f4a24fd4f227ed58936080a987574b650e79a053fd119e90c"}
Jul 16 22:18:41.406765 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:41.406722    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-j246p" podStartSLOduration=17.671717506 podStartE2EDuration="30.406687184s" totalImagesPullingTime="12.734969678s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 22:18:11 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:18:41.40559867 +0000 UTC m=+295.620379829" watchObservedRunningTime="2026-07-16 22:18:41.406687184 +0000 UTC m=+295.621468343"
Jul 16 22:18:41.984347 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:41.984311    2552 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8648d96ddb-qq8gr"
Jul 16 22:18:41.984586 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:41.984571    2552 scope.go:117] "RemoveContainer" containerID="f14cf28c51ba39347c3ba3088aeb7faa8d9cfa296c08524cdcf3021078b137a7"
Jul 16 22:18:41.984729 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:18:41.984692    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-8648d96ddb-qq8gr_open-cluster-management-agent-addon(153b8695-f585-4876-9a14-3489c3f9fa58)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8648d96ddb-qq8gr" podUID="153b8695-f585-4876-9a14-3489c3f9fa58"
Jul 16 22:18:42.017844 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:42.017815    2552 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65775f88f-vrh7f" podUID="6dba2385-55b2-4b81-a603-3f6e433dd4ea" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 16 22:18:42.042927 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:42.042907    2552 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86bdb8d5c6-kdd8l"
Jul 16 22:18:42.043186 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:42.043174    2552 scope.go:117] "RemoveContainer" containerID="f4f5a53a9c9afdc623265376a6496832accc0803450c60631ff046467d651bd5"
Jul 16 22:18:42.043300 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:18:42.043285    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-86bdb8d5c6-kdd8l_open-cluster-management-agent-addon(7efa7b74-0fd5-458b-89b3-ad1fc3b1493a)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86bdb8d5c6-kdd8l" podUID="7efa7b74-0fd5-458b-89b3-ad1fc3b1493a"
Jul 16 22:18:46.062166 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:46.062135    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-lj9kv"]
Jul 16 22:18:46.065603 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:46.065581    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-lj9kv"
Jul 16 22:18:46.068946 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:46.068919    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-5n7ln\""
Jul 16 22:18:46.069463 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:46.069447    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 16 22:18:46.069549 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:46.069509    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 16 22:18:46.070153 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:46.070136    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 16 22:18:46.070267 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:46.070182    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 16 22:18:46.070267 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:46.070182    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 16 22:18:46.074467 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:46.074451    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 16 22:18:46.156759 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:46.156735    2552 kubelet.go:1648] "Image garbage collection succeeded"
Jul 16 22:18:46.162884 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:46.162861    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8cd7945c-2e95-4e5a-884c-34d976b1545a-node-exporter-textfile\") pod \"node-exporter-lj9kv\" (UID: \"8cd7945c-2e95-4e5a-884c-34d976b1545a\") " pod="openshift-monitoring/node-exporter-lj9kv"
Jul 16 22:18:46.162999 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:46.162889    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8cd7945c-2e95-4e5a-884c-34d976b1545a-node-exporter-wtmp\") pod \"node-exporter-lj9kv\" (UID: \"8cd7945c-2e95-4e5a-884c-34d976b1545a\") " pod="openshift-monitoring/node-exporter-lj9kv"
Jul 16 22:18:46.162999 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:46.162913    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8cd7945c-2e95-4e5a-884c-34d976b1545a-node-exporter-tls\") pod \"node-exporter-lj9kv\" (UID: \"8cd7945c-2e95-4e5a-884c-34d976b1545a\") " pod="openshift-monitoring/node-exporter-lj9kv"
Jul 16 22:18:46.162999 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:46.162969    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8cd7945c-2e95-4e5a-884c-34d976b1545a-metrics-client-ca\") pod \"node-exporter-lj9kv\" (UID: \"8cd7945c-2e95-4e5a-884c-34d976b1545a\") " pod="openshift-monitoring/node-exporter-lj9kv"
Jul 16 22:18:46.163124 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:46.163038    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8cd7945c-2e95-4e5a-884c-34d976b1545a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lj9kv\" (UID: \"8cd7945c-2e95-4e5a-884c-34d976b1545a\") " pod="openshift-monitoring/node-exporter-lj9kv"
Jul 16 22:18:46.163124 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:46.163071    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8cd7945c-2e95-4e5a-884c-34d976b1545a-sys\") pod \"node-exporter-lj9kv\" (UID: \"8cd7945c-2e95-4e5a-884c-34d976b1545a\") " pod="openshift-monitoring/node-exporter-lj9kv"
Jul 16 22:18:46.163124 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:46.163091    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8bk66\" (UniqueName: \"kubernetes.io/projected/8cd7945c-2e95-4e5a-884c-34d976b1545a-kube-api-access-8bk66\") pod \"node-exporter-lj9kv\" (UID: \"8cd7945c-2e95-4e5a-884c-34d976b1545a\") " pod="openshift-monitoring/node-exporter-lj9kv"
Jul 16 22:18:46.163124 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:46.163109    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8cd7945c-2e95-4e5a-884c-34d976b1545a-root\") pod \"node-exporter-lj9kv\" (UID: \"8cd7945c-2e95-4e5a-884c-34d976b1545a\") " pod="openshift-monitoring/node-exporter-lj9kv"
Jul 16 22:18:46.163237 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:46.163124    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8cd7945c-2e95-4e5a-884c-34d976b1545a-node-exporter-accelerators-collector-config\") pod \"node-exporter-lj9kv\" (UID: \"8cd7945c-2e95-4e5a-884c-34d976b1545a\") " pod="openshift-monitoring/node-exporter-lj9kv"
Jul 16 22:18:46.263731 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:46.263610    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8cd7945c-2e95-4e5a-884c-34d976b1545a-sys\") pod \"node-exporter-lj9kv\" (UID: \"8cd7945c-2e95-4e5a-884c-34d976b1545a\") " pod="openshift-monitoring/node-exporter-lj9kv"
Jul 16 22:18:46.263731 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:46.263640    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8bk66\" (UniqueName: \"kubernetes.io/projected/8cd7945c-2e95-4e5a-884c-34d976b1545a-kube-api-access-8bk66\") pod \"node-exporter-lj9kv\" (UID: \"8cd7945c-2e95-4e5a-884c-34d976b1545a\") " pod="openshift-monitoring/node-exporter-lj9kv"
Jul 16 22:18:46.263731 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:46.263656    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8cd7945c-2e95-4e5a-884c-34d976b1545a-root\") pod \"node-exporter-lj9kv\" (UID: \"8cd7945c-2e95-4e5a-884c-34d976b1545a\") " pod="openshift-monitoring/node-exporter-lj9kv"
Jul 16 22:18:46.263731 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:46.263678    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8cd7945c-2e95-4e5a-884c-34d976b1545a-node-exporter-accelerators-collector-config\") pod \"node-exporter-lj9kv\" (UID: \"8cd7945c-2e95-4e5a-884c-34d976b1545a\") " pod="openshift-monitoring/node-exporter-lj9kv"
Jul 16 22:18:46.283893 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:46.263747    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8cd7945c-2e95-4e5a-884c-34d976b1545a-root\") pod \"node-exporter-lj9kv\" (UID: \"8cd7945c-2e95-4e5a-884c-34d976b1545a\") " pod="openshift-monitoring/node-exporter-lj9kv"
Jul 16 22:18:46.283893 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:46.263759    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8cd7945c-2e95-4e5a-884c-34d976b1545a-sys\") pod \"node-exporter-lj9kv\" (UID: \"8cd7945c-2e95-4e5a-884c-34d976b1545a\") " pod="openshift-monitoring/node-exporter-lj9kv"
Jul 16 22:18:46.283893 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:46.263789    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8cd7945c-2e95-4e5a-884c-34d976b1545a-node-exporter-textfile\") pod \"node-exporter-lj9kv\" (UID: \"8cd7945c-2e95-4e5a-884c-34d976b1545a\") " pod="openshift-monitoring/node-exporter-lj9kv"
Jul 16 22:18:46.283893 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:46.263814    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8cd7945c-2e95-4e5a-884c-34d976b1545a-node-exporter-wtmp\") pod \"node-exporter-lj9kv\" (UID: \"8cd7945c-2e95-4e5a-884c-34d976b1545a\") " pod="openshift-monitoring/node-exporter-lj9kv"
Jul 16 22:18:46.283893 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:46.263857    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8cd7945c-2e95-4e5a-884c-34d976b1545a-node-exporter-tls\") pod \"node-exporter-lj9kv\" (UID: \"8cd7945c-2e95-4e5a-884c-34d976b1545a\") " pod="openshift-monitoring/node-exporter-lj9kv"
Jul 16 22:18:46.283893 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:46.263891    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8cd7945c-2e95-4e5a-884c-34d976b1545a-metrics-client-ca\") pod \"node-exporter-lj9kv\" (UID: \"8cd7945c-2e95-4e5a-884c-34d976b1545a\") " pod="openshift-monitoring/node-exporter-lj9kv"
Jul 16 22:18:46.283893 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:46.263914    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8cd7945c-2e95-4e5a-884c-34d976b1545a-node-exporter-wtmp\") pod \"node-exporter-lj9kv\" (UID: \"8cd7945c-2e95-4e5a-884c-34d976b1545a\") " pod="openshift-monitoring/node-exporter-lj9kv"
Jul 16 22:18:46.283893 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:46.263926    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8cd7945c-2e95-4e5a-884c-34d976b1545a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lj9kv\" (UID: \"8cd7945c-2e95-4e5a-884c-34d976b1545a\") " pod="openshift-monitoring/node-exporter-lj9kv"
Jul 16 22:18:46.283893 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:46.264086    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8cd7945c-2e95-4e5a-884c-34d976b1545a-node-exporter-textfile\") pod \"node-exporter-lj9kv\" (UID: \"8cd7945c-2e95-4e5a-884c-34d976b1545a\") " pod="openshift-monitoring/node-exporter-lj9kv"
Jul 16 22:18:46.283893 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:46.266754    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 16 22:18:46.283893 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:46.266835    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 16 22:18:46.283893 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:46.267029    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 16 22:18:46.283893 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:46.267384    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 16 22:18:46.283893 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:46.273433    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 16 22:18:46.283893 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:46.274529    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8cd7945c-2e95-4e5a-884c-34d976b1545a-metrics-client-ca\") pod \"node-exporter-lj9kv\" (UID: \"8cd7945c-2e95-4e5a-884c-34d976b1545a\") " pod="openshift-monitoring/node-exporter-lj9kv"
Jul 16 22:18:46.283893 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:46.274755    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8cd7945c-2e95-4e5a-884c-34d976b1545a-node-exporter-accelerators-collector-config\") pod \"node-exporter-lj9kv\" (UID: \"8cd7945c-2e95-4e5a-884c-34d976b1545a\") " pod="openshift-monitoring/node-exporter-lj9kv"
Jul 16 22:18:46.283893 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:46.276194    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8cd7945c-2e95-4e5a-884c-34d976b1545a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lj9kv\" (UID: \"8cd7945c-2e95-4e5a-884c-34d976b1545a\") " pod="openshift-monitoring/node-exporter-lj9kv"
Jul 16 22:18:46.284403 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:46.276361    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8cd7945c-2e95-4e5a-884c-34d976b1545a-node-exporter-tls\") pod \"node-exporter-lj9kv\" (UID: \"8cd7945c-2e95-4e5a-884c-34d976b1545a\") " pod="openshift-monitoring/node-exporter-lj9kv"
Jul 16 22:18:46.286120 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:46.286104    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 16 22:18:46.293460 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:46.293443    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8bk66\" (UniqueName: \"kubernetes.io/projected/8cd7945c-2e95-4e5a-884c-34d976b1545a-kube-api-access-8bk66\") pod \"node-exporter-lj9kv\" (UID: \"8cd7945c-2e95-4e5a-884c-34d976b1545a\") " pod="openshift-monitoring/node-exporter-lj9kv"
Jul 16 22:18:46.376910 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:46.376864    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-5n7ln\""
Jul 16 22:18:46.385029 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:46.385011    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-lj9kv"
Jul 16 22:18:46.394340 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:18:46.394318    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8cd7945c_2e95_4e5a_884c_34d976b1545a.slice/crio-86655326154a6c27f3e0600162dacfd1d8c18191a4edaf9163278ba5620c38f6 WatchSource:0}: Error finding container 86655326154a6c27f3e0600162dacfd1d8c18191a4edaf9163278ba5620c38f6: Status 404 returned error can't find the container with id 86655326154a6c27f3e0600162dacfd1d8c18191a4edaf9163278ba5620c38f6
Jul 16 22:18:46.404421 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:46.404392    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lj9kv" event={"ID":"8cd7945c-2e95-4e5a-884c-34d976b1545a","Type":"ContainerStarted","Data":"86655326154a6c27f3e0600162dacfd1d8c18191a4edaf9163278ba5620c38f6"}
Jul 16 22:18:47.376395 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:47.376364    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-st98p"
Jul 16 22:18:48.412033 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:48.412005    2552 generic.go:356] "Generic (PLEG): container finished" podID="8cd7945c-2e95-4e5a-884c-34d976b1545a" containerID="6a6fac1e32ed696de5b8933b2a3d61ca6f891b70bea4ada5b23bb89856a426a2" exitCode=0
Jul 16 22:18:48.412391 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:48.412082    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lj9kv" event={"ID":"8cd7945c-2e95-4e5a-884c-34d976b1545a","Type":"ContainerDied","Data":"6a6fac1e32ed696de5b8933b2a3d61ca6f891b70bea4ada5b23bb89856a426a2"}
Jul 16 22:18:49.417554 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:49.417518    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lj9kv" event={"ID":"8cd7945c-2e95-4e5a-884c-34d976b1545a","Type":"ContainerStarted","Data":"6bc2627682e8d647d08aab22917f926834a3bbfc06024cea7ff108c09c1d04ba"}
Jul 16 22:18:49.417928 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:49.417577    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lj9kv" event={"ID":"8cd7945c-2e95-4e5a-884c-34d976b1545a","Type":"ContainerStarted","Data":"2dda616ba10ac2df281800f530953d524ac4d1d66c7e3bc938c2e4b8deeddd37"}
Jul 16 22:18:49.437839 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:49.437793    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-lj9kv" podStartSLOduration=2.071425102 podStartE2EDuration="3.437778753s" totalImagesPullingTime="1.305636685s" totalInitContainerRuntime="60.716966ms" isStatefulPod=true podCreationTimestamp="2026-07-16 22:18:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:18:49.436538402 +0000 UTC m=+303.651319562" watchObservedRunningTime="2026-07-16 22:18:49.437778753 +0000 UTC m=+303.652559963"
Jul 16 22:18:51.636188 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:51.636153    2552 patch_prober.go:28] interesting pod/image-registry-564fbd977f-49gxl container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 16 22:18:51.636566 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:51.636206    2552 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-564fbd977f-49gxl" podUID="3bb158ab-7979-4010-aa22-e13370e73d78" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 16 22:18:52.017556 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:52.017520    2552 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65775f88f-vrh7f" podUID="6dba2385-55b2-4b81-a603-3f6e433dd4ea" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 16 22:18:53.269850 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:53.269821    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zr4k5"
Jul 16 22:18:54.271112 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:54.271084    2552 scope.go:117] "RemoveContainer" containerID="f14cf28c51ba39347c3ba3088aeb7faa8d9cfa296c08524cdcf3021078b137a7"
Jul 16 22:18:54.359226 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:54.359205    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-564fbd977f-49gxl"
Jul 16 22:18:55.270308 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:55.270280    2552 scope.go:117] "RemoveContainer" containerID="f4f5a53a9c9afdc623265376a6496832accc0803450c60631ff046467d651bd5"
Jul 16 22:18:55.437400 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:55.437370    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86bdb8d5c6-kdd8l" event={"ID":"7efa7b74-0fd5-458b-89b3-ad1fc3b1493a","Type":"ContainerStarted","Data":"cbecb6178625bc7a9c25749b220e3bf1ffeb89d40d11bf5b8a5d3bae333025c8"}
Jul 16 22:18:55.437844 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:55.437654    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86bdb8d5c6-kdd8l"
Jul 16 22:18:55.438903 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:55.438883    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86bdb8d5c6-kdd8l"
Jul 16 22:18:55.439141 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:18:55.439123    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8648d96ddb-qq8gr" event={"ID":"153b8695-f585-4876-9a14-3489c3f9fa58","Type":"ContainerStarted","Data":"a810cf0c5ea4981a5d670707915c6d7748beadce0d261d8c9c10fb7f008dc16e"}
Jul 16 22:19:01.462474 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:19:01.462442    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-564fbd977f-49gxl"]
Jul 16 22:19:02.017233 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:19:02.017192    2552 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65775f88f-vrh7f" podUID="6dba2385-55b2-4b81-a603-3f6e433dd4ea" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 16 22:19:02.017376 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:19:02.017253    2552 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65775f88f-vrh7f"
Jul 16 22:19:02.017730 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:19:02.017678    2552 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"c328c20ee9c56158bad3d9d94d0aefd594a9fb4e21ea7fe355d2bcb0fc012cc1"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65775f88f-vrh7f" containerMessage="Container service-proxy failed liveness probe, will be restarted"
Jul 16 22:19:02.017778 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:19:02.017751    2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65775f88f-vrh7f" podUID="6dba2385-55b2-4b81-a603-3f6e433dd4ea" containerName="service-proxy" containerID="cri-o://c328c20ee9c56158bad3d9d94d0aefd594a9fb4e21ea7fe355d2bcb0fc012cc1" gracePeriod=30
Jul 16 22:19:02.464882 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:19:02.464853    2552 generic.go:356] "Generic (PLEG): container finished" podID="6dba2385-55b2-4b81-a603-3f6e433dd4ea" containerID="c328c20ee9c56158bad3d9d94d0aefd594a9fb4e21ea7fe355d2bcb0fc012cc1" exitCode=2
Jul 16 22:19:02.465239 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:19:02.464920    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65775f88f-vrh7f" event={"ID":"6dba2385-55b2-4b81-a603-3f6e433dd4ea","Type":"ContainerDied","Data":"c328c20ee9c56158bad3d9d94d0aefd594a9fb4e21ea7fe355d2bcb0fc012cc1"}
Jul 16 22:19:02.465239 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:19:02.464968    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65775f88f-vrh7f" event={"ID":"6dba2385-55b2-4b81-a603-3f6e433dd4ea","Type":"ContainerStarted","Data":"8ccc57b371c57c3bec38b378212cf5809e40f146bb1ee08f914876ec5d7a8f1d"}
Jul 16 22:19:26.487497 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:19:26.487444    2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-564fbd977f-49gxl" podUID="3bb158ab-7979-4010-aa22-e13370e73d78" containerName="registry" containerID="cri-o://783d64e244a263439aedc53fb8b1f485a634b751a74f2bc02f09c6ccc8825b56" gracePeriod=30
Jul 16 22:19:26.729805 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:19:26.729785    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-564fbd977f-49gxl"
Jul 16 22:19:26.827212 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:19:26.827159    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3bb158ab-7979-4010-aa22-e13370e73d78-registry-tls\") pod \"3bb158ab-7979-4010-aa22-e13370e73d78\" (UID: \"3bb158ab-7979-4010-aa22-e13370e73d78\") "
Jul 16 22:19:26.827212 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:19:26.827201    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3bb158ab-7979-4010-aa22-e13370e73d78-bound-sa-token\") pod \"3bb158ab-7979-4010-aa22-e13370e73d78\" (UID: \"3bb158ab-7979-4010-aa22-e13370e73d78\") "
Jul 16 22:19:26.827362 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:19:26.827221    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3bb158ab-7979-4010-aa22-e13370e73d78-registry-certificates\") pod \"3bb158ab-7979-4010-aa22-e13370e73d78\" (UID: \"3bb158ab-7979-4010-aa22-e13370e73d78\") "
Jul 16 22:19:26.827362 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:19:26.827239    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c527g\" (UniqueName: \"kubernetes.io/projected/3bb158ab-7979-4010-aa22-e13370e73d78-kube-api-access-c527g\") pod \"3bb158ab-7979-4010-aa22-e13370e73d78\" (UID: \"3bb158ab-7979-4010-aa22-e13370e73d78\") "
Jul 16 22:19:26.827362 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:19:26.827262    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3bb158ab-7979-4010-aa22-e13370e73d78-image-registry-private-configuration\") pod \"3bb158ab-7979-4010-aa22-e13370e73d78\" (UID: \"3bb158ab-7979-4010-aa22-e13370e73d78\") "
Jul 16 22:19:26.827362 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:19:26.827294    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3bb158ab-7979-4010-aa22-e13370e73d78-trusted-ca\") pod \"3bb158ab-7979-4010-aa22-e13370e73d78\" (UID: \"3bb158ab-7979-4010-aa22-e13370e73d78\") "
Jul 16 22:19:26.827362 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:19:26.827339    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3bb158ab-7979-4010-aa22-e13370e73d78-ca-trust-extracted\") pod \"3bb158ab-7979-4010-aa22-e13370e73d78\" (UID: \"3bb158ab-7979-4010-aa22-e13370e73d78\") "
Jul 16 22:19:26.827579 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:19:26.827381    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3bb158ab-7979-4010-aa22-e13370e73d78-installation-pull-secrets\") pod \"3bb158ab-7979-4010-aa22-e13370e73d78\" (UID: \"3bb158ab-7979-4010-aa22-e13370e73d78\") "
Jul 16 22:19:26.827743 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:19:26.827672    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3bb158ab-7979-4010-aa22-e13370e73d78-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "3bb158ab-7979-4010-aa22-e13370e73d78" (UID: "3bb158ab-7979-4010-aa22-e13370e73d78"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 22:19:26.827927 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:19:26.827890    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3bb158ab-7979-4010-aa22-e13370e73d78-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "3bb158ab-7979-4010-aa22-e13370e73d78" (UID: "3bb158ab-7979-4010-aa22-e13370e73d78"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 22:19:26.829833 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:19:26.829791    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3bb158ab-7979-4010-aa22-e13370e73d78-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "3bb158ab-7979-4010-aa22-e13370e73d78" (UID: "3bb158ab-7979-4010-aa22-e13370e73d78"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 22:19:26.829929 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:19:26.829854    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3bb158ab-7979-4010-aa22-e13370e73d78-kube-api-access-c527g" (OuterVolumeSpecName: "kube-api-access-c527g") pod "3bb158ab-7979-4010-aa22-e13370e73d78" (UID: "3bb158ab-7979-4010-aa22-e13370e73d78"). InnerVolumeSpecName "kube-api-access-c527g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:19:26.829929 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:19:26.829861    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3bb158ab-7979-4010-aa22-e13370e73d78-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "3bb158ab-7979-4010-aa22-e13370e73d78" (UID: "3bb158ab-7979-4010-aa22-e13370e73d78"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 22:19:26.830020 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:19:26.829959    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3bb158ab-7979-4010-aa22-e13370e73d78-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "3bb158ab-7979-4010-aa22-e13370e73d78" (UID: "3bb158ab-7979-4010-aa22-e13370e73d78"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:19:26.830020 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:19:26.829965    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3bb158ab-7979-4010-aa22-e13370e73d78-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "3bb158ab-7979-4010-aa22-e13370e73d78" (UID: "3bb158ab-7979-4010-aa22-e13370e73d78"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:19:26.836398 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:19:26.836374    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3bb158ab-7979-4010-aa22-e13370e73d78-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "3bb158ab-7979-4010-aa22-e13370e73d78" (UID: "3bb158ab-7979-4010-aa22-e13370e73d78"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:19:26.928646 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:19:26.928625    2552 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3bb158ab-7979-4010-aa22-e13370e73d78-installation-pull-secrets\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 16 22:19:26.928646 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:19:26.928644    2552 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3bb158ab-7979-4010-aa22-e13370e73d78-registry-tls\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 16 22:19:26.928778 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:19:26.928653    2552 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3bb158ab-7979-4010-aa22-e13370e73d78-bound-sa-token\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 16 22:19:26.928778 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:19:26.928660    2552 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3bb158ab-7979-4010-aa22-e13370e73d78-registry-certificates\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 16 22:19:26.928778 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:19:26.928669    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c527g\" (UniqueName: \"kubernetes.io/projected/3bb158ab-7979-4010-aa22-e13370e73d78-kube-api-access-c527g\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 16 22:19:26.928778 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:19:26.928677    2552 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3bb158ab-7979-4010-aa22-e13370e73d78-image-registry-private-configuration\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 16 22:19:26.928778 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:19:26.928686    2552 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3bb158ab-7979-4010-aa22-e13370e73d78-trusted-ca\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 16 22:19:26.928778 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:19:26.928710    2552 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3bb158ab-7979-4010-aa22-e13370e73d78-ca-trust-extracted\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 16 22:19:27.540685 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:19:27.540651    2552 generic.go:356] "Generic (PLEG): container finished" podID="3bb158ab-7979-4010-aa22-e13370e73d78" containerID="783d64e244a263439aedc53fb8b1f485a634b751a74f2bc02f09c6ccc8825b56" exitCode=0
Jul 16 22:19:27.541088 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:19:27.540714    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-564fbd977f-49gxl"
Jul 16 22:19:27.541088 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:19:27.540738    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-564fbd977f-49gxl" event={"ID":"3bb158ab-7979-4010-aa22-e13370e73d78","Type":"ContainerDied","Data":"783d64e244a263439aedc53fb8b1f485a634b751a74f2bc02f09c6ccc8825b56"}
Jul 16 22:19:27.541088 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:19:27.540794    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-564fbd977f-49gxl" event={"ID":"3bb158ab-7979-4010-aa22-e13370e73d78","Type":"ContainerDied","Data":"5ac97677158d58d51d6e203ef8fb2596da9f7046c502b45fef3487b28a3ea0fc"}
Jul 16 22:19:27.541088 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:19:27.540821    2552 scope.go:117] "RemoveContainer" containerID="783d64e244a263439aedc53fb8b1f485a634b751a74f2bc02f09c6ccc8825b56"
Jul 16 22:19:27.548456 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:19:27.548431    2552 scope.go:117] "RemoveContainer" containerID="783d64e244a263439aedc53fb8b1f485a634b751a74f2bc02f09c6ccc8825b56"
Jul 16 22:19:27.548826 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:19:27.548802    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"783d64e244a263439aedc53fb8b1f485a634b751a74f2bc02f09c6ccc8825b56\": container with ID starting with 783d64e244a263439aedc53fb8b1f485a634b751a74f2bc02f09c6ccc8825b56 not found: ID does not exist" containerID="783d64e244a263439aedc53fb8b1f485a634b751a74f2bc02f09c6ccc8825b56"
Jul 16 22:19:27.548917 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:19:27.548836    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"783d64e244a263439aedc53fb8b1f485a634b751a74f2bc02f09c6ccc8825b56"} err="failed to get container status \"783d64e244a263439aedc53fb8b1f485a634b751a74f2bc02f09c6ccc8825b56\": rpc error: code = NotFound desc = could not find container \"783d64e244a263439aedc53fb8b1f485a634b751a74f2bc02f09c6ccc8825b56\": container with ID starting with 783d64e244a263439aedc53fb8b1f485a634b751a74f2bc02f09c6ccc8825b56 not found: ID does not exist"
Jul 16 22:19:27.561939 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:19:27.561895    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-564fbd977f-49gxl"]
Jul 16 22:19:27.565412 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:19:27.565393    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-564fbd977f-49gxl"]
Jul 16 22:19:28.274607 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:19:28.274581    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3bb158ab-7979-4010-aa22-e13370e73d78" path="/var/lib/kubelet/pods/3bb158ab-7979-4010-aa22-e13370e73d78/volumes"
Jul 16 22:20:00.042578 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:20:00.042544    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0dea03c6-7be0-48e6-ad97-b245cbb3e76f-metrics-certs\") pod \"network-metrics-daemon-zr4k5\" (UID: \"0dea03c6-7be0-48e6-ad97-b245cbb3e76f\") " pod="openshift-multus/network-metrics-daemon-zr4k5"
Jul 16 22:20:00.044771 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:20:00.044742    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0dea03c6-7be0-48e6-ad97-b245cbb3e76f-metrics-certs\") pod \"network-metrics-daemon-zr4k5\" (UID: \"0dea03c6-7be0-48e6-ad97-b245cbb3e76f\") " pod="openshift-multus/network-metrics-daemon-zr4k5"
Jul 16 22:20:00.173901 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:20:00.173877    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-7sbmm\""
Jul 16 22:20:00.181241 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:20:00.181219    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zr4k5"
Jul 16 22:20:00.304998 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:20:00.304874    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zr4k5"]
Jul 16 22:20:00.307425 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:20:00.307396    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0dea03c6_7be0_48e6_ad97_b245cbb3e76f.slice/crio-3a3ca775d371c3fce8477554bd6228af85b0784c457a55a870da62dc8bb238cd WatchSource:0}: Error finding container 3a3ca775d371c3fce8477554bd6228af85b0784c457a55a870da62dc8bb238cd: Status 404 returned error can't find the container with id 3a3ca775d371c3fce8477554bd6228af85b0784c457a55a870da62dc8bb238cd
Jul 16 22:20:00.309263 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:20:00.309243    2552 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 16 22:20:00.644283 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:20:00.644216    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zr4k5" event={"ID":"0dea03c6-7be0-48e6-ad97-b245cbb3e76f","Type":"ContainerStarted","Data":"3a3ca775d371c3fce8477554bd6228af85b0784c457a55a870da62dc8bb238cd"}
Jul 16 22:20:01.648916 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:20:01.648831    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zr4k5" event={"ID":"0dea03c6-7be0-48e6-ad97-b245cbb3e76f","Type":"ContainerStarted","Data":"cb376f7288accf4e02423c8effcef2b9ded4e070d966c983e4d95baa69734384"}
Jul 16 22:20:01.649247 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:20:01.648920    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zr4k5" event={"ID":"0dea03c6-7be0-48e6-ad97-b245cbb3e76f","Type":"ContainerStarted","Data":"2373c5ebeaea4ee4449ef65b61260e1209b2a1f788a3252f21164ee2edfcc30c"}
Jul 16 22:20:01.667330 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:20:01.667287    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-zr4k5" podStartSLOduration=374.667829915 podStartE2EDuration="6m15.667274484s" totalImagesPullingTime="999.444569ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:13:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:20:01.665676313 +0000 UTC m=+375.880457474" watchObservedRunningTime="2026-07-16 22:20:01.667274484 +0000 UTC m=+375.882055643"
Jul 16 22:21:23.554604 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:21:23.554575    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl5j6b"]
Jul 16 22:21:23.555035 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:21:23.554793    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3bb158ab-7979-4010-aa22-e13370e73d78" containerName="registry"
Jul 16 22:21:23.555035 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:21:23.554804    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="3bb158ab-7979-4010-aa22-e13370e73d78" containerName="registry"
Jul 16 22:21:23.555035 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:21:23.554852    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="3bb158ab-7979-4010-aa22-e13370e73d78" containerName="registry"
Jul 16 22:21:23.557674 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:21:23.557657    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl5j6b"
Jul 16 22:21:23.560691 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:21:23.560668    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 16 22:21:23.560813 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:21:23.560721    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-nqpbq\""
Jul 16 22:21:23.561716 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:21:23.561685    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 16 22:21:23.568975 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:21:23.568956    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl5j6b"]
Jul 16 22:21:23.685317 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:21:23.685294    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/536653de-307c-40d1-8d98-4c8779bcdc89-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl5j6b\" (UID: \"536653de-307c-40d1-8d98-4c8779bcdc89\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl5j6b"
Jul 16 22:21:23.685423 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:21:23.685322    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q25pc\" (UniqueName: \"kubernetes.io/projected/536653de-307c-40d1-8d98-4c8779bcdc89-kube-api-access-q25pc\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl5j6b\" (UID: \"536653de-307c-40d1-8d98-4c8779bcdc89\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl5j6b"
Jul 16 22:21:23.685423 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:21:23.685359    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/536653de-307c-40d1-8d98-4c8779bcdc89-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl5j6b\" (UID: \"536653de-307c-40d1-8d98-4c8779bcdc89\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl5j6b"
Jul 16 22:21:23.786618 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:21:23.786595    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/536653de-307c-40d1-8d98-4c8779bcdc89-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl5j6b\" (UID: \"536653de-307c-40d1-8d98-4c8779bcdc89\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl5j6b"
Jul 16 22:21:23.786692 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:21:23.786634    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/536653de-307c-40d1-8d98-4c8779bcdc89-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl5j6b\" (UID: \"536653de-307c-40d1-8d98-4c8779bcdc89\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl5j6b"
Jul 16 22:21:23.786692 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:21:23.786654    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q25pc\" (UniqueName: \"kubernetes.io/projected/536653de-307c-40d1-8d98-4c8779bcdc89-kube-api-access-q25pc\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl5j6b\" (UID: \"536653de-307c-40d1-8d98-4c8779bcdc89\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl5j6b"
Jul 16 22:21:23.786988 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:21:23.786970    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/536653de-307c-40d1-8d98-4c8779bcdc89-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl5j6b\" (UID: \"536653de-307c-40d1-8d98-4c8779bcdc89\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl5j6b"
Jul 16 22:21:23.787051 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:21:23.787005    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/536653de-307c-40d1-8d98-4c8779bcdc89-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl5j6b\" (UID: \"536653de-307c-40d1-8d98-4c8779bcdc89\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl5j6b"
Jul 16 22:21:23.797007 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:21:23.796988    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q25pc\" (UniqueName: \"kubernetes.io/projected/536653de-307c-40d1-8d98-4c8779bcdc89-kube-api-access-q25pc\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl5j6b\" (UID: \"536653de-307c-40d1-8d98-4c8779bcdc89\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl5j6b"
Jul 16 22:21:23.866616 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:21:23.866566    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl5j6b"
Jul 16 22:21:23.987105 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:21:23.987077    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl5j6b"]
Jul 16 22:21:23.990286 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:21:23.990262    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod536653de_307c_40d1_8d98_4c8779bcdc89.slice/crio-7c8d4a62df5f4e8cdac3379268c5a1f2e9f345685bd230c1b865c035a6c44e7d WatchSource:0}: Error finding container 7c8d4a62df5f4e8cdac3379268c5a1f2e9f345685bd230c1b865c035a6c44e7d: Status 404 returned error can't find the container with id 7c8d4a62df5f4e8cdac3379268c5a1f2e9f345685bd230c1b865c035a6c44e7d
Jul 16 22:21:24.911189 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:21:24.911157    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl5j6b" event={"ID":"536653de-307c-40d1-8d98-4c8779bcdc89","Type":"ContainerStarted","Data":"7c8d4a62df5f4e8cdac3379268c5a1f2e9f345685bd230c1b865c035a6c44e7d"}
Jul 16 22:21:31.936465 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:21:31.936433    2552 generic.go:356] "Generic (PLEG): container finished" podID="536653de-307c-40d1-8d98-4c8779bcdc89" containerID="c7240b928ecaa95695e3ff2cd3663649574435f8c4cc0b53c2dcdf3a3187ea28" exitCode=0
Jul 16 22:21:31.936883 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:21:31.936502    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl5j6b" event={"ID":"536653de-307c-40d1-8d98-4c8779bcdc89","Type":"ContainerDied","Data":"c7240b928ecaa95695e3ff2cd3663649574435f8c4cc0b53c2dcdf3a3187ea28"}
Jul 16 22:21:33.945563 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:21:33.945503    2552 generic.go:356] "Generic (PLEG): container finished" podID="536653de-307c-40d1-8d98-4c8779bcdc89" containerID="0441766b7d38a87ccc149699004b1da5e1af285c8c0fd6db5139be87c1c2d934" exitCode=0
Jul 16 22:21:33.945915 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:21:33.945595    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl5j6b" event={"ID":"536653de-307c-40d1-8d98-4c8779bcdc89","Type":"ContainerDied","Data":"0441766b7d38a87ccc149699004b1da5e1af285c8c0fd6db5139be87c1c2d934"}
Jul 16 22:21:41.978100 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:21:41.978069    2552 generic.go:356] "Generic (PLEG): container finished" podID="536653de-307c-40d1-8d98-4c8779bcdc89" containerID="410a67bdb01f171c093c9efb71eefb441c13ed2f4c607bd28a4453bdef4c9f91" exitCode=0
Jul 16 22:21:41.978474 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:21:41.978157    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl5j6b" event={"ID":"536653de-307c-40d1-8d98-4c8779bcdc89","Type":"ContainerDied","Data":"410a67bdb01f171c093c9efb71eefb441c13ed2f4c607bd28a4453bdef4c9f91"}
Jul 16 22:21:43.101547 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:21:43.101526    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl5j6b"
Jul 16 22:21:43.217420 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:21:43.217395    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/536653de-307c-40d1-8d98-4c8779bcdc89-util\") pod \"536653de-307c-40d1-8d98-4c8779bcdc89\" (UID: \"536653de-307c-40d1-8d98-4c8779bcdc89\") "
Jul 16 22:21:43.217540 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:21:43.217456    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/536653de-307c-40d1-8d98-4c8779bcdc89-bundle\") pod \"536653de-307c-40d1-8d98-4c8779bcdc89\" (UID: \"536653de-307c-40d1-8d98-4c8779bcdc89\") "
Jul 16 22:21:43.217540 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:21:43.217476    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q25pc\" (UniqueName: \"kubernetes.io/projected/536653de-307c-40d1-8d98-4c8779bcdc89-kube-api-access-q25pc\") pod \"536653de-307c-40d1-8d98-4c8779bcdc89\" (UID: \"536653de-307c-40d1-8d98-4c8779bcdc89\") "
Jul 16 22:21:43.217834 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:21:43.217811    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/536653de-307c-40d1-8d98-4c8779bcdc89-bundle" (OuterVolumeSpecName: "bundle") pod "536653de-307c-40d1-8d98-4c8779bcdc89" (UID: "536653de-307c-40d1-8d98-4c8779bcdc89"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:21:43.219581 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:21:43.219558    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/536653de-307c-40d1-8d98-4c8779bcdc89-kube-api-access-q25pc" (OuterVolumeSpecName: "kube-api-access-q25pc") pod "536653de-307c-40d1-8d98-4c8779bcdc89" (UID: "536653de-307c-40d1-8d98-4c8779bcdc89"). InnerVolumeSpecName "kube-api-access-q25pc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:21:43.223918 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:21:43.223894    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/536653de-307c-40d1-8d98-4c8779bcdc89-util" (OuterVolumeSpecName: "util") pod "536653de-307c-40d1-8d98-4c8779bcdc89" (UID: "536653de-307c-40d1-8d98-4c8779bcdc89"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:21:43.318738 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:21:43.318680    2552 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/536653de-307c-40d1-8d98-4c8779bcdc89-util\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 16 22:21:43.318738 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:21:43.318716    2552 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/536653de-307c-40d1-8d98-4c8779bcdc89-bundle\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 16 22:21:43.318738 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:21:43.318730    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q25pc\" (UniqueName: \"kubernetes.io/projected/536653de-307c-40d1-8d98-4c8779bcdc89-kube-api-access-q25pc\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 16 22:21:43.985834 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:21:43.985805    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl5j6b" event={"ID":"536653de-307c-40d1-8d98-4c8779bcdc89","Type":"ContainerDied","Data":"7c8d4a62df5f4e8cdac3379268c5a1f2e9f345685bd230c1b865c035a6c44e7d"}
Jul 16 22:21:43.985952 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:21:43.985846    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl5j6b"
Jul 16 22:21:43.985952 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:21:43.985854    2552 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7c8d4a62df5f4e8cdac3379268c5a1f2e9f345685bd230c1b865c035a6c44e7d"
Jul 16 22:21:47.771239 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:21:47.771206    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-k67tq"]
Jul 16 22:21:47.771680 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:21:47.771434    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="536653de-307c-40d1-8d98-4c8779bcdc89" containerName="pull"
Jul 16 22:21:47.771680 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:21:47.771445    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="536653de-307c-40d1-8d98-4c8779bcdc89" containerName="pull"
Jul 16 22:21:47.771680 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:21:47.771455    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="536653de-307c-40d1-8d98-4c8779bcdc89" containerName="util"
Jul 16 22:21:47.771680 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:21:47.771460    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="536653de-307c-40d1-8d98-4c8779bcdc89" containerName="util"
Jul 16 22:21:47.771680 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:21:47.771467    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="536653de-307c-40d1-8d98-4c8779bcdc89" containerName="extract"
Jul 16 22:21:47.771680 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:21:47.771472    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="536653de-307c-40d1-8d98-4c8779bcdc89" containerName="extract"
Jul 16 22:21:47.771680 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:21:47.771519    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="536653de-307c-40d1-8d98-4c8779bcdc89" containerName="extract"
Jul 16 22:21:47.818105 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:21:47.818081    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-k67tq"]
Jul 16 22:21:47.818224 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:21:47.818164    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-k67tq"
Jul 16 22:21:47.820808 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:21:47.820788    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 16 22:21:47.820941 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:21:47.820922    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 16 22:21:47.821936 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:21:47.821916    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-gm446\""
Jul 16 22:21:47.946589 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:21:47.946566    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/53bceff6-64ea-4c27-9110-2c6e47fe421c-tmp\") pod \"openshift-lws-operator-fd8ccff4c-k67tq\" (UID: \"53bceff6-64ea-4c27-9110-2c6e47fe421c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-k67tq"
Jul 16 22:21:47.946682 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:21:47.946593    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qj5s8\" (UniqueName: \"kubernetes.io/projected/53bceff6-64ea-4c27-9110-2c6e47fe421c-kube-api-access-qj5s8\") pod \"openshift-lws-operator-fd8ccff4c-k67tq\" (UID: \"53bceff6-64ea-4c27-9110-2c6e47fe421c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-k67tq"
Jul 16 22:21:48.047755 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:21:48.047704    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/53bceff6-64ea-4c27-9110-2c6e47fe421c-tmp\") pod \"openshift-lws-operator-fd8ccff4c-k67tq\" (UID: \"53bceff6-64ea-4c27-9110-2c6e47fe421c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-k67tq"
Jul 16 22:21:48.047755 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:21:48.047737    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qj5s8\" (UniqueName: \"kubernetes.io/projected/53bceff6-64ea-4c27-9110-2c6e47fe421c-kube-api-access-qj5s8\") pod \"openshift-lws-operator-fd8ccff4c-k67tq\" (UID: \"53bceff6-64ea-4c27-9110-2c6e47fe421c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-k67tq"
Jul 16 22:21:48.048001 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:21:48.047983    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/53bceff6-64ea-4c27-9110-2c6e47fe421c-tmp\") pod \"openshift-lws-operator-fd8ccff4c-k67tq\" (UID: \"53bceff6-64ea-4c27-9110-2c6e47fe421c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-k67tq"
Jul 16 22:21:48.058343 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:21:48.058322    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qj5s8\" (UniqueName: \"kubernetes.io/projected/53bceff6-64ea-4c27-9110-2c6e47fe421c-kube-api-access-qj5s8\") pod \"openshift-lws-operator-fd8ccff4c-k67tq\" (UID: \"53bceff6-64ea-4c27-9110-2c6e47fe421c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-k67tq"
Jul 16 22:21:48.126464 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:21:48.126443    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-k67tq"
Jul 16 22:21:48.261648 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:21:48.261605    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-k67tq"]
Jul 16 22:21:48.264283 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:21:48.264257    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod53bceff6_64ea_4c27_9110_2c6e47fe421c.slice/crio-aeaff6079bcfed4389c1ab6ae4125396ecda4bea621bb28d782cf994a3a83e83 WatchSource:0}: Error finding container aeaff6079bcfed4389c1ab6ae4125396ecda4bea621bb28d782cf994a3a83e83: Status 404 returned error can't find the container with id aeaff6079bcfed4389c1ab6ae4125396ecda4bea621bb28d782cf994a3a83e83
Jul 16 22:21:49.001938 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:21:49.001909    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-k67tq" event={"ID":"53bceff6-64ea-4c27-9110-2c6e47fe421c","Type":"ContainerStarted","Data":"aeaff6079bcfed4389c1ab6ae4125396ecda4bea621bb28d782cf994a3a83e83"}
Jul 16 22:21:51.011319 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:21:51.011286    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-k67tq" event={"ID":"53bceff6-64ea-4c27-9110-2c6e47fe421c","Type":"ContainerStarted","Data":"5431dae9e6137b600f36185f420f91f5442b0e8d0a457febc333b4af187739cb"}
Jul 16 22:21:51.028269 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:21:51.028224    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-k67tq" podStartSLOduration=2.213320552 podStartE2EDuration="4.028208198s" totalImagesPullingTime="1.814887646s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:21:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:21:51.027247416 +0000 UTC m=+485.242028575" watchObservedRunningTime="2026-07-16 22:21:51.028208198 +0000 UTC m=+485.242989357"
Jul 16 22:21:53.662647 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:21:53.662615    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8p5b2"]
Jul 16 22:21:53.664746 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:21:53.664730    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8p5b2"
Jul 16 22:21:53.667181 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:21:53.667150    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 16 22:21:53.668133 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:21:53.668110    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-nqpbq\""
Jul 16 22:21:53.668267 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:21:53.668110    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 16 22:21:53.674857 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:21:53.674838    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8p5b2"]
Jul 16 22:21:53.781683 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:21:53.781658    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkzvz\" (UniqueName: \"kubernetes.io/projected/0c60a769-5976-4394-b4ff-8991ad12555c-kube-api-access-lkzvz\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8p5b2\" (UID: \"0c60a769-5976-4394-b4ff-8991ad12555c\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8p5b2"
Jul 16 22:21:53.781795 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:21:53.781720    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0c60a769-5976-4394-b4ff-8991ad12555c-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8p5b2\" (UID: \"0c60a769-5976-4394-b4ff-8991ad12555c\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8p5b2"
Jul 16 22:21:53.781795 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:21:53.781757    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0c60a769-5976-4394-b4ff-8991ad12555c-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8p5b2\" (UID: \"0c60a769-5976-4394-b4ff-8991ad12555c\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8p5b2"
Jul 16 22:21:53.882708 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:21:53.882668    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lkzvz\" (UniqueName: \"kubernetes.io/projected/0c60a769-5976-4394-b4ff-8991ad12555c-kube-api-access-lkzvz\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8p5b2\" (UID: \"0c60a769-5976-4394-b4ff-8991ad12555c\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8p5b2"
Jul 16 22:21:53.882821 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:21:53.882723    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0c60a769-5976-4394-b4ff-8991ad12555c-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8p5b2\" (UID: \"0c60a769-5976-4394-b4ff-8991ad12555c\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8p5b2"
Jul 16 22:21:53.882821 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:21:53.882742    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0c60a769-5976-4394-b4ff-8991ad12555c-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8p5b2\" (UID: \"0c60a769-5976-4394-b4ff-8991ad12555c\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8p5b2"
Jul 16 22:21:53.883039 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:21:53.883026    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0c60a769-5976-4394-b4ff-8991ad12555c-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8p5b2\" (UID: \"0c60a769-5976-4394-b4ff-8991ad12555c\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8p5b2"
Jul 16 22:21:53.883083 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:21:53.883063    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0c60a769-5976-4394-b4ff-8991ad12555c-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8p5b2\" (UID: \"0c60a769-5976-4394-b4ff-8991ad12555c\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8p5b2"
Jul 16 22:21:53.891431 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:21:53.891412    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkzvz\" (UniqueName: \"kubernetes.io/projected/0c60a769-5976-4394-b4ff-8991ad12555c-kube-api-access-lkzvz\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8p5b2\" (UID: \"0c60a769-5976-4394-b4ff-8991ad12555c\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8p5b2"
Jul 16 22:21:53.973785 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:21:53.973758    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8p5b2"
Jul 16 22:21:54.094715 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:21:54.094678    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8p5b2"]
Jul 16 22:21:54.097315 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:21:54.097291    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c60a769_5976_4394_b4ff_8991ad12555c.slice/crio-0a265abb0a85bea4815cfcd4165bea17f8faf220f8b28b8ec3b410c42fe54dbf WatchSource:0}: Error finding container 0a265abb0a85bea4815cfcd4165bea17f8faf220f8b28b8ec3b410c42fe54dbf: Status 404 returned error can't find the container with id 0a265abb0a85bea4815cfcd4165bea17f8faf220f8b28b8ec3b410c42fe54dbf
Jul 16 22:21:55.026868 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:21:55.026839    2552 generic.go:356] "Generic (PLEG): container finished" podID="0c60a769-5976-4394-b4ff-8991ad12555c" containerID="d3ef71da9a3b74fba8ed53c05e217343f045e2e83a8f9952a25be358a84ebabe" exitCode=0
Jul 16 22:21:55.027228 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:21:55.026932    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8p5b2" event={"ID":"0c60a769-5976-4394-b4ff-8991ad12555c","Type":"ContainerDied","Data":"d3ef71da9a3b74fba8ed53c05e217343f045e2e83a8f9952a25be358a84ebabe"}
Jul 16 22:21:55.027228 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:21:55.026986    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8p5b2" event={"ID":"0c60a769-5976-4394-b4ff-8991ad12555c","Type":"ContainerStarted","Data":"0a265abb0a85bea4815cfcd4165bea17f8faf220f8b28b8ec3b410c42fe54dbf"}
Jul 16 22:21:56.032228 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:21:56.032202    2552 generic.go:356] "Generic (PLEG): container finished" podID="0c60a769-5976-4394-b4ff-8991ad12555c" containerID="1128ebb7ff9157fe64bca5f4b33077a2361e2d55731ae94612550178df3ebef7" exitCode=0
Jul 16 22:21:56.032568 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:21:56.032286    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8p5b2" event={"ID":"0c60a769-5976-4394-b4ff-8991ad12555c","Type":"ContainerDied","Data":"1128ebb7ff9157fe64bca5f4b33077a2361e2d55731ae94612550178df3ebef7"}
Jul 16 22:21:57.037012 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:21:57.036979    2552 generic.go:356] "Generic (PLEG): container finished" podID="0c60a769-5976-4394-b4ff-8991ad12555c" containerID="38d69ccddf60d8241adb029ed95f9d9e8b5cb1d775ea7b276e343a2b43cefda4" exitCode=0
Jul 16 22:21:57.037406 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:21:57.037065    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8p5b2" event={"ID":"0c60a769-5976-4394-b4ff-8991ad12555c","Type":"ContainerDied","Data":"38d69ccddf60d8241adb029ed95f9d9e8b5cb1d775ea7b276e343a2b43cefda4"}
Jul 16 22:21:58.153573 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:21:58.153553    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8p5b2"
Jul 16 22:21:58.309455 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:21:58.309395    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0c60a769-5976-4394-b4ff-8991ad12555c-bundle\") pod \"0c60a769-5976-4394-b4ff-8991ad12555c\" (UID: \"0c60a769-5976-4394-b4ff-8991ad12555c\") "
Jul 16 22:21:58.309577 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:21:58.309454    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lkzvz\" (UniqueName: \"kubernetes.io/projected/0c60a769-5976-4394-b4ff-8991ad12555c-kube-api-access-lkzvz\") pod \"0c60a769-5976-4394-b4ff-8991ad12555c\" (UID: \"0c60a769-5976-4394-b4ff-8991ad12555c\") "
Jul 16 22:21:58.309577 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:21:58.309486    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0c60a769-5976-4394-b4ff-8991ad12555c-util\") pod \"0c60a769-5976-4394-b4ff-8991ad12555c\" (UID: \"0c60a769-5976-4394-b4ff-8991ad12555c\") "
Jul 16 22:21:58.310084 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:21:58.310060    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c60a769-5976-4394-b4ff-8991ad12555c-bundle" (OuterVolumeSpecName: "bundle") pod "0c60a769-5976-4394-b4ff-8991ad12555c" (UID: "0c60a769-5976-4394-b4ff-8991ad12555c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:21:58.311464 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:21:58.311436    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c60a769-5976-4394-b4ff-8991ad12555c-kube-api-access-lkzvz" (OuterVolumeSpecName: "kube-api-access-lkzvz") pod "0c60a769-5976-4394-b4ff-8991ad12555c" (UID: "0c60a769-5976-4394-b4ff-8991ad12555c"). InnerVolumeSpecName "kube-api-access-lkzvz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:21:58.314975 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:21:58.314947    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c60a769-5976-4394-b4ff-8991ad12555c-util" (OuterVolumeSpecName: "util") pod "0c60a769-5976-4394-b4ff-8991ad12555c" (UID: "0c60a769-5976-4394-b4ff-8991ad12555c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:21:58.410675 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:21:58.410657    2552 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0c60a769-5976-4394-b4ff-8991ad12555c-bundle\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 16 22:21:58.410675 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:21:58.410677    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lkzvz\" (UniqueName: \"kubernetes.io/projected/0c60a769-5976-4394-b4ff-8991ad12555c-kube-api-access-lkzvz\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 16 22:21:58.410815 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:21:58.410686    2552 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0c60a769-5976-4394-b4ff-8991ad12555c-util\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 16 22:21:59.045574 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:21:59.045544    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8p5b2" event={"ID":"0c60a769-5976-4394-b4ff-8991ad12555c","Type":"ContainerDied","Data":"0a265abb0a85bea4815cfcd4165bea17f8faf220f8b28b8ec3b410c42fe54dbf"}
Jul 16 22:21:59.045723 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:21:59.045582    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8p5b2"
Jul 16 22:21:59.045723 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:21:59.045596    2552 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0a265abb0a85bea4815cfcd4165bea17f8faf220f8b28b8ec3b410c42fe54dbf"
Jul 16 22:22:06.530941 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:06.530910    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7846b6849-98rlr"]
Jul 16 22:22:06.531299 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:06.531119    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c60a769-5976-4394-b4ff-8991ad12555c" containerName="extract"
Jul 16 22:22:06.531299 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:06.531129    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c60a769-5976-4394-b4ff-8991ad12555c" containerName="extract"
Jul 16 22:22:06.531299 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:06.531146    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c60a769-5976-4394-b4ff-8991ad12555c" containerName="util"
Jul 16 22:22:06.531299 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:06.531151    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c60a769-5976-4394-b4ff-8991ad12555c" containerName="util"
Jul 16 22:22:06.531299 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:06.531160    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c60a769-5976-4394-b4ff-8991ad12555c" containerName="pull"
Jul 16 22:22:06.531299 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:06.531166    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c60a769-5976-4394-b4ff-8991ad12555c" containerName="pull"
Jul 16 22:22:06.531299 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:06.531220    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c60a769-5976-4394-b4ff-8991ad12555c" containerName="extract"
Jul 16 22:22:06.533405 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:06.533390    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7846b6849-98rlr"
Jul 16 22:22:06.536350 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:06.536327    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 16 22:22:06.536587 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:06.536564    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 16 22:22:06.536915 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:06.536900    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 16 22:22:06.537563 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:06.537545    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 16 22:22:06.538080 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:06.538065    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-4psbw\""
Jul 16 22:22:06.554821 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:06.554800    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7846b6849-98rlr"]
Jul 16 22:22:06.567689 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:06.567665    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/54e0c828-7c8a-46a9-9e14-b9078c26c9f5-tmp\") pod \"opendatahub-operator-controller-manager-7846b6849-98rlr\" (UID: \"54e0c828-7c8a-46a9-9e14-b9078c26c9f5\") " pod="opendatahub/opendatahub-operator-controller-manager-7846b6849-98rlr"
Jul 16 22:22:06.567789 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:06.567710    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/54e0c828-7c8a-46a9-9e14-b9078c26c9f5-webhook-cert\") pod \"opendatahub-operator-controller-manager-7846b6849-98rlr\" (UID: \"54e0c828-7c8a-46a9-9e14-b9078c26c9f5\") " pod="opendatahub/opendatahub-operator-controller-manager-7846b6849-98rlr"
Jul 16 22:22:06.567789 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:06.567755    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/54e0c828-7c8a-46a9-9e14-b9078c26c9f5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7846b6849-98rlr\" (UID: \"54e0c828-7c8a-46a9-9e14-b9078c26c9f5\") " pod="opendatahub/opendatahub-operator-controller-manager-7846b6849-98rlr"
Jul 16 22:22:06.567893 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:06.567795    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/54e0c828-7c8a-46a9-9e14-b9078c26c9f5-manifests\") pod \"opendatahub-operator-controller-manager-7846b6849-98rlr\" (UID: \"54e0c828-7c8a-46a9-9e14-b9078c26c9f5\") " pod="opendatahub/opendatahub-operator-controller-manager-7846b6849-98rlr"
Jul 16 22:22:06.567893 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:06.567867    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dd4pb\" (UniqueName: \"kubernetes.io/projected/54e0c828-7c8a-46a9-9e14-b9078c26c9f5-kube-api-access-dd4pb\") pod \"opendatahub-operator-controller-manager-7846b6849-98rlr\" (UID: \"54e0c828-7c8a-46a9-9e14-b9078c26c9f5\") " pod="opendatahub/opendatahub-operator-controller-manager-7846b6849-98rlr"
Jul 16 22:22:06.668778 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:06.668753    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/54e0c828-7c8a-46a9-9e14-b9078c26c9f5-manifests\") pod \"opendatahub-operator-controller-manager-7846b6849-98rlr\" (UID: \"54e0c828-7c8a-46a9-9e14-b9078c26c9f5\") " pod="opendatahub/opendatahub-operator-controller-manager-7846b6849-98rlr"
Jul 16 22:22:06.668870 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:06.668785    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dd4pb\" (UniqueName: \"kubernetes.io/projected/54e0c828-7c8a-46a9-9e14-b9078c26c9f5-kube-api-access-dd4pb\") pod \"opendatahub-operator-controller-manager-7846b6849-98rlr\" (UID: \"54e0c828-7c8a-46a9-9e14-b9078c26c9f5\") " pod="opendatahub/opendatahub-operator-controller-manager-7846b6849-98rlr"
Jul 16 22:22:06.668870 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:06.668819    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/54e0c828-7c8a-46a9-9e14-b9078c26c9f5-tmp\") pod \"opendatahub-operator-controller-manager-7846b6849-98rlr\" (UID: \"54e0c828-7c8a-46a9-9e14-b9078c26c9f5\") " pod="opendatahub/opendatahub-operator-controller-manager-7846b6849-98rlr"
Jul 16 22:22:06.668967 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:06.668937    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/54e0c828-7c8a-46a9-9e14-b9078c26c9f5-webhook-cert\") pod \"opendatahub-operator-controller-manager-7846b6849-98rlr\" (UID: \"54e0c828-7c8a-46a9-9e14-b9078c26c9f5\") " pod="opendatahub/opendatahub-operator-controller-manager-7846b6849-98rlr"
Jul 16 22:22:06.669022 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:06.668979    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/54e0c828-7c8a-46a9-9e14-b9078c26c9f5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7846b6849-98rlr\" (UID: \"54e0c828-7c8a-46a9-9e14-b9078c26c9f5\") " pod="opendatahub/opendatahub-operator-controller-manager-7846b6849-98rlr"
Jul 16 22:22:06.669076 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:06.669057    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/54e0c828-7c8a-46a9-9e14-b9078c26c9f5-manifests\") pod \"opendatahub-operator-controller-manager-7846b6849-98rlr\" (UID: \"54e0c828-7c8a-46a9-9e14-b9078c26c9f5\") " pod="opendatahub/opendatahub-operator-controller-manager-7846b6849-98rlr"
Jul 16 22:22:06.670997 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:06.670965    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/54e0c828-7c8a-46a9-9e14-b9078c26c9f5-tmp\") pod \"opendatahub-operator-controller-manager-7846b6849-98rlr\" (UID: \"54e0c828-7c8a-46a9-9e14-b9078c26c9f5\") " pod="opendatahub/opendatahub-operator-controller-manager-7846b6849-98rlr"
Jul 16 22:22:06.671281 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:06.671264    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/54e0c828-7c8a-46a9-9e14-b9078c26c9f5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7846b6849-98rlr\" (UID: \"54e0c828-7c8a-46a9-9e14-b9078c26c9f5\") " pod="opendatahub/opendatahub-operator-controller-manager-7846b6849-98rlr"
Jul 16 22:22:06.671357 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:06.671335    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/54e0c828-7c8a-46a9-9e14-b9078c26c9f5-webhook-cert\") pod \"opendatahub-operator-controller-manager-7846b6849-98rlr\" (UID: \"54e0c828-7c8a-46a9-9e14-b9078c26c9f5\") " pod="opendatahub/opendatahub-operator-controller-manager-7846b6849-98rlr"
Jul 16 22:22:06.678104 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:06.678084    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dd4pb\" (UniqueName: \"kubernetes.io/projected/54e0c828-7c8a-46a9-9e14-b9078c26c9f5-kube-api-access-dd4pb\") pod \"opendatahub-operator-controller-manager-7846b6849-98rlr\" (UID: \"54e0c828-7c8a-46a9-9e14-b9078c26c9f5\") " pod="opendatahub/opendatahub-operator-controller-manager-7846b6849-98rlr"
Jul 16 22:22:06.843620 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:06.843549    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7846b6849-98rlr"
Jul 16 22:22:06.973501 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:06.973477    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7846b6849-98rlr"]
Jul 16 22:22:06.976035 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:22:06.976000    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54e0c828_7c8a_46a9_9e14_b9078c26c9f5.slice/crio-777d249bec186a2e270a4dd4cdb5b20e9ea48fbb5cebbcc89e054fd82d446328 WatchSource:0}: Error finding container 777d249bec186a2e270a4dd4cdb5b20e9ea48fbb5cebbcc89e054fd82d446328: Status 404 returned error can't find the container with id 777d249bec186a2e270a4dd4cdb5b20e9ea48fbb5cebbcc89e054fd82d446328
Jul 16 22:22:07.072839 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:07.072806    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7846b6849-98rlr" event={"ID":"54e0c828-7c8a-46a9-9e14-b9078c26c9f5","Type":"ContainerStarted","Data":"777d249bec186a2e270a4dd4cdb5b20e9ea48fbb5cebbcc89e054fd82d446328"}
Jul 16 22:22:10.087405 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:10.087319    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7846b6849-98rlr" event={"ID":"54e0c828-7c8a-46a9-9e14-b9078c26c9f5","Type":"ContainerStarted","Data":"210c2e94fb4df1eff8659af38767bf259b6c6d2939cac3e39b996dbdea1201aa"}
Jul 16 22:22:11.092828 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:11.092795    2552 generic.go:356] "Generic (PLEG): container finished" podID="54e0c828-7c8a-46a9-9e14-b9078c26c9f5" containerID="210c2e94fb4df1eff8659af38767bf259b6c6d2939cac3e39b996dbdea1201aa" exitCode=0
Jul 16 22:22:11.092828 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:11.092831    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7846b6849-98rlr" event={"ID":"54e0c828-7c8a-46a9-9e14-b9078c26c9f5","Type":"ContainerDied","Data":"210c2e94fb4df1eff8659af38767bf259b6c6d2939cac3e39b996dbdea1201aa"}
Jul 16 22:22:12.099519 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:12.099486    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7846b6849-98rlr" event={"ID":"54e0c828-7c8a-46a9-9e14-b9078c26c9f5","Type":"ContainerStarted","Data":"fb61f03b56892ab257c77cd04511b6a79793bfc5600c9e00e7859a39575047b3"}
Jul 16 22:22:12.099950 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:12.099600    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7846b6849-98rlr"
Jul 16 22:22:12.168083 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:12.168028    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7846b6849-98rlr" podStartSLOduration=1.799363816 podStartE2EDuration="6.168010914s" totalImagesPullingTime="3.294266718s" totalInitContainerRuntime="1.07438038s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:22:06 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:22:12.165919216 +0000 UTC m=+506.380700376" watchObservedRunningTime="2026-07-16 22:22:12.168010914 +0000 UTC m=+506.382792074"
Jul 16 22:22:23.105547 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:23.105515    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7846b6849-98rlr"
Jul 16 22:22:26.110198 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:26.110164    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5f4cc9ff56-pfq9r"]
Jul 16 22:22:26.120006 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:26.119982    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5f4cc9ff56-pfq9r"
Jul 16 22:22:26.126986 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:26.126949    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 16 22:22:26.127192 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:26.127169    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 16 22:22:26.128129 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:26.128101    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 16 22:22:26.128242 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:26.128174    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-9lnc9\""
Jul 16 22:22:26.128242 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:26.128199    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 16 22:22:26.133395 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:26.133373    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5f4cc9ff56-pfq9r"]
Jul 16 22:22:26.211055 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:26.211021    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cfefab5d-db7e-499f-88eb-75b6bd8187e4-tmp\") pod \"kube-auth-proxy-5f4cc9ff56-pfq9r\" (UID: \"cfefab5d-db7e-499f-88eb-75b6bd8187e4\") " pod="openshift-ingress/kube-auth-proxy-5f4cc9ff56-pfq9r"
Jul 16 22:22:26.211055 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:26.211060    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cfefab5d-db7e-499f-88eb-75b6bd8187e4-tls-certs\") pod \"kube-auth-proxy-5f4cc9ff56-pfq9r\" (UID: \"cfefab5d-db7e-499f-88eb-75b6bd8187e4\") " pod="openshift-ingress/kube-auth-proxy-5f4cc9ff56-pfq9r"
Jul 16 22:22:26.211273 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:26.211207    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-52kcr\" (UniqueName: \"kubernetes.io/projected/cfefab5d-db7e-499f-88eb-75b6bd8187e4-kube-api-access-52kcr\") pod \"kube-auth-proxy-5f4cc9ff56-pfq9r\" (UID: \"cfefab5d-db7e-499f-88eb-75b6bd8187e4\") " pod="openshift-ingress/kube-auth-proxy-5f4cc9ff56-pfq9r"
Jul 16 22:22:26.312571 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:26.312528    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cfefab5d-db7e-499f-88eb-75b6bd8187e4-tmp\") pod \"kube-auth-proxy-5f4cc9ff56-pfq9r\" (UID: \"cfefab5d-db7e-499f-88eb-75b6bd8187e4\") " pod="openshift-ingress/kube-auth-proxy-5f4cc9ff56-pfq9r"
Jul 16 22:22:26.312571 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:26.312570    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cfefab5d-db7e-499f-88eb-75b6bd8187e4-tls-certs\") pod \"kube-auth-proxy-5f4cc9ff56-pfq9r\" (UID: \"cfefab5d-db7e-499f-88eb-75b6bd8187e4\") " pod="openshift-ingress/kube-auth-proxy-5f4cc9ff56-pfq9r"
Jul 16 22:22:26.312832 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:26.312739    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-52kcr\" (UniqueName: \"kubernetes.io/projected/cfefab5d-db7e-499f-88eb-75b6bd8187e4-kube-api-access-52kcr\") pod \"kube-auth-proxy-5f4cc9ff56-pfq9r\" (UID: \"cfefab5d-db7e-499f-88eb-75b6bd8187e4\") " pod="openshift-ingress/kube-auth-proxy-5f4cc9ff56-pfq9r"
Jul 16 22:22:26.314974 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:26.314947    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cfefab5d-db7e-499f-88eb-75b6bd8187e4-tmp\") pod \"kube-auth-proxy-5f4cc9ff56-pfq9r\" (UID: \"cfefab5d-db7e-499f-88eb-75b6bd8187e4\") " pod="openshift-ingress/kube-auth-proxy-5f4cc9ff56-pfq9r"
Jul 16 22:22:26.315149 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:26.315134    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cfefab5d-db7e-499f-88eb-75b6bd8187e4-tls-certs\") pod \"kube-auth-proxy-5f4cc9ff56-pfq9r\" (UID: \"cfefab5d-db7e-499f-88eb-75b6bd8187e4\") " pod="openshift-ingress/kube-auth-proxy-5f4cc9ff56-pfq9r"
Jul 16 22:22:26.327354 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:26.327329    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-52kcr\" (UniqueName: \"kubernetes.io/projected/cfefab5d-db7e-499f-88eb-75b6bd8187e4-kube-api-access-52kcr\") pod \"kube-auth-proxy-5f4cc9ff56-pfq9r\" (UID: \"cfefab5d-db7e-499f-88eb-75b6bd8187e4\") " pod="openshift-ingress/kube-auth-proxy-5f4cc9ff56-pfq9r"
Jul 16 22:22:26.391730 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:26.391642    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-vq7pc"]
Jul 16 22:22:26.395202 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:26.395182    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-vq7pc"
Jul 16 22:22:26.398354 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:26.398334    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-xmrqm\""
Jul 16 22:22:26.398620 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:26.398601    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 16 22:22:26.410928 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:26.410909    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-vq7pc"]
Jul 16 22:22:26.413728 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:26.413685    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3a19fc0d-127d-479c-94e6-bd9dd1111513-cert\") pod \"odh-model-controller-7998c67dc4-vq7pc\" (UID: \"3a19fc0d-127d-479c-94e6-bd9dd1111513\") " pod="opendatahub/odh-model-controller-7998c67dc4-vq7pc"
Jul 16 22:22:26.413831 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:26.413792    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4dpnt\" (UniqueName: \"kubernetes.io/projected/3a19fc0d-127d-479c-94e6-bd9dd1111513-kube-api-access-4dpnt\") pod \"odh-model-controller-7998c67dc4-vq7pc\" (UID: \"3a19fc0d-127d-479c-94e6-bd9dd1111513\") " pod="opendatahub/odh-model-controller-7998c67dc4-vq7pc"
Jul 16 22:22:26.429760 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:26.429736    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5f4cc9ff56-pfq9r"
Jul 16 22:22:26.514739 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:26.514681    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3a19fc0d-127d-479c-94e6-bd9dd1111513-cert\") pod \"odh-model-controller-7998c67dc4-vq7pc\" (UID: \"3a19fc0d-127d-479c-94e6-bd9dd1111513\") " pod="opendatahub/odh-model-controller-7998c67dc4-vq7pc"
Jul 16 22:22:26.514909 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:26.514805    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4dpnt\" (UniqueName: \"kubernetes.io/projected/3a19fc0d-127d-479c-94e6-bd9dd1111513-kube-api-access-4dpnt\") pod \"odh-model-controller-7998c67dc4-vq7pc\" (UID: \"3a19fc0d-127d-479c-94e6-bd9dd1111513\") " pod="opendatahub/odh-model-controller-7998c67dc4-vq7pc"
Jul 16 22:22:26.514909 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:22:26.514873    2552 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 16 22:22:26.515030 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:22:26.514943    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a19fc0d-127d-479c-94e6-bd9dd1111513-cert podName:3a19fc0d-127d-479c-94e6-bd9dd1111513 nodeName:}" failed. No retries permitted until 2026-07-16 22:22:27.014922649 +0000 UTC m=+521.229703797 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/3a19fc0d-127d-479c-94e6-bd9dd1111513-cert") pod "odh-model-controller-7998c67dc4-vq7pc" (UID: "3a19fc0d-127d-479c-94e6-bd9dd1111513") : secret "odh-model-controller-webhook-cert" not found
Jul 16 22:22:26.530985 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:26.530958    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4dpnt\" (UniqueName: \"kubernetes.io/projected/3a19fc0d-127d-479c-94e6-bd9dd1111513-kube-api-access-4dpnt\") pod \"odh-model-controller-7998c67dc4-vq7pc\" (UID: \"3a19fc0d-127d-479c-94e6-bd9dd1111513\") " pod="opendatahub/odh-model-controller-7998c67dc4-vq7pc"
Jul 16 22:22:26.574220 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:26.574193    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5f4cc9ff56-pfq9r"]
Jul 16 22:22:26.576921 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:22:26.576891    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfefab5d_db7e_499f_88eb_75b6bd8187e4.slice/crio-59a7fb34ac1eb7ef560fba1acdee749605d58d9a03da1073ce46fc6faf4221ca WatchSource:0}: Error finding container 59a7fb34ac1eb7ef560fba1acdee749605d58d9a03da1073ce46fc6faf4221ca: Status 404 returned error can't find the container with id 59a7fb34ac1eb7ef560fba1acdee749605d58d9a03da1073ce46fc6faf4221ca
Jul 16 22:22:27.017852 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:27.017812    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3a19fc0d-127d-479c-94e6-bd9dd1111513-cert\") pod \"odh-model-controller-7998c67dc4-vq7pc\" (UID: \"3a19fc0d-127d-479c-94e6-bd9dd1111513\") " pod="opendatahub/odh-model-controller-7998c67dc4-vq7pc"
Jul 16 22:22:27.020181 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:27.020156    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3a19fc0d-127d-479c-94e6-bd9dd1111513-cert\") pod \"odh-model-controller-7998c67dc4-vq7pc\" (UID: \"3a19fc0d-127d-479c-94e6-bd9dd1111513\") " pod="opendatahub/odh-model-controller-7998c67dc4-vq7pc"
Jul 16 22:22:27.154156 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:27.154119    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5f4cc9ff56-pfq9r" event={"ID":"cfefab5d-db7e-499f-88eb-75b6bd8187e4","Type":"ContainerStarted","Data":"59a7fb34ac1eb7ef560fba1acdee749605d58d9a03da1073ce46fc6faf4221ca"}
Jul 16 22:22:27.308563 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:27.308463    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-vq7pc"
Jul 16 22:22:27.468861 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:27.468824    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-vq7pc"]
Jul 16 22:22:27.470952 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:27.470575    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-zdmz9"]
Jul 16 22:22:27.473890 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:22:27.473863    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a19fc0d_127d_479c_94e6_bd9dd1111513.slice/crio-b5e3ae0d4a7fe6c1be8ea6674f00004b7d60a9a508c114d55d7fbee9680aaf6f WatchSource:0}: Error finding container b5e3ae0d4a7fe6c1be8ea6674f00004b7d60a9a508c114d55d7fbee9680aaf6f: Status 404 returned error can't find the container with id b5e3ae0d4a7fe6c1be8ea6674f00004b7d60a9a508c114d55d7fbee9680aaf6f
Jul 16 22:22:27.475202 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:27.475180    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-zdmz9"
Jul 16 22:22:27.477765 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:27.477746    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 16 22:22:27.489567 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:27.488072    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-zdmz9"]
Jul 16 22:22:27.522256 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:27.522226    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpccz\" (UniqueName: \"kubernetes.io/projected/fc1a8076-017d-48c5-8332-b357545f6098-kube-api-access-wpccz\") pod \"model-serving-api-54d89bd5fc-zdmz9\" (UID: \"fc1a8076-017d-48c5-8332-b357545f6098\") " pod="opendatahub/model-serving-api-54d89bd5fc-zdmz9"
Jul 16 22:22:27.522406 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:27.522287    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fc1a8076-017d-48c5-8332-b357545f6098-tls-certs\") pod \"model-serving-api-54d89bd5fc-zdmz9\" (UID: \"fc1a8076-017d-48c5-8332-b357545f6098\") " pod="opendatahub/model-serving-api-54d89bd5fc-zdmz9"
Jul 16 22:22:27.623004 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:27.622909    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fc1a8076-017d-48c5-8332-b357545f6098-tls-certs\") pod \"model-serving-api-54d89bd5fc-zdmz9\" (UID: \"fc1a8076-017d-48c5-8332-b357545f6098\") " pod="opendatahub/model-serving-api-54d89bd5fc-zdmz9"
Jul 16 22:22:27.623165 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:27.623015    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wpccz\" (UniqueName: \"kubernetes.io/projected/fc1a8076-017d-48c5-8332-b357545f6098-kube-api-access-wpccz\") pod \"model-serving-api-54d89bd5fc-zdmz9\" (UID: \"fc1a8076-017d-48c5-8332-b357545f6098\") " pod="opendatahub/model-serving-api-54d89bd5fc-zdmz9"
Jul 16 22:22:27.623375 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:22:27.623348    2552 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Jul 16 22:22:27.623524 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:22:27.623448    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc1a8076-017d-48c5-8332-b357545f6098-tls-certs podName:fc1a8076-017d-48c5-8332-b357545f6098 nodeName:}" failed. No retries permitted until 2026-07-16 22:22:28.123425715 +0000 UTC m=+522.338206853 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/fc1a8076-017d-48c5-8332-b357545f6098-tls-certs") pod "model-serving-api-54d89bd5fc-zdmz9" (UID: "fc1a8076-017d-48c5-8332-b357545f6098") : secret "model-serving-api-tls" not found
Jul 16 22:22:27.635405 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:27.635373    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpccz\" (UniqueName: \"kubernetes.io/projected/fc1a8076-017d-48c5-8332-b357545f6098-kube-api-access-wpccz\") pod \"model-serving-api-54d89bd5fc-zdmz9\" (UID: \"fc1a8076-017d-48c5-8332-b357545f6098\") " pod="opendatahub/model-serving-api-54d89bd5fc-zdmz9"
Jul 16 22:22:27.666073 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:27.666039    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-q22bk"]
Jul 16 22:22:27.669371 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:27.669350    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-q22bk"
Jul 16 22:22:27.672087 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:27.672063    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 16 22:22:27.672187 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:27.672151    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 16 22:22:27.672525 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:27.672508    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 16 22:22:27.672671 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:27.672656    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-hnsck\""
Jul 16 22:22:27.672815 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:27.672798    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 16 22:22:27.683406 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:27.683351    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-q22bk"]
Jul 16 22:22:27.723753 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:27.723687    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e8657ea3-532c-4ec1-9071-c28c7517ad6e-local-certs\") pod \"istiod-openshift-gateway-7574459656-q22bk\" (UID: \"e8657ea3-532c-4ec1-9071-c28c7517ad6e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-q22bk"
Jul 16 22:22:27.723929 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:27.723761    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e8657ea3-532c-4ec1-9071-c28c7517ad6e-cacerts\") pod \"istiod-openshift-gateway-7574459656-q22bk\" (UID: \"e8657ea3-532c-4ec1-9071-c28c7517ad6e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-q22bk"
Jul 16 22:22:27.723929 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:27.723810    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e8657ea3-532c-4ec1-9071-c28c7517ad6e-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-q22bk\" (UID: \"e8657ea3-532c-4ec1-9071-c28c7517ad6e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-q22bk"
Jul 16 22:22:27.723929 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:27.723903    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4lv4\" (UniqueName: \"kubernetes.io/projected/e8657ea3-532c-4ec1-9071-c28c7517ad6e-kube-api-access-c4lv4\") pod \"istiod-openshift-gateway-7574459656-q22bk\" (UID: \"e8657ea3-532c-4ec1-9071-c28c7517ad6e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-q22bk"
Jul 16 22:22:27.724160 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:27.723979    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e8657ea3-532c-4ec1-9071-c28c7517ad6e-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-q22bk\" (UID: \"e8657ea3-532c-4ec1-9071-c28c7517ad6e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-q22bk"
Jul 16 22:22:27.724160 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:27.724007    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e8657ea3-532c-4ec1-9071-c28c7517ad6e-istio-token\") pod \"istiod-openshift-gateway-7574459656-q22bk\" (UID: \"e8657ea3-532c-4ec1-9071-c28c7517ad6e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-q22bk"
Jul 16 22:22:27.724160 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:27.724034    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e8657ea3-532c-4ec1-9071-c28c7517ad6e-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-q22bk\" (UID: \"e8657ea3-532c-4ec1-9071-c28c7517ad6e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-q22bk"
Jul 16 22:22:27.824874 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:27.824834    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e8657ea3-532c-4ec1-9071-c28c7517ad6e-local-certs\") pod \"istiod-openshift-gateway-7574459656-q22bk\" (UID: \"e8657ea3-532c-4ec1-9071-c28c7517ad6e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-q22bk"
Jul 16 22:22:27.825063 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:27.824889    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e8657ea3-532c-4ec1-9071-c28c7517ad6e-cacerts\") pod \"istiod-openshift-gateway-7574459656-q22bk\" (UID: \"e8657ea3-532c-4ec1-9071-c28c7517ad6e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-q22bk"
Jul 16 22:22:27.825063 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:27.824916    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e8657ea3-532c-4ec1-9071-c28c7517ad6e-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-q22bk\" (UID: \"e8657ea3-532c-4ec1-9071-c28c7517ad6e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-q22bk"
Jul 16 22:22:27.825063 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:27.824965    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4lv4\" (UniqueName: \"kubernetes.io/projected/e8657ea3-532c-4ec1-9071-c28c7517ad6e-kube-api-access-c4lv4\") pod \"istiod-openshift-gateway-7574459656-q22bk\" (UID: \"e8657ea3-532c-4ec1-9071-c28c7517ad6e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-q22bk"
Jul 16 22:22:27.825063 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:27.825039    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e8657ea3-532c-4ec1-9071-c28c7517ad6e-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-q22bk\" (UID: \"e8657ea3-532c-4ec1-9071-c28c7517ad6e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-q22bk"
Jul 16 22:22:27.825278 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:27.825065    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e8657ea3-532c-4ec1-9071-c28c7517ad6e-istio-token\") pod \"istiod-openshift-gateway-7574459656-q22bk\" (UID: \"e8657ea3-532c-4ec1-9071-c28c7517ad6e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-q22bk"
Jul 16 22:22:27.825278 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:27.825089    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e8657ea3-532c-4ec1-9071-c28c7517ad6e-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-q22bk\" (UID: \"e8657ea3-532c-4ec1-9071-c28c7517ad6e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-q22bk"
Jul 16 22:22:27.825854 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:27.825738    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e8657ea3-532c-4ec1-9071-c28c7517ad6e-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-q22bk\" (UID: \"e8657ea3-532c-4ec1-9071-c28c7517ad6e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-q22bk"
Jul 16 22:22:27.828482 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:27.828451    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e8657ea3-532c-4ec1-9071-c28c7517ad6e-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-q22bk\" (UID: \"e8657ea3-532c-4ec1-9071-c28c7517ad6e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-q22bk"
Jul 16 22:22:27.828984 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:27.828961    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e8657ea3-532c-4ec1-9071-c28c7517ad6e-cacerts\") pod \"istiod-openshift-gateway-7574459656-q22bk\" (UID: \"e8657ea3-532c-4ec1-9071-c28c7517ad6e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-q22bk"
Jul 16 22:22:27.829188 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:27.829160    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e8657ea3-532c-4ec1-9071-c28c7517ad6e-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-q22bk\" (UID: \"e8657ea3-532c-4ec1-9071-c28c7517ad6e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-q22bk"
Jul 16 22:22:27.829557 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:27.829532    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e8657ea3-532c-4ec1-9071-c28c7517ad6e-local-certs\") pod \"istiod-openshift-gateway-7574459656-q22bk\" (UID: \"e8657ea3-532c-4ec1-9071-c28c7517ad6e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-q22bk"
Jul 16 22:22:27.840408 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:27.840384    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4lv4\" (UniqueName: \"kubernetes.io/projected/e8657ea3-532c-4ec1-9071-c28c7517ad6e-kube-api-access-c4lv4\") pod \"istiod-openshift-gateway-7574459656-q22bk\" (UID: \"e8657ea3-532c-4ec1-9071-c28c7517ad6e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-q22bk"
Jul 16 22:22:27.840529 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:27.840518    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e8657ea3-532c-4ec1-9071-c28c7517ad6e-istio-token\") pod \"istiod-openshift-gateway-7574459656-q22bk\" (UID: \"e8657ea3-532c-4ec1-9071-c28c7517ad6e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-q22bk"
Jul 16 22:22:27.979953 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:27.979649    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-q22bk"
Jul 16 22:22:28.127991 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:28.127951    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fc1a8076-017d-48c5-8332-b357545f6098-tls-certs\") pod \"model-serving-api-54d89bd5fc-zdmz9\" (UID: \"fc1a8076-017d-48c5-8332-b357545f6098\") " pod="opendatahub/model-serving-api-54d89bd5fc-zdmz9"
Jul 16 22:22:28.132559 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:28.132376    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fc1a8076-017d-48c5-8332-b357545f6098-tls-certs\") pod \"model-serving-api-54d89bd5fc-zdmz9\" (UID: \"fc1a8076-017d-48c5-8332-b357545f6098\") " pod="opendatahub/model-serving-api-54d89bd5fc-zdmz9"
Jul 16 22:22:28.161135 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:28.161063    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-q22bk"]
Jul 16 22:22:28.162851 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:28.162790    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-vq7pc" event={"ID":"3a19fc0d-127d-479c-94e6-bd9dd1111513","Type":"ContainerStarted","Data":"b5e3ae0d4a7fe6c1be8ea6674f00004b7d60a9a508c114d55d7fbee9680aaf6f"}
Jul 16 22:22:28.163893 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:22:28.163855    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8657ea3_532c_4ec1_9071_c28c7517ad6e.slice/crio-66ab8642c3c2d925d9e011b8e2dc99a2a806c104599a92a8a8a41ec7595ea445 WatchSource:0}: Error finding container 66ab8642c3c2d925d9e011b8e2dc99a2a806c104599a92a8a8a41ec7595ea445: Status 404 returned error can't find the container with id 66ab8642c3c2d925d9e011b8e2dc99a2a806c104599a92a8a8a41ec7595ea445
Jul 16 22:22:28.402160 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:28.402077    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-zdmz9"
Jul 16 22:22:28.579540 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:28.579501    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-zdmz9"]
Jul 16 22:22:29.169062 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:29.169020    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-q22bk" event={"ID":"e8657ea3-532c-4ec1-9071-c28c7517ad6e","Type":"ContainerStarted","Data":"66ab8642c3c2d925d9e011b8e2dc99a2a806c104599a92a8a8a41ec7595ea445"}
Jul 16 22:22:29.276739 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:22:29.276691    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc1a8076_017d_48c5_8332_b357545f6098.slice/crio-73f70aa95545a2c4c7737432609a775c945e6c35107c6768b33ee04cde3f0212 WatchSource:0}: Error finding container 73f70aa95545a2c4c7737432609a775c945e6c35107c6768b33ee04cde3f0212: Status 404 returned error can't find the container with id 73f70aa95545a2c4c7737432609a775c945e6c35107c6768b33ee04cde3f0212
Jul 16 22:22:30.176728 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:30.176671    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-zdmz9" event={"ID":"fc1a8076-017d-48c5-8332-b357545f6098","Type":"ContainerStarted","Data":"73f70aa95545a2c4c7737432609a775c945e6c35107c6768b33ee04cde3f0212"}
Jul 16 22:22:32.350798 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:32.350681    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 22:22:32.351163 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:32.350823    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 22:22:33.195606 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:33.195565    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-zdmz9" event={"ID":"fc1a8076-017d-48c5-8332-b357545f6098","Type":"ContainerStarted","Data":"b88c31792b843a915c119f3b6fd1e0da5d3b9dcefdf673be4215a44915e5562f"}
Jul 16 22:22:33.195825 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:33.195687    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-zdmz9"
Jul 16 22:22:33.197049 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:33.197024    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5f4cc9ff56-pfq9r" event={"ID":"cfefab5d-db7e-499f-88eb-75b6bd8187e4","Type":"ContainerStarted","Data":"597faa51a4036f01eaec53c1b6e4a8c47c4fd00bf7a2fc80c5800a65af4e0b59"}
Jul 16 22:22:33.198554 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:33.198530    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-vq7pc" event={"ID":"3a19fc0d-127d-479c-94e6-bd9dd1111513","Type":"ContainerStarted","Data":"682881b02837129b207cbe5cf3429f661b38af69f7f0870adc2095645be6249f"}
Jul 16 22:22:33.198682 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:33.198657    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-vq7pc"
Jul 16 22:22:33.200314 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:33.200286    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-q22bk" event={"ID":"e8657ea3-532c-4ec1-9071-c28c7517ad6e","Type":"ContainerStarted","Data":"8b4e992a9315991446f47e75549145edb7ce11545b4418a129d65af271d2cd40"}
Jul 16 22:22:33.200441 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:33.200425    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-q22bk"
Jul 16 22:22:33.202014 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:33.201993    2552 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-q22bk container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 16 22:22:33.202091 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:33.202045    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-q22bk" podUID="e8657ea3-532c-4ec1-9071-c28c7517ad6e" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 16 22:22:33.228573 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:33.228531    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-zdmz9" podStartSLOduration=3.155649625 podStartE2EDuration="6.228520003s" totalImagesPullingTime="3.072870378s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:22:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:22:33.224052631 +0000 UTC m=+527.438833792" watchObservedRunningTime="2026-07-16 22:22:33.228520003 +0000 UTC m=+527.443301162"
Jul 16 22:22:33.261574 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:33.261510    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-q22bk" podStartSLOduration=2.077243204 podStartE2EDuration="6.261490997s" totalImagesPullingTime="4.184247793s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:22:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:22:33.258826634 +0000 UTC m=+527.473607799" watchObservedRunningTime="2026-07-16 22:22:33.261490997 +0000 UTC m=+527.476272158"
Jul 16 22:22:33.313202 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:33.313148    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5f4cc9ff56-pfq9r" podStartSLOduration=1.614196868 podStartE2EDuration="7.313130898s" totalImagesPullingTime="5.69893403s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:22:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:22:33.28733846 +0000 UTC m=+527.502119617" watchObservedRunningTime="2026-07-16 22:22:33.313130898 +0000 UTC m=+527.527912058"
Jul 16 22:22:33.313973 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:33.313935    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-vq7pc" podStartSLOduration=2.44189138 podStartE2EDuration="7.313923077s" totalImagesPullingTime="4.872031697s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:22:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:22:33.312893211 +0000 UTC m=+527.527674394" watchObservedRunningTime="2026-07-16 22:22:33.313923077 +0000 UTC m=+527.528704236"
Jul 16 22:22:34.205579 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:34.205549    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-q22bk"
Jul 16 22:22:38.049279 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:38.049247    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-52qmk"]
Jul 16 22:22:38.052247 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:38.052228    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-52qmk"
Jul 16 22:22:38.063716 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:38.061925    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 16 22:22:38.063840 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:38.063736    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-lcb2x\""
Jul 16 22:22:38.066319 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:38.066296    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-w2jbq"]
Jul 16 22:22:38.069769 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:38.069753    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-w2jbq"
Jul 16 22:22:38.072410 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:38.072392    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 16 22:22:38.074028 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:38.074009    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-52qmk"]
Jul 16 22:22:38.075044 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:38.075025    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-p2jlc\""
Jul 16 22:22:38.094932 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:38.094911    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-w2jbq"]
Jul 16 22:22:38.113534 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:38.113511    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drkj5\" (UniqueName: \"kubernetes.io/projected/ee481a0b-0f61-46f6-bae6-bb4bc044ee14-kube-api-access-drkj5\") pod \"kserve-controller-manager-d6f4b65b8-w2jbq\" (UID: \"ee481a0b-0f61-46f6-bae6-bb4bc044ee14\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-w2jbq"
Jul 16 22:22:38.113625 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:38.113544    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqvc9\" (UniqueName: \"kubernetes.io/projected/15854bde-e31c-4149-b303-c828b0d08949-kube-api-access-wqvc9\") pod \"llmisvc-controller-manager-777c6bd7d5-52qmk\" (UID: \"15854bde-e31c-4149-b303-c828b0d08949\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-52qmk"
Jul 16 22:22:38.113625 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:38.113569    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/15854bde-e31c-4149-b303-c828b0d08949-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-52qmk\" (UID: \"15854bde-e31c-4149-b303-c828b0d08949\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-52qmk"
Jul 16 22:22:38.113625 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:38.113616    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ee481a0b-0f61-46f6-bae6-bb4bc044ee14-cert\") pod \"kserve-controller-manager-d6f4b65b8-w2jbq\" (UID: \"ee481a0b-0f61-46f6-bae6-bb4bc044ee14\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-w2jbq"
Jul 16 22:22:38.214154 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:38.214128    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drkj5\" (UniqueName: \"kubernetes.io/projected/ee481a0b-0f61-46f6-bae6-bb4bc044ee14-kube-api-access-drkj5\") pod \"kserve-controller-manager-d6f4b65b8-w2jbq\" (UID: \"ee481a0b-0f61-46f6-bae6-bb4bc044ee14\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-w2jbq"
Jul 16 22:22:38.214266 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:38.214163    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqvc9\" (UniqueName: \"kubernetes.io/projected/15854bde-e31c-4149-b303-c828b0d08949-kube-api-access-wqvc9\") pod \"llmisvc-controller-manager-777c6bd7d5-52qmk\" (UID: \"15854bde-e31c-4149-b303-c828b0d08949\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-52qmk"
Jul 16 22:22:38.214266 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:38.214185    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/15854bde-e31c-4149-b303-c828b0d08949-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-52qmk\" (UID: \"15854bde-e31c-4149-b303-c828b0d08949\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-52qmk"
Jul 16 22:22:38.214266 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:38.214208    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ee481a0b-0f61-46f6-bae6-bb4bc044ee14-cert\") pod \"kserve-controller-manager-d6f4b65b8-w2jbq\" (UID: \"ee481a0b-0f61-46f6-bae6-bb4bc044ee14\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-w2jbq"
Jul 16 22:22:38.216473 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:38.216446    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ee481a0b-0f61-46f6-bae6-bb4bc044ee14-cert\") pod \"kserve-controller-manager-d6f4b65b8-w2jbq\" (UID: \"ee481a0b-0f61-46f6-bae6-bb4bc044ee14\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-w2jbq"
Jul 16 22:22:38.216473 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:38.216470    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/15854bde-e31c-4149-b303-c828b0d08949-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-52qmk\" (UID: \"15854bde-e31c-4149-b303-c828b0d08949\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-52qmk"
Jul 16 22:22:38.226251 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:38.226232    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqvc9\" (UniqueName: \"kubernetes.io/projected/15854bde-e31c-4149-b303-c828b0d08949-kube-api-access-wqvc9\") pod \"llmisvc-controller-manager-777c6bd7d5-52qmk\" (UID: \"15854bde-e31c-4149-b303-c828b0d08949\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-52qmk"
Jul 16 22:22:38.227768 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:38.227748    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-drkj5\" (UniqueName: \"kubernetes.io/projected/ee481a0b-0f61-46f6-bae6-bb4bc044ee14-kube-api-access-drkj5\") pod \"kserve-controller-manager-d6f4b65b8-w2jbq\" (UID: \"ee481a0b-0f61-46f6-bae6-bb4bc044ee14\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-w2jbq"
Jul 16 22:22:38.363867 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:38.363811    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-52qmk"
Jul 16 22:22:38.381630 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:38.381612    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-w2jbq"
Jul 16 22:22:38.550198 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:38.550169    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-52qmk"]
Jul 16 22:22:38.553061 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:22:38.553035    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod15854bde_e31c_4149_b303_c828b0d08949.slice/crio-8d6832f45a7edbf65eaa46a14ba33dc2bfe5f3d419cba35e07d4e27079521ec5 WatchSource:0}: Error finding container 8d6832f45a7edbf65eaa46a14ba33dc2bfe5f3d419cba35e07d4e27079521ec5: Status 404 returned error can't find the container with id 8d6832f45a7edbf65eaa46a14ba33dc2bfe5f3d419cba35e07d4e27079521ec5
Jul 16 22:22:38.571570 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:38.571545    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-w2jbq"]
Jul 16 22:22:38.573837 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:22:38.573818    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee481a0b_0f61_46f6_bae6_bb4bc044ee14.slice/crio-d16be79424f37c78f0b9399ac813785a683e8b239bfff3850d5d975909f3aef5 WatchSource:0}: Error finding container d16be79424f37c78f0b9399ac813785a683e8b239bfff3850d5d975909f3aef5: Status 404 returned error can't find the container with id d16be79424f37c78f0b9399ac813785a683e8b239bfff3850d5d975909f3aef5
Jul 16 22:22:39.226812 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:39.226771    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-w2jbq" event={"ID":"ee481a0b-0f61-46f6-bae6-bb4bc044ee14","Type":"ContainerStarted","Data":"d16be79424f37c78f0b9399ac813785a683e8b239bfff3850d5d975909f3aef5"}
Jul 16 22:22:39.228157 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:39.228129    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-52qmk" event={"ID":"15854bde-e31c-4149-b303-c828b0d08949","Type":"ContainerStarted","Data":"8d6832f45a7edbf65eaa46a14ba33dc2bfe5f3d419cba35e07d4e27079521ec5"}
Jul 16 22:22:40.696173 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:40.696137    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-q22bk"]
Jul 16 22:22:40.696647 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:40.696349    2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-q22bk" podUID="e8657ea3-532c-4ec1-9071-c28c7517ad6e" containerName="discovery" containerID="cri-o://8b4e992a9315991446f47e75549145edb7ce11545b4418a129d65af271d2cd40" gracePeriod=30
Jul 16 22:22:41.056180 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:41.056158    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-q22bk"
Jul 16 22:22:41.137151 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:41.137127    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e8657ea3-532c-4ec1-9071-c28c7517ad6e-istio-csr-dns-cert\") pod \"e8657ea3-532c-4ec1-9071-c28c7517ad6e\" (UID: \"e8657ea3-532c-4ec1-9071-c28c7517ad6e\") "
Jul 16 22:22:41.137281 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:41.137170    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e8657ea3-532c-4ec1-9071-c28c7517ad6e-istio-csr-ca-configmap\") pod \"e8657ea3-532c-4ec1-9071-c28c7517ad6e\" (UID: \"e8657ea3-532c-4ec1-9071-c28c7517ad6e\") "
Jul 16 22:22:41.137281 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:41.137207    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e8657ea3-532c-4ec1-9071-c28c7517ad6e-local-certs\") pod \"e8657ea3-532c-4ec1-9071-c28c7517ad6e\" (UID: \"e8657ea3-532c-4ec1-9071-c28c7517ad6e\") "
Jul 16 22:22:41.137281 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:41.137230    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e8657ea3-532c-4ec1-9071-c28c7517ad6e-istio-kubeconfig\") pod \"e8657ea3-532c-4ec1-9071-c28c7517ad6e\" (UID: \"e8657ea3-532c-4ec1-9071-c28c7517ad6e\") "
Jul 16 22:22:41.137281 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:41.137266    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e8657ea3-532c-4ec1-9071-c28c7517ad6e-istio-token\") pod \"e8657ea3-532c-4ec1-9071-c28c7517ad6e\" (UID: \"e8657ea3-532c-4ec1-9071-c28c7517ad6e\") "
Jul 16 22:22:41.137503 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:41.137304    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e8657ea3-532c-4ec1-9071-c28c7517ad6e-cacerts\") pod \"e8657ea3-532c-4ec1-9071-c28c7517ad6e\" (UID: \"e8657ea3-532c-4ec1-9071-c28c7517ad6e\") "
Jul 16 22:22:41.137503 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:41.137329    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c4lv4\" (UniqueName: \"kubernetes.io/projected/e8657ea3-532c-4ec1-9071-c28c7517ad6e-kube-api-access-c4lv4\") pod \"e8657ea3-532c-4ec1-9071-c28c7517ad6e\" (UID: \"e8657ea3-532c-4ec1-9071-c28c7517ad6e\") "
Jul 16 22:22:41.137684 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:41.137657    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8657ea3-532c-4ec1-9071-c28c7517ad6e-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "e8657ea3-532c-4ec1-9071-c28c7517ad6e" (UID: "e8657ea3-532c-4ec1-9071-c28c7517ad6e"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 22:22:41.139657 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:41.139617    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8657ea3-532c-4ec1-9071-c28c7517ad6e-local-certs" (OuterVolumeSpecName: "local-certs") pod "e8657ea3-532c-4ec1-9071-c28c7517ad6e" (UID: "e8657ea3-532c-4ec1-9071-c28c7517ad6e"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:22:41.139914 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:41.139876    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8657ea3-532c-4ec1-9071-c28c7517ad6e-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "e8657ea3-532c-4ec1-9071-c28c7517ad6e" (UID: "e8657ea3-532c-4ec1-9071-c28c7517ad6e"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 22:22:41.139914 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:41.139887    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8657ea3-532c-4ec1-9071-c28c7517ad6e-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "e8657ea3-532c-4ec1-9071-c28c7517ad6e" (UID: "e8657ea3-532c-4ec1-9071-c28c7517ad6e"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 22:22:41.139914 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:41.139882    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8657ea3-532c-4ec1-9071-c28c7517ad6e-istio-token" (OuterVolumeSpecName: "istio-token") pod "e8657ea3-532c-4ec1-9071-c28c7517ad6e" (UID: "e8657ea3-532c-4ec1-9071-c28c7517ad6e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:22:41.139914 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:41.139906    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8657ea3-532c-4ec1-9071-c28c7517ad6e-cacerts" (OuterVolumeSpecName: "cacerts") pod "e8657ea3-532c-4ec1-9071-c28c7517ad6e" (UID: "e8657ea3-532c-4ec1-9071-c28c7517ad6e"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 22:22:41.140094 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:41.140045    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8657ea3-532c-4ec1-9071-c28c7517ad6e-kube-api-access-c4lv4" (OuterVolumeSpecName: "kube-api-access-c4lv4") pod "e8657ea3-532c-4ec1-9071-c28c7517ad6e" (UID: "e8657ea3-532c-4ec1-9071-c28c7517ad6e"). InnerVolumeSpecName "kube-api-access-c4lv4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:22:41.238070 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:41.238000    2552 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e8657ea3-532c-4ec1-9071-c28c7517ad6e-istio-csr-dns-cert\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 16 22:22:41.238070 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:41.238032    2552 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e8657ea3-532c-4ec1-9071-c28c7517ad6e-istio-csr-ca-configmap\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 16 22:22:41.238070 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:41.238046    2552 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e8657ea3-532c-4ec1-9071-c28c7517ad6e-local-certs\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 16 22:22:41.238070 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:41.238060    2552 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e8657ea3-532c-4ec1-9071-c28c7517ad6e-istio-kubeconfig\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 16 22:22:41.238294 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:41.238075    2552 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e8657ea3-532c-4ec1-9071-c28c7517ad6e-istio-token\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 16 22:22:41.238294 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:41.238087    2552 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e8657ea3-532c-4ec1-9071-c28c7517ad6e-cacerts\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 16 22:22:41.238294 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:41.238102    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c4lv4\" (UniqueName: \"kubernetes.io/projected/e8657ea3-532c-4ec1-9071-c28c7517ad6e-kube-api-access-c4lv4\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 16 22:22:41.239496 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:41.239462    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-w2jbq" event={"ID":"ee481a0b-0f61-46f6-bae6-bb4bc044ee14","Type":"ContainerStarted","Data":"d17f5fd43450c89b742d59f92a7471da3920bd98372263700336e94a2265a978"}
Jul 16 22:22:41.239620 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:41.239535    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-w2jbq"
Jul 16 22:22:41.240833 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:41.240803    2552 generic.go:356] "Generic (PLEG): container finished" podID="e8657ea3-532c-4ec1-9071-c28c7517ad6e" containerID="8b4e992a9315991446f47e75549145edb7ce11545b4418a129d65af271d2cd40" exitCode=0
Jul 16 22:22:41.240932 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:41.240841    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-q22bk"
Jul 16 22:22:41.240932 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:41.240872    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-q22bk" event={"ID":"e8657ea3-532c-4ec1-9071-c28c7517ad6e","Type":"ContainerDied","Data":"8b4e992a9315991446f47e75549145edb7ce11545b4418a129d65af271d2cd40"}
Jul 16 22:22:41.240932 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:41.240910    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-q22bk" event={"ID":"e8657ea3-532c-4ec1-9071-c28c7517ad6e","Type":"ContainerDied","Data":"66ab8642c3c2d925d9e011b8e2dc99a2a806c104599a92a8a8a41ec7595ea445"}
Jul 16 22:22:41.241090 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:41.240939    2552 scope.go:117] "RemoveContainer" containerID="8b4e992a9315991446f47e75549145edb7ce11545b4418a129d65af271d2cd40"
Jul 16 22:22:41.250101 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:41.250071    2552 scope.go:117] "RemoveContainer" containerID="8b4e992a9315991446f47e75549145edb7ce11545b4418a129d65af271d2cd40"
Jul 16 22:22:41.250422 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:22:41.250395    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8b4e992a9315991446f47e75549145edb7ce11545b4418a129d65af271d2cd40\": container with ID starting with 8b4e992a9315991446f47e75549145edb7ce11545b4418a129d65af271d2cd40 not found: ID does not exist" containerID="8b4e992a9315991446f47e75549145edb7ce11545b4418a129d65af271d2cd40"
Jul 16 22:22:41.250502 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:41.250431    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b4e992a9315991446f47e75549145edb7ce11545b4418a129d65af271d2cd40"} err="failed to get container status \"8b4e992a9315991446f47e75549145edb7ce11545b4418a129d65af271d2cd40\": rpc error: code = NotFound desc = could not find container \"8b4e992a9315991446f47e75549145edb7ce11545b4418a129d65af271d2cd40\": container with ID starting with 8b4e992a9315991446f47e75549145edb7ce11545b4418a129d65af271d2cd40 not found: ID does not exist"
Jul 16 22:22:41.292429 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:41.292387    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-w2jbq" podStartSLOduration=0.912974285 podStartE2EDuration="3.292374616s" totalImagesPullingTime="2.379400331s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:22:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:22:41.28980814 +0000 UTC m=+535.504589300" watchObservedRunningTime="2026-07-16 22:22:41.292374616 +0000 UTC m=+535.507155816"
Jul 16 22:22:41.327194 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:41.327158    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-q22bk"]
Jul 16 22:22:41.335632 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:41.335602    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-q22bk"]
Jul 16 22:22:42.251587 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:42.251531    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-52qmk" event={"ID":"15854bde-e31c-4149-b303-c828b0d08949","Type":"ContainerStarted","Data":"c6a8d8c13d3892d8c2102c206da84b4efc3f10fd04d4ee734a54e537922e19b1"}
Jul 16 22:22:42.252079 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:42.251738    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-52qmk"
Jul 16 22:22:42.275212 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:42.275185    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e8657ea3-532c-4ec1-9071-c28c7517ad6e" path="/var/lib/kubelet/pods/e8657ea3-532c-4ec1-9071-c28c7517ad6e/volumes"
Jul 16 22:22:42.281737 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:42.281681    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-52qmk" podStartSLOduration=0.993968254 podStartE2EDuration="4.28166868s" totalImagesPullingTime="3.287700426s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:22:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:22:42.280161732 +0000 UTC m=+536.494942887" watchObservedRunningTime="2026-07-16 22:22:42.28166868 +0000 UTC m=+536.496449886"
Jul 16 22:22:44.206964 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:44.206931    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-vq7pc"
Jul 16 22:22:44.210042 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:22:44.210015    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-zdmz9"
Jul 16 22:23:12.257967 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:12.257937    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-w2jbq"
Jul 16 22:23:13.258834 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:13.258808    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-52qmk"
Jul 16 22:23:26.981768 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:26.981737    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-84nv7"]
Jul 16 22:23:26.982183 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:26.981998    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8657ea3-532c-4ec1-9071-c28c7517ad6e" containerName="discovery"
Jul 16 22:23:26.982183 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:26.982009    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8657ea3-532c-4ec1-9071-c28c7517ad6e" containerName="discovery"
Jul 16 22:23:26.982183 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:26.982075    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="e8657ea3-532c-4ec1-9071-c28c7517ad6e" containerName="discovery"
Jul 16 22:23:26.985298 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:26.985282    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-84nv7"
Jul 16 22:23:26.988406 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:26.988379    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 16 22:23:26.989522 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:26.989502    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-j6mh9\""
Jul 16 22:23:26.989643 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:26.989543    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 16 22:23:26.998639 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:26.998599    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-84nv7"]
Jul 16 22:23:27.153794 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:27.153765    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9pk9\" (UniqueName: \"kubernetes.io/projected/66137129-3467-4a89-9952-59709168528f-kube-api-access-j9pk9\") pod \"kuadrant-operator-catalog-84nv7\" (UID: \"66137129-3467-4a89-9952-59709168528f\") " pod="kuadrant-system/kuadrant-operator-catalog-84nv7"
Jul 16 22:23:27.254736 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:27.254663    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9pk9\" (UniqueName: \"kubernetes.io/projected/66137129-3467-4a89-9952-59709168528f-kube-api-access-j9pk9\") pod \"kuadrant-operator-catalog-84nv7\" (UID: \"66137129-3467-4a89-9952-59709168528f\") " pod="kuadrant-system/kuadrant-operator-catalog-84nv7"
Jul 16 22:23:27.264485 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:27.264462    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9pk9\" (UniqueName: \"kubernetes.io/projected/66137129-3467-4a89-9952-59709168528f-kube-api-access-j9pk9\") pod \"kuadrant-operator-catalog-84nv7\" (UID: \"66137129-3467-4a89-9952-59709168528f\") " pod="kuadrant-system/kuadrant-operator-catalog-84nv7"
Jul 16 22:23:27.294866 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:27.294839    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-84nv7"
Jul 16 22:23:27.333379 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:27.333352    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-84nv7"]
Jul 16 22:23:27.426971 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:27.426910    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-84nv7"]
Jul 16 22:23:27.430648 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:23:27.430620    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66137129_3467_4a89_9952_59709168528f.slice/crio-50b3f5ba424e2be18ec335bb91c0b2c08446456e732f2445c138009900c949ed WatchSource:0}: Error finding container 50b3f5ba424e2be18ec335bb91c0b2c08446456e732f2445c138009900c949ed: Status 404 returned error can't find the container with id 50b3f5ba424e2be18ec335bb91c0b2c08446456e732f2445c138009900c949ed
Jul 16 22:23:27.544390 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:27.544332    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hckbj"]
Jul 16 22:23:27.547111 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:27.547095    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-hckbj"
Jul 16 22:23:27.555556 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:27.555532    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hckbj"]
Jul 16 22:23:27.657034 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:27.657011    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zslfw\" (UniqueName: \"kubernetes.io/projected/18f5a823-80d4-443f-a3a2-166fa88605e5-kube-api-access-zslfw\") pod \"kuadrant-operator-catalog-hckbj\" (UID: \"18f5a823-80d4-443f-a3a2-166fa88605e5\") " pod="kuadrant-system/kuadrant-operator-catalog-hckbj"
Jul 16 22:23:27.758182 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:27.758157    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zslfw\" (UniqueName: \"kubernetes.io/projected/18f5a823-80d4-443f-a3a2-166fa88605e5-kube-api-access-zslfw\") pod \"kuadrant-operator-catalog-hckbj\" (UID: \"18f5a823-80d4-443f-a3a2-166fa88605e5\") " pod="kuadrant-system/kuadrant-operator-catalog-hckbj"
Jul 16 22:23:27.767920 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:27.767894    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zslfw\" (UniqueName: \"kubernetes.io/projected/18f5a823-80d4-443f-a3a2-166fa88605e5-kube-api-access-zslfw\") pod \"kuadrant-operator-catalog-hckbj\" (UID: \"18f5a823-80d4-443f-a3a2-166fa88605e5\") " pod="kuadrant-system/kuadrant-operator-catalog-hckbj"
Jul 16 22:23:27.856039 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:27.855993    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-hckbj"
Jul 16 22:23:27.994719 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:27.994679    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hckbj"]
Jul 16 22:23:28.182134 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:23:28.182032    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18f5a823_80d4_443f_a3a2_166fa88605e5.slice/crio-c29f12848cc3449f41c99156ea3e06fb31537055478d43eb340728bab4bbec49 WatchSource:0}: Error finding container c29f12848cc3449f41c99156ea3e06fb31537055478d43eb340728bab4bbec49: Status 404 returned error can't find the container with id c29f12848cc3449f41c99156ea3e06fb31537055478d43eb340728bab4bbec49
Jul 16 22:23:28.435129 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:28.435056    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-84nv7" event={"ID":"66137129-3467-4a89-9952-59709168528f","Type":"ContainerStarted","Data":"50b3f5ba424e2be18ec335bb91c0b2c08446456e732f2445c138009900c949ed"}
Jul 16 22:23:28.436283 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:28.436260    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-hckbj" event={"ID":"18f5a823-80d4-443f-a3a2-166fa88605e5","Type":"ContainerStarted","Data":"c29f12848cc3449f41c99156ea3e06fb31537055478d43eb340728bab4bbec49"}
Jul 16 22:23:29.442205 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:29.442167    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-84nv7" event={"ID":"66137129-3467-4a89-9952-59709168528f","Type":"ContainerStarted","Data":"3079bab0cf747f249a3f88041b6f9e01a7a7f218d48adddaed90e6dbbbb5419c"}
Jul 16 22:23:29.442651 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:29.442223    2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-84nv7" podUID="66137129-3467-4a89-9952-59709168528f" containerName="registry-server" containerID="cri-o://3079bab0cf747f249a3f88041b6f9e01a7a7f218d48adddaed90e6dbbbb5419c" gracePeriod=2
Jul 16 22:23:29.443686 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:29.443652    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-hckbj" event={"ID":"18f5a823-80d4-443f-a3a2-166fa88605e5","Type":"ContainerStarted","Data":"9920d9f982ac3ad1a228b9d557a60bda162f6027540630ca0c2fdae99fb6ffd6"}
Jul 16 22:23:29.460339 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:29.460295    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-84nv7" podStartSLOduration=1.6824156540000001 podStartE2EDuration="3.460280497s" totalImagesPullingTime="1.777864843s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:23:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:23:29.458825585 +0000 UTC m=+583.673606758" watchObservedRunningTime="2026-07-16 22:23:29.460280497 +0000 UTC m=+583.675061656"
Jul 16 22:23:29.476820 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:29.476771    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-hckbj" podStartSLOduration=1.450197417 podStartE2EDuration="2.47675704s" totalImagesPullingTime="1.026559623s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:23:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:23:29.476030205 +0000 UTC m=+583.690811366" watchObservedRunningTime="2026-07-16 22:23:29.47675704 +0000 UTC m=+583.691538199"
Jul 16 22:23:29.678663 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:29.678640    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-84nv7"
Jul 16 22:23:29.774866 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:29.774803    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j9pk9\" (UniqueName: \"kubernetes.io/projected/66137129-3467-4a89-9952-59709168528f-kube-api-access-j9pk9\") pod \"66137129-3467-4a89-9952-59709168528f\" (UID: \"66137129-3467-4a89-9952-59709168528f\") "
Jul 16 22:23:29.776876 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:29.776847    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/66137129-3467-4a89-9952-59709168528f-kube-api-access-j9pk9" (OuterVolumeSpecName: "kube-api-access-j9pk9") pod "66137129-3467-4a89-9952-59709168528f" (UID: "66137129-3467-4a89-9952-59709168528f"). InnerVolumeSpecName "kube-api-access-j9pk9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:23:29.876063 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:29.876036    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j9pk9\" (UniqueName: \"kubernetes.io/projected/66137129-3467-4a89-9952-59709168528f-kube-api-access-j9pk9\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 16 22:23:30.448152 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:30.448121    2552 generic.go:356] "Generic (PLEG): container finished" podID="66137129-3467-4a89-9952-59709168528f" containerID="3079bab0cf747f249a3f88041b6f9e01a7a7f218d48adddaed90e6dbbbb5419c" exitCode=0
Jul 16 22:23:30.448552 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:30.448173    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-84nv7"
Jul 16 22:23:30.448552 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:30.448201    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-84nv7" event={"ID":"66137129-3467-4a89-9952-59709168528f","Type":"ContainerDied","Data":"3079bab0cf747f249a3f88041b6f9e01a7a7f218d48adddaed90e6dbbbb5419c"}
Jul 16 22:23:30.448552 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:30.448244    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-84nv7" event={"ID":"66137129-3467-4a89-9952-59709168528f","Type":"ContainerDied","Data":"50b3f5ba424e2be18ec335bb91c0b2c08446456e732f2445c138009900c949ed"}
Jul 16 22:23:30.448552 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:30.448265    2552 scope.go:117] "RemoveContainer" containerID="3079bab0cf747f249a3f88041b6f9e01a7a7f218d48adddaed90e6dbbbb5419c"
Jul 16 22:23:30.456397 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:30.456380    2552 scope.go:117] "RemoveContainer" containerID="3079bab0cf747f249a3f88041b6f9e01a7a7f218d48adddaed90e6dbbbb5419c"
Jul 16 22:23:30.456642 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:23:30.456622    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3079bab0cf747f249a3f88041b6f9e01a7a7f218d48adddaed90e6dbbbb5419c\": container with ID starting with 3079bab0cf747f249a3f88041b6f9e01a7a7f218d48adddaed90e6dbbbb5419c not found: ID does not exist" containerID="3079bab0cf747f249a3f88041b6f9e01a7a7f218d48adddaed90e6dbbbb5419c"
Jul 16 22:23:30.456726 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:30.456650    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3079bab0cf747f249a3f88041b6f9e01a7a7f218d48adddaed90e6dbbbb5419c"} err="failed to get container status \"3079bab0cf747f249a3f88041b6f9e01a7a7f218d48adddaed90e6dbbbb5419c\": rpc error: code = NotFound desc = could not find container \"3079bab0cf747f249a3f88041b6f9e01a7a7f218d48adddaed90e6dbbbb5419c\": container with ID starting with 3079bab0cf747f249a3f88041b6f9e01a7a7f218d48adddaed90e6dbbbb5419c not found: ID does not exist"
Jul 16 22:23:30.470912 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:30.470888    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-84nv7"]
Jul 16 22:23:30.474356 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:30.474337    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-84nv7"]
Jul 16 22:23:32.280359 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:32.280324    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="66137129-3467-4a89-9952-59709168528f" path="/var/lib/kubelet/pods/66137129-3467-4a89-9952-59709168528f/volumes"
Jul 16 22:23:37.856826 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:37.856794    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-hckbj"
Jul 16 22:23:37.857176 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:37.856846    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-hckbj"
Jul 16 22:23:37.878842 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:37.878813    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-hckbj"
Jul 16 22:23:38.500118 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:38.500087    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-hckbj"
Jul 16 22:23:42.360791 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:42.360757    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73krvf5"]
Jul 16 22:23:42.361170 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:42.361008    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66137129-3467-4a89-9952-59709168528f" containerName="registry-server"
Jul 16 22:23:42.361170 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:42.361018    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="66137129-3467-4a89-9952-59709168528f" containerName="registry-server"
Jul 16 22:23:42.361170 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:42.361073    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="66137129-3467-4a89-9952-59709168528f" containerName="registry-server"
Jul 16 22:23:42.363765 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:42.363749    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73krvf5"
Jul 16 22:23:42.366774 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:42.366750    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-dwmx8\""
Jul 16 22:23:42.378920 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:42.378894    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73krvf5"]
Jul 16 22:23:42.552360 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:42.552328    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2hms\" (UniqueName: \"kubernetes.io/projected/ab2794ae-2618-4c3c-aa15-a998e2001def-kube-api-access-m2hms\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73krvf5\" (UID: \"ab2794ae-2618-4c3c-aa15-a998e2001def\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73krvf5"
Jul 16 22:23:42.552510 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:42.552381    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ab2794ae-2618-4c3c-aa15-a998e2001def-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73krvf5\" (UID: \"ab2794ae-2618-4c3c-aa15-a998e2001def\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73krvf5"
Jul 16 22:23:42.552510 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:42.552461    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ab2794ae-2618-4c3c-aa15-a998e2001def-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73krvf5\" (UID: \"ab2794ae-2618-4c3c-aa15-a998e2001def\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73krvf5"
Jul 16 22:23:42.653582 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:42.653512    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2hms\" (UniqueName: \"kubernetes.io/projected/ab2794ae-2618-4c3c-aa15-a998e2001def-kube-api-access-m2hms\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73krvf5\" (UID: \"ab2794ae-2618-4c3c-aa15-a998e2001def\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73krvf5"
Jul 16 22:23:42.653582 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:42.653563    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ab2794ae-2618-4c3c-aa15-a998e2001def-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73krvf5\" (UID: \"ab2794ae-2618-4c3c-aa15-a998e2001def\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73krvf5"
Jul 16 22:23:42.653741 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:42.653603    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ab2794ae-2618-4c3c-aa15-a998e2001def-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73krvf5\" (UID: \"ab2794ae-2618-4c3c-aa15-a998e2001def\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73krvf5"
Jul 16 22:23:42.653922 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:42.653906    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ab2794ae-2618-4c3c-aa15-a998e2001def-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73krvf5\" (UID: \"ab2794ae-2618-4c3c-aa15-a998e2001def\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73krvf5"
Jul 16 22:23:42.653994 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:42.653977    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ab2794ae-2618-4c3c-aa15-a998e2001def-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73krvf5\" (UID: \"ab2794ae-2618-4c3c-aa15-a998e2001def\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73krvf5"
Jul 16 22:23:42.663151 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:42.663127    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2hms\" (UniqueName: \"kubernetes.io/projected/ab2794ae-2618-4c3c-aa15-a998e2001def-kube-api-access-m2hms\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73krvf5\" (UID: \"ab2794ae-2618-4c3c-aa15-a998e2001def\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73krvf5"
Jul 16 22:23:42.672756 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:42.672737    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73krvf5"
Jul 16 22:23:42.795522 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:42.795456    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73krvf5"]
Jul 16 22:23:42.797527 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:23:42.797495    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab2794ae_2618_4c3c_aa15_a998e2001def.slice/crio-a08ac0c5fd177871fe430ccf36c0a2666e53c39e85e75b51b30ccdbffee22b29 WatchSource:0}: Error finding container a08ac0c5fd177871fe430ccf36c0a2666e53c39e85e75b51b30ccdbffee22b29: Status 404 returned error can't find the container with id a08ac0c5fd177871fe430ccf36c0a2666e53c39e85e75b51b30ccdbffee22b29
Jul 16 22:23:42.954349 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:42.954325    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qcxnf"]
Jul 16 22:23:42.958083 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:42.958064    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qcxnf"
Jul 16 22:23:42.967252 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:42.967227    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qcxnf"]
Jul 16 22:23:43.056378 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:43.056349    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbxg7\" (UniqueName: \"kubernetes.io/projected/8f17f275-aa05-4ba8-9344-27f9e4a2b83d-kube-api-access-vbxg7\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qcxnf\" (UID: \"8f17f275-aa05-4ba8-9344-27f9e4a2b83d\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qcxnf"
Jul 16 22:23:43.056466 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:43.056390    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8f17f275-aa05-4ba8-9344-27f9e4a2b83d-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qcxnf\" (UID: \"8f17f275-aa05-4ba8-9344-27f9e4a2b83d\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qcxnf"
Jul 16 22:23:43.056466 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:43.056447    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8f17f275-aa05-4ba8-9344-27f9e4a2b83d-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qcxnf\" (UID: \"8f17f275-aa05-4ba8-9344-27f9e4a2b83d\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qcxnf"
Jul 16 22:23:43.157086 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:43.157056    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8f17f275-aa05-4ba8-9344-27f9e4a2b83d-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qcxnf\" (UID: \"8f17f275-aa05-4ba8-9344-27f9e4a2b83d\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qcxnf"
Jul 16 22:23:43.157207 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:43.157097    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8f17f275-aa05-4ba8-9344-27f9e4a2b83d-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qcxnf\" (UID: \"8f17f275-aa05-4ba8-9344-27f9e4a2b83d\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qcxnf"
Jul 16 22:23:43.157207 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:43.157162    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vbxg7\" (UniqueName: \"kubernetes.io/projected/8f17f275-aa05-4ba8-9344-27f9e4a2b83d-kube-api-access-vbxg7\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qcxnf\" (UID: \"8f17f275-aa05-4ba8-9344-27f9e4a2b83d\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qcxnf"
Jul 16 22:23:43.157487 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:43.157463    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8f17f275-aa05-4ba8-9344-27f9e4a2b83d-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qcxnf\" (UID: \"8f17f275-aa05-4ba8-9344-27f9e4a2b83d\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qcxnf"
Jul 16 22:23:43.157544 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:43.157473    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8f17f275-aa05-4ba8-9344-27f9e4a2b83d-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qcxnf\" (UID: \"8f17f275-aa05-4ba8-9344-27f9e4a2b83d\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qcxnf"
Jul 16 22:23:43.166505 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:43.166481    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbxg7\" (UniqueName: \"kubernetes.io/projected/8f17f275-aa05-4ba8-9344-27f9e4a2b83d-kube-api-access-vbxg7\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qcxnf\" (UID: \"8f17f275-aa05-4ba8-9344-27f9e4a2b83d\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qcxnf"
Jul 16 22:23:43.271835 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:43.271778    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qcxnf"
Jul 16 22:23:43.355294 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:43.355270    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5hcq"]
Jul 16 22:23:43.359847 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:43.359823    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5hcq"
Jul 16 22:23:43.368554 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:43.368504    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5hcq"]
Jul 16 22:23:43.405538 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:43.405465    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qcxnf"]
Jul 16 22:23:43.407583 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:23:43.407564    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f17f275_aa05_4ba8_9344_27f9e4a2b83d.slice/crio-60ecdb2bee2c02147aad46ad9a7accac5ca7184d719000b515ca67e5f93be321 WatchSource:0}: Error finding container 60ecdb2bee2c02147aad46ad9a7accac5ca7184d719000b515ca67e5f93be321: Status 404 returned error can't find the container with id 60ecdb2bee2c02147aad46ad9a7accac5ca7184d719000b515ca67e5f93be321
Jul 16 22:23:43.459895 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:43.459870    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/85210f09-e4c3-4107-90e6-fedf15ae8de3-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5hcq\" (UID: \"85210f09-e4c3-4107-90e6-fedf15ae8de3\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5hcq"
Jul 16 22:23:43.460001 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:43.459900    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/85210f09-e4c3-4107-90e6-fedf15ae8de3-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5hcq\" (UID: \"85210f09-e4c3-4107-90e6-fedf15ae8de3\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5hcq"
Jul 16 22:23:43.460001 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:43.459923    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7l8c6\" (UniqueName: \"kubernetes.io/projected/85210f09-e4c3-4107-90e6-fedf15ae8de3-kube-api-access-7l8c6\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5hcq\" (UID: \"85210f09-e4c3-4107-90e6-fedf15ae8de3\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5hcq"
Jul 16 22:23:43.501008 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:43.500979    2552 generic.go:356] "Generic (PLEG): container finished" podID="ab2794ae-2618-4c3c-aa15-a998e2001def" containerID="e78f64f611f123ee6d7d0161f29cfaaa2680d9663cdbcad9e01dea8f83ae91a5" exitCode=0
Jul 16 22:23:43.501111 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:43.501065    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73krvf5" event={"ID":"ab2794ae-2618-4c3c-aa15-a998e2001def","Type":"ContainerDied","Data":"e78f64f611f123ee6d7d0161f29cfaaa2680d9663cdbcad9e01dea8f83ae91a5"}
Jul 16 22:23:43.501171 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:43.501125    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73krvf5" event={"ID":"ab2794ae-2618-4c3c-aa15-a998e2001def","Type":"ContainerStarted","Data":"a08ac0c5fd177871fe430ccf36c0a2666e53c39e85e75b51b30ccdbffee22b29"}
Jul 16 22:23:43.502762 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:43.502735    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qcxnf" event={"ID":"8f17f275-aa05-4ba8-9344-27f9e4a2b83d","Type":"ContainerStarted","Data":"bbf47f654747c8f17df5ccdf5ce6d4aa0883548576b1e454ab32ade4a56bb903"}
Jul 16 22:23:43.502846 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:43.502793    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qcxnf" event={"ID":"8f17f275-aa05-4ba8-9344-27f9e4a2b83d","Type":"ContainerStarted","Data":"60ecdb2bee2c02147aad46ad9a7accac5ca7184d719000b515ca67e5f93be321"}
Jul 16 22:23:43.561247 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:43.561187    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/85210f09-e4c3-4107-90e6-fedf15ae8de3-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5hcq\" (UID: \"85210f09-e4c3-4107-90e6-fedf15ae8de3\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5hcq"
Jul 16 22:23:43.561247 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:43.561218    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/85210f09-e4c3-4107-90e6-fedf15ae8de3-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5hcq\" (UID: \"85210f09-e4c3-4107-90e6-fedf15ae8de3\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5hcq"
Jul 16 22:23:43.561247 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:43.561239    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7l8c6\" (UniqueName: \"kubernetes.io/projected/85210f09-e4c3-4107-90e6-fedf15ae8de3-kube-api-access-7l8c6\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5hcq\" (UID: \"85210f09-e4c3-4107-90e6-fedf15ae8de3\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5hcq"
Jul 16 22:23:43.561572 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:43.561552    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/85210f09-e4c3-4107-90e6-fedf15ae8de3-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5hcq\" (UID: \"85210f09-e4c3-4107-90e6-fedf15ae8de3\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5hcq"
Jul 16 22:23:43.561632 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:43.561571    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/85210f09-e4c3-4107-90e6-fedf15ae8de3-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5hcq\" (UID: \"85210f09-e4c3-4107-90e6-fedf15ae8de3\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5hcq"
Jul 16 22:23:43.571880 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:43.571860    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7l8c6\" (UniqueName: \"kubernetes.io/projected/85210f09-e4c3-4107-90e6-fedf15ae8de3-kube-api-access-7l8c6\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5hcq\" (UID: \"85210f09-e4c3-4107-90e6-fedf15ae8de3\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5hcq"
Jul 16 22:23:43.671586 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:43.671563    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5hcq"
Jul 16 22:23:43.765645 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:43.765602    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fbp87"]
Jul 16 22:23:43.770658 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:43.770638    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fbp87"
Jul 16 22:23:43.779070 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:43.779046    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fbp87"]
Jul 16 22:23:43.798945 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:43.798909    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5hcq"]
Jul 16 22:23:43.801491 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:23:43.801470    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85210f09_e4c3_4107_90e6_fedf15ae8de3.slice/crio-56232f1ac745280a1d5646aa7b0240dbd60cb773952c508e1547945198ed5593 WatchSource:0}: Error finding container 56232f1ac745280a1d5646aa7b0240dbd60cb773952c508e1547945198ed5593: Status 404 returned error can't find the container with id 56232f1ac745280a1d5646aa7b0240dbd60cb773952c508e1547945198ed5593
Jul 16 22:23:43.963508 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:43.963471    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58xp6\" (UniqueName: \"kubernetes.io/projected/4c71d1ba-b4ce-41f4-8732-70e585f32271-kube-api-access-58xp6\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fbp87\" (UID: \"4c71d1ba-b4ce-41f4-8732-70e585f32271\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fbp87"
Jul 16 22:23:43.963630 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:43.963548    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4c71d1ba-b4ce-41f4-8732-70e585f32271-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fbp87\" (UID: \"4c71d1ba-b4ce-41f4-8732-70e585f32271\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fbp87"
Jul 16 22:23:43.963630 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:43.963571    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4c71d1ba-b4ce-41f4-8732-70e585f32271-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fbp87\" (UID: \"4c71d1ba-b4ce-41f4-8732-70e585f32271\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fbp87"
Jul 16 22:23:44.064211 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:44.064183    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4c71d1ba-b4ce-41f4-8732-70e585f32271-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fbp87\" (UID: \"4c71d1ba-b4ce-41f4-8732-70e585f32271\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fbp87"
Jul 16 22:23:44.064292 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:44.064218    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4c71d1ba-b4ce-41f4-8732-70e585f32271-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fbp87\" (UID: \"4c71d1ba-b4ce-41f4-8732-70e585f32271\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fbp87"
Jul 16 22:23:44.064292 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:44.064249    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58xp6\" (UniqueName: \"kubernetes.io/projected/4c71d1ba-b4ce-41f4-8732-70e585f32271-kube-api-access-58xp6\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fbp87\" (UID: \"4c71d1ba-b4ce-41f4-8732-70e585f32271\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fbp87"
Jul 16 22:23:44.064610 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:44.064565    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4c71d1ba-b4ce-41f4-8732-70e585f32271-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fbp87\" (UID: \"4c71d1ba-b4ce-41f4-8732-70e585f32271\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fbp87"
Jul 16 22:23:44.064610 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:44.064576    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4c71d1ba-b4ce-41f4-8732-70e585f32271-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fbp87\" (UID: \"4c71d1ba-b4ce-41f4-8732-70e585f32271\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fbp87"
Jul 16 22:23:44.075333 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:44.075308    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-58xp6\" (UniqueName: \"kubernetes.io/projected/4c71d1ba-b4ce-41f4-8732-70e585f32271-kube-api-access-58xp6\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fbp87\" (UID: \"4c71d1ba-b4ce-41f4-8732-70e585f32271\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fbp87"
Jul 16 22:23:44.081179 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:44.081158    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fbp87"
Jul 16 22:23:44.206286 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:44.206260    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fbp87"]
Jul 16 22:23:44.208646 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:23:44.208618    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c71d1ba_b4ce_41f4_8732_70e585f32271.slice/crio-91cbd608cf43f191793776834f03124eee27cc351b3a782e5505071367dca65b WatchSource:0}: Error finding container 91cbd608cf43f191793776834f03124eee27cc351b3a782e5505071367dca65b: Status 404 returned error can't find the container with id 91cbd608cf43f191793776834f03124eee27cc351b3a782e5505071367dca65b
Jul 16 22:23:44.508182 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:44.508153    2552 generic.go:356] "Generic (PLEG): container finished" podID="8f17f275-aa05-4ba8-9344-27f9e4a2b83d" containerID="bbf47f654747c8f17df5ccdf5ce6d4aa0883548576b1e454ab32ade4a56bb903" exitCode=0
Jul 16 22:23:44.508526 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:44.508223    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qcxnf" event={"ID":"8f17f275-aa05-4ba8-9344-27f9e4a2b83d","Type":"ContainerDied","Data":"bbf47f654747c8f17df5ccdf5ce6d4aa0883548576b1e454ab32ade4a56bb903"}
Jul 16 22:23:44.509807 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:44.509786    2552 generic.go:356] "Generic (PLEG): container finished" podID="4c71d1ba-b4ce-41f4-8732-70e585f32271" containerID="89555f554168acd4aef61f7b80f7a4d04d1c987886ac7398ec30dd04e0c9bc03" exitCode=0
Jul 16 22:23:44.509896 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:44.509870    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fbp87" event={"ID":"4c71d1ba-b4ce-41f4-8732-70e585f32271","Type":"ContainerDied","Data":"89555f554168acd4aef61f7b80f7a4d04d1c987886ac7398ec30dd04e0c9bc03"}
Jul 16 22:23:44.509953 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:44.509914    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fbp87" event={"ID":"4c71d1ba-b4ce-41f4-8732-70e585f32271","Type":"ContainerStarted","Data":"91cbd608cf43f191793776834f03124eee27cc351b3a782e5505071367dca65b"}
Jul 16 22:23:44.511938 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:44.511914    2552 generic.go:356] "Generic (PLEG): container finished" podID="ab2794ae-2618-4c3c-aa15-a998e2001def" containerID="a6a6b6d494a37f78278bf570bdad4d12e3b2c0245ec343ed84dbddda246eb985" exitCode=0
Jul 16 22:23:44.512020 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:44.512005    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73krvf5" event={"ID":"ab2794ae-2618-4c3c-aa15-a998e2001def","Type":"ContainerDied","Data":"a6a6b6d494a37f78278bf570bdad4d12e3b2c0245ec343ed84dbddda246eb985"}
Jul 16 22:23:44.513490 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:44.513471    2552 generic.go:356] "Generic (PLEG): container finished" podID="85210f09-e4c3-4107-90e6-fedf15ae8de3" containerID="2d8674d6c8154cfcb8fd1e103393740f8375f2239568d6543023729cca5d2909" exitCode=0
Jul 16 22:23:44.513574 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:44.513519    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5hcq" event={"ID":"85210f09-e4c3-4107-90e6-fedf15ae8de3","Type":"ContainerDied","Data":"2d8674d6c8154cfcb8fd1e103393740f8375f2239568d6543023729cca5d2909"}
Jul 16 22:23:44.513574 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:44.513552    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5hcq" event={"ID":"85210f09-e4c3-4107-90e6-fedf15ae8de3","Type":"ContainerStarted","Data":"56232f1ac745280a1d5646aa7b0240dbd60cb773952c508e1547945198ed5593"}
Jul 16 22:23:45.520294 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:45.520199    2552 generic.go:356] "Generic (PLEG): container finished" podID="8f17f275-aa05-4ba8-9344-27f9e4a2b83d" containerID="258b802c79c6a3abcdc1ba9e68df551e1e41b6e340027571225aa5f556f7cc84" exitCode=0
Jul 16 22:23:45.520294 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:45.520280    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qcxnf" event={"ID":"8f17f275-aa05-4ba8-9344-27f9e4a2b83d","Type":"ContainerDied","Data":"258b802c79c6a3abcdc1ba9e68df551e1e41b6e340027571225aa5f556f7cc84"}
Jul 16 22:23:45.522301 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:45.522280    2552 generic.go:356] "Generic (PLEG): container finished" podID="4c71d1ba-b4ce-41f4-8732-70e585f32271" containerID="d72fc9a5b6a60c857b8e3085ce2485e0e623fa6b85791f396c191c8cdf9655ff" exitCode=0
Jul 16 22:23:45.522383 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:45.522359    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fbp87" event={"ID":"4c71d1ba-b4ce-41f4-8732-70e585f32271","Type":"ContainerDied","Data":"d72fc9a5b6a60c857b8e3085ce2485e0e623fa6b85791f396c191c8cdf9655ff"}
Jul 16 22:23:45.524632 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:45.524609    2552 generic.go:356] "Generic (PLEG): container finished" podID="ab2794ae-2618-4c3c-aa15-a998e2001def" containerID="4eee8612b0b648a62b56e21ad38dfec1f32bea607e739b6d98db02d80271444c" exitCode=0
Jul 16 22:23:45.524732 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:45.524680    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73krvf5" event={"ID":"ab2794ae-2618-4c3c-aa15-a998e2001def","Type":"ContainerDied","Data":"4eee8612b0b648a62b56e21ad38dfec1f32bea607e739b6d98db02d80271444c"}
Jul 16 22:23:45.526871 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:45.526850    2552 generic.go:356] "Generic (PLEG): container finished" podID="85210f09-e4c3-4107-90e6-fedf15ae8de3" containerID="f631caf91a76c80db7acb6919ed6ca407e0cf14546b3f156953f6ebdae5c82fa" exitCode=0
Jul 16 22:23:45.526943 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:45.526891    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5hcq" event={"ID":"85210f09-e4c3-4107-90e6-fedf15ae8de3","Type":"ContainerDied","Data":"f631caf91a76c80db7acb6919ed6ca407e0cf14546b3f156953f6ebdae5c82fa"}
Jul 16 22:23:46.533084 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:46.533050    2552 generic.go:356] "Generic (PLEG): container finished" podID="85210f09-e4c3-4107-90e6-fedf15ae8de3" containerID="3873caf9d79d2f9fa81360bdbee0a73ea45adbab3cae791686ba9ebdf263c730" exitCode=0
Jul 16 22:23:46.535401 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:46.533139    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5hcq" event={"ID":"85210f09-e4c3-4107-90e6-fedf15ae8de3","Type":"ContainerDied","Data":"3873caf9d79d2f9fa81360bdbee0a73ea45adbab3cae791686ba9ebdf263c730"}
Jul 16 22:23:46.535401 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:46.535056    2552 generic.go:356] "Generic (PLEG): container finished" podID="8f17f275-aa05-4ba8-9344-27f9e4a2b83d" containerID="962d92d15309549fb94253bba0bfddc143d30a613c4cc4f8aebce0be1a5ae367" exitCode=0
Jul 16 22:23:46.535401 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:46.535114    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qcxnf" event={"ID":"8f17f275-aa05-4ba8-9344-27f9e4a2b83d","Type":"ContainerDied","Data":"962d92d15309549fb94253bba0bfddc143d30a613c4cc4f8aebce0be1a5ae367"}
Jul 16 22:23:46.536889 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:46.536865    2552 generic.go:356] "Generic (PLEG): container finished" podID="4c71d1ba-b4ce-41f4-8732-70e585f32271" containerID="ad51048207457d604b60e4937f43f7867d707047de2b848d58983c8cd59a0ceb" exitCode=0
Jul 16 22:23:46.536978 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:46.536910    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fbp87" event={"ID":"4c71d1ba-b4ce-41f4-8732-70e585f32271","Type":"ContainerDied","Data":"ad51048207457d604b60e4937f43f7867d707047de2b848d58983c8cd59a0ceb"}
Jul 16 22:23:46.660354 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:46.660327    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73krvf5"
Jul 16 22:23:46.686239 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:46.686215    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ab2794ae-2618-4c3c-aa15-a998e2001def-util\") pod \"ab2794ae-2618-4c3c-aa15-a998e2001def\" (UID: \"ab2794ae-2618-4c3c-aa15-a998e2001def\") "
Jul 16 22:23:46.686361 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:46.686270    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m2hms\" (UniqueName: \"kubernetes.io/projected/ab2794ae-2618-4c3c-aa15-a998e2001def-kube-api-access-m2hms\") pod \"ab2794ae-2618-4c3c-aa15-a998e2001def\" (UID: \"ab2794ae-2618-4c3c-aa15-a998e2001def\") "
Jul 16 22:23:46.686361 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:46.686299    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ab2794ae-2618-4c3c-aa15-a998e2001def-bundle\") pod \"ab2794ae-2618-4c3c-aa15-a998e2001def\" (UID: \"ab2794ae-2618-4c3c-aa15-a998e2001def\") "
Jul 16 22:23:46.686907 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:46.686883    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab2794ae-2618-4c3c-aa15-a998e2001def-bundle" (OuterVolumeSpecName: "bundle") pod "ab2794ae-2618-4c3c-aa15-a998e2001def" (UID: "ab2794ae-2618-4c3c-aa15-a998e2001def"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:23:46.688235 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:46.688207    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab2794ae-2618-4c3c-aa15-a998e2001def-kube-api-access-m2hms" (OuterVolumeSpecName: "kube-api-access-m2hms") pod "ab2794ae-2618-4c3c-aa15-a998e2001def" (UID: "ab2794ae-2618-4c3c-aa15-a998e2001def"). InnerVolumeSpecName "kube-api-access-m2hms". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:23:46.691289 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:46.691258    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab2794ae-2618-4c3c-aa15-a998e2001def-util" (OuterVolumeSpecName: "util") pod "ab2794ae-2618-4c3c-aa15-a998e2001def" (UID: "ab2794ae-2618-4c3c-aa15-a998e2001def"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:23:46.787050 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:46.787002    2552 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ab2794ae-2618-4c3c-aa15-a998e2001def-util\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 16 22:23:46.787050 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:46.787023    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m2hms\" (UniqueName: \"kubernetes.io/projected/ab2794ae-2618-4c3c-aa15-a998e2001def-kube-api-access-m2hms\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 16 22:23:46.787050 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:46.787033    2552 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ab2794ae-2618-4c3c-aa15-a998e2001def-bundle\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 16 22:23:47.545841 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:47.545815    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73krvf5"
Jul 16 22:23:47.545841 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:47.545827    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73krvf5" event={"ID":"ab2794ae-2618-4c3c-aa15-a998e2001def","Type":"ContainerDied","Data":"a08ac0c5fd177871fe430ccf36c0a2666e53c39e85e75b51b30ccdbffee22b29"}
Jul 16 22:23:47.546296 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:47.545916    2552 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a08ac0c5fd177871fe430ccf36c0a2666e53c39e85e75b51b30ccdbffee22b29"
Jul 16 22:23:47.683485 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:47.683451    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qcxnf"
Jul 16 22:23:47.692195 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:47.692168    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8f17f275-aa05-4ba8-9344-27f9e4a2b83d-util\") pod \"8f17f275-aa05-4ba8-9344-27f9e4a2b83d\" (UID: \"8f17f275-aa05-4ba8-9344-27f9e4a2b83d\") "
Jul 16 22:23:47.692318 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:47.692212    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vbxg7\" (UniqueName: \"kubernetes.io/projected/8f17f275-aa05-4ba8-9344-27f9e4a2b83d-kube-api-access-vbxg7\") pod \"8f17f275-aa05-4ba8-9344-27f9e4a2b83d\" (UID: \"8f17f275-aa05-4ba8-9344-27f9e4a2b83d\") "
Jul 16 22:23:47.692318 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:47.692237    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8f17f275-aa05-4ba8-9344-27f9e4a2b83d-bundle\") pod \"8f17f275-aa05-4ba8-9344-27f9e4a2b83d\" (UID: \"8f17f275-aa05-4ba8-9344-27f9e4a2b83d\") "
Jul 16 22:23:47.693580 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:47.693534    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f17f275-aa05-4ba8-9344-27f9e4a2b83d-bundle" (OuterVolumeSpecName: "bundle") pod "8f17f275-aa05-4ba8-9344-27f9e4a2b83d" (UID: "8f17f275-aa05-4ba8-9344-27f9e4a2b83d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:23:47.696847 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:47.696814    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f17f275-aa05-4ba8-9344-27f9e4a2b83d-kube-api-access-vbxg7" (OuterVolumeSpecName: "kube-api-access-vbxg7") pod "8f17f275-aa05-4ba8-9344-27f9e4a2b83d" (UID: "8f17f275-aa05-4ba8-9344-27f9e4a2b83d"). InnerVolumeSpecName "kube-api-access-vbxg7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:23:47.699724 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:47.699682    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f17f275-aa05-4ba8-9344-27f9e4a2b83d-util" (OuterVolumeSpecName: "util") pod "8f17f275-aa05-4ba8-9344-27f9e4a2b83d" (UID: "8f17f275-aa05-4ba8-9344-27f9e4a2b83d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:23:47.725465 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:47.725445    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5hcq"
Jul 16 22:23:47.727893 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:47.727877    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fbp87"
Jul 16 22:23:47.793074 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:47.793051    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4c71d1ba-b4ce-41f4-8732-70e585f32271-util\") pod \"4c71d1ba-b4ce-41f4-8732-70e585f32271\" (UID: \"4c71d1ba-b4ce-41f4-8732-70e585f32271\") "
Jul 16 22:23:47.793174 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:47.793096    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-58xp6\" (UniqueName: \"kubernetes.io/projected/4c71d1ba-b4ce-41f4-8732-70e585f32271-kube-api-access-58xp6\") pod \"4c71d1ba-b4ce-41f4-8732-70e585f32271\" (UID: \"4c71d1ba-b4ce-41f4-8732-70e585f32271\") "
Jul 16 22:23:47.793174 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:47.793129    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/85210f09-e4c3-4107-90e6-fedf15ae8de3-util\") pod \"85210f09-e4c3-4107-90e6-fedf15ae8de3\" (UID: \"85210f09-e4c3-4107-90e6-fedf15ae8de3\") "
Jul 16 22:23:47.793174 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:47.793159    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/85210f09-e4c3-4107-90e6-fedf15ae8de3-bundle\") pod \"85210f09-e4c3-4107-90e6-fedf15ae8de3\" (UID: \"85210f09-e4c3-4107-90e6-fedf15ae8de3\") "
Jul 16 22:23:47.793319 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:47.793180    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4c71d1ba-b4ce-41f4-8732-70e585f32271-bundle\") pod \"4c71d1ba-b4ce-41f4-8732-70e585f32271\" (UID: \"4c71d1ba-b4ce-41f4-8732-70e585f32271\") "
Jul 16 22:23:47.793319 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:47.793206    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7l8c6\" (UniqueName: \"kubernetes.io/projected/85210f09-e4c3-4107-90e6-fedf15ae8de3-kube-api-access-7l8c6\") pod \"85210f09-e4c3-4107-90e6-fedf15ae8de3\" (UID: \"85210f09-e4c3-4107-90e6-fedf15ae8de3\") "
Jul 16 22:23:47.793420 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:47.793357    2552 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8f17f275-aa05-4ba8-9344-27f9e4a2b83d-util\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 16 22:23:47.793420 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:47.793374    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vbxg7\" (UniqueName: \"kubernetes.io/projected/8f17f275-aa05-4ba8-9344-27f9e4a2b83d-kube-api-access-vbxg7\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 16 22:23:47.793420 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:47.793388    2552 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8f17f275-aa05-4ba8-9344-27f9e4a2b83d-bundle\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 16 22:23:47.793820 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:47.793661    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85210f09-e4c3-4107-90e6-fedf15ae8de3-bundle" (OuterVolumeSpecName: "bundle") pod "85210f09-e4c3-4107-90e6-fedf15ae8de3" (UID: "85210f09-e4c3-4107-90e6-fedf15ae8de3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:23:47.793820 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:47.793783    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c71d1ba-b4ce-41f4-8732-70e585f32271-bundle" (OuterVolumeSpecName: "bundle") pod "4c71d1ba-b4ce-41f4-8732-70e585f32271" (UID: "4c71d1ba-b4ce-41f4-8732-70e585f32271"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:23:47.795740 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:47.795717    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85210f09-e4c3-4107-90e6-fedf15ae8de3-kube-api-access-7l8c6" (OuterVolumeSpecName: "kube-api-access-7l8c6") pod "85210f09-e4c3-4107-90e6-fedf15ae8de3" (UID: "85210f09-e4c3-4107-90e6-fedf15ae8de3"). InnerVolumeSpecName "kube-api-access-7l8c6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:23:47.795836 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:47.795737    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c71d1ba-b4ce-41f4-8732-70e585f32271-kube-api-access-58xp6" (OuterVolumeSpecName: "kube-api-access-58xp6") pod "4c71d1ba-b4ce-41f4-8732-70e585f32271" (UID: "4c71d1ba-b4ce-41f4-8732-70e585f32271"). InnerVolumeSpecName "kube-api-access-58xp6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:23:47.801708 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:47.801672    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c71d1ba-b4ce-41f4-8732-70e585f32271-util" (OuterVolumeSpecName: "util") pod "4c71d1ba-b4ce-41f4-8732-70e585f32271" (UID: "4c71d1ba-b4ce-41f4-8732-70e585f32271"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:23:47.802155 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:47.802137    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85210f09-e4c3-4107-90e6-fedf15ae8de3-util" (OuterVolumeSpecName: "util") pod "85210f09-e4c3-4107-90e6-fedf15ae8de3" (UID: "85210f09-e4c3-4107-90e6-fedf15ae8de3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:23:47.894301 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:47.894278    2552 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/85210f09-e4c3-4107-90e6-fedf15ae8de3-util\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 16 22:23:47.894301 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:47.894298    2552 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/85210f09-e4c3-4107-90e6-fedf15ae8de3-bundle\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 16 22:23:47.894405 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:47.894307    2552 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4c71d1ba-b4ce-41f4-8732-70e585f32271-bundle\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 16 22:23:47.894405 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:47.894315    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7l8c6\" (UniqueName: \"kubernetes.io/projected/85210f09-e4c3-4107-90e6-fedf15ae8de3-kube-api-access-7l8c6\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 16 22:23:47.894405 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:47.894325    2552 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4c71d1ba-b4ce-41f4-8732-70e585f32271-util\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 16 22:23:47.894405 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:47.894333    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-58xp6\" (UniqueName: \"kubernetes.io/projected/4c71d1ba-b4ce-41f4-8732-70e585f32271-kube-api-access-58xp6\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 16 22:23:48.551897 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:48.551814    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5hcq" event={"ID":"85210f09-e4c3-4107-90e6-fedf15ae8de3","Type":"ContainerDied","Data":"56232f1ac745280a1d5646aa7b0240dbd60cb773952c508e1547945198ed5593"}
Jul 16 22:23:48.551897 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:48.551831    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5hcq"
Jul 16 22:23:48.551897 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:48.551879    2552 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="56232f1ac745280a1d5646aa7b0240dbd60cb773952c508e1547945198ed5593"
Jul 16 22:23:48.554065 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:48.554044    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qcxnf"
Jul 16 22:23:48.554065 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:48.554058    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qcxnf" event={"ID":"8f17f275-aa05-4ba8-9344-27f9e4a2b83d","Type":"ContainerDied","Data":"60ecdb2bee2c02147aad46ad9a7accac5ca7184d719000b515ca67e5f93be321"}
Jul 16 22:23:48.554233 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:48.554112    2552 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="60ecdb2bee2c02147aad46ad9a7accac5ca7184d719000b515ca67e5f93be321"
Jul 16 22:23:48.556198 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:48.556174    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fbp87" event={"ID":"4c71d1ba-b4ce-41f4-8732-70e585f32271","Type":"ContainerDied","Data":"91cbd608cf43f191793776834f03124eee27cc351b3a782e5505071367dca65b"}
Jul 16 22:23:48.556288 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:48.556213    2552 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="91cbd608cf43f191793776834f03124eee27cc351b3a782e5505071367dca65b"
Jul 16 22:23:48.556325 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:48.556313    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fbp87"
Jul 16 22:23:54.888529 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:54.888500    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4hrzs"]
Jul 16 22:23:54.888984 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:54.888796    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85210f09-e4c3-4107-90e6-fedf15ae8de3" containerName="util"
Jul 16 22:23:54.888984 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:54.888810    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="85210f09-e4c3-4107-90e6-fedf15ae8de3" containerName="util"
Jul 16 22:23:54.888984 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:54.888822    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f17f275-aa05-4ba8-9344-27f9e4a2b83d" containerName="pull"
Jul 16 22:23:54.888984 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:54.888827    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f17f275-aa05-4ba8-9344-27f9e4a2b83d" containerName="pull"
Jul 16 22:23:54.888984 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:54.888833    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f17f275-aa05-4ba8-9344-27f9e4a2b83d" containerName="extract"
Jul 16 22:23:54.888984 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:54.888840    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f17f275-aa05-4ba8-9344-27f9e4a2b83d" containerName="extract"
Jul 16 22:23:54.888984 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:54.888849    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab2794ae-2618-4c3c-aa15-a998e2001def" containerName="extract"
Jul 16 22:23:54.888984 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:54.888854    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab2794ae-2618-4c3c-aa15-a998e2001def" containerName="extract"
Jul 16 22:23:54.888984 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:54.888861    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c71d1ba-b4ce-41f4-8732-70e585f32271" containerName="extract"
Jul 16 22:23:54.888984 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:54.888866    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c71d1ba-b4ce-41f4-8732-70e585f32271" containerName="extract"
Jul 16 22:23:54.888984 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:54.888875    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f17f275-aa05-4ba8-9344-27f9e4a2b83d" containerName="util"
Jul 16 22:23:54.888984 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:54.888880    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f17f275-aa05-4ba8-9344-27f9e4a2b83d" containerName="util"
Jul 16 22:23:54.888984 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:54.888887    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c71d1ba-b4ce-41f4-8732-70e585f32271" containerName="util"
Jul 16 22:23:54.888984 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:54.888891    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c71d1ba-b4ce-41f4-8732-70e585f32271" containerName="util"
Jul 16 22:23:54.888984 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:54.888897    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c71d1ba-b4ce-41f4-8732-70e585f32271" containerName="pull"
Jul 16 22:23:54.888984 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:54.888902    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c71d1ba-b4ce-41f4-8732-70e585f32271" containerName="pull"
Jul 16 22:23:54.888984 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:54.888909    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85210f09-e4c3-4107-90e6-fedf15ae8de3" containerName="pull"
Jul 16 22:23:54.888984 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:54.888914    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="85210f09-e4c3-4107-90e6-fedf15ae8de3" containerName="pull"
Jul 16 22:23:54.888984 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:54.888920    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab2794ae-2618-4c3c-aa15-a998e2001def" containerName="pull"
Jul 16 22:23:54.888984 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:54.888925    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab2794ae-2618-4c3c-aa15-a998e2001def" containerName="pull"
Jul 16 22:23:54.888984 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:54.888931    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab2794ae-2618-4c3c-aa15-a998e2001def" containerName="util"
Jul 16 22:23:54.888984 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:54.888937    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab2794ae-2618-4c3c-aa15-a998e2001def" containerName="util"
Jul 16 22:23:54.888984 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:54.888943    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85210f09-e4c3-4107-90e6-fedf15ae8de3" containerName="extract"
Jul 16 22:23:54.888984 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:54.888947    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="85210f09-e4c3-4107-90e6-fedf15ae8de3" containerName="extract"
Jul 16 22:23:54.888984 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:54.888991    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f17f275-aa05-4ba8-9344-27f9e4a2b83d" containerName="extract"
Jul 16 22:23:54.888984 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:54.888999    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="85210f09-e4c3-4107-90e6-fedf15ae8de3" containerName="extract"
Jul 16 22:23:54.889731 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:54.889005    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c71d1ba-b4ce-41f4-8732-70e585f32271" containerName="extract"
Jul 16 22:23:54.889731 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:54.889012    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="ab2794ae-2618-4c3c-aa15-a998e2001def" containerName="extract"
Jul 16 22:23:54.892842 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:54.892821    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4hrzs"
Jul 16 22:23:54.896793 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:54.896770    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-76t4q\""
Jul 16 22:23:54.917192 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:54.917170    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4hrzs"]
Jul 16 22:23:54.935376 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:54.935353    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/671ac700-e816-4bc3-ac29-27806cbfef63-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-4hrzs\" (UID: \"671ac700-e816-4bc3-ac29-27806cbfef63\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4hrzs"
Jul 16 22:23:54.935461 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:54.935396    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-brq4v\" (UniqueName: \"kubernetes.io/projected/671ac700-e816-4bc3-ac29-27806cbfef63-kube-api-access-brq4v\") pod \"kuadrant-operator-controller-manager-8684c9ff49-4hrzs\" (UID: \"671ac700-e816-4bc3-ac29-27806cbfef63\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4hrzs"
Jul 16 22:23:55.035899 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:55.035868    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brq4v\" (UniqueName: \"kubernetes.io/projected/671ac700-e816-4bc3-ac29-27806cbfef63-kube-api-access-brq4v\") pod \"kuadrant-operator-controller-manager-8684c9ff49-4hrzs\" (UID: \"671ac700-e816-4bc3-ac29-27806cbfef63\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4hrzs"
Jul 16 22:23:55.035984 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:55.035922    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/671ac700-e816-4bc3-ac29-27806cbfef63-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-4hrzs\" (UID: \"671ac700-e816-4bc3-ac29-27806cbfef63\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4hrzs"
Jul 16 22:23:55.036236 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:55.036220    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/671ac700-e816-4bc3-ac29-27806cbfef63-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-4hrzs\" (UID: \"671ac700-e816-4bc3-ac29-27806cbfef63\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4hrzs"
Jul 16 22:23:55.047671 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:55.047649    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-brq4v\" (UniqueName: \"kubernetes.io/projected/671ac700-e816-4bc3-ac29-27806cbfef63-kube-api-access-brq4v\") pod \"kuadrant-operator-controller-manager-8684c9ff49-4hrzs\" (UID: \"671ac700-e816-4bc3-ac29-27806cbfef63\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4hrzs"
Jul 16 22:23:55.202635 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:55.202606    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4hrzs"
Jul 16 22:23:55.339222 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:55.339198    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4hrzs"]
Jul 16 22:23:55.340769 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:23:55.340744    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod671ac700_e816_4bc3_ac29_27806cbfef63.slice/crio-dd507b5b03fe90835e13cc5081aeeb820b80240d261bb065905f84991181dac7 WatchSource:0}: Error finding container dd507b5b03fe90835e13cc5081aeeb820b80240d261bb065905f84991181dac7: Status 404 returned error can't find the container with id dd507b5b03fe90835e13cc5081aeeb820b80240d261bb065905f84991181dac7
Jul 16 22:23:55.587719 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:55.587639    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4hrzs" event={"ID":"671ac700-e816-4bc3-ac29-27806cbfef63","Type":"ContainerStarted","Data":"dd507b5b03fe90835e13cc5081aeeb820b80240d261bb065905f84991181dac7"}
Jul 16 22:23:56.567555 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:56.567522    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-kvdfr"]
Jul 16 22:23:56.571061 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:56.571036    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kvdfr"
Jul 16 22:23:56.575988 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:56.575967    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-vsbmd\""
Jul 16 22:23:56.576979 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:56.576956    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 16 22:23:56.594096 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:56.594075    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-kvdfr"]
Jul 16 22:23:56.647355 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:56.647323    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hftn\" (UniqueName: \"kubernetes.io/projected/7baecf64-03e6-43a1-84eb-3feb51494edd-kube-api-access-9hftn\") pod \"dns-operator-controller-manager-864dd78c4c-kvdfr\" (UID: \"7baecf64-03e6-43a1-84eb-3feb51494edd\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kvdfr"
Jul 16 22:23:56.747822 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:56.747794    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hftn\" (UniqueName: \"kubernetes.io/projected/7baecf64-03e6-43a1-84eb-3feb51494edd-kube-api-access-9hftn\") pod \"dns-operator-controller-manager-864dd78c4c-kvdfr\" (UID: \"7baecf64-03e6-43a1-84eb-3feb51494edd\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kvdfr"
Jul 16 22:23:56.759798 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:56.759772    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hftn\" (UniqueName: \"kubernetes.io/projected/7baecf64-03e6-43a1-84eb-3feb51494edd-kube-api-access-9hftn\") pod \"dns-operator-controller-manager-864dd78c4c-kvdfr\" (UID: \"7baecf64-03e6-43a1-84eb-3feb51494edd\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kvdfr"
Jul 16 22:23:56.883457 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:56.883387    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kvdfr"
Jul 16 22:23:57.042959 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:57.042929    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-kvdfr"]
Jul 16 22:23:57.046446 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:23:57.046414    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7baecf64_03e6_43a1_84eb_3feb51494edd.slice/crio-71267248a662394042876aedb65ceccab2a3c71b63df1cbdabceba0c16497d34 WatchSource:0}: Error finding container 71267248a662394042876aedb65ceccab2a3c71b63df1cbdabceba0c16497d34: Status 404 returned error can't find the container with id 71267248a662394042876aedb65ceccab2a3c71b63df1cbdabceba0c16497d34
Jul 16 22:23:57.605126 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:57.605087    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kvdfr" event={"ID":"7baecf64-03e6-43a1-84eb-3feb51494edd","Type":"ContainerStarted","Data":"71267248a662394042876aedb65ceccab2a3c71b63df1cbdabceba0c16497d34"}
Jul 16 22:23:59.778193 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:59.778160    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-kjxfc"]
Jul 16 22:23:59.781580 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:59.781557    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-kjxfc"
Jul 16 22:23:59.784407 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:59.784382    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-nrh4n\""
Jul 16 22:23:59.794522 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:59.794496    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-kjxfc"]
Jul 16 22:23:59.867328 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:59.867264    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wxqn\" (UniqueName: \"kubernetes.io/projected/951f1766-ba8c-4b56-9116-afa1f71aba6d-kube-api-access-2wxqn\") pod \"authorino-operator-75cc8d5cb7-kjxfc\" (UID: \"951f1766-ba8c-4b56-9116-afa1f71aba6d\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-kjxfc"
Jul 16 22:23:59.967821 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:59.967793    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wxqn\" (UniqueName: \"kubernetes.io/projected/951f1766-ba8c-4b56-9116-afa1f71aba6d-kube-api-access-2wxqn\") pod \"authorino-operator-75cc8d5cb7-kjxfc\" (UID: \"951f1766-ba8c-4b56-9116-afa1f71aba6d\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-kjxfc"
Jul 16 22:23:59.998996 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:23:59.998973    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wxqn\" (UniqueName: \"kubernetes.io/projected/951f1766-ba8c-4b56-9116-afa1f71aba6d-kube-api-access-2wxqn\") pod \"authorino-operator-75cc8d5cb7-kjxfc\" (UID: \"951f1766-ba8c-4b56-9116-afa1f71aba6d\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-kjxfc"
Jul 16 22:24:00.092066 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:00.092037    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-kjxfc"
Jul 16 22:24:00.228240 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:00.228209    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-kjxfc"]
Jul 16 22:24:00.231416 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:24:00.231386    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod951f1766_ba8c_4b56_9116_afa1f71aba6d.slice/crio-31c1785153823fc7ee579972c886dce709c017a24a8c3c8377921ccf4a9009c0 WatchSource:0}: Error finding container 31c1785153823fc7ee579972c886dce709c017a24a8c3c8377921ccf4a9009c0: Status 404 returned error can't find the container with id 31c1785153823fc7ee579972c886dce709c017a24a8c3c8377921ccf4a9009c0
Jul 16 22:24:00.624220 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:00.624185    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4hrzs" event={"ID":"671ac700-e816-4bc3-ac29-27806cbfef63","Type":"ContainerStarted","Data":"7abc1913a054cc668ca0040663cb76502314c09a3eee96e1f52e68975aa3cf9f"}
Jul 16 22:24:00.624399 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:00.624262    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4hrzs"
Jul 16 22:24:00.625426 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:00.625400    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-kjxfc" event={"ID":"951f1766-ba8c-4b56-9116-afa1f71aba6d","Type":"ContainerStarted","Data":"31c1785153823fc7ee579972c886dce709c017a24a8c3c8377921ccf4a9009c0"}
Jul 16 22:24:00.626759 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:00.626738    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kvdfr" event={"ID":"7baecf64-03e6-43a1-84eb-3feb51494edd","Type":"ContainerStarted","Data":"805e7c0252320f85783a80ade93efb4263ff7a8a4732afa65e64e75467574747"}
Jul 16 22:24:00.626877 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:00.626862    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kvdfr"
Jul 16 22:24:00.690378 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:00.690333    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4hrzs" podStartSLOduration=2.4676765449999998 podStartE2EDuration="6.69031355s" totalImagesPullingTime="4.222637005s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:23:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:24:00.655376314 +0000 UTC m=+614.870157474" watchObservedRunningTime="2026-07-16 22:24:00.69031355 +0000 UTC m=+614.905094713"
Jul 16 22:24:02.392297 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:02.392246    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kvdfr" podStartSLOduration=3.823684686 podStartE2EDuration="6.392230101s" totalImagesPullingTime="2.568545415s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:23:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:24:00.694287207 +0000 UTC m=+614.909068364" watchObservedRunningTime="2026-07-16 22:24:02.392230101 +0000 UTC m=+616.607011262"
Jul 16 22:24:02.393644 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:02.393621    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fqgz9"]
Jul 16 22:24:02.397251 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:02.397228    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fqgz9"
Jul 16 22:24:02.399800 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:02.399784    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-7xzpn\""
Jul 16 22:24:02.408174 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:02.408154    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fqgz9"]
Jul 16 22:24:02.486984 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:02.486956    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5w8l\" (UniqueName: \"kubernetes.io/projected/b3831274-8796-4209-9ec4-f3f74246a6f8-kube-api-access-k5w8l\") pod \"limitador-operator-controller-manager-859d7b78bd-fqgz9\" (UID: \"b3831274-8796-4209-9ec4-f3f74246a6f8\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fqgz9"
Jul 16 22:24:02.587602 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:02.587509    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5w8l\" (UniqueName: \"kubernetes.io/projected/b3831274-8796-4209-9ec4-f3f74246a6f8-kube-api-access-k5w8l\") pod \"limitador-operator-controller-manager-859d7b78bd-fqgz9\" (UID: \"b3831274-8796-4209-9ec4-f3f74246a6f8\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fqgz9"
Jul 16 22:24:02.599664 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:02.599632    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5w8l\" (UniqueName: \"kubernetes.io/projected/b3831274-8796-4209-9ec4-f3f74246a6f8-kube-api-access-k5w8l\") pod \"limitador-operator-controller-manager-859d7b78bd-fqgz9\" (UID: \"b3831274-8796-4209-9ec4-f3f74246a6f8\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fqgz9"
Jul 16 22:24:02.638322 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:02.638293    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-kjxfc" event={"ID":"951f1766-ba8c-4b56-9116-afa1f71aba6d","Type":"ContainerStarted","Data":"485bcba6601bef0000a39f6e6b580c21b035084bc7f17fd7b27da093fe9f622d"}
Jul 16 22:24:02.638451 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:02.638434    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-kjxfc"
Jul 16 22:24:02.657280 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:02.657236    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-kjxfc" podStartSLOduration=1.576985059 podStartE2EDuration="3.657222138s" totalImagesPullingTime="2.080237079s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:23:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:24:02.656130804 +0000 UTC m=+616.870911964" watchObservedRunningTime="2026-07-16 22:24:02.657222138 +0000 UTC m=+616.872003298"
Jul 16 22:24:02.706605 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:02.706580    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fqgz9"
Jul 16 22:24:02.833066 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:02.833036    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fqgz9"]
Jul 16 22:24:02.834796 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:24:02.834767    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3831274_8796_4209_9ec4_f3f74246a6f8.slice/crio-0364312c43eee190a0ab7937e9a6dec7d59832d38e9578b8ff1f53376fae42a6 WatchSource:0}: Error finding container 0364312c43eee190a0ab7937e9a6dec7d59832d38e9578b8ff1f53376fae42a6: Status 404 returned error can't find the container with id 0364312c43eee190a0ab7937e9a6dec7d59832d38e9578b8ff1f53376fae42a6
Jul 16 22:24:03.646443 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:03.646396    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fqgz9" event={"ID":"b3831274-8796-4209-9ec4-f3f74246a6f8","Type":"ContainerStarted","Data":"0364312c43eee190a0ab7937e9a6dec7d59832d38e9578b8ff1f53376fae42a6"}
Jul 16 22:24:04.652184 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:04.652143    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fqgz9" event={"ID":"b3831274-8796-4209-9ec4-f3f74246a6f8","Type":"ContainerStarted","Data":"00de0b01aed9598b109714a7377f7fb7b8d9ef2f58c3f70d078607aa36fe0ae3"}
Jul 16 22:24:04.652575 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:04.652220    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fqgz9"
Jul 16 22:24:04.674353 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:04.674307    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fqgz9" podStartSLOduration=1.326527591 podStartE2EDuration="2.674292458s" totalImagesPullingTime="1.347764867s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:24:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:24:04.673060872 +0000 UTC m=+618.887842031" watchObservedRunningTime="2026-07-16 22:24:04.674292458 +0000 UTC m=+618.889073618"
Jul 16 22:24:11.634436 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:11.634401    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kvdfr"
Jul 16 22:24:11.634883 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:11.634556    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4hrzs"
Jul 16 22:24:13.649279 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:13.649248    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-kjxfc"
Jul 16 22:24:13.820303 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:13.820262    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4hrzs"]
Jul 16 22:24:13.820516 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:13.820490    2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4hrzs" podUID="671ac700-e816-4bc3-ac29-27806cbfef63" containerName="manager" containerID="cri-o://7abc1913a054cc668ca0040663cb76502314c09a3eee96e1f52e68975aa3cf9f" gracePeriod=2
Jul 16 22:24:13.832120 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:13.832093    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4hrzs"]
Jul 16 22:24:13.850725 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:13.850685    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fqgz9"]
Jul 16 22:24:13.850996 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:13.850949    2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fqgz9" podUID="b3831274-8796-4209-9ec4-f3f74246a6f8" containerName="manager" containerID="cri-o://00de0b01aed9598b109714a7377f7fb7b8d9ef2f58c3f70d078607aa36fe0ae3" gracePeriod=2
Jul 16 22:24:13.852795 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:13.852767    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fqgz9"
Jul 16 22:24:13.859788 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:13.859275    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fqgz9"]
Jul 16 22:24:13.873240 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:24:13.873211    2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-4hrzs\" is forbidden: User \"system:node:ip-10-0-141-47.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-47.ec2.internal' and this object" podUID="671ac700-e816-4bc3-ac29-27806cbfef63" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4hrzs"
Jul 16 22:24:13.875460 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:24:13.875398    2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-4hrzs\" is forbidden: User \"system:node:ip-10-0-141-47.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-47.ec2.internal' and this object" podUID="671ac700-e816-4bc3-ac29-27806cbfef63" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4hrzs"
Jul 16 22:24:13.877316 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:13.877296    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g4b98"]
Jul 16 22:24:13.877589 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:13.877578    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="671ac700-e816-4bc3-ac29-27806cbfef63" containerName="manager"
Jul 16 22:24:13.877630 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:13.877592    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="671ac700-e816-4bc3-ac29-27806cbfef63" containerName="manager"
Jul 16 22:24:13.877630 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:13.877603    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3831274-8796-4209-9ec4-f3f74246a6f8" containerName="manager"
Jul 16 22:24:13.877630 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:13.877609    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3831274-8796-4209-9ec4-f3f74246a6f8" containerName="manager"
Jul 16 22:24:13.877735 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:13.877663    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="671ac700-e816-4bc3-ac29-27806cbfef63" containerName="manager"
Jul 16 22:24:13.877735 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:13.877672    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="b3831274-8796-4209-9ec4-f3f74246a6f8" containerName="manager"
Jul 16 22:24:13.880680 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:13.880662    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g4b98"
Jul 16 22:24:13.883019 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:24:13.882991    2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-fqgz9\" is forbidden: User \"system:node:ip-10-0-141-47.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-47.ec2.internal' and this object" podUID="b3831274-8796-4209-9ec4-f3f74246a6f8" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fqgz9"
Jul 16 22:24:13.885300 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:24:13.885273    2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-4hrzs\" is forbidden: User \"system:node:ip-10-0-141-47.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-47.ec2.internal' and this object" podUID="671ac700-e816-4bc3-ac29-27806cbfef63" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4hrzs"
Jul 16 22:24:13.888493 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:24:13.888467    2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-fqgz9\" is forbidden: User \"system:node:ip-10-0-141-47.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-47.ec2.internal' and this object" podUID="b3831274-8796-4209-9ec4-f3f74246a6f8" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fqgz9"
Jul 16 22:24:13.904819 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:13.904798    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g4b98"]
Jul 16 22:24:13.911279 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:13.911258    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vxzrg"]
Jul 16 22:24:13.914899 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:13.914880    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vxzrg"
Jul 16 22:24:13.935432 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:13.935410    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vxzrg"]
Jul 16 22:24:13.950174 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:24:13.950146    2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-4hrzs\" is forbidden: User \"system:node:ip-10-0-141-47.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-47.ec2.internal' and this object" podUID="671ac700-e816-4bc3-ac29-27806cbfef63" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4hrzs"
Jul 16 22:24:13.958754 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:13.958725    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xlwzh\" (UniqueName: \"kubernetes.io/projected/ae48b2fd-aa0d-4398-90e0-dbd8019ce326-kube-api-access-xlwzh\") pod \"limitador-operator-controller-manager-859d7b78bd-vxzrg\" (UID: \"ae48b2fd-aa0d-4398-90e0-dbd8019ce326\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vxzrg"
Jul 16 22:24:13.992111 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:24:13.992068    2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-fqgz9\" is forbidden: User \"system:node:ip-10-0-141-47.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-47.ec2.internal' and this object" podUID="b3831274-8796-4209-9ec4-f3f74246a6f8" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fqgz9"
Jul 16 22:24:14.059294 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:14.059260    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5c19fde3-1376-416d-9a42-0e0bee177445-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-g4b98\" (UID: \"5c19fde3-1376-416d-9a42-0e0bee177445\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g4b98"
Jul 16 22:24:14.059447 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:14.059314    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xlwzh\" (UniqueName: \"kubernetes.io/projected/ae48b2fd-aa0d-4398-90e0-dbd8019ce326-kube-api-access-xlwzh\") pod \"limitador-operator-controller-manager-859d7b78bd-vxzrg\" (UID: \"ae48b2fd-aa0d-4398-90e0-dbd8019ce326\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vxzrg"
Jul 16 22:24:14.059447 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:14.059388    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kw56v\" (UniqueName: \"kubernetes.io/projected/5c19fde3-1376-416d-9a42-0e0bee177445-kube-api-access-kw56v\") pod \"kuadrant-operator-controller-manager-8684c9ff49-g4b98\" (UID: \"5c19fde3-1376-416d-9a42-0e0bee177445\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g4b98"
Jul 16 22:24:14.070414 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:14.070389    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xlwzh\" (UniqueName: \"kubernetes.io/projected/ae48b2fd-aa0d-4398-90e0-dbd8019ce326-kube-api-access-xlwzh\") pod \"limitador-operator-controller-manager-859d7b78bd-vxzrg\" (UID: \"ae48b2fd-aa0d-4398-90e0-dbd8019ce326\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vxzrg"
Jul 16 22:24:14.097168 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:14.097148    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4hrzs"
Jul 16 22:24:14.099365 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:14.099347    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fqgz9"
Jul 16 22:24:14.099739 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:24:14.099716    2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-4hrzs\" is forbidden: User \"system:node:ip-10-0-141-47.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-47.ec2.internal' and this object" podUID="671ac700-e816-4bc3-ac29-27806cbfef63" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4hrzs"
Jul 16 22:24:14.101956 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:24:14.101935    2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-fqgz9\" is forbidden: User \"system:node:ip-10-0-141-47.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-47.ec2.internal' and this object" podUID="b3831274-8796-4209-9ec4-f3f74246a6f8" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fqgz9"
Jul 16 22:24:14.103948 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:24:14.103926    2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-4hrzs\" is forbidden: User \"system:node:ip-10-0-141-47.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-47.ec2.internal' and this object" podUID="671ac700-e816-4bc3-ac29-27806cbfef63" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4hrzs"
Jul 16 22:24:14.108352 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:24:14.108332    2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-fqgz9\" is forbidden: User \"system:node:ip-10-0-141-47.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-47.ec2.internal' and this object" podUID="b3831274-8796-4209-9ec4-f3f74246a6f8" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fqgz9"
Jul 16 22:24:14.159804 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:14.159751    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k5w8l\" (UniqueName: \"kubernetes.io/projected/b3831274-8796-4209-9ec4-f3f74246a6f8-kube-api-access-k5w8l\") pod \"b3831274-8796-4209-9ec4-f3f74246a6f8\" (UID: \"b3831274-8796-4209-9ec4-f3f74246a6f8\") "
Jul 16 22:24:14.159804 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:14.159797    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/671ac700-e816-4bc3-ac29-27806cbfef63-extensions-socket-volume\") pod \"671ac700-e816-4bc3-ac29-27806cbfef63\" (UID: \"671ac700-e816-4bc3-ac29-27806cbfef63\") "
Jul 16 22:24:14.159923 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:14.159838    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-brq4v\" (UniqueName: \"kubernetes.io/projected/671ac700-e816-4bc3-ac29-27806cbfef63-kube-api-access-brq4v\") pod \"671ac700-e816-4bc3-ac29-27806cbfef63\" (UID: \"671ac700-e816-4bc3-ac29-27806cbfef63\") "
Jul 16 22:24:14.159969 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:14.159934    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kw56v\" (UniqueName: \"kubernetes.io/projected/5c19fde3-1376-416d-9a42-0e0bee177445-kube-api-access-kw56v\") pod \"kuadrant-operator-controller-manager-8684c9ff49-g4b98\" (UID: \"5c19fde3-1376-416d-9a42-0e0bee177445\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g4b98"
Jul 16 22:24:14.160005 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:14.159990    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5c19fde3-1376-416d-9a42-0e0bee177445-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-g4b98\" (UID: \"5c19fde3-1376-416d-9a42-0e0bee177445\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g4b98"
Jul 16 22:24:14.160350 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:14.160326    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/671ac700-e816-4bc3-ac29-27806cbfef63-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "671ac700-e816-4bc3-ac29-27806cbfef63" (UID: "671ac700-e816-4bc3-ac29-27806cbfef63"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:24:14.160426 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:14.160380    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5c19fde3-1376-416d-9a42-0e0bee177445-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-g4b98\" (UID: \"5c19fde3-1376-416d-9a42-0e0bee177445\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g4b98"
Jul 16 22:24:14.161790 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:14.161769    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3831274-8796-4209-9ec4-f3f74246a6f8-kube-api-access-k5w8l" (OuterVolumeSpecName: "kube-api-access-k5w8l") pod "b3831274-8796-4209-9ec4-f3f74246a6f8" (UID: "b3831274-8796-4209-9ec4-f3f74246a6f8"). InnerVolumeSpecName "kube-api-access-k5w8l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:24:14.161970 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:14.161950    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/671ac700-e816-4bc3-ac29-27806cbfef63-kube-api-access-brq4v" (OuterVolumeSpecName: "kube-api-access-brq4v") pod "671ac700-e816-4bc3-ac29-27806cbfef63" (UID: "671ac700-e816-4bc3-ac29-27806cbfef63"). InnerVolumeSpecName "kube-api-access-brq4v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:24:14.168619 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:14.168596    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kw56v\" (UniqueName: \"kubernetes.io/projected/5c19fde3-1376-416d-9a42-0e0bee177445-kube-api-access-kw56v\") pod \"kuadrant-operator-controller-manager-8684c9ff49-g4b98\" (UID: \"5c19fde3-1376-416d-9a42-0e0bee177445\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g4b98"
Jul 16 22:24:14.260981 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:14.260962    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k5w8l\" (UniqueName: \"kubernetes.io/projected/b3831274-8796-4209-9ec4-f3f74246a6f8-kube-api-access-k5w8l\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 16 22:24:14.260981 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:14.260983    2552 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/671ac700-e816-4bc3-ac29-27806cbfef63-extensions-socket-volume\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 16 22:24:14.261103 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:14.260992    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-brq4v\" (UniqueName: \"kubernetes.io/projected/671ac700-e816-4bc3-ac29-27806cbfef63-kube-api-access-brq4v\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 16 22:24:14.265961 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:14.265932    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g4b98"
Jul 16 22:24:14.273486 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:14.273468    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vxzrg"
Jul 16 22:24:14.275543 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:14.275520    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="671ac700-e816-4bc3-ac29-27806cbfef63" path="/var/lib/kubelet/pods/671ac700-e816-4bc3-ac29-27806cbfef63/volumes"
Jul 16 22:24:14.275859 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:14.275843    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b3831274-8796-4209-9ec4-f3f74246a6f8" path="/var/lib/kubelet/pods/b3831274-8796-4209-9ec4-f3f74246a6f8/volumes"
Jul 16 22:24:14.429607 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:14.429537    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g4b98"]
Jul 16 22:24:14.432878 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:24:14.432852    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c19fde3_1376_416d_9a42_0e0bee177445.slice/crio-9db100c8100027175201c8ae415aa0c9a3c1455a7b8e8a658ba27848bb24d727 WatchSource:0}: Error finding container 9db100c8100027175201c8ae415aa0c9a3c1455a7b8e8a658ba27848bb24d727: Status 404 returned error can't find the container with id 9db100c8100027175201c8ae415aa0c9a3c1455a7b8e8a658ba27848bb24d727
Jul 16 22:24:14.438157 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:14.438132    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vxzrg"]
Jul 16 22:24:14.440978 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:24:14.440956    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae48b2fd_aa0d_4398_90e0_dbd8019ce326.slice/crio-6e5405fed73610e6819fad875e3ce9e2259e84fbf92abba06894bce50323c9ad WatchSource:0}: Error finding container 6e5405fed73610e6819fad875e3ce9e2259e84fbf92abba06894bce50323c9ad: Status 404 returned error can't find the container with id 6e5405fed73610e6819fad875e3ce9e2259e84fbf92abba06894bce50323c9ad
Jul 16 22:24:14.705596 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:14.705565    2552 generic.go:356] "Generic (PLEG): container finished" podID="b3831274-8796-4209-9ec4-f3f74246a6f8" containerID="00de0b01aed9598b109714a7377f7fb7b8d9ef2f58c3f70d078607aa36fe0ae3" exitCode=0
Jul 16 22:24:14.706105 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:14.705621    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fqgz9"
Jul 16 22:24:14.706105 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:14.705677    2552 scope.go:117] "RemoveContainer" containerID="00de0b01aed9598b109714a7377f7fb7b8d9ef2f58c3f70d078607aa36fe0ae3"
Jul 16 22:24:14.708573 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:14.708504    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vxzrg" event={"ID":"ae48b2fd-aa0d-4398-90e0-dbd8019ce326","Type":"ContainerStarted","Data":"a3e9f22e281996f42bd41c54e50a3580f744fbe32ce1ce0a5055a79c92135cf6"}
Jul 16 22:24:14.708751 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:14.708632    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vxzrg" event={"ID":"ae48b2fd-aa0d-4398-90e0-dbd8019ce326","Type":"ContainerStarted","Data":"6e5405fed73610e6819fad875e3ce9e2259e84fbf92abba06894bce50323c9ad"}
Jul 16 22:24:14.708751 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:14.708667    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vxzrg"
Jul 16 22:24:14.710473 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:14.710446    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g4b98" event={"ID":"5c19fde3-1376-416d-9a42-0e0bee177445","Type":"ContainerStarted","Data":"3640e743d39f3064112ad3672d4cc0fd33a4d5b2a9d8be8d963fb333b16c597c"}
Jul 16 22:24:14.710580 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:14.710508    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g4b98" event={"ID":"5c19fde3-1376-416d-9a42-0e0bee177445","Type":"ContainerStarted","Data":"9db100c8100027175201c8ae415aa0c9a3c1455a7b8e8a658ba27848bb24d727"}
Jul 16 22:24:14.710580 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:14.710538    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g4b98"
Jul 16 22:24:14.712185 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:14.712163    2552 generic.go:356] "Generic (PLEG): container finished" podID="671ac700-e816-4bc3-ac29-27806cbfef63" containerID="7abc1913a054cc668ca0040663cb76502314c09a3eee96e1f52e68975aa3cf9f" exitCode=0
Jul 16 22:24:14.712357 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:14.712201    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4hrzs"
Jul 16 22:24:14.715601 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:14.715584    2552 scope.go:117] "RemoveContainer" containerID="00de0b01aed9598b109714a7377f7fb7b8d9ef2f58c3f70d078607aa36fe0ae3"
Jul 16 22:24:14.715896 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:24:14.715873    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"00de0b01aed9598b109714a7377f7fb7b8d9ef2f58c3f70d078607aa36fe0ae3\": container with ID starting with 00de0b01aed9598b109714a7377f7fb7b8d9ef2f58c3f70d078607aa36fe0ae3 not found: ID does not exist" containerID="00de0b01aed9598b109714a7377f7fb7b8d9ef2f58c3f70d078607aa36fe0ae3"
Jul 16 22:24:14.715975 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:14.715903    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00de0b01aed9598b109714a7377f7fb7b8d9ef2f58c3f70d078607aa36fe0ae3"} err="failed to get container status \"00de0b01aed9598b109714a7377f7fb7b8d9ef2f58c3f70d078607aa36fe0ae3\": rpc error: code = NotFound desc = could not find container \"00de0b01aed9598b109714a7377f7fb7b8d9ef2f58c3f70d078607aa36fe0ae3\": container with ID starting with 00de0b01aed9598b109714a7377f7fb7b8d9ef2f58c3f70d078607aa36fe0ae3 not found: ID does not exist"
Jul 16 22:24:14.715975 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:14.715920    2552 scope.go:117] "RemoveContainer" containerID="7abc1913a054cc668ca0040663cb76502314c09a3eee96e1f52e68975aa3cf9f"
Jul 16 22:24:14.723830 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:14.723814    2552 scope.go:117] "RemoveContainer" containerID="7abc1913a054cc668ca0040663cb76502314c09a3eee96e1f52e68975aa3cf9f"
Jul 16 22:24:14.724062 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:24:14.724048    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7abc1913a054cc668ca0040663cb76502314c09a3eee96e1f52e68975aa3cf9f\": container with ID starting with 7abc1913a054cc668ca0040663cb76502314c09a3eee96e1f52e68975aa3cf9f not found: ID does not exist" containerID="7abc1913a054cc668ca0040663cb76502314c09a3eee96e1f52e68975aa3cf9f"
Jul 16 22:24:14.724116 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:14.724068    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7abc1913a054cc668ca0040663cb76502314c09a3eee96e1f52e68975aa3cf9f"} err="failed to get container status \"7abc1913a054cc668ca0040663cb76502314c09a3eee96e1f52e68975aa3cf9f\": rpc error: code = NotFound desc = could not find container \"7abc1913a054cc668ca0040663cb76502314c09a3eee96e1f52e68975aa3cf9f\": container with ID starting with 7abc1913a054cc668ca0040663cb76502314c09a3eee96e1f52e68975aa3cf9f not found: ID does not exist"
Jul 16 22:24:14.736400 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:14.736362    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vxzrg" podStartSLOduration=1.736349514 podStartE2EDuration="1.736349514s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:24:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:24:14.73337307 +0000 UTC m=+628.948154224" watchObservedRunningTime="2026-07-16 22:24:14.736349514 +0000 UTC m=+628.951130674"
Jul 16 22:24:14.767555 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:14.767515    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g4b98" podStartSLOduration=1.7675043160000001 podStartE2EDuration="1.767504316s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:24:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:24:14.767013072 +0000 UTC m=+628.981794257" watchObservedRunningTime="2026-07-16 22:24:14.767504316 +0000 UTC m=+628.982285551"
Jul 16 22:24:15.214711 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:15.214665    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lxvtv"]
Jul 16 22:24:15.219256 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:15.219237    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lxvtv"
Jul 16 22:24:15.238091 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:15.238067    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lxvtv"]
Jul 16 22:24:15.268841 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:15.268813    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2hdg\" (UniqueName: \"kubernetes.io/projected/4bfd9b37-96a4-496a-96a3-36885a73e07b-kube-api-access-v2hdg\") pod \"kuadrant-operator-controller-manager-86878c769f-lxvtv\" (UID: \"4bfd9b37-96a4-496a-96a3-36885a73e07b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lxvtv"
Jul 16 22:24:15.268979 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:15.268865    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4bfd9b37-96a4-496a-96a3-36885a73e07b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-lxvtv\" (UID: \"4bfd9b37-96a4-496a-96a3-36885a73e07b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lxvtv"
Jul 16 22:24:15.369421 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:15.369391    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2hdg\" (UniqueName: \"kubernetes.io/projected/4bfd9b37-96a4-496a-96a3-36885a73e07b-kube-api-access-v2hdg\") pod \"kuadrant-operator-controller-manager-86878c769f-lxvtv\" (UID: \"4bfd9b37-96a4-496a-96a3-36885a73e07b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lxvtv"
Jul 16 22:24:15.369568 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:15.369439    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4bfd9b37-96a4-496a-96a3-36885a73e07b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-lxvtv\" (UID: \"4bfd9b37-96a4-496a-96a3-36885a73e07b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lxvtv"
Jul 16 22:24:15.369788 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:15.369772    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4bfd9b37-96a4-496a-96a3-36885a73e07b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-lxvtv\" (UID: \"4bfd9b37-96a4-496a-96a3-36885a73e07b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lxvtv"
Jul 16 22:24:15.379304 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:15.379277    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2hdg\" (UniqueName: \"kubernetes.io/projected/4bfd9b37-96a4-496a-96a3-36885a73e07b-kube-api-access-v2hdg\") pod \"kuadrant-operator-controller-manager-86878c769f-lxvtv\" (UID: \"4bfd9b37-96a4-496a-96a3-36885a73e07b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lxvtv"
Jul 16 22:24:15.529499 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:15.529423    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lxvtv"
Jul 16 22:24:15.658812 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:15.658778    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lxvtv"]
Jul 16 22:24:15.661863 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:24:15.661837    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bfd9b37_96a4_496a_96a3_36885a73e07b.slice/crio-f86bd2ca79503324d644b8d9d89e5f65866f57c1fde3953af1608907e1ea3130 WatchSource:0}: Error finding container f86bd2ca79503324d644b8d9d89e5f65866f57c1fde3953af1608907e1ea3130: Status 404 returned error can't find the container with id f86bd2ca79503324d644b8d9d89e5f65866f57c1fde3953af1608907e1ea3130
Jul 16 22:24:15.720768 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:15.720737    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lxvtv" event={"ID":"4bfd9b37-96a4-496a-96a3-36885a73e07b","Type":"ContainerStarted","Data":"f86bd2ca79503324d644b8d9d89e5f65866f57c1fde3953af1608907e1ea3130"}
Jul 16 22:24:16.727055 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:16.727020    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lxvtv" event={"ID":"4bfd9b37-96a4-496a-96a3-36885a73e07b","Type":"ContainerStarted","Data":"9d5549413a1d5268c0179ebc035c94be4f30ce1f6116db29336200d1fbb3f912"}
Jul 16 22:24:16.727423 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:16.727084    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lxvtv"
Jul 16 22:24:16.766441 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:16.766400    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lxvtv" podStartSLOduration=1.766385538 podStartE2EDuration="1.766385538s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:24:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:24:16.764928271 +0000 UTC m=+630.979709431" watchObservedRunningTime="2026-07-16 22:24:16.766385538 +0000 UTC m=+630.981166698"
Jul 16 22:24:25.723393 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:25.723355    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vxzrg"
Jul 16 22:24:25.723777 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:25.723442    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g4b98"
Jul 16 22:24:27.734103 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:27.734073    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lxvtv"
Jul 16 22:24:27.787944 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:27.787914    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g4b98"]
Jul 16 22:24:27.788117 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:27.788093    2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g4b98" podUID="5c19fde3-1376-416d-9a42-0e0bee177445" containerName="manager" containerID="cri-o://3640e743d39f3064112ad3672d4cc0fd33a4d5b2a9d8be8d963fb333b16c597c" gracePeriod=10
Jul 16 22:24:28.046263 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:28.046239    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g4b98"
Jul 16 22:24:28.065103 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:28.065080    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kw56v\" (UniqueName: \"kubernetes.io/projected/5c19fde3-1376-416d-9a42-0e0bee177445-kube-api-access-kw56v\") pod \"5c19fde3-1376-416d-9a42-0e0bee177445\" (UID: \"5c19fde3-1376-416d-9a42-0e0bee177445\") "
Jul 16 22:24:28.065231 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:28.065143    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5c19fde3-1376-416d-9a42-0e0bee177445-extensions-socket-volume\") pod \"5c19fde3-1376-416d-9a42-0e0bee177445\" (UID: \"5c19fde3-1376-416d-9a42-0e0bee177445\") "
Jul 16 22:24:28.065449 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:28.065424    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c19fde3-1376-416d-9a42-0e0bee177445-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "5c19fde3-1376-416d-9a42-0e0bee177445" (UID: "5c19fde3-1376-416d-9a42-0e0bee177445"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:24:28.067050 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:28.067019    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c19fde3-1376-416d-9a42-0e0bee177445-kube-api-access-kw56v" (OuterVolumeSpecName: "kube-api-access-kw56v") pod "5c19fde3-1376-416d-9a42-0e0bee177445" (UID: "5c19fde3-1376-416d-9a42-0e0bee177445"). InnerVolumeSpecName "kube-api-access-kw56v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:24:28.166065 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:28.166036    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kw56v\" (UniqueName: \"kubernetes.io/projected/5c19fde3-1376-416d-9a42-0e0bee177445-kube-api-access-kw56v\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 16 22:24:28.166065 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:28.166059    2552 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5c19fde3-1376-416d-9a42-0e0bee177445-extensions-socket-volume\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 16 22:24:28.788196 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:28.788157    2552 generic.go:356] "Generic (PLEG): container finished" podID="5c19fde3-1376-416d-9a42-0e0bee177445" containerID="3640e743d39f3064112ad3672d4cc0fd33a4d5b2a9d8be8d963fb333b16c597c" exitCode=0
Jul 16 22:24:28.788579 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:28.788204    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g4b98"
Jul 16 22:24:28.788579 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:28.788203    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g4b98" event={"ID":"5c19fde3-1376-416d-9a42-0e0bee177445","Type":"ContainerDied","Data":"3640e743d39f3064112ad3672d4cc0fd33a4d5b2a9d8be8d963fb333b16c597c"}
Jul 16 22:24:28.788579 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:28.788340    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g4b98" event={"ID":"5c19fde3-1376-416d-9a42-0e0bee177445","Type":"ContainerDied","Data":"9db100c8100027175201c8ae415aa0c9a3c1455a7b8e8a658ba27848bb24d727"}
Jul 16 22:24:28.788579 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:28.788372    2552 scope.go:117] "RemoveContainer" containerID="3640e743d39f3064112ad3672d4cc0fd33a4d5b2a9d8be8d963fb333b16c597c"
Jul 16 22:24:28.797088 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:28.797068    2552 scope.go:117] "RemoveContainer" containerID="3640e743d39f3064112ad3672d4cc0fd33a4d5b2a9d8be8d963fb333b16c597c"
Jul 16 22:24:28.797349 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:24:28.797328    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3640e743d39f3064112ad3672d4cc0fd33a4d5b2a9d8be8d963fb333b16c597c\": container with ID starting with 3640e743d39f3064112ad3672d4cc0fd33a4d5b2a9d8be8d963fb333b16c597c not found: ID does not exist" containerID="3640e743d39f3064112ad3672d4cc0fd33a4d5b2a9d8be8d963fb333b16c597c"
Jul 16 22:24:28.797409 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:28.797362    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3640e743d39f3064112ad3672d4cc0fd33a4d5b2a9d8be8d963fb333b16c597c"} err="failed to get container status \"3640e743d39f3064112ad3672d4cc0fd33a4d5b2a9d8be8d963fb333b16c597c\": rpc error: code = NotFound desc = could not find container \"3640e743d39f3064112ad3672d4cc0fd33a4d5b2a9d8be8d963fb333b16c597c\": container with ID starting with 3640e743d39f3064112ad3672d4cc0fd33a4d5b2a9d8be8d963fb333b16c597c not found: ID does not exist"
Jul 16 22:24:28.814102 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:28.814077    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g4b98"]
Jul 16 22:24:28.817360 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:28.817338    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g4b98"]
Jul 16 22:24:30.275533 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:30.275502    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5c19fde3-1376-416d-9a42-0e0bee177445" path="/var/lib/kubelet/pods/5c19fde3-1376-416d-9a42-0e0bee177445/volumes"
Jul 16 22:24:46.295711 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:46.295670    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-j74kk"]
Jul 16 22:24:46.296143 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:46.295985    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c19fde3-1376-416d-9a42-0e0bee177445" containerName="manager"
Jul 16 22:24:46.296143 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:46.295997    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c19fde3-1376-416d-9a42-0e0bee177445" containerName="manager"
Jul 16 22:24:46.296143 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:46.296052    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c19fde3-1376-416d-9a42-0e0bee177445" containerName="manager"
Jul 16 22:24:46.300102 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:46.300081    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-j74kk"
Jul 16 22:24:46.302813 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:46.302791    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 16 22:24:46.302949 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:46.302861    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-dwmx8\""
Jul 16 22:24:46.308487 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:46.308196    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-j74kk"]
Jul 16 22:24:46.391120 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:46.391081    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5l7nb\" (UniqueName: \"kubernetes.io/projected/3d73ba30-af60-4a72-8f70-cdb00c819800-kube-api-access-5l7nb\") pod \"limitador-limitador-64c94fd64f-j74kk\" (UID: \"3d73ba30-af60-4a72-8f70-cdb00c819800\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-j74kk"
Jul 16 22:24:46.391296 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:46.391231    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3d73ba30-af60-4a72-8f70-cdb00c819800-config-file\") pod \"limitador-limitador-64c94fd64f-j74kk\" (UID: \"3d73ba30-af60-4a72-8f70-cdb00c819800\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-j74kk"
Jul 16 22:24:46.398832 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:46.398795    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-j74kk"]
Jul 16 22:24:46.492458 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:46.492429    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3d73ba30-af60-4a72-8f70-cdb00c819800-config-file\") pod \"limitador-limitador-64c94fd64f-j74kk\" (UID: \"3d73ba30-af60-4a72-8f70-cdb00c819800\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-j74kk"
Jul 16 22:24:46.492577 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:46.492489    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5l7nb\" (UniqueName: \"kubernetes.io/projected/3d73ba30-af60-4a72-8f70-cdb00c819800-kube-api-access-5l7nb\") pod \"limitador-limitador-64c94fd64f-j74kk\" (UID: \"3d73ba30-af60-4a72-8f70-cdb00c819800\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-j74kk"
Jul 16 22:24:46.493021 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:46.493003    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3d73ba30-af60-4a72-8f70-cdb00c819800-config-file\") pod \"limitador-limitador-64c94fd64f-j74kk\" (UID: \"3d73ba30-af60-4a72-8f70-cdb00c819800\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-j74kk"
Jul 16 22:24:46.505316 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:46.505292    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5l7nb\" (UniqueName: \"kubernetes.io/projected/3d73ba30-af60-4a72-8f70-cdb00c819800-kube-api-access-5l7nb\") pod \"limitador-limitador-64c94fd64f-j74kk\" (UID: \"3d73ba30-af60-4a72-8f70-cdb00c819800\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-j74kk"
Jul 16 22:24:46.612547 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:46.612520    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-j74kk"
Jul 16 22:24:46.749061 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:46.748992    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-j74kk"]
Jul 16 22:24:46.751859 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:24:46.751835    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d73ba30_af60_4a72_8f70_cdb00c819800.slice/crio-69b03dc28bbd4c989773ff3f0bc74818cc8ca5a6491a4f97578a45ed13d48bc1 WatchSource:0}: Error finding container 69b03dc28bbd4c989773ff3f0bc74818cc8ca5a6491a4f97578a45ed13d48bc1: Status 404 returned error can't find the container with id 69b03dc28bbd4c989773ff3f0bc74818cc8ca5a6491a4f97578a45ed13d48bc1
Jul 16 22:24:46.876050 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:46.876020    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-j74kk" event={"ID":"3d73ba30-af60-4a72-8f70-cdb00c819800","Type":"ContainerStarted","Data":"69b03dc28bbd4c989773ff3f0bc74818cc8ca5a6491a4f97578a45ed13d48bc1"}
Jul 16 22:24:47.123870 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:47.123807    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-4f56z"]
Jul 16 22:24:47.128133 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:47.128115    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-4f56z"
Jul 16 22:24:47.131975 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:47.131958    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-7xb4r\""
Jul 16 22:24:47.145957 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:47.145935    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-4f56z"]
Jul 16 22:24:47.198598 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:47.198576    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvl7n\" (UniqueName: \"kubernetes.io/projected/4f4cd899-892b-4684-b043-52a402ffad96-kube-api-access-jvl7n\") pod \"authorino-58cd955675-4f56z\" (UID: \"4f4cd899-892b-4684-b043-52a402ffad96\") " pod="kuadrant-system/authorino-58cd955675-4f56z"
Jul 16 22:24:47.286913 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:47.286890    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-645q4"]
Jul 16 22:24:47.290072 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:47.290044    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-645q4"
Jul 16 22:24:47.298529 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:47.298501    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-645q4"]
Jul 16 22:24:47.299358 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:47.299337    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvl7n\" (UniqueName: \"kubernetes.io/projected/4f4cd899-892b-4684-b043-52a402ffad96-kube-api-access-jvl7n\") pod \"authorino-58cd955675-4f56z\" (UID: \"4f4cd899-892b-4684-b043-52a402ffad96\") " pod="kuadrant-system/authorino-58cd955675-4f56z"
Jul 16 22:24:47.308768 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:47.308744    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvl7n\" (UniqueName: \"kubernetes.io/projected/4f4cd899-892b-4684-b043-52a402ffad96-kube-api-access-jvl7n\") pod \"authorino-58cd955675-4f56z\" (UID: \"4f4cd899-892b-4684-b043-52a402ffad96\") " pod="kuadrant-system/authorino-58cd955675-4f56z"
Jul 16 22:24:47.400791 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:47.400623    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mqgsc\" (UniqueName: \"kubernetes.io/projected/eba196ae-9c8e-4677-99c5-af6a514b7fba-kube-api-access-mqgsc\") pod \"authorino-75d556bd77-645q4\" (UID: \"eba196ae-9c8e-4677-99c5-af6a514b7fba\") " pod="kuadrant-system/authorino-75d556bd77-645q4"
Jul 16 22:24:47.437052 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:47.436834    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-4f56z"
Jul 16 22:24:47.501682 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:47.501646    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mqgsc\" (UniqueName: \"kubernetes.io/projected/eba196ae-9c8e-4677-99c5-af6a514b7fba-kube-api-access-mqgsc\") pod \"authorino-75d556bd77-645q4\" (UID: \"eba196ae-9c8e-4677-99c5-af6a514b7fba\") " pod="kuadrant-system/authorino-75d556bd77-645q4"
Jul 16 22:24:47.513729 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:47.513613    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqgsc\" (UniqueName: \"kubernetes.io/projected/eba196ae-9c8e-4677-99c5-af6a514b7fba-kube-api-access-mqgsc\") pod \"authorino-75d556bd77-645q4\" (UID: \"eba196ae-9c8e-4677-99c5-af6a514b7fba\") " pod="kuadrant-system/authorino-75d556bd77-645q4"
Jul 16 22:24:47.600312 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:47.600280    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-645q4"
Jul 16 22:24:47.615337 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:47.615313    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-4f56z"]
Jul 16 22:24:47.619102 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:24:47.619075    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4f4cd899_892b_4684_b043_52a402ffad96.slice/crio-27715f2e31b040d6650e8fd8cd73f18e2752f658bd1cb166bdf4c0536c03c915 WatchSource:0}: Error finding container 27715f2e31b040d6650e8fd8cd73f18e2752f658bd1cb166bdf4c0536c03c915: Status 404 returned error can't find the container with id 27715f2e31b040d6650e8fd8cd73f18e2752f658bd1cb166bdf4c0536c03c915
Jul 16 22:24:47.792629 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:47.792605    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-645q4"]
Jul 16 22:24:47.795382 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:24:47.795352    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podeba196ae_9c8e_4677_99c5_af6a514b7fba.slice/crio-ccf5a62033d2c89b2320d65adc1eda501dda91f2ba9ea1aa1f25d5ee63ccaf8b WatchSource:0}: Error finding container ccf5a62033d2c89b2320d65adc1eda501dda91f2ba9ea1aa1f25d5ee63ccaf8b: Status 404 returned error can't find the container with id ccf5a62033d2c89b2320d65adc1eda501dda91f2ba9ea1aa1f25d5ee63ccaf8b
Jul 16 22:24:47.883481 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:47.883449    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-645q4" event={"ID":"eba196ae-9c8e-4677-99c5-af6a514b7fba","Type":"ContainerStarted","Data":"ccf5a62033d2c89b2320d65adc1eda501dda91f2ba9ea1aa1f25d5ee63ccaf8b"}
Jul 16 22:24:47.884691 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:47.884666    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-4f56z" event={"ID":"4f4cd899-892b-4684-b043-52a402ffad96","Type":"ContainerStarted","Data":"27715f2e31b040d6650e8fd8cd73f18e2752f658bd1cb166bdf4c0536c03c915"}
Jul 16 22:24:51.912823 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:51.912727    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-645q4" event={"ID":"eba196ae-9c8e-4677-99c5-af6a514b7fba","Type":"ContainerStarted","Data":"d05748512c347f86897faac58319670e5562b7643f7907c3f1cfa33b4f4538ae"}
Jul 16 22:24:51.914282 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:51.914256    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-4f56z" event={"ID":"4f4cd899-892b-4684-b043-52a402ffad96","Type":"ContainerStarted","Data":"5aba8d9a993f33abcec36ba95efd1e471ff65b283c17c48b559d2308780dc5e0"}
Jul 16 22:24:51.915675 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:51.915653    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-j74kk" event={"ID":"3d73ba30-af60-4a72-8f70-cdb00c819800","Type":"ContainerStarted","Data":"418636688a51610fca007cdc6551f03fd974e7b2ef39022ba733e6340cd7b6b9"}
Jul 16 22:24:51.915851 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:51.915824    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-j74kk"
Jul 16 22:24:51.928392 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:51.928352    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-645q4" podStartSLOduration=1.181017703 podStartE2EDuration="4.928338854s" totalImagesPullingTime="3.747321151s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:24:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:24:51.92766539 +0000 UTC m=+666.142446552" watchObservedRunningTime="2026-07-16 22:24:51.928338854 +0000 UTC m=+666.143120014"
Jul 16 22:24:51.945563 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:51.945517    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-j74kk" podStartSLOduration=1.159205206 podStartE2EDuration="5.945499433s" totalImagesPullingTime="4.786294227s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:24:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:24:51.945098575 +0000 UTC m=+666.159879736" watchObservedRunningTime="2026-07-16 22:24:51.945499433 +0000 UTC m=+666.160280594"
Jul 16 22:24:51.960768 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:51.960740    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-4f56z"]
Jul 16 22:24:51.977060 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:51.976947    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-4f56z" podStartSLOduration=1.057166923 podStartE2EDuration="4.976925164s" totalImagesPullingTime="3.919758241s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:24:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:24:51.968475624 +0000 UTC m=+666.183256777" watchObservedRunningTime="2026-07-16 22:24:51.976925164 +0000 UTC m=+666.191706325"
Jul 16 22:24:53.925058 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:53.925024    2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-4f56z" podUID="4f4cd899-892b-4684-b043-52a402ffad96" containerName="authorino" containerID="cri-o://5aba8d9a993f33abcec36ba95efd1e471ff65b283c17c48b559d2308780dc5e0" gracePeriod=30
Jul 16 22:24:54.173231 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:54.173209    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-4f56z"
Jul 16 22:24:54.253336 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:54.253307    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jvl7n\" (UniqueName: \"kubernetes.io/projected/4f4cd899-892b-4684-b043-52a402ffad96-kube-api-access-jvl7n\") pod \"4f4cd899-892b-4684-b043-52a402ffad96\" (UID: \"4f4cd899-892b-4684-b043-52a402ffad96\") "
Jul 16 22:24:54.255193 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:54.255173    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f4cd899-892b-4684-b043-52a402ffad96-kube-api-access-jvl7n" (OuterVolumeSpecName: "kube-api-access-jvl7n") pod "4f4cd899-892b-4684-b043-52a402ffad96" (UID: "4f4cd899-892b-4684-b043-52a402ffad96"). InnerVolumeSpecName "kube-api-access-jvl7n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:24:54.354151 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:54.354125    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jvl7n\" (UniqueName: \"kubernetes.io/projected/4f4cd899-892b-4684-b043-52a402ffad96-kube-api-access-jvl7n\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 16 22:24:54.930623 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:54.930586    2552 generic.go:356] "Generic (PLEG): container finished" podID="4f4cd899-892b-4684-b043-52a402ffad96" containerID="5aba8d9a993f33abcec36ba95efd1e471ff65b283c17c48b559d2308780dc5e0" exitCode=0
Jul 16 22:24:54.931121 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:54.930635    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-4f56z"
Jul 16 22:24:54.931121 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:54.930674    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-4f56z" event={"ID":"4f4cd899-892b-4684-b043-52a402ffad96","Type":"ContainerDied","Data":"5aba8d9a993f33abcec36ba95efd1e471ff65b283c17c48b559d2308780dc5e0"}
Jul 16 22:24:54.931121 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:54.930745    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-4f56z" event={"ID":"4f4cd899-892b-4684-b043-52a402ffad96","Type":"ContainerDied","Data":"27715f2e31b040d6650e8fd8cd73f18e2752f658bd1cb166bdf4c0536c03c915"}
Jul 16 22:24:54.931121 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:54.930770    2552 scope.go:117] "RemoveContainer" containerID="5aba8d9a993f33abcec36ba95efd1e471ff65b283c17c48b559d2308780dc5e0"
Jul 16 22:24:54.939075 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:54.939049    2552 scope.go:117] "RemoveContainer" containerID="5aba8d9a993f33abcec36ba95efd1e471ff65b283c17c48b559d2308780dc5e0"
Jul 16 22:24:54.939328 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:24:54.939309    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5aba8d9a993f33abcec36ba95efd1e471ff65b283c17c48b559d2308780dc5e0\": container with ID starting with 5aba8d9a993f33abcec36ba95efd1e471ff65b283c17c48b559d2308780dc5e0 not found: ID does not exist" containerID="5aba8d9a993f33abcec36ba95efd1e471ff65b283c17c48b559d2308780dc5e0"
Jul 16 22:24:54.939370 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:54.939340    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5aba8d9a993f33abcec36ba95efd1e471ff65b283c17c48b559d2308780dc5e0"} err="failed to get container status \"5aba8d9a993f33abcec36ba95efd1e471ff65b283c17c48b559d2308780dc5e0\": rpc error: code = NotFound desc = could not find container \"5aba8d9a993f33abcec36ba95efd1e471ff65b283c17c48b559d2308780dc5e0\": container with ID starting with 5aba8d9a993f33abcec36ba95efd1e471ff65b283c17c48b559d2308780dc5e0 not found: ID does not exist"
Jul 16 22:24:54.947451 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:54.947431    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-4f56z"]
Jul 16 22:24:54.953075 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:54.953057    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-4f56z"]
Jul 16 22:24:56.275950 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:24:56.275912    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4f4cd899-892b-4684-b043-52a402ffad96" path="/var/lib/kubelet/pods/4f4cd899-892b-4684-b043-52a402ffad96/volumes"
Jul 16 22:25:01.399494 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:01.399459    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-j74kk"]
Jul 16 22:25:01.400036 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:01.399650    2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-j74kk" podUID="3d73ba30-af60-4a72-8f70-cdb00c819800" containerName="limitador" containerID="cri-o://418636688a51610fca007cdc6551f03fd974e7b2ef39022ba733e6340cd7b6b9" gracePeriod=30
Jul 16 22:25:01.400418 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:01.400400    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-j74kk"
Jul 16 22:25:01.944127 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:01.944105    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-j74kk"
Jul 16 22:25:01.968099 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:01.968038    2552 generic.go:356] "Generic (PLEG): container finished" podID="3d73ba30-af60-4a72-8f70-cdb00c819800" containerID="418636688a51610fca007cdc6551f03fd974e7b2ef39022ba733e6340cd7b6b9" exitCode=0
Jul 16 22:25:01.968099 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:01.968076    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-j74kk"
Jul 16 22:25:01.968270 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:01.968112    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-j74kk" event={"ID":"3d73ba30-af60-4a72-8f70-cdb00c819800","Type":"ContainerDied","Data":"418636688a51610fca007cdc6551f03fd974e7b2ef39022ba733e6340cd7b6b9"}
Jul 16 22:25:01.968270 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:01.968164    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-j74kk" event={"ID":"3d73ba30-af60-4a72-8f70-cdb00c819800","Type":"ContainerDied","Data":"69b03dc28bbd4c989773ff3f0bc74818cc8ca5a6491a4f97578a45ed13d48bc1"}
Jul 16 22:25:01.968270 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:01.968189    2552 scope.go:117] "RemoveContainer" containerID="418636688a51610fca007cdc6551f03fd974e7b2ef39022ba733e6340cd7b6b9"
Jul 16 22:25:01.977521 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:01.977502    2552 scope.go:117] "RemoveContainer" containerID="418636688a51610fca007cdc6551f03fd974e7b2ef39022ba733e6340cd7b6b9"
Jul 16 22:25:01.977778 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:25:01.977756    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"418636688a51610fca007cdc6551f03fd974e7b2ef39022ba733e6340cd7b6b9\": container with ID starting with 418636688a51610fca007cdc6551f03fd974e7b2ef39022ba733e6340cd7b6b9 not found: ID does not exist" containerID="418636688a51610fca007cdc6551f03fd974e7b2ef39022ba733e6340cd7b6b9"
Jul 16 22:25:01.977850 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:01.977793    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"418636688a51610fca007cdc6551f03fd974e7b2ef39022ba733e6340cd7b6b9"} err="failed to get container status \"418636688a51610fca007cdc6551f03fd974e7b2ef39022ba733e6340cd7b6b9\": rpc error: code = NotFound desc = could not find container \"418636688a51610fca007cdc6551f03fd974e7b2ef39022ba733e6340cd7b6b9\": container with ID starting with 418636688a51610fca007cdc6551f03fd974e7b2ef39022ba733e6340cd7b6b9 not found: ID does not exist"
Jul 16 22:25:02.005333 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:02.005313    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5l7nb\" (UniqueName: \"kubernetes.io/projected/3d73ba30-af60-4a72-8f70-cdb00c819800-kube-api-access-5l7nb\") pod \"3d73ba30-af60-4a72-8f70-cdb00c819800\" (UID: \"3d73ba30-af60-4a72-8f70-cdb00c819800\") "
Jul 16 22:25:02.005419 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:02.005399    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3d73ba30-af60-4a72-8f70-cdb00c819800-config-file\") pod \"3d73ba30-af60-4a72-8f70-cdb00c819800\" (UID: \"3d73ba30-af60-4a72-8f70-cdb00c819800\") "
Jul 16 22:25:02.005745 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:02.005719    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d73ba30-af60-4a72-8f70-cdb00c819800-config-file" (OuterVolumeSpecName: "config-file") pod "3d73ba30-af60-4a72-8f70-cdb00c819800" (UID: "3d73ba30-af60-4a72-8f70-cdb00c819800"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 22:25:02.007198 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:02.007172    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d73ba30-af60-4a72-8f70-cdb00c819800-kube-api-access-5l7nb" (OuterVolumeSpecName: "kube-api-access-5l7nb") pod "3d73ba30-af60-4a72-8f70-cdb00c819800" (UID: "3d73ba30-af60-4a72-8f70-cdb00c819800"). InnerVolumeSpecName "kube-api-access-5l7nb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:25:02.106172 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:02.106143    2552 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3d73ba30-af60-4a72-8f70-cdb00c819800-config-file\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 16 22:25:02.106172 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:02.106173    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5l7nb\" (UniqueName: \"kubernetes.io/projected/3d73ba30-af60-4a72-8f70-cdb00c819800-kube-api-access-5l7nb\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 16 22:25:02.290761 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:02.290734    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-j74kk"]
Jul 16 22:25:02.294825 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:02.294795    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-j74kk"]
Jul 16 22:25:04.274982 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:04.274947    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3d73ba30-af60-4a72-8f70-cdb00c819800" path="/var/lib/kubelet/pods/3d73ba30-af60-4a72-8f70-cdb00c819800/volumes"
Jul 16 22:25:07.951751 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:07.951688    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-9t859"]
Jul 16 22:25:07.952190 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:07.952161    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f4cd899-892b-4684-b043-52a402ffad96" containerName="authorino"
Jul 16 22:25:07.952190 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:07.952180    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f4cd899-892b-4684-b043-52a402ffad96" containerName="authorino"
Jul 16 22:25:07.952309 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:07.952201    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d73ba30-af60-4a72-8f70-cdb00c819800" containerName="limitador"
Jul 16 22:25:07.952309 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:07.952210    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d73ba30-af60-4a72-8f70-cdb00c819800" containerName="limitador"
Jul 16 22:25:07.952309 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:07.952289    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d73ba30-af60-4a72-8f70-cdb00c819800" containerName="limitador"
Jul 16 22:25:07.952309 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:07.952300    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="4f4cd899-892b-4684-b043-52a402ffad96" containerName="authorino"
Jul 16 22:25:07.956461 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:07.956438    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-9t859"
Jul 16 22:25:07.959190 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:07.959173    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 16 22:25:07.959297 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:07.959272    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-758fg\""
Jul 16 22:25:07.960183 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:07.960143    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 16 22:25:07.960183 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:07.960167    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 16 22:25:07.963826 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:07.963807    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-9t859"]
Jul 16 22:25:08.043357 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:08.043328    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/cb3f2801-3f7f-4dd0-b479-e2580cca601c-data\") pod \"postgres-69fb4594cf-9t859\" (UID: \"cb3f2801-3f7f-4dd0-b479-e2580cca601c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-9t859"
Jul 16 22:25:08.043456 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:08.043368    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9tgg\" (UniqueName: \"kubernetes.io/projected/cb3f2801-3f7f-4dd0-b479-e2580cca601c-kube-api-access-d9tgg\") pod \"postgres-69fb4594cf-9t859\" (UID: \"cb3f2801-3f7f-4dd0-b479-e2580cca601c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-9t859"
Jul 16 22:25:08.144054 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:08.144024    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9tgg\" (UniqueName: \"kubernetes.io/projected/cb3f2801-3f7f-4dd0-b479-e2580cca601c-kube-api-access-d9tgg\") pod \"postgres-69fb4594cf-9t859\" (UID: \"cb3f2801-3f7f-4dd0-b479-e2580cca601c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-9t859"
Jul 16 22:25:08.144144 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:08.144080    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/cb3f2801-3f7f-4dd0-b479-e2580cca601c-data\") pod \"postgres-69fb4594cf-9t859\" (UID: \"cb3f2801-3f7f-4dd0-b479-e2580cca601c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-9t859"
Jul 16 22:25:08.144367 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:08.144351    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/cb3f2801-3f7f-4dd0-b479-e2580cca601c-data\") pod \"postgres-69fb4594cf-9t859\" (UID: \"cb3f2801-3f7f-4dd0-b479-e2580cca601c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-9t859"
Jul 16 22:25:08.162070 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:08.162052    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9tgg\" (UniqueName: \"kubernetes.io/projected/cb3f2801-3f7f-4dd0-b479-e2580cca601c-kube-api-access-d9tgg\") pod \"postgres-69fb4594cf-9t859\" (UID: \"cb3f2801-3f7f-4dd0-b479-e2580cca601c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-9t859"
Jul 16 22:25:08.266880 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:08.266834    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-9t859"
Jul 16 22:25:08.396296 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:08.396266    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-9t859"]
Jul 16 22:25:08.398231 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:25:08.398201    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb3f2801_3f7f_4dd0_b479_e2580cca601c.slice/crio-8394d0ece40e7c758943bb9c01d7c7d68c637dd03de834d24edaa05574f7a8f8 WatchSource:0}: Error finding container 8394d0ece40e7c758943bb9c01d7c7d68c637dd03de834d24edaa05574f7a8f8: Status 404 returned error can't find the container with id 8394d0ece40e7c758943bb9c01d7c7d68c637dd03de834d24edaa05574f7a8f8
Jul 16 22:25:08.399899 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:08.399879    2552 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 16 22:25:09.007643 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:09.007611    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-9t859" event={"ID":"cb3f2801-3f7f-4dd0-b479-e2580cca601c","Type":"ContainerStarted","Data":"8394d0ece40e7c758943bb9c01d7c7d68c637dd03de834d24edaa05574f7a8f8"}
Jul 16 22:25:14.038165 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:14.038127    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-9t859" event={"ID":"cb3f2801-3f7f-4dd0-b479-e2580cca601c","Type":"ContainerStarted","Data":"b438fc3658059d8569c04ca03f9a736634c02529c7ad240aa12674858ecff59a"}
Jul 16 22:25:14.038614 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:14.038247    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-9t859"
Jul 16 22:25:14.056498 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:14.056449    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-9t859" podStartSLOduration=2.288944387 podStartE2EDuration="7.056435779s" totalImagesPullingTime="4.767491392s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:25:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:25:14.054912637 +0000 UTC m=+688.269693797" watchObservedRunningTime="2026-07-16 22:25:14.056435779 +0000 UTC m=+688.271216979"
Jul 16 22:25:20.070997 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:20.070965    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-9t859"
Jul 16 22:25:20.640801 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:20.640771    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-jdx8s"]
Jul 16 22:25:20.646429 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:20.646407    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-jdx8s"
Jul 16 22:25:20.651871 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:20.651847    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-jdx8s"]
Jul 16 22:25:20.730400 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:20.730377    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zf4r4\" (UniqueName: \"kubernetes.io/projected/db4ec01d-abe3-4a40-a460-53c56f84b1ce-kube-api-access-zf4r4\") pod \"authorino-5d4b67c446-jdx8s\" (UID: \"db4ec01d-abe3-4a40-a460-53c56f84b1ce\") " pod="kuadrant-system/authorino-5d4b67c446-jdx8s"
Jul 16 22:25:20.831381 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:20.831162    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zf4r4\" (UniqueName: \"kubernetes.io/projected/db4ec01d-abe3-4a40-a460-53c56f84b1ce-kube-api-access-zf4r4\") pod \"authorino-5d4b67c446-jdx8s\" (UID: \"db4ec01d-abe3-4a40-a460-53c56f84b1ce\") " pod="kuadrant-system/authorino-5d4b67c446-jdx8s"
Jul 16 22:25:20.833270 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:20.833251    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-jdx8s"]
Jul 16 22:25:20.833408 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:25:20.833391    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-zf4r4], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-jdx8s" podUID="db4ec01d-abe3-4a40-a460-53c56f84b1ce"
Jul 16 22:25:20.844401 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:20.844381    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zf4r4\" (UniqueName: \"kubernetes.io/projected/db4ec01d-abe3-4a40-a460-53c56f84b1ce-kube-api-access-zf4r4\") pod \"authorino-5d4b67c446-jdx8s\" (UID: \"db4ec01d-abe3-4a40-a460-53c56f84b1ce\") " pod="kuadrant-system/authorino-5d4b67c446-jdx8s"
Jul 16 22:25:20.942395 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:20.942337    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-546df4bcf6-dxq5z"]
Jul 16 22:25:20.945963 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:20.945946    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-546df4bcf6-dxq5z"
Jul 16 22:25:20.948518 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:20.948501    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 16 22:25:20.956478 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:20.956454    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-546df4bcf6-dxq5z"]
Jul 16 22:25:21.032923 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:21.032899    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/54ec0e1d-115c-49cf-86cf-6dae489c8508-tls-cert\") pod \"authorino-546df4bcf6-dxq5z\" (UID: \"54ec0e1d-115c-49cf-86cf-6dae489c8508\") " pod="kuadrant-system/authorino-546df4bcf6-dxq5z"
Jul 16 22:25:21.033021 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:21.032938    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sbqtq\" (UniqueName: \"kubernetes.io/projected/54ec0e1d-115c-49cf-86cf-6dae489c8508-kube-api-access-sbqtq\") pod \"authorino-546df4bcf6-dxq5z\" (UID: \"54ec0e1d-115c-49cf-86cf-6dae489c8508\") " pod="kuadrant-system/authorino-546df4bcf6-dxq5z"
Jul 16 22:25:21.069155 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:21.069134    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-jdx8s"
Jul 16 22:25:21.075890 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:21.075873    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-jdx8s"
Jul 16 22:25:21.133618 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:21.133593    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zf4r4\" (UniqueName: \"kubernetes.io/projected/db4ec01d-abe3-4a40-a460-53c56f84b1ce-kube-api-access-zf4r4\") pod \"db4ec01d-abe3-4a40-a460-53c56f84b1ce\" (UID: \"db4ec01d-abe3-4a40-a460-53c56f84b1ce\") "
Jul 16 22:25:21.133768 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:21.133751    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sbqtq\" (UniqueName: \"kubernetes.io/projected/54ec0e1d-115c-49cf-86cf-6dae489c8508-kube-api-access-sbqtq\") pod \"authorino-546df4bcf6-dxq5z\" (UID: \"54ec0e1d-115c-49cf-86cf-6dae489c8508\") " pod="kuadrant-system/authorino-546df4bcf6-dxq5z"
Jul 16 22:25:21.133844 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:21.133828    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/54ec0e1d-115c-49cf-86cf-6dae489c8508-tls-cert\") pod \"authorino-546df4bcf6-dxq5z\" (UID: \"54ec0e1d-115c-49cf-86cf-6dae489c8508\") " pod="kuadrant-system/authorino-546df4bcf6-dxq5z"
Jul 16 22:25:21.135611 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:21.135589    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db4ec01d-abe3-4a40-a460-53c56f84b1ce-kube-api-access-zf4r4" (OuterVolumeSpecName: "kube-api-access-zf4r4") pod "db4ec01d-abe3-4a40-a460-53c56f84b1ce" (UID: "db4ec01d-abe3-4a40-a460-53c56f84b1ce"). InnerVolumeSpecName "kube-api-access-zf4r4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:25:21.136186 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:21.136166    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/54ec0e1d-115c-49cf-86cf-6dae489c8508-tls-cert\") pod \"authorino-546df4bcf6-dxq5z\" (UID: \"54ec0e1d-115c-49cf-86cf-6dae489c8508\") " pod="kuadrant-system/authorino-546df4bcf6-dxq5z"
Jul 16 22:25:21.142121 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:21.142097    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sbqtq\" (UniqueName: \"kubernetes.io/projected/54ec0e1d-115c-49cf-86cf-6dae489c8508-kube-api-access-sbqtq\") pod \"authorino-546df4bcf6-dxq5z\" (UID: \"54ec0e1d-115c-49cf-86cf-6dae489c8508\") " pod="kuadrant-system/authorino-546df4bcf6-dxq5z"
Jul 16 22:25:21.234646 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:21.234619    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zf4r4\" (UniqueName: \"kubernetes.io/projected/db4ec01d-abe3-4a40-a460-53c56f84b1ce-kube-api-access-zf4r4\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 16 22:25:21.254766 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:21.254740    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-546df4bcf6-dxq5z"
Jul 16 22:25:21.384571 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:21.384536    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-546df4bcf6-dxq5z"]
Jul 16 22:25:21.386788 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:25:21.386761    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod54ec0e1d_115c_49cf_86cf_6dae489c8508.slice/crio-5a0ccc99a3f06061fd42c4e3753247bfb19317586357a1e082a0b5e39597d6b4 WatchSource:0}: Error finding container 5a0ccc99a3f06061fd42c4e3753247bfb19317586357a1e082a0b5e39597d6b4: Status 404 returned error can't find the container with id 5a0ccc99a3f06061fd42c4e3753247bfb19317586357a1e082a0b5e39597d6b4
Jul 16 22:25:22.074810 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:22.074733    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-jdx8s"
Jul 16 22:25:22.074810 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:22.074756    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-546df4bcf6-dxq5z" event={"ID":"54ec0e1d-115c-49cf-86cf-6dae489c8508","Type":"ContainerStarted","Data":"bd42c46360dec4795f4f21ba3943dfc1b5f94fd174af875695d6ac4ed22d65a3"}
Jul 16 22:25:22.074810 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:22.074794    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-546df4bcf6-dxq5z" event={"ID":"54ec0e1d-115c-49cf-86cf-6dae489c8508","Type":"ContainerStarted","Data":"5a0ccc99a3f06061fd42c4e3753247bfb19317586357a1e082a0b5e39597d6b4"}
Jul 16 22:25:22.100398 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:22.100357    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-546df4bcf6-dxq5z" podStartSLOduration=1.78457045 podStartE2EDuration="2.100343598s" totalImagesPullingTime="315.773148ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:25:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:25:22.097639476 +0000 UTC m=+696.312420635" watchObservedRunningTime="2026-07-16 22:25:22.100343598 +0000 UTC m=+696.315124757"
Jul 16 22:25:22.121830 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:22.121801    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-jdx8s"]
Jul 16 22:25:22.128624 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:22.128592    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-645q4"]
Jul 16 22:25:22.128827 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:22.128799    2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-645q4" podUID="eba196ae-9c8e-4677-99c5-af6a514b7fba" containerName="authorino" containerID="cri-o://d05748512c347f86897faac58319670e5562b7643f7907c3f1cfa33b4f4538ae" gracePeriod=30
Jul 16 22:25:22.130816 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:22.130795    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-jdx8s"]
Jul 16 22:25:22.276033 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:22.276003    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="db4ec01d-abe3-4a40-a460-53c56f84b1ce" path="/var/lib/kubelet/pods/db4ec01d-abe3-4a40-a460-53c56f84b1ce/volumes"
Jul 16 22:25:22.374861 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:22.374838    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-645q4"
Jul 16 22:25:22.443524 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:22.443498    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mqgsc\" (UniqueName: \"kubernetes.io/projected/eba196ae-9c8e-4677-99c5-af6a514b7fba-kube-api-access-mqgsc\") pod \"eba196ae-9c8e-4677-99c5-af6a514b7fba\" (UID: \"eba196ae-9c8e-4677-99c5-af6a514b7fba\") "
Jul 16 22:25:22.445428 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:22.445407    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eba196ae-9c8e-4677-99c5-af6a514b7fba-kube-api-access-mqgsc" (OuterVolumeSpecName: "kube-api-access-mqgsc") pod "eba196ae-9c8e-4677-99c5-af6a514b7fba" (UID: "eba196ae-9c8e-4677-99c5-af6a514b7fba"). InnerVolumeSpecName "kube-api-access-mqgsc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:25:22.544911 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:22.544887    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mqgsc\" (UniqueName: \"kubernetes.io/projected/eba196ae-9c8e-4677-99c5-af6a514b7fba-kube-api-access-mqgsc\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 16 22:25:23.080567 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:23.080539    2552 generic.go:356] "Generic (PLEG): container finished" podID="eba196ae-9c8e-4677-99c5-af6a514b7fba" containerID="d05748512c347f86897faac58319670e5562b7643f7907c3f1cfa33b4f4538ae" exitCode=0
Jul 16 22:25:23.080682 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:23.080583    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-645q4"
Jul 16 22:25:23.080682 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:23.080628    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-645q4" event={"ID":"eba196ae-9c8e-4677-99c5-af6a514b7fba","Type":"ContainerDied","Data":"d05748512c347f86897faac58319670e5562b7643f7907c3f1cfa33b4f4538ae"}
Jul 16 22:25:23.080682 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:23.080665    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-645q4" event={"ID":"eba196ae-9c8e-4677-99c5-af6a514b7fba","Type":"ContainerDied","Data":"ccf5a62033d2c89b2320d65adc1eda501dda91f2ba9ea1aa1f25d5ee63ccaf8b"}
Jul 16 22:25:23.080812 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:23.080685    2552 scope.go:117] "RemoveContainer" containerID="d05748512c347f86897faac58319670e5562b7643f7907c3f1cfa33b4f4538ae"
Jul 16 22:25:23.089539 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:23.089522    2552 scope.go:117] "RemoveContainer" containerID="d05748512c347f86897faac58319670e5562b7643f7907c3f1cfa33b4f4538ae"
Jul 16 22:25:23.089867 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:25:23.089849    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d05748512c347f86897faac58319670e5562b7643f7907c3f1cfa33b4f4538ae\": container with ID starting with d05748512c347f86897faac58319670e5562b7643f7907c3f1cfa33b4f4538ae not found: ID does not exist" containerID="d05748512c347f86897faac58319670e5562b7643f7907c3f1cfa33b4f4538ae"
Jul 16 22:25:23.089926 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:23.089875    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d05748512c347f86897faac58319670e5562b7643f7907c3f1cfa33b4f4538ae"} err="failed to get container status \"d05748512c347f86897faac58319670e5562b7643f7907c3f1cfa33b4f4538ae\": rpc error: code = NotFound desc = could not find container \"d05748512c347f86897faac58319670e5562b7643f7907c3f1cfa33b4f4538ae\": container with ID starting with d05748512c347f86897faac58319670e5562b7643f7907c3f1cfa33b4f4538ae not found: ID does not exist"
Jul 16 22:25:23.103022 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:23.102998    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-645q4"]
Jul 16 22:25:23.105457 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:23.105431    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-645q4"]
Jul 16 22:25:24.275874 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:24.275841    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eba196ae-9c8e-4677-99c5-af6a514b7fba" path="/var/lib/kubelet/pods/eba196ae-9c8e-4677-99c5-af6a514b7fba/volumes"
Jul 16 22:25:26.955378 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:26.955349    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5fff6b6d99-fpn8t"]
Jul 16 22:25:26.955746 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:26.955664    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eba196ae-9c8e-4677-99c5-af6a514b7fba" containerName="authorino"
Jul 16 22:25:26.955746 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:26.955674    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="eba196ae-9c8e-4677-99c5-af6a514b7fba" containerName="authorino"
Jul 16 22:25:26.955746 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:26.955739    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="eba196ae-9c8e-4677-99c5-af6a514b7fba" containerName="authorino"
Jul 16 22:25:26.961960 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:26.961939    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5fff6b6d99-fpn8t"
Jul 16 22:25:26.964781 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:26.964759    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 16 22:25:26.964962 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:26.964819    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-dr7ck\""
Jul 16 22:25:26.964962 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:26.964821    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 16 22:25:26.970867 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:26.970842    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5fff6b6d99-fpn8t"]
Jul 16 22:25:27.072389 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:27.072361    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gnpfj\" (UniqueName: \"kubernetes.io/projected/f3f18478-b537-4d60-8365-d1f5dae6aecb-kube-api-access-gnpfj\") pod \"maas-controller-5fff6b6d99-fpn8t\" (UID: \"f3f18478-b537-4d60-8365-d1f5dae6aecb\") " pod="opendatahub/maas-controller-5fff6b6d99-fpn8t"
Jul 16 22:25:27.072516 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:27.072394    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f3f18478-b537-4d60-8365-d1f5dae6aecb-webhook-cert\") pod \"maas-controller-5fff6b6d99-fpn8t\" (UID: \"f3f18478-b537-4d60-8365-d1f5dae6aecb\") " pod="opendatahub/maas-controller-5fff6b6d99-fpn8t"
Jul 16 22:25:27.163725 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:27.163682    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-695cf7dbbd-4lbzk"]
Jul 16 22:25:27.165976 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:27.165949    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-695cf7dbbd-4lbzk"
Jul 16 22:25:27.173660 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:27.173636    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gnpfj\" (UniqueName: \"kubernetes.io/projected/f3f18478-b537-4d60-8365-d1f5dae6aecb-kube-api-access-gnpfj\") pod \"maas-controller-5fff6b6d99-fpn8t\" (UID: \"f3f18478-b537-4d60-8365-d1f5dae6aecb\") " pod="opendatahub/maas-controller-5fff6b6d99-fpn8t"
Jul 16 22:25:27.173797 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:27.173666    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f3f18478-b537-4d60-8365-d1f5dae6aecb-webhook-cert\") pod \"maas-controller-5fff6b6d99-fpn8t\" (UID: \"f3f18478-b537-4d60-8365-d1f5dae6aecb\") " pod="opendatahub/maas-controller-5fff6b6d99-fpn8t"
Jul 16 22:25:27.176171 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:27.176141    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f3f18478-b537-4d60-8365-d1f5dae6aecb-webhook-cert\") pod \"maas-controller-5fff6b6d99-fpn8t\" (UID: \"f3f18478-b537-4d60-8365-d1f5dae6aecb\") " pod="opendatahub/maas-controller-5fff6b6d99-fpn8t"
Jul 16 22:25:27.178094 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:27.178070    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-695cf7dbbd-4lbzk"]
Jul 16 22:25:27.185268 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:27.185250    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gnpfj\" (UniqueName: \"kubernetes.io/projected/f3f18478-b537-4d60-8365-d1f5dae6aecb-kube-api-access-gnpfj\") pod \"maas-controller-5fff6b6d99-fpn8t\" (UID: \"f3f18478-b537-4d60-8365-d1f5dae6aecb\") " pod="opendatahub/maas-controller-5fff6b6d99-fpn8t"
Jul 16 22:25:27.273639 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:27.273577    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5fff6b6d99-fpn8t"
Jul 16 22:25:27.274827 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:27.274806    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/20ad114e-5b0b-431e-8d01-0519fb7ee4f9-webhook-cert\") pod \"maas-controller-695cf7dbbd-4lbzk\" (UID: \"20ad114e-5b0b-431e-8d01-0519fb7ee4f9\") " pod="opendatahub/maas-controller-695cf7dbbd-4lbzk"
Jul 16 22:25:27.274913 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:27.274864    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-555zp\" (UniqueName: \"kubernetes.io/projected/20ad114e-5b0b-431e-8d01-0519fb7ee4f9-kube-api-access-555zp\") pod \"maas-controller-695cf7dbbd-4lbzk\" (UID: \"20ad114e-5b0b-431e-8d01-0519fb7ee4f9\") " pod="opendatahub/maas-controller-695cf7dbbd-4lbzk"
Jul 16 22:25:27.375477 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:27.375300    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/20ad114e-5b0b-431e-8d01-0519fb7ee4f9-webhook-cert\") pod \"maas-controller-695cf7dbbd-4lbzk\" (UID: \"20ad114e-5b0b-431e-8d01-0519fb7ee4f9\") " pod="opendatahub/maas-controller-695cf7dbbd-4lbzk"
Jul 16 22:25:27.375477 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:27.375387    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-555zp\" (UniqueName: \"kubernetes.io/projected/20ad114e-5b0b-431e-8d01-0519fb7ee4f9-kube-api-access-555zp\") pod \"maas-controller-695cf7dbbd-4lbzk\" (UID: \"20ad114e-5b0b-431e-8d01-0519fb7ee4f9\") " pod="opendatahub/maas-controller-695cf7dbbd-4lbzk"
Jul 16 22:25:27.378322 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:27.378295    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/20ad114e-5b0b-431e-8d01-0519fb7ee4f9-webhook-cert\") pod \"maas-controller-695cf7dbbd-4lbzk\" (UID: \"20ad114e-5b0b-431e-8d01-0519fb7ee4f9\") " pod="opendatahub/maas-controller-695cf7dbbd-4lbzk"
Jul 16 22:25:27.384786 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:27.384763    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-555zp\" (UniqueName: \"kubernetes.io/projected/20ad114e-5b0b-431e-8d01-0519fb7ee4f9-kube-api-access-555zp\") pod \"maas-controller-695cf7dbbd-4lbzk\" (UID: \"20ad114e-5b0b-431e-8d01-0519fb7ee4f9\") " pod="opendatahub/maas-controller-695cf7dbbd-4lbzk"
Jul 16 22:25:27.405404 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:27.405384    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5fff6b6d99-fpn8t"]
Jul 16 22:25:27.408019 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:25:27.407995    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3f18478_b537_4d60_8365_d1f5dae6aecb.slice/crio-214c2ac4175405212905ff42dc64d5b4ea7d8c716ce94bef75402543dabffca6 WatchSource:0}: Error finding container 214c2ac4175405212905ff42dc64d5b4ea7d8c716ce94bef75402543dabffca6: Status 404 returned error can't find the container with id 214c2ac4175405212905ff42dc64d5b4ea7d8c716ce94bef75402543dabffca6
Jul 16 22:25:27.475288 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:27.475269    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-695cf7dbbd-4lbzk"
Jul 16 22:25:27.603550 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:27.603527    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-695cf7dbbd-4lbzk"]
Jul 16 22:25:27.605467 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:25:27.605438    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20ad114e_5b0b_431e_8d01_0519fb7ee4f9.slice/crio-409a3de689ea958f1508e359aae14f9cb35e16896132830174a23f3016837f39 WatchSource:0}: Error finding container 409a3de689ea958f1508e359aae14f9cb35e16896132830174a23f3016837f39: Status 404 returned error can't find the container with id 409a3de689ea958f1508e359aae14f9cb35e16896132830174a23f3016837f39
Jul 16 22:25:28.108621 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:28.108587    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5fff6b6d99-fpn8t" event={"ID":"f3f18478-b537-4d60-8365-d1f5dae6aecb","Type":"ContainerStarted","Data":"214c2ac4175405212905ff42dc64d5b4ea7d8c716ce94bef75402543dabffca6"}
Jul 16 22:25:28.110178 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:28.110142    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-695cf7dbbd-4lbzk" event={"ID":"20ad114e-5b0b-431e-8d01-0519fb7ee4f9","Type":"ContainerStarted","Data":"409a3de689ea958f1508e359aae14f9cb35e16896132830174a23f3016837f39"}
Jul 16 22:25:31.126326 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:31.126289    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5fff6b6d99-fpn8t" event={"ID":"f3f18478-b537-4d60-8365-d1f5dae6aecb","Type":"ContainerStarted","Data":"115e3f244960a37a19228dea79f910abdead215f9a1ebdb0538afb43b120d5bd"}
Jul 16 22:25:31.126795 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:31.126348    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5fff6b6d99-fpn8t"
Jul 16 22:25:31.127840 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:31.127814    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-695cf7dbbd-4lbzk" event={"ID":"20ad114e-5b0b-431e-8d01-0519fb7ee4f9","Type":"ContainerStarted","Data":"c969be0b61e9a27daaf66737df45c7b1597bd67ef7a2ecad5fded9cf85a38ff8"}
Jul 16 22:25:31.127957 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:31.127880    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-695cf7dbbd-4lbzk"
Jul 16 22:25:31.146064 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:31.146026    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5fff6b6d99-fpn8t" podStartSLOduration=2.433807607 podStartE2EDuration="5.146012796s" totalImagesPullingTime="2.712205189s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:25:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:25:31.144388343 +0000 UTC m=+705.359169497" watchObservedRunningTime="2026-07-16 22:25:31.146012796 +0000 UTC m=+705.360794005"
Jul 16 22:25:31.162926 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:31.162891    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-695cf7dbbd-4lbzk" podStartSLOduration=1.6591053869999999 podStartE2EDuration="4.162878998s" totalImagesPullingTime="2.503773611s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:25:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:25:31.161936357 +0000 UTC m=+705.376717517" watchObservedRunningTime="2026-07-16 22:25:31.162878998 +0000 UTC m=+705.377660188"
Jul 16 22:25:42.134984 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:42.134900    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5fff6b6d99-fpn8t"
Jul 16 22:25:42.135510 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:42.134985    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-695cf7dbbd-4lbzk"
Jul 16 22:25:42.198074 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:42.198046    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5fff6b6d99-fpn8t"]
Jul 16 22:25:42.198255 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:42.198226    2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-5fff6b6d99-fpn8t" podUID="f3f18478-b537-4d60-8365-d1f5dae6aecb" containerName="manager" containerID="cri-o://115e3f244960a37a19228dea79f910abdead215f9a1ebdb0538afb43b120d5bd" gracePeriod=30
Jul 16 22:25:42.998244 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:42.998220    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5fff6b6d99-fpn8t"
Jul 16 22:25:43.086024 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:43.085996    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f3f18478-b537-4d60-8365-d1f5dae6aecb-webhook-cert\") pod \"f3f18478-b537-4d60-8365-d1f5dae6aecb\" (UID: \"f3f18478-b537-4d60-8365-d1f5dae6aecb\") "
Jul 16 22:25:43.086165 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:43.086045    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gnpfj\" (UniqueName: \"kubernetes.io/projected/f3f18478-b537-4d60-8365-d1f5dae6aecb-kube-api-access-gnpfj\") pod \"f3f18478-b537-4d60-8365-d1f5dae6aecb\" (UID: \"f3f18478-b537-4d60-8365-d1f5dae6aecb\") "
Jul 16 22:25:43.088123 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:43.088096    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3f18478-b537-4d60-8365-d1f5dae6aecb-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "f3f18478-b537-4d60-8365-d1f5dae6aecb" (UID: "f3f18478-b537-4d60-8365-d1f5dae6aecb"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 22:25:43.088209 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:43.088126    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3f18478-b537-4d60-8365-d1f5dae6aecb-kube-api-access-gnpfj" (OuterVolumeSpecName: "kube-api-access-gnpfj") pod "f3f18478-b537-4d60-8365-d1f5dae6aecb" (UID: "f3f18478-b537-4d60-8365-d1f5dae6aecb"). InnerVolumeSpecName "kube-api-access-gnpfj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:25:43.186979 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:43.186927    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gnpfj\" (UniqueName: \"kubernetes.io/projected/f3f18478-b537-4d60-8365-d1f5dae6aecb-kube-api-access-gnpfj\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 16 22:25:43.186979 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:43.186953    2552 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f3f18478-b537-4d60-8365-d1f5dae6aecb-webhook-cert\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 16 22:25:43.188997 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:43.188970    2552 generic.go:356] "Generic (PLEG): container finished" podID="f3f18478-b537-4d60-8365-d1f5dae6aecb" containerID="115e3f244960a37a19228dea79f910abdead215f9a1ebdb0538afb43b120d5bd" exitCode=0
Jul 16 22:25:43.189082 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:43.189028    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5fff6b6d99-fpn8t" event={"ID":"f3f18478-b537-4d60-8365-d1f5dae6aecb","Type":"ContainerDied","Data":"115e3f244960a37a19228dea79f910abdead215f9a1ebdb0538afb43b120d5bd"}
Jul 16 22:25:43.189082 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:43.189034    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5fff6b6d99-fpn8t"
Jul 16 22:25:43.189168 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:43.189104    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5fff6b6d99-fpn8t" event={"ID":"f3f18478-b537-4d60-8365-d1f5dae6aecb","Type":"ContainerDied","Data":"214c2ac4175405212905ff42dc64d5b4ea7d8c716ce94bef75402543dabffca6"}
Jul 16 22:25:43.189168 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:43.189133    2552 scope.go:117] "RemoveContainer" containerID="115e3f244960a37a19228dea79f910abdead215f9a1ebdb0538afb43b120d5bd"
Jul 16 22:25:43.197612 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:43.197595    2552 scope.go:117] "RemoveContainer" containerID="115e3f244960a37a19228dea79f910abdead215f9a1ebdb0538afb43b120d5bd"
Jul 16 22:25:43.197903 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:25:43.197885    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"115e3f244960a37a19228dea79f910abdead215f9a1ebdb0538afb43b120d5bd\": container with ID starting with 115e3f244960a37a19228dea79f910abdead215f9a1ebdb0538afb43b120d5bd not found: ID does not exist" containerID="115e3f244960a37a19228dea79f910abdead215f9a1ebdb0538afb43b120d5bd"
Jul 16 22:25:43.197965 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:43.197912    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"115e3f244960a37a19228dea79f910abdead215f9a1ebdb0538afb43b120d5bd"} err="failed to get container status \"115e3f244960a37a19228dea79f910abdead215f9a1ebdb0538afb43b120d5bd\": rpc error: code = NotFound desc = could not find container \"115e3f244960a37a19228dea79f910abdead215f9a1ebdb0538afb43b120d5bd\": container with ID starting with 115e3f244960a37a19228dea79f910abdead215f9a1ebdb0538afb43b120d5bd not found: ID does not exist"
Jul 16 22:25:43.211530 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:43.211507    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5fff6b6d99-fpn8t"]
Jul 16 22:25:43.216274 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:43.216255    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5fff6b6d99-fpn8t"]
Jul 16 22:25:44.275682 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:25:44.275650    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f3f18478-b537-4d60-8365-d1f5dae6aecb" path="/var/lib/kubelet/pods/f3f18478-b537-4d60-8365-d1f5dae6aecb/volumes"
Jul 16 22:26:04.535798 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:26:04.535766    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-578547cd4-r2xmh"]
Jul 16 22:26:04.536356 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:26:04.536251    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3f18478-b537-4d60-8365-d1f5dae6aecb" containerName="manager"
Jul 16 22:26:04.536356 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:26:04.536272    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3f18478-b537-4d60-8365-d1f5dae6aecb" containerName="manager"
Jul 16 22:26:04.536477 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:26:04.536366    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="f3f18478-b537-4d60-8365-d1f5dae6aecb" containerName="manager"
Jul 16 22:26:04.543963 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:26:04.543940    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-578547cd4-r2xmh"
Jul 16 22:26:04.547683 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:26:04.547659    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 16 22:26:04.547811 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:26:04.547659    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-nlbnt\""
Jul 16 22:26:04.553466 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:26:04.553440    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-578547cd4-r2xmh"]
Jul 16 22:26:04.640148 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:26:04.640115    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/85b4d362-b592-44e8-8e3a-76574fcf06b2-openshift-service-ca\") pod \"maas-api-578547cd4-r2xmh\" (UID: \"85b4d362-b592-44e8-8e3a-76574fcf06b2\") " pod="odh-ai-gateway-infra/maas-api-578547cd4-r2xmh"
Jul 16 22:26:04.640148 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:26:04.640152    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/85b4d362-b592-44e8-8e3a-76574fcf06b2-maas-api-tls\") pod \"maas-api-578547cd4-r2xmh\" (UID: \"85b4d362-b592-44e8-8e3a-76574fcf06b2\") " pod="odh-ai-gateway-infra/maas-api-578547cd4-r2xmh"
Jul 16 22:26:04.640353 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:26:04.640177    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ntgd\" (UniqueName: \"kubernetes.io/projected/85b4d362-b592-44e8-8e3a-76574fcf06b2-kube-api-access-2ntgd\") pod \"maas-api-578547cd4-r2xmh\" (UID: \"85b4d362-b592-44e8-8e3a-76574fcf06b2\") " pod="odh-ai-gateway-infra/maas-api-578547cd4-r2xmh"
Jul 16 22:26:04.741017 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:26:04.740980    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/85b4d362-b592-44e8-8e3a-76574fcf06b2-openshift-service-ca\") pod \"maas-api-578547cd4-r2xmh\" (UID: \"85b4d362-b592-44e8-8e3a-76574fcf06b2\") " pod="odh-ai-gateway-infra/maas-api-578547cd4-r2xmh"
Jul 16 22:26:04.741017 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:26:04.741019    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/85b4d362-b592-44e8-8e3a-76574fcf06b2-maas-api-tls\") pod \"maas-api-578547cd4-r2xmh\" (UID: \"85b4d362-b592-44e8-8e3a-76574fcf06b2\") " pod="odh-ai-gateway-infra/maas-api-578547cd4-r2xmh"
Jul 16 22:26:04.741252 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:26:04.741046    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ntgd\" (UniqueName: \"kubernetes.io/projected/85b4d362-b592-44e8-8e3a-76574fcf06b2-kube-api-access-2ntgd\") pod \"maas-api-578547cd4-r2xmh\" (UID: \"85b4d362-b592-44e8-8e3a-76574fcf06b2\") " pod="odh-ai-gateway-infra/maas-api-578547cd4-r2xmh"
Jul 16 22:26:04.741691 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:26:04.741668    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/85b4d362-b592-44e8-8e3a-76574fcf06b2-openshift-service-ca\") pod \"maas-api-578547cd4-r2xmh\" (UID: \"85b4d362-b592-44e8-8e3a-76574fcf06b2\") " pod="odh-ai-gateway-infra/maas-api-578547cd4-r2xmh"
Jul 16 22:26:04.743798 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:26:04.743772    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/85b4d362-b592-44e8-8e3a-76574fcf06b2-maas-api-tls\") pod \"maas-api-578547cd4-r2xmh\" (UID: \"85b4d362-b592-44e8-8e3a-76574fcf06b2\") " pod="odh-ai-gateway-infra/maas-api-578547cd4-r2xmh"
Jul 16 22:26:04.749074 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:26:04.749049    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ntgd\" (UniqueName: \"kubernetes.io/projected/85b4d362-b592-44e8-8e3a-76574fcf06b2-kube-api-access-2ntgd\") pod \"maas-api-578547cd4-r2xmh\" (UID: \"85b4d362-b592-44e8-8e3a-76574fcf06b2\") " pod="odh-ai-gateway-infra/maas-api-578547cd4-r2xmh"
Jul 16 22:26:04.855449 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:26:04.855363    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-578547cd4-r2xmh"
Jul 16 22:26:04.995969 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:26:04.995946    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-578547cd4-r2xmh"]
Jul 16 22:26:04.998162 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:26:04.998130    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85b4d362_b592_44e8_8e3a_76574fcf06b2.slice/crio-c3f9e4018bea5883ae95c502fd4d3e7e9d7ca2850a7ded8c6dcd78e0b953ceb3 WatchSource:0}: Error finding container c3f9e4018bea5883ae95c502fd4d3e7e9d7ca2850a7ded8c6dcd78e0b953ceb3: Status 404 returned error can't find the container with id c3f9e4018bea5883ae95c502fd4d3e7e9d7ca2850a7ded8c6dcd78e0b953ceb3
Jul 16 22:26:05.052132 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:26:05.052096    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-d2vqd"]
Jul 16 22:26:05.055175 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:26:05.055158    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-d2vqd"
Jul 16 22:26:05.057920 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:26:05.057901    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-mtwrb\""
Jul 16 22:26:05.057920 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:26:05.057916    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 16 22:26:05.070494 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:26:05.070135    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-d2vqd"]
Jul 16 22:26:05.101969 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:26:05.101941    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-dxwzq"]
Jul 16 22:26:05.104607 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:26:05.104590    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-dxwzq"
Jul 16 22:26:05.114497 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:26:05.114461    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-dxwzq"]
Jul 16 22:26:05.144742 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:26:05.144686    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1f686924-d39e-463d-a706-f20c5efe4ed2-plugins-config-volume\") pod \"payload-processing-5bf47cd988-d2vqd\" (UID: \"1f686924-d39e-463d-a706-f20c5efe4ed2\") " pod="openshift-ingress/payload-processing-5bf47cd988-d2vqd"
Jul 16 22:26:05.144884 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:26:05.144754    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sssm4\" (UniqueName: \"kubernetes.io/projected/1f686924-d39e-463d-a706-f20c5efe4ed2-kube-api-access-sssm4\") pod \"payload-processing-5bf47cd988-d2vqd\" (UID: \"1f686924-d39e-463d-a706-f20c5efe4ed2\") " pod="openshift-ingress/payload-processing-5bf47cd988-d2vqd"
Jul 16 22:26:05.246039 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:26:05.246009    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1f686924-d39e-463d-a706-f20c5efe4ed2-plugins-config-volume\") pod \"payload-processing-5bf47cd988-d2vqd\" (UID: \"1f686924-d39e-463d-a706-f20c5efe4ed2\") " pod="openshift-ingress/payload-processing-5bf47cd988-d2vqd"
Jul 16 22:26:05.246226 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:26:05.246053    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sssm4\" (UniqueName: \"kubernetes.io/projected/1f686924-d39e-463d-a706-f20c5efe4ed2-kube-api-access-sssm4\") pod \"payload-processing-5bf47cd988-d2vqd\" (UID: \"1f686924-d39e-463d-a706-f20c5efe4ed2\") " pod="openshift-ingress/payload-processing-5bf47cd988-d2vqd"
Jul 16 22:26:05.246226 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:26:05.246077    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ms4rd\" (UniqueName: \"kubernetes.io/projected/3e30ac18-198e-4c09-9507-1cadf1151f83-kube-api-access-ms4rd\") pod \"payload-pre-processing-7677b774bb-dxwzq\" (UID: \"3e30ac18-198e-4c09-9507-1cadf1151f83\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-dxwzq"
Jul 16 22:26:05.246319 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:26:05.246233    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3e30ac18-198e-4c09-9507-1cadf1151f83-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-dxwzq\" (UID: \"3e30ac18-198e-4c09-9507-1cadf1151f83\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-dxwzq"
Jul 16 22:26:05.246867 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:26:05.246850    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1f686924-d39e-463d-a706-f20c5efe4ed2-plugins-config-volume\") pod \"payload-processing-5bf47cd988-d2vqd\" (UID: \"1f686924-d39e-463d-a706-f20c5efe4ed2\") " pod="openshift-ingress/payload-processing-5bf47cd988-d2vqd"
Jul 16 22:26:05.254141 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:26:05.254118    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sssm4\" (UniqueName: \"kubernetes.io/projected/1f686924-d39e-463d-a706-f20c5efe4ed2-kube-api-access-sssm4\") pod \"payload-processing-5bf47cd988-d2vqd\" (UID: \"1f686924-d39e-463d-a706-f20c5efe4ed2\") " pod="openshift-ingress/payload-processing-5bf47cd988-d2vqd"
Jul 16 22:26:05.301304 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:26:05.301276    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-578547cd4-r2xmh" event={"ID":"85b4d362-b592-44e8-8e3a-76574fcf06b2","Type":"ContainerStarted","Data":"c3f9e4018bea5883ae95c502fd4d3e7e9d7ca2850a7ded8c6dcd78e0b953ceb3"}
Jul 16 22:26:05.346663 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:26:05.346624    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3e30ac18-198e-4c09-9507-1cadf1151f83-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-dxwzq\" (UID: \"3e30ac18-198e-4c09-9507-1cadf1151f83\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-dxwzq"
Jul 16 22:26:05.346831 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:26:05.346742    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ms4rd\" (UniqueName: \"kubernetes.io/projected/3e30ac18-198e-4c09-9507-1cadf1151f83-kube-api-access-ms4rd\") pod \"payload-pre-processing-7677b774bb-dxwzq\" (UID: \"3e30ac18-198e-4c09-9507-1cadf1151f83\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-dxwzq"
Jul 16 22:26:05.347385 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:26:05.347365    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3e30ac18-198e-4c09-9507-1cadf1151f83-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-dxwzq\" (UID: \"3e30ac18-198e-4c09-9507-1cadf1151f83\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-dxwzq"
Jul 16 22:26:05.355751 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:26:05.355728    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ms4rd\" (UniqueName: \"kubernetes.io/projected/3e30ac18-198e-4c09-9507-1cadf1151f83-kube-api-access-ms4rd\") pod \"payload-pre-processing-7677b774bb-dxwzq\" (UID: \"3e30ac18-198e-4c09-9507-1cadf1151f83\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-dxwzq"
Jul 16 22:26:05.366562 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:26:05.366496    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-d2vqd"
Jul 16 22:26:05.415686 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:26:05.415644    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-dxwzq"
Jul 16 22:26:05.516084 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:26:05.516054    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-d2vqd"]
Jul 16 22:26:05.520104 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:26:05.520074    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f686924_d39e_463d_a706_f20c5efe4ed2.slice/crio-184a4edbebb322d7212bb4ac28a1911a4d7e2f469c3d95d6c94ed6ff8e715bb5 WatchSource:0}: Error finding container 184a4edbebb322d7212bb4ac28a1911a4d7e2f469c3d95d6c94ed6ff8e715bb5: Status 404 returned error can't find the container with id 184a4edbebb322d7212bb4ac28a1911a4d7e2f469c3d95d6c94ed6ff8e715bb5
Jul 16 22:26:05.564636 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:26:05.564611    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-dxwzq"]
Jul 16 22:26:05.566388 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:26:05.566355    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e30ac18_198e_4c09_9507_1cadf1151f83.slice/crio-057a54b581d688ba51b318e88a4c72da0b8cbf23bbe848ee2a59baaab01e0af8 WatchSource:0}: Error finding container 057a54b581d688ba51b318e88a4c72da0b8cbf23bbe848ee2a59baaab01e0af8: Status 404 returned error can't find the container with id 057a54b581d688ba51b318e88a4c72da0b8cbf23bbe848ee2a59baaab01e0af8
Jul 16 22:26:06.311971 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:26:06.311931    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-dxwzq" event={"ID":"3e30ac18-198e-4c09-9507-1cadf1151f83","Type":"ContainerStarted","Data":"057a54b581d688ba51b318e88a4c72da0b8cbf23bbe848ee2a59baaab01e0af8"}
Jul 16 22:26:06.316068 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:26:06.316012    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-d2vqd" event={"ID":"1f686924-d39e-463d-a706-f20c5efe4ed2","Type":"ContainerStarted","Data":"184a4edbebb322d7212bb4ac28a1911a4d7e2f469c3d95d6c94ed6ff8e715bb5"}
Jul 16 22:26:08.328419 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:26:08.328378    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-d2vqd" event={"ID":"1f686924-d39e-463d-a706-f20c5efe4ed2","Type":"ContainerStarted","Data":"6012dfddeb450e09489bc4ce0909f0383bcd0fac2044c331c85c0b3d8ac4d635"}
Jul 16 22:26:08.328896 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:26:08.328539    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5bf47cd988-d2vqd"
Jul 16 22:26:08.329937 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:26:08.329912    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-578547cd4-r2xmh" event={"ID":"85b4d362-b592-44e8-8e3a-76574fcf06b2","Type":"ContainerStarted","Data":"45ab2258a2cce35439b33ccb4fe14560d883344c53f7ab5216119d0b1b950580"}
Jul 16 22:26:08.330051 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:26:08.329997    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-578547cd4-r2xmh"
Jul 16 22:26:08.331276 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:26:08.331252    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-dxwzq" event={"ID":"3e30ac18-198e-4c09-9507-1cadf1151f83","Type":"ContainerStarted","Data":"512b89ccdcc06ac14e22418a719d87ad265023432ef6934a788e52a2ecc59a88"}
Jul 16 22:26:08.331395 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:26:08.331377    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-dxwzq"
Jul 16 22:26:08.430102 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:26:08.430039    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5bf47cd988-d2vqd" podStartSLOduration=0.972270248 podStartE2EDuration="3.430018232s" totalImagesPullingTime="2.457747984s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:26:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:26:08.346776387 +0000 UTC m=+742.561557548" watchObservedRunningTime="2026-07-16 22:26:08.430018232 +0000 UTC m=+742.644799393"
Jul 16 22:26:08.431585 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:26:08.431553    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7677b774bb-dxwzq" podStartSLOduration=1.017268372 podStartE2EDuration="3.431541816s" totalImagesPullingTime="2.414273444s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:26:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:26:08.422267234 +0000 UTC m=+742.637048394" watchObservedRunningTime="2026-07-16 22:26:08.431541816 +0000 UTC m=+742.646322969"
Jul 16 22:26:08.487251 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:26:08.487185    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-578547cd4-r2xmh" podStartSLOduration=1.558029638 podStartE2EDuration="4.48716469s" totalImagesPullingTime="2.929135052s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:26:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:26:08.485286882 +0000 UTC m=+742.700068048" watchObservedRunningTime="2026-07-16 22:26:08.48716469 +0000 UTC m=+742.701945853"
Jul 16 22:26:14.341386 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:26:14.341357    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-578547cd4-r2xmh"
Jul 16 22:26:19.338322 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:26:19.338287    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5bf47cd988-d2vqd"
Jul 16 22:26:19.338740 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:26:19.338395    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-dxwzq"
Jul 16 22:26:42.236023 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:26:42.235983    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-kn5kk"]
Jul 16 22:26:42.238581 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:26:42.238564    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kn5kk"
Jul 16 22:26:42.242225 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:26:42.242202    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 16 22:26:42.242342 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:26:42.242253    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 16 22:26:42.242342 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:26:42.242209    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 16 22:26:42.242342 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:26:42.242290    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-2bhmx\""
Jul 16 22:26:42.250911 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:26:42.250887    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-kn5kk"]
Jul 16 22:26:42.317403 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:26:42.317378    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b17bbb5a-01d2-46f7-a480-a9c0c8b676b4-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-kn5kk\" (UID: \"b17bbb5a-01d2-46f7-a480-a9c0c8b676b4\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kn5kk"
Jul 16 22:26:42.317540 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:26:42.317427    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b17bbb5a-01d2-46f7-a480-a9c0c8b676b4-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-kn5kk\" (UID: \"b17bbb5a-01d2-46f7-a480-a9c0c8b676b4\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kn5kk"
Jul 16 22:26:42.317540 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:26:42.317449    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b17bbb5a-01d2-46f7-a480-a9c0c8b676b4-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-kn5kk\" (UID: \"b17bbb5a-01d2-46f7-a480-a9c0c8b676b4\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kn5kk"
Jul 16 22:26:42.317656 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:26:42.317573    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-snrg6\" (UniqueName: \"kubernetes.io/projected/b17bbb5a-01d2-46f7-a480-a9c0c8b676b4-kube-api-access-snrg6\") pod \"e2e-distinct-simulated-kserve-59975d69f9-kn5kk\" (UID: \"b17bbb5a-01d2-46f7-a480-a9c0c8b676b4\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kn5kk"
Jul 16 22:26:42.317656 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:26:42.317613    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b17bbb5a-01d2-46f7-a480-a9c0c8b676b4-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-kn5kk\" (UID: \"b17bbb5a-01d2-46f7-a480-a9c0c8b676b4\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kn5kk"
Jul 16 22:26:42.317807 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:26:42.317688    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b17bbb5a-01d2-46f7-a480-a9c0c8b676b4-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-kn5kk\" (UID: \"b17bbb5a-01d2-46f7-a480-a9c0c8b676b4\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kn5kk"
Jul 16 22:26:42.418313 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:26:42.418286    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-snrg6\" (UniqueName: \"kubernetes.io/projected/b17bbb5a-01d2-46f7-a480-a9c0c8b676b4-kube-api-access-snrg6\") pod \"e2e-distinct-simulated-kserve-59975d69f9-kn5kk\" (UID: \"b17bbb5a-01d2-46f7-a480-a9c0c8b676b4\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kn5kk"
Jul 16 22:26:42.418423 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:26:42.418316    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b17bbb5a-01d2-46f7-a480-a9c0c8b676b4-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-kn5kk\" (UID: \"b17bbb5a-01d2-46f7-a480-a9c0c8b676b4\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kn5kk"
Jul 16 22:26:42.418423 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:26:42.418342    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b17bbb5a-01d2-46f7-a480-a9c0c8b676b4-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-kn5kk\" (UID: \"b17bbb5a-01d2-46f7-a480-a9c0c8b676b4\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kn5kk"
Jul 16 22:26:42.418423 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:26:42.418377    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b17bbb5a-01d2-46f7-a480-a9c0c8b676b4-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-kn5kk\" (UID: \"b17bbb5a-01d2-46f7-a480-a9c0c8b676b4\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kn5kk"
Jul 16 22:26:42.418582 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:26:42.418421    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b17bbb5a-01d2-46f7-a480-a9c0c8b676b4-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-kn5kk\" (UID: \"b17bbb5a-01d2-46f7-a480-a9c0c8b676b4\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kn5kk"
Jul 16 22:26:42.418582 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:26:42.418450    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b17bbb5a-01d2-46f7-a480-a9c0c8b676b4-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-kn5kk\" (UID: \"b17bbb5a-01d2-46f7-a480-a9c0c8b676b4\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kn5kk"
Jul 16 22:26:42.418794 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:26:42.418773    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b17bbb5a-01d2-46f7-a480-a9c0c8b676b4-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-kn5kk\" (UID: \"b17bbb5a-01d2-46f7-a480-a9c0c8b676b4\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kn5kk"
Jul 16 22:26:42.418794 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:26:42.418787    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b17bbb5a-01d2-46f7-a480-a9c0c8b676b4-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-kn5kk\" (UID: \"b17bbb5a-01d2-46f7-a480-a9c0c8b676b4\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kn5kk"
Jul 16 22:26:42.418911 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:26:42.418846    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b17bbb5a-01d2-46f7-a480-a9c0c8b676b4-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-kn5kk\" (UID: \"b17bbb5a-01d2-46f7-a480-a9c0c8b676b4\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kn5kk"
Jul 16 22:26:42.420674 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:26:42.420650    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b17bbb5a-01d2-46f7-a480-a9c0c8b676b4-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-kn5kk\" (UID: \"b17bbb5a-01d2-46f7-a480-a9c0c8b676b4\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kn5kk"
Jul 16 22:26:42.420892 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:26:42.420876    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b17bbb5a-01d2-46f7-a480-a9c0c8b676b4-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-kn5kk\" (UID: \"b17bbb5a-01d2-46f7-a480-a9c0c8b676b4\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kn5kk"
Jul 16 22:26:42.427181 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:26:42.427161    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-snrg6\" (UniqueName: \"kubernetes.io/projected/b17bbb5a-01d2-46f7-a480-a9c0c8b676b4-kube-api-access-snrg6\") pod \"e2e-distinct-simulated-kserve-59975d69f9-kn5kk\" (UID: \"b17bbb5a-01d2-46f7-a480-a9c0c8b676b4\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kn5kk"
Jul 16 22:26:42.549857 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:26:42.549796    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kn5kk"
Jul 16 22:26:42.681569 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:26:42.681539    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-kn5kk"]
Jul 16 22:26:42.684105 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:26:42.684082    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb17bbb5a_01d2_46f7_a480_a9c0c8b676b4.slice/crio-8fa686ed73ab36dad6f4febb7a639aed86048b3d73742fc517b7df66270057a3 WatchSource:0}: Error finding container 8fa686ed73ab36dad6f4febb7a639aed86048b3d73742fc517b7df66270057a3: Status 404 returned error can't find the container with id 8fa686ed73ab36dad6f4febb7a639aed86048b3d73742fc517b7df66270057a3
Jul 16 22:26:43.498478 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:26:43.498423    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kn5kk" event={"ID":"b17bbb5a-01d2-46f7-a480-a9c0c8b676b4","Type":"ContainerStarted","Data":"8fa686ed73ab36dad6f4febb7a639aed86048b3d73742fc517b7df66270057a3"}
Jul 16 22:26:44.504859 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:26:44.504825    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kn5kk" event={"ID":"b17bbb5a-01d2-46f7-a480-a9c0c8b676b4","Type":"ContainerStarted","Data":"2e6b0c0c5211cfcab1e7c1503ad929c61ca03e53ac0e7b9e9f41e31a895127df"}
Jul 16 22:26:44.538897 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:26:44.538849    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kn5kk" podStartSLOduration=1.431620645 podStartE2EDuration="2.538834294s" totalImagesPullingTime="1.107213649s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:26:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:26:44.538119825 +0000 UTC m=+778.752900985" watchObservedRunningTime="2026-07-16 22:26:44.538834294 +0000 UTC m=+778.753615454"
Jul 16 22:26:52.550602 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:26:52.550564    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kn5kk"
Jul 16 22:26:52.551107 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:26:52.550629    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kn5kk"
Jul 16 22:26:52.562986 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:26:52.562963    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kn5kk"
Jul 16 22:26:53.558983 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:26:53.558955    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kn5kk"
Jul 16 22:27:18.539418 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:27:18.539379    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6rjrd"]
Jul 16 22:27:18.545892 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:27:18.545872    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6rjrd"
Jul 16 22:27:18.548367 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:27:18.548348    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 16 22:27:18.555919 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:27:18.555898    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6rjrd"]
Jul 16 22:27:18.672868 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:27:18.672840    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4a50d4d0-335a-4381-bf6a-4f87557203cf-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6rjrd\" (UID: \"4a50d4d0-335a-4381-bf6a-4f87557203cf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6rjrd"
Jul 16 22:27:18.672998 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:27:18.672880    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4a50d4d0-335a-4381-bf6a-4f87557203cf-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6rjrd\" (UID: \"4a50d4d0-335a-4381-bf6a-4f87557203cf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6rjrd"
Jul 16 22:27:18.672998 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:27:18.672912    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4a50d4d0-335a-4381-bf6a-4f87557203cf-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6rjrd\" (UID: \"4a50d4d0-335a-4381-bf6a-4f87557203cf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6rjrd"
Jul 16 22:27:18.672998 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:27:18.672935    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4a50d4d0-335a-4381-bf6a-4f87557203cf-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6rjrd\" (UID: \"4a50d4d0-335a-4381-bf6a-4f87557203cf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6rjrd"
Jul 16 22:27:18.672998 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:27:18.672975    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hg2xc\" (UniqueName: \"kubernetes.io/projected/4a50d4d0-335a-4381-bf6a-4f87557203cf-kube-api-access-hg2xc\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6rjrd\" (UID: \"4a50d4d0-335a-4381-bf6a-4f87557203cf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6rjrd"
Jul 16 22:27:18.673133 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:27:18.673002    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4a50d4d0-335a-4381-bf6a-4f87557203cf-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6rjrd\" (UID: \"4a50d4d0-335a-4381-bf6a-4f87557203cf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6rjrd"
Jul 16 22:27:18.773722 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:27:18.773676    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4a50d4d0-335a-4381-bf6a-4f87557203cf-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6rjrd\" (UID: \"4a50d4d0-335a-4381-bf6a-4f87557203cf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6rjrd"
Jul 16 22:27:18.773834 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:27:18.773728    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4a50d4d0-335a-4381-bf6a-4f87557203cf-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6rjrd\" (UID: \"4a50d4d0-335a-4381-bf6a-4f87557203cf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6rjrd"
Jul 16 22:27:18.773834 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:27:18.773758    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4a50d4d0-335a-4381-bf6a-4f87557203cf-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6rjrd\" (UID: \"4a50d4d0-335a-4381-bf6a-4f87557203cf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6rjrd"
Jul 16 22:27:18.773834 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:27:18.773793    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hg2xc\" (UniqueName: \"kubernetes.io/projected/4a50d4d0-335a-4381-bf6a-4f87557203cf-kube-api-access-hg2xc\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6rjrd\" (UID: \"4a50d4d0-335a-4381-bf6a-4f87557203cf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6rjrd"
Jul 16 22:27:18.773953 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:27:18.773927    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4a50d4d0-335a-4381-bf6a-4f87557203cf-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6rjrd\" (UID: \"4a50d4d0-335a-4381-bf6a-4f87557203cf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6rjrd"
Jul 16 22:27:18.774025 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:27:18.774007    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4a50d4d0-335a-4381-bf6a-4f87557203cf-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6rjrd\" (UID: \"4a50d4d0-335a-4381-bf6a-4f87557203cf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6rjrd"
Jul 16 22:27:18.774188 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:27:18.774167    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4a50d4d0-335a-4381-bf6a-4f87557203cf-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6rjrd\" (UID: \"4a50d4d0-335a-4381-bf6a-4f87557203cf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6rjrd"
Jul 16 22:27:18.774261 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:27:18.774204    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4a50d4d0-335a-4381-bf6a-4f87557203cf-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6rjrd\" (UID: \"4a50d4d0-335a-4381-bf6a-4f87557203cf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6rjrd"
Jul 16 22:27:18.774334 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:27:18.774316    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4a50d4d0-335a-4381-bf6a-4f87557203cf-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6rjrd\" (UID: \"4a50d4d0-335a-4381-bf6a-4f87557203cf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6rjrd"
Jul 16 22:27:18.775832 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:27:18.775815    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4a50d4d0-335a-4381-bf6a-4f87557203cf-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6rjrd\" (UID: \"4a50d4d0-335a-4381-bf6a-4f87557203cf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6rjrd"
Jul 16 22:27:18.776366 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:27:18.776342    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4a50d4d0-335a-4381-bf6a-4f87557203cf-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6rjrd\" (UID: \"4a50d4d0-335a-4381-bf6a-4f87557203cf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6rjrd"
Jul 16 22:27:18.782718 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:27:18.782673    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hg2xc\" (UniqueName: \"kubernetes.io/projected/4a50d4d0-335a-4381-bf6a-4f87557203cf-kube-api-access-hg2xc\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6rjrd\" (UID: \"4a50d4d0-335a-4381-bf6a-4f87557203cf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6rjrd"
Jul 16 22:27:18.858504 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:27:18.858449    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6rjrd"
Jul 16 22:27:18.991112 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:27:18.991087    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6rjrd"]
Jul 16 22:27:18.993200 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:27:18.993173    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a50d4d0_335a_4381_bf6a_4f87557203cf.slice/crio-d1ca7294643d92dba9a0a03ccbc68897d94b95a5631e8251884f8f08352d0417 WatchSource:0}: Error finding container d1ca7294643d92dba9a0a03ccbc68897d94b95a5631e8251884f8f08352d0417: Status 404 returned error can't find the container with id d1ca7294643d92dba9a0a03ccbc68897d94b95a5631e8251884f8f08352d0417
Jul 16 22:27:19.680468 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:27:19.680431    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6rjrd" event={"ID":"4a50d4d0-335a-4381-bf6a-4f87557203cf","Type":"ContainerStarted","Data":"c3372ed000e4e872631d4645cfb55abd21aeb57bd83942c9c61cd034cc144bf4"}
Jul 16 22:27:19.680913 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:27:19.680493    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6rjrd" event={"ID":"4a50d4d0-335a-4381-bf6a-4f87557203cf","Type":"ContainerStarted","Data":"d1ca7294643d92dba9a0a03ccbc68897d94b95a5631e8251884f8f08352d0417"}
Jul 16 22:27:19.701287 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:27:19.701238    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6rjrd" podStartSLOduration=1.5042912529999999 podStartE2EDuration="1.701222756s" totalImagesPullingTime="196.931503ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:27:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:27:19.699673395 +0000 UTC m=+813.914454566" watchObservedRunningTime="2026-07-16 22:27:19.701222756 +0000 UTC m=+813.916003916"
Jul 16 22:27:28.859240 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:27:28.859194    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6rjrd"
Jul 16 22:27:28.859841 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:27:28.859273    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6rjrd"
Jul 16 22:27:28.871458 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:27:28.871434    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6rjrd"
Jul 16 22:27:29.749062 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:27:29.749033    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6rjrd"
Jul 16 22:28:30.343106 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:28:30.343068    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-94c4465d5-7fhbm"]
Jul 16 22:28:30.346799 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:28:30.346776    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-94c4465d5-7fhbm"
Jul 16 22:28:30.357925 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:28:30.357900    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-94c4465d5-7fhbm"]
Jul 16 22:28:30.440086 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:28:30.440061    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ndl29\" (UniqueName: \"kubernetes.io/projected/e93d6eda-f58a-4286-8ace-73400238846b-kube-api-access-ndl29\") pod \"authorino-94c4465d5-7fhbm\" (UID: \"e93d6eda-f58a-4286-8ace-73400238846b\") " pod="kuadrant-system/authorino-94c4465d5-7fhbm"
Jul 16 22:28:30.440209 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:28:30.440101    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e93d6eda-f58a-4286-8ace-73400238846b-tls-cert\") pod \"authorino-94c4465d5-7fhbm\" (UID: \"e93d6eda-f58a-4286-8ace-73400238846b\") " pod="kuadrant-system/authorino-94c4465d5-7fhbm"
Jul 16 22:28:30.540914 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:28:30.540881    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ndl29\" (UniqueName: \"kubernetes.io/projected/e93d6eda-f58a-4286-8ace-73400238846b-kube-api-access-ndl29\") pod \"authorino-94c4465d5-7fhbm\" (UID: \"e93d6eda-f58a-4286-8ace-73400238846b\") " pod="kuadrant-system/authorino-94c4465d5-7fhbm"
Jul 16 22:28:30.541043 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:28:30.540925    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e93d6eda-f58a-4286-8ace-73400238846b-tls-cert\") pod \"authorino-94c4465d5-7fhbm\" (UID: \"e93d6eda-f58a-4286-8ace-73400238846b\") " pod="kuadrant-system/authorino-94c4465d5-7fhbm"
Jul 16 22:28:30.543329 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:28:30.543300    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e93d6eda-f58a-4286-8ace-73400238846b-tls-cert\") pod \"authorino-94c4465d5-7fhbm\" (UID: \"e93d6eda-f58a-4286-8ace-73400238846b\") " pod="kuadrant-system/authorino-94c4465d5-7fhbm"
Jul 16 22:28:30.550550 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:28:30.550527    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ndl29\" (UniqueName: \"kubernetes.io/projected/e93d6eda-f58a-4286-8ace-73400238846b-kube-api-access-ndl29\") pod \"authorino-94c4465d5-7fhbm\" (UID: \"e93d6eda-f58a-4286-8ace-73400238846b\") " pod="kuadrant-system/authorino-94c4465d5-7fhbm"
Jul 16 22:28:30.655899 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:28:30.655814    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-94c4465d5-7fhbm"
Jul 16 22:28:30.810386 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:28:30.810362    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-94c4465d5-7fhbm"]
Jul 16 22:28:30.812349 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:28:30.812319    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode93d6eda_f58a_4286_8ace_73400238846b.slice/crio-179f88dc9581c028a028ea50ccdaf3c00e5605fce37ff7057a473d7c736736a3 WatchSource:0}: Error finding container 179f88dc9581c028a028ea50ccdaf3c00e5605fce37ff7057a473d7c736736a3: Status 404 returned error can't find the container with id 179f88dc9581c028a028ea50ccdaf3c00e5605fce37ff7057a473d7c736736a3
Jul 16 22:28:31.045253 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:28:31.045222    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-94c4465d5-7fhbm" event={"ID":"e93d6eda-f58a-4286-8ace-73400238846b","Type":"ContainerStarted","Data":"179f88dc9581c028a028ea50ccdaf3c00e5605fce37ff7057a473d7c736736a3"}
Jul 16 22:28:32.056440 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:28:32.056391    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-94c4465d5-7fhbm" event={"ID":"e93d6eda-f58a-4286-8ace-73400238846b","Type":"ContainerStarted","Data":"73aae1bb30cabc79e411b34646ef8a3c0b8558f8a2984ac65c01c15624a6cdca"}
Jul 16 22:28:32.076670 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:28:32.076600    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-94c4465d5-7fhbm" podStartSLOduration=1.518013361 podStartE2EDuration="2.076577728s" totalImagesPullingTime="558.564367ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:28:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:28:32.074277548 +0000 UTC m=+886.289058708" watchObservedRunningTime="2026-07-16 22:28:32.076577728 +0000 UTC m=+886.291358888"
Jul 16 22:28:32.109571 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:28:32.109534    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-546df4bcf6-dxq5z"]
Jul 16 22:28:32.110100 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:28:32.110014    2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-546df4bcf6-dxq5z" podUID="54ec0e1d-115c-49cf-86cf-6dae489c8508" containerName="authorino" containerID="cri-o://bd42c46360dec4795f4f21ba3943dfc1b5f94fd174af875695d6ac4ed22d65a3" gracePeriod=30
Jul 16 22:28:32.370348 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:28:32.370319    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-546df4bcf6-dxq5z"
Jul 16 22:28:32.457577 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:28:32.457541    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/54ec0e1d-115c-49cf-86cf-6dae489c8508-tls-cert\") pod \"54ec0e1d-115c-49cf-86cf-6dae489c8508\" (UID: \"54ec0e1d-115c-49cf-86cf-6dae489c8508\") "
Jul 16 22:28:32.457577 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:28:32.457581    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sbqtq\" (UniqueName: \"kubernetes.io/projected/54ec0e1d-115c-49cf-86cf-6dae489c8508-kube-api-access-sbqtq\") pod \"54ec0e1d-115c-49cf-86cf-6dae489c8508\" (UID: \"54ec0e1d-115c-49cf-86cf-6dae489c8508\") "
Jul 16 22:28:32.460230 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:28:32.460204    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54ec0e1d-115c-49cf-86cf-6dae489c8508-kube-api-access-sbqtq" (OuterVolumeSpecName: "kube-api-access-sbqtq") pod "54ec0e1d-115c-49cf-86cf-6dae489c8508" (UID: "54ec0e1d-115c-49cf-86cf-6dae489c8508"). InnerVolumeSpecName "kube-api-access-sbqtq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:28:32.468051 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:28:32.468027    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/54ec0e1d-115c-49cf-86cf-6dae489c8508-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "54ec0e1d-115c-49cf-86cf-6dae489c8508" (UID: "54ec0e1d-115c-49cf-86cf-6dae489c8508"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 22:28:32.558862 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:28:32.558832    2552 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/54ec0e1d-115c-49cf-86cf-6dae489c8508-tls-cert\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 16 22:28:32.558982 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:28:32.558865    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sbqtq\" (UniqueName: \"kubernetes.io/projected/54ec0e1d-115c-49cf-86cf-6dae489c8508-kube-api-access-sbqtq\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 16 22:28:33.063724 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:28:33.063676    2552 generic.go:356] "Generic (PLEG): container finished" podID="54ec0e1d-115c-49cf-86cf-6dae489c8508" containerID="bd42c46360dec4795f4f21ba3943dfc1b5f94fd174af875695d6ac4ed22d65a3" exitCode=0
Jul 16 22:28:33.064178 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:28:33.063749    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-546df4bcf6-dxq5z"
Jul 16 22:28:33.064178 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:28:33.063771    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-546df4bcf6-dxq5z" event={"ID":"54ec0e1d-115c-49cf-86cf-6dae489c8508","Type":"ContainerDied","Data":"bd42c46360dec4795f4f21ba3943dfc1b5f94fd174af875695d6ac4ed22d65a3"}
Jul 16 22:28:33.064178 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:28:33.063819    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-546df4bcf6-dxq5z" event={"ID":"54ec0e1d-115c-49cf-86cf-6dae489c8508","Type":"ContainerDied","Data":"5a0ccc99a3f06061fd42c4e3753247bfb19317586357a1e082a0b5e39597d6b4"}
Jul 16 22:28:33.064178 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:28:33.063840    2552 scope.go:117] "RemoveContainer" containerID="bd42c46360dec4795f4f21ba3943dfc1b5f94fd174af875695d6ac4ed22d65a3"
Jul 16 22:28:33.074024 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:28:33.074007    2552 scope.go:117] "RemoveContainer" containerID="bd42c46360dec4795f4f21ba3943dfc1b5f94fd174af875695d6ac4ed22d65a3"
Jul 16 22:28:33.074281 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:28:33.074262    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd42c46360dec4795f4f21ba3943dfc1b5f94fd174af875695d6ac4ed22d65a3\": container with ID starting with bd42c46360dec4795f4f21ba3943dfc1b5f94fd174af875695d6ac4ed22d65a3 not found: ID does not exist" containerID="bd42c46360dec4795f4f21ba3943dfc1b5f94fd174af875695d6ac4ed22d65a3"
Jul 16 22:28:33.074357 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:28:33.074287    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd42c46360dec4795f4f21ba3943dfc1b5f94fd174af875695d6ac4ed22d65a3"} err="failed to get container status \"bd42c46360dec4795f4f21ba3943dfc1b5f94fd174af875695d6ac4ed22d65a3\": rpc error: code = NotFound desc = could not find container \"bd42c46360dec4795f4f21ba3943dfc1b5f94fd174af875695d6ac4ed22d65a3\": container with ID starting with bd42c46360dec4795f4f21ba3943dfc1b5f94fd174af875695d6ac4ed22d65a3 not found: ID does not exist"
Jul 16 22:28:33.095538 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:28:33.095511    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-546df4bcf6-dxq5z"]
Jul 16 22:28:33.108524 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:28:33.108502    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-546df4bcf6-dxq5z"]
Jul 16 22:28:34.276817 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:28:34.276786    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="54ec0e1d-115c-49cf-86cf-6dae489c8508" path="/var/lib/kubelet/pods/54ec0e1d-115c-49cf-86cf-6dae489c8508/volumes"
Jul 16 22:29:17.647558 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:29:17.647526    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-695cf7dbbd-4lbzk"]
Jul 16 22:29:17.648230 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:29:17.647797    2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-695cf7dbbd-4lbzk" podUID="20ad114e-5b0b-431e-8d01-0519fb7ee4f9" containerName="manager" containerID="cri-o://c969be0b61e9a27daaf66737df45c7b1597bd67ef7a2ecad5fded9cf85a38ff8" gracePeriod=30
Jul 16 22:29:17.897999 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:29:17.897941    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-695cf7dbbd-4lbzk"
Jul 16 22:29:17.908295 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:29:17.908267    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-555zp\" (UniqueName: \"kubernetes.io/projected/20ad114e-5b0b-431e-8d01-0519fb7ee4f9-kube-api-access-555zp\") pod \"20ad114e-5b0b-431e-8d01-0519fb7ee4f9\" (UID: \"20ad114e-5b0b-431e-8d01-0519fb7ee4f9\") "
Jul 16 22:29:17.908420 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:29:17.908305    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/20ad114e-5b0b-431e-8d01-0519fb7ee4f9-webhook-cert\") pod \"20ad114e-5b0b-431e-8d01-0519fb7ee4f9\" (UID: \"20ad114e-5b0b-431e-8d01-0519fb7ee4f9\") "
Jul 16 22:29:17.910182 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:29:17.910155    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20ad114e-5b0b-431e-8d01-0519fb7ee4f9-kube-api-access-555zp" (OuterVolumeSpecName: "kube-api-access-555zp") pod "20ad114e-5b0b-431e-8d01-0519fb7ee4f9" (UID: "20ad114e-5b0b-431e-8d01-0519fb7ee4f9"). InnerVolumeSpecName "kube-api-access-555zp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:29:17.910273 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:29:17.910183    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/20ad114e-5b0b-431e-8d01-0519fb7ee4f9-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "20ad114e-5b0b-431e-8d01-0519fb7ee4f9" (UID: "20ad114e-5b0b-431e-8d01-0519fb7ee4f9"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 22:29:18.009492 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:29:18.009465    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-555zp\" (UniqueName: \"kubernetes.io/projected/20ad114e-5b0b-431e-8d01-0519fb7ee4f9-kube-api-access-555zp\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 16 22:29:18.009492 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:29:18.009491    2552 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/20ad114e-5b0b-431e-8d01-0519fb7ee4f9-webhook-cert\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 16 22:29:18.296524 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:29:18.296492    2552 generic.go:356] "Generic (PLEG): container finished" podID="20ad114e-5b0b-431e-8d01-0519fb7ee4f9" containerID="c969be0b61e9a27daaf66737df45c7b1597bd67ef7a2ecad5fded9cf85a38ff8" exitCode=0
Jul 16 22:29:18.296673 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:29:18.296540    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-695cf7dbbd-4lbzk"
Jul 16 22:29:18.296673 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:29:18.296572    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-695cf7dbbd-4lbzk" event={"ID":"20ad114e-5b0b-431e-8d01-0519fb7ee4f9","Type":"ContainerDied","Data":"c969be0b61e9a27daaf66737df45c7b1597bd67ef7a2ecad5fded9cf85a38ff8"}
Jul 16 22:29:18.296673 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:29:18.296620    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-695cf7dbbd-4lbzk" event={"ID":"20ad114e-5b0b-431e-8d01-0519fb7ee4f9","Type":"ContainerDied","Data":"409a3de689ea958f1508e359aae14f9cb35e16896132830174a23f3016837f39"}
Jul 16 22:29:18.296673 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:29:18.296643    2552 scope.go:117] "RemoveContainer" containerID="c969be0b61e9a27daaf66737df45c7b1597bd67ef7a2ecad5fded9cf85a38ff8"
Jul 16 22:29:18.305150 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:29:18.305133    2552 scope.go:117] "RemoveContainer" containerID="c969be0b61e9a27daaf66737df45c7b1597bd67ef7a2ecad5fded9cf85a38ff8"
Jul 16 22:29:18.305428 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:29:18.305406    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c969be0b61e9a27daaf66737df45c7b1597bd67ef7a2ecad5fded9cf85a38ff8\": container with ID starting with c969be0b61e9a27daaf66737df45c7b1597bd67ef7a2ecad5fded9cf85a38ff8 not found: ID does not exist" containerID="c969be0b61e9a27daaf66737df45c7b1597bd67ef7a2ecad5fded9cf85a38ff8"
Jul 16 22:29:18.305477 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:29:18.305437    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c969be0b61e9a27daaf66737df45c7b1597bd67ef7a2ecad5fded9cf85a38ff8"} err="failed to get container status \"c969be0b61e9a27daaf66737df45c7b1597bd67ef7a2ecad5fded9cf85a38ff8\": rpc error: code = NotFound desc = could not find container \"c969be0b61e9a27daaf66737df45c7b1597bd67ef7a2ecad5fded9cf85a38ff8\": container with ID starting with c969be0b61e9a27daaf66737df45c7b1597bd67ef7a2ecad5fded9cf85a38ff8 not found: ID does not exist"
Jul 16 22:29:18.326819 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:29:18.326791    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-695cf7dbbd-4lbzk"]
Jul 16 22:29:18.332767 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:29:18.332748    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-695cf7dbbd-4lbzk"]
Jul 16 22:29:20.276452 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:29:20.276418    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="20ad114e-5b0b-431e-8d01-0519fb7ee4f9" path="/var/lib/kubelet/pods/20ad114e-5b0b-431e-8d01-0519fb7ee4f9/volumes"
Jul 16 22:30:19.161581 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:30:19.161543    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-695cf7dbbd-pbqbj"]
Jul 16 22:30:19.162132 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:30:19.161922    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20ad114e-5b0b-431e-8d01-0519fb7ee4f9" containerName="manager"
Jul 16 22:30:19.162132 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:30:19.161934    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="20ad114e-5b0b-431e-8d01-0519fb7ee4f9" containerName="manager"
Jul 16 22:30:19.162132 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:30:19.161949    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54ec0e1d-115c-49cf-86cf-6dae489c8508" containerName="authorino"
Jul 16 22:30:19.162132 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:30:19.161955    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="54ec0e1d-115c-49cf-86cf-6dae489c8508" containerName="authorino"
Jul 16 22:30:19.162132 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:30:19.162007    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="20ad114e-5b0b-431e-8d01-0519fb7ee4f9" containerName="manager"
Jul 16 22:30:19.162132 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:30:19.162015    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="54ec0e1d-115c-49cf-86cf-6dae489c8508" containerName="authorino"
Jul 16 22:30:19.165279 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:30:19.165257    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-695cf7dbbd-pbqbj"
Jul 16 22:30:19.167959 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:30:19.167938    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 16 22:30:19.169058 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:30:19.169042    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-dr7ck\""
Jul 16 22:30:19.169058 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:30:19.169049    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 16 22:30:19.175621 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:30:19.175598    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-695cf7dbbd-pbqbj"]
Jul 16 22:30:19.206332 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:30:19.206302    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0d84e1ed-6f1b-481e-a065-4356b7387ed1-webhook-cert\") pod \"maas-controller-695cf7dbbd-pbqbj\" (UID: \"0d84e1ed-6f1b-481e-a065-4356b7387ed1\") " pod="opendatahub/maas-controller-695cf7dbbd-pbqbj"
Jul 16 22:30:19.206465 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:30:19.206349    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k82dt\" (UniqueName: \"kubernetes.io/projected/0d84e1ed-6f1b-481e-a065-4356b7387ed1-kube-api-access-k82dt\") pod \"maas-controller-695cf7dbbd-pbqbj\" (UID: \"0d84e1ed-6f1b-481e-a065-4356b7387ed1\") " pod="opendatahub/maas-controller-695cf7dbbd-pbqbj"
Jul 16 22:30:19.307057 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:30:19.307025    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k82dt\" (UniqueName: \"kubernetes.io/projected/0d84e1ed-6f1b-481e-a065-4356b7387ed1-kube-api-access-k82dt\") pod \"maas-controller-695cf7dbbd-pbqbj\" (UID: \"0d84e1ed-6f1b-481e-a065-4356b7387ed1\") " pod="opendatahub/maas-controller-695cf7dbbd-pbqbj"
Jul 16 22:30:19.307238 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:30:19.307099    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0d84e1ed-6f1b-481e-a065-4356b7387ed1-webhook-cert\") pod \"maas-controller-695cf7dbbd-pbqbj\" (UID: \"0d84e1ed-6f1b-481e-a065-4356b7387ed1\") " pod="opendatahub/maas-controller-695cf7dbbd-pbqbj"
Jul 16 22:30:19.309565 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:30:19.309540    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0d84e1ed-6f1b-481e-a065-4356b7387ed1-webhook-cert\") pod \"maas-controller-695cf7dbbd-pbqbj\" (UID: \"0d84e1ed-6f1b-481e-a065-4356b7387ed1\") " pod="opendatahub/maas-controller-695cf7dbbd-pbqbj"
Jul 16 22:30:19.317379 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:30:19.317355    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k82dt\" (UniqueName: \"kubernetes.io/projected/0d84e1ed-6f1b-481e-a065-4356b7387ed1-kube-api-access-k82dt\") pod \"maas-controller-695cf7dbbd-pbqbj\" (UID: \"0d84e1ed-6f1b-481e-a065-4356b7387ed1\") " pod="opendatahub/maas-controller-695cf7dbbd-pbqbj"
Jul 16 22:30:19.476382 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:30:19.476349    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-695cf7dbbd-pbqbj"
Jul 16 22:30:19.611870 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:30:19.611845    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-695cf7dbbd-pbqbj"]
Jul 16 22:30:19.613841 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:30:19.613816    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d84e1ed_6f1b_481e_a065_4356b7387ed1.slice/crio-3abf31e2af4d5cdb51fdcea7ac545340f1e7c09c263dd42c2b890bfaf3c00459 WatchSource:0}: Error finding container 3abf31e2af4d5cdb51fdcea7ac545340f1e7c09c263dd42c2b890bfaf3c00459: Status 404 returned error can't find the container with id 3abf31e2af4d5cdb51fdcea7ac545340f1e7c09c263dd42c2b890bfaf3c00459
Jul 16 22:30:19.615517 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:30:19.615499    2552 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 16 22:30:19.621296 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:30:19.621263    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-695cf7dbbd-pbqbj" event={"ID":"0d84e1ed-6f1b-481e-a065-4356b7387ed1","Type":"ContainerStarted","Data":"3abf31e2af4d5cdb51fdcea7ac545340f1e7c09c263dd42c2b890bfaf3c00459"}
Jul 16 22:30:20.627783 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:30:20.627743    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-695cf7dbbd-pbqbj" event={"ID":"0d84e1ed-6f1b-481e-a065-4356b7387ed1","Type":"ContainerStarted","Data":"f44fa64a981608146e37a57e4fdb6159746d48cee1d3d89e07b2727536147a17"}
Jul 16 22:30:20.628166 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:30:20.627805    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-695cf7dbbd-pbqbj"
Jul 16 22:30:20.647657 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:30:20.647612    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-695cf7dbbd-pbqbj" podStartSLOduration=1.1254726800000001 podStartE2EDuration="1.647597893s" totalImagesPullingTime="522.125213ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:30:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:30:20.646748472 +0000 UTC m=+994.861529656" watchObservedRunningTime="2026-07-16 22:30:20.647597893 +0000 UTC m=+994.862379052"
Jul 16 22:30:31.634451 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:30:31.634422    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-695cf7dbbd-pbqbj"
Jul 16 22:30:36.315952 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:30:36.315918    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-695cf7dbbd-pbqbj"]
Jul 16 22:30:36.316333 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:30:36.316107    2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-695cf7dbbd-pbqbj" podUID="0d84e1ed-6f1b-481e-a065-4356b7387ed1" containerName="manager" containerID="cri-o://f44fa64a981608146e37a57e4fdb6159746d48cee1d3d89e07b2727536147a17" gracePeriod=30
Jul 16 22:30:36.561667 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:30:36.561644    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-695cf7dbbd-pbqbj"
Jul 16 22:30:36.656637 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:30:36.656552    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k82dt\" (UniqueName: \"kubernetes.io/projected/0d84e1ed-6f1b-481e-a065-4356b7387ed1-kube-api-access-k82dt\") pod \"0d84e1ed-6f1b-481e-a065-4356b7387ed1\" (UID: \"0d84e1ed-6f1b-481e-a065-4356b7387ed1\") "
Jul 16 22:30:36.656815 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:30:36.656647    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0d84e1ed-6f1b-481e-a065-4356b7387ed1-webhook-cert\") pod \"0d84e1ed-6f1b-481e-a065-4356b7387ed1\" (UID: \"0d84e1ed-6f1b-481e-a065-4356b7387ed1\") "
Jul 16 22:30:36.658475 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:30:36.658442    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d84e1ed-6f1b-481e-a065-4356b7387ed1-kube-api-access-k82dt" (OuterVolumeSpecName: "kube-api-access-k82dt") pod "0d84e1ed-6f1b-481e-a065-4356b7387ed1" (UID: "0d84e1ed-6f1b-481e-a065-4356b7387ed1"). InnerVolumeSpecName "kube-api-access-k82dt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:30:36.658618 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:30:36.658479    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0d84e1ed-6f1b-481e-a065-4356b7387ed1-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "0d84e1ed-6f1b-481e-a065-4356b7387ed1" (UID: "0d84e1ed-6f1b-481e-a065-4356b7387ed1"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 22:30:36.707846 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:30:36.707819    2552 generic.go:356] "Generic (PLEG): container finished" podID="0d84e1ed-6f1b-481e-a065-4356b7387ed1" containerID="f44fa64a981608146e37a57e4fdb6159746d48cee1d3d89e07b2727536147a17" exitCode=0
Jul 16 22:30:36.707951 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:30:36.707925    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-695cf7dbbd-pbqbj" event={"ID":"0d84e1ed-6f1b-481e-a065-4356b7387ed1","Type":"ContainerDied","Data":"f44fa64a981608146e37a57e4fdb6159746d48cee1d3d89e07b2727536147a17"}
Jul 16 22:30:36.707951 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:30:36.707932    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-695cf7dbbd-pbqbj"
Jul 16 22:30:36.708023 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:30:36.707979    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-695cf7dbbd-pbqbj" event={"ID":"0d84e1ed-6f1b-481e-a065-4356b7387ed1","Type":"ContainerDied","Data":"3abf31e2af4d5cdb51fdcea7ac545340f1e7c09c263dd42c2b890bfaf3c00459"}
Jul 16 22:30:36.708023 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:30:36.708010    2552 scope.go:117] "RemoveContainer" containerID="f44fa64a981608146e37a57e4fdb6159746d48cee1d3d89e07b2727536147a17"
Jul 16 22:30:36.716962 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:30:36.716946    2552 scope.go:117] "RemoveContainer" containerID="f44fa64a981608146e37a57e4fdb6159746d48cee1d3d89e07b2727536147a17"
Jul 16 22:30:36.717198 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:30:36.717175    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f44fa64a981608146e37a57e4fdb6159746d48cee1d3d89e07b2727536147a17\": container with ID starting with f44fa64a981608146e37a57e4fdb6159746d48cee1d3d89e07b2727536147a17 not found: ID does not exist" containerID="f44fa64a981608146e37a57e4fdb6159746d48cee1d3d89e07b2727536147a17"
Jul 16 22:30:36.717259 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:30:36.717206    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f44fa64a981608146e37a57e4fdb6159746d48cee1d3d89e07b2727536147a17"} err="failed to get container status \"f44fa64a981608146e37a57e4fdb6159746d48cee1d3d89e07b2727536147a17\": rpc error: code = NotFound desc = could not find container \"f44fa64a981608146e37a57e4fdb6159746d48cee1d3d89e07b2727536147a17\": container with ID starting with f44fa64a981608146e37a57e4fdb6159746d48cee1d3d89e07b2727536147a17 not found: ID does not exist"
Jul 16 22:30:36.730097 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:30:36.730073    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-695cf7dbbd-pbqbj"]
Jul 16 22:30:36.732037 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:30:36.732016    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-695cf7dbbd-pbqbj"]
Jul 16 22:30:36.757595 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:30:36.757580    2552 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0d84e1ed-6f1b-481e-a065-4356b7387ed1-webhook-cert\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 16 22:30:36.757664 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:30:36.757598    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k82dt\" (UniqueName: \"kubernetes.io/projected/0d84e1ed-6f1b-481e-a065-4356b7387ed1-kube-api-access-k82dt\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 16 22:30:37.552800 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:30:37.552769    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-695cf7dbbd-8gqp9"]
Jul 16 22:30:37.553152 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:30:37.553116    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d84e1ed-6f1b-481e-a065-4356b7387ed1" containerName="manager"
Jul 16 22:30:37.553152 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:30:37.553126    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d84e1ed-6f1b-481e-a065-4356b7387ed1" containerName="manager"
Jul 16 22:30:37.553222 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:30:37.553197    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d84e1ed-6f1b-481e-a065-4356b7387ed1" containerName="manager"
Jul 16 22:30:37.556298 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:30:37.556277    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-695cf7dbbd-8gqp9"
Jul 16 22:30:37.558849 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:30:37.558831    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 16 22:30:37.559830 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:30:37.559815    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-dr7ck\""
Jul 16 22:30:37.559898 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:30:37.559865    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 16 22:30:37.565573 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:30:37.565553    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-695cf7dbbd-8gqp9"]
Jul 16 22:30:37.664038 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:30:37.664015    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/052a1331-0c9b-42fe-8f4c-2fe6d7c78ae1-webhook-cert\") pod \"maas-controller-695cf7dbbd-8gqp9\" (UID: \"052a1331-0c9b-42fe-8f4c-2fe6d7c78ae1\") " pod="opendatahub/maas-controller-695cf7dbbd-8gqp9"
Jul 16 22:30:37.664168 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:30:37.664071    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mstm8\" (UniqueName: \"kubernetes.io/projected/052a1331-0c9b-42fe-8f4c-2fe6d7c78ae1-kube-api-access-mstm8\") pod \"maas-controller-695cf7dbbd-8gqp9\" (UID: \"052a1331-0c9b-42fe-8f4c-2fe6d7c78ae1\") " pod="opendatahub/maas-controller-695cf7dbbd-8gqp9"
Jul 16 22:30:37.765002 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:30:37.764980    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mstm8\" (UniqueName: \"kubernetes.io/projected/052a1331-0c9b-42fe-8f4c-2fe6d7c78ae1-kube-api-access-mstm8\") pod \"maas-controller-695cf7dbbd-8gqp9\" (UID: \"052a1331-0c9b-42fe-8f4c-2fe6d7c78ae1\") " pod="opendatahub/maas-controller-695cf7dbbd-8gqp9"
Jul 16 22:30:37.765127 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:30:37.765024    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/052a1331-0c9b-42fe-8f4c-2fe6d7c78ae1-webhook-cert\") pod \"maas-controller-695cf7dbbd-8gqp9\" (UID: \"052a1331-0c9b-42fe-8f4c-2fe6d7c78ae1\") " pod="opendatahub/maas-controller-695cf7dbbd-8gqp9"
Jul 16 22:30:37.767353 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:30:37.767336    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/052a1331-0c9b-42fe-8f4c-2fe6d7c78ae1-webhook-cert\") pod \"maas-controller-695cf7dbbd-8gqp9\" (UID: \"052a1331-0c9b-42fe-8f4c-2fe6d7c78ae1\") " pod="opendatahub/maas-controller-695cf7dbbd-8gqp9"
Jul 16 22:30:37.774747 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:30:37.774728    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mstm8\" (UniqueName: \"kubernetes.io/projected/052a1331-0c9b-42fe-8f4c-2fe6d7c78ae1-kube-api-access-mstm8\") pod \"maas-controller-695cf7dbbd-8gqp9\" (UID: \"052a1331-0c9b-42fe-8f4c-2fe6d7c78ae1\") " pod="opendatahub/maas-controller-695cf7dbbd-8gqp9"
Jul 16 22:30:37.866984 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:30:37.866911    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-695cf7dbbd-8gqp9"
Jul 16 22:30:38.003893 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:30:38.003863    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-695cf7dbbd-8gqp9"]
Jul 16 22:30:38.005300 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:30:38.005275    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod052a1331_0c9b_42fe_8f4c_2fe6d7c78ae1.slice/crio-8d2d0788d98ff0ca3e894cbcf6f22528e0d19af2fbef2658f484d502cb4e4f63 WatchSource:0}: Error finding container 8d2d0788d98ff0ca3e894cbcf6f22528e0d19af2fbef2658f484d502cb4e4f63: Status 404 returned error can't find the container with id 8d2d0788d98ff0ca3e894cbcf6f22528e0d19af2fbef2658f484d502cb4e4f63
Jul 16 22:30:38.276587 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:30:38.276557    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0d84e1ed-6f1b-481e-a065-4356b7387ed1" path="/var/lib/kubelet/pods/0d84e1ed-6f1b-481e-a065-4356b7387ed1/volumes"
Jul 16 22:30:38.720571 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:30:38.720535    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-695cf7dbbd-8gqp9" event={"ID":"052a1331-0c9b-42fe-8f4c-2fe6d7c78ae1","Type":"ContainerStarted","Data":"54dd14f1458c9fd076c348f500bdcc7bf0836562d747d4f22f443e0a99c5ecaa"}
Jul 16 22:30:38.721012 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:30:38.720622    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-695cf7dbbd-8gqp9" event={"ID":"052a1331-0c9b-42fe-8f4c-2fe6d7c78ae1","Type":"ContainerStarted","Data":"8d2d0788d98ff0ca3e894cbcf6f22528e0d19af2fbef2658f484d502cb4e4f63"}
Jul 16 22:30:38.721012 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:30:38.720673    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-695cf7dbbd-8gqp9"
Jul 16 22:30:38.741125 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:30:38.741075    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-695cf7dbbd-8gqp9" podStartSLOduration=1.393502659 podStartE2EDuration="1.74105962s" totalImagesPullingTime="347.556961ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:30:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:30:38.738951879 +0000 UTC m=+1012.953733064" watchObservedRunningTime="2026-07-16 22:30:38.74105962 +0000 UTC m=+1012.955840836"
Jul 16 22:30:49.727041 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:30:49.727007    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-695cf7dbbd-8gqp9"
Jul 16 22:35:30.004526 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:35:30.004496    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lxvtv"]
Jul 16 22:35:30.006713 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:35:30.004712    2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lxvtv" podUID="4bfd9b37-96a4-496a-96a3-36885a73e07b" containerName="manager" containerID="cri-o://9d5549413a1d5268c0179ebc035c94be4f30ce1f6116db29336200d1fbb3f912" gracePeriod=10
Jul 16 22:35:32.152099 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:35:32.152078    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lxvtv"
Jul 16 22:35:32.199715 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:35:32.199677    2552 generic.go:356] "Generic (PLEG): container finished" podID="4bfd9b37-96a4-496a-96a3-36885a73e07b" containerID="9d5549413a1d5268c0179ebc035c94be4f30ce1f6116db29336200d1fbb3f912" exitCode=0
Jul 16 22:35:32.199836 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:35:32.199733    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lxvtv" event={"ID":"4bfd9b37-96a4-496a-96a3-36885a73e07b","Type":"ContainerDied","Data":"9d5549413a1d5268c0179ebc035c94be4f30ce1f6116db29336200d1fbb3f912"}
Jul 16 22:35:32.199836 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:35:32.199739    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lxvtv"
Jul 16 22:35:32.199836 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:35:32.199774    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lxvtv" event={"ID":"4bfd9b37-96a4-496a-96a3-36885a73e07b","Type":"ContainerDied","Data":"f86bd2ca79503324d644b8d9d89e5f65866f57c1fde3953af1608907e1ea3130"}
Jul 16 22:35:32.199836 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:35:32.199796    2552 scope.go:117] "RemoveContainer" containerID="9d5549413a1d5268c0179ebc035c94be4f30ce1f6116db29336200d1fbb3f912"
Jul 16 22:35:32.210004 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:35:32.209983    2552 scope.go:117] "RemoveContainer" containerID="9d5549413a1d5268c0179ebc035c94be4f30ce1f6116db29336200d1fbb3f912"
Jul 16 22:35:32.210310 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:35:32.210288    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d5549413a1d5268c0179ebc035c94be4f30ce1f6116db29336200d1fbb3f912\": container with ID starting with 9d5549413a1d5268c0179ebc035c94be4f30ce1f6116db29336200d1fbb3f912 not found: ID does not exist" containerID="9d5549413a1d5268c0179ebc035c94be4f30ce1f6116db29336200d1fbb3f912"
Jul 16 22:35:32.210419 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:35:32.210319    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d5549413a1d5268c0179ebc035c94be4f30ce1f6116db29336200d1fbb3f912"} err="failed to get container status \"9d5549413a1d5268c0179ebc035c94be4f30ce1f6116db29336200d1fbb3f912\": rpc error: code = NotFound desc = could not find container \"9d5549413a1d5268c0179ebc035c94be4f30ce1f6116db29336200d1fbb3f912\": container with ID starting with 9d5549413a1d5268c0179ebc035c94be4f30ce1f6116db29336200d1fbb3f912 not found: ID does not exist"
Jul 16 22:35:32.255056 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:35:32.255035    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v2hdg\" (UniqueName: \"kubernetes.io/projected/4bfd9b37-96a4-496a-96a3-36885a73e07b-kube-api-access-v2hdg\") pod \"4bfd9b37-96a4-496a-96a3-36885a73e07b\" (UID: \"4bfd9b37-96a4-496a-96a3-36885a73e07b\") "
Jul 16 22:35:32.255171 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:35:32.255106    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4bfd9b37-96a4-496a-96a3-36885a73e07b-extensions-socket-volume\") pod \"4bfd9b37-96a4-496a-96a3-36885a73e07b\" (UID: \"4bfd9b37-96a4-496a-96a3-36885a73e07b\") "
Jul 16 22:35:32.255417 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:35:32.255394    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4bfd9b37-96a4-496a-96a3-36885a73e07b-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "4bfd9b37-96a4-496a-96a3-36885a73e07b" (UID: "4bfd9b37-96a4-496a-96a3-36885a73e07b"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:35:32.257013 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:35:32.256985    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4bfd9b37-96a4-496a-96a3-36885a73e07b-kube-api-access-v2hdg" (OuterVolumeSpecName: "kube-api-access-v2hdg") pod "4bfd9b37-96a4-496a-96a3-36885a73e07b" (UID: "4bfd9b37-96a4-496a-96a3-36885a73e07b"). InnerVolumeSpecName "kube-api-access-v2hdg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:35:32.356567 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:35:32.356545    2552 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4bfd9b37-96a4-496a-96a3-36885a73e07b-extensions-socket-volume\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 16 22:35:32.356567 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:35:32.356566    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v2hdg\" (UniqueName: \"kubernetes.io/projected/4bfd9b37-96a4-496a-96a3-36885a73e07b-kube-api-access-v2hdg\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 16 22:35:32.525655 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:35:32.525623    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lxvtv"]
Jul 16 22:35:32.527600 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:35:32.527576    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lxvtv"]
Jul 16 22:35:34.276424 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:35:34.276392    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4bfd9b37-96a4-496a-96a3-36885a73e07b" path="/var/lib/kubelet/pods/4bfd9b37-96a4-496a-96a3-36885a73e07b/volumes"
Jul 16 22:36:31.234273 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:36:31.234235    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mxnn2"]
Jul 16 22:36:31.234771 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:36:31.234601    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4bfd9b37-96a4-496a-96a3-36885a73e07b" containerName="manager"
Jul 16 22:36:31.234771 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:36:31.234613    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="4bfd9b37-96a4-496a-96a3-36885a73e07b" containerName="manager"
Jul 16 22:36:31.234771 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:36:31.234691    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="4bfd9b37-96a4-496a-96a3-36885a73e07b" containerName="manager"
Jul 16 22:36:31.237692 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:36:31.237672    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mxnn2"
Jul 16 22:36:31.240686 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:36:31.240668    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-76t4q\""
Jul 16 22:36:31.272477 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:36:31.272453    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mxnn2"]
Jul 16 22:36:31.398810 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:36:31.398774    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3f1b3d4f-79ad-4c24-808f-3cb9d52fd14f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-mxnn2\" (UID: \"3f1b3d4f-79ad-4c24-808f-3cb9d52fd14f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mxnn2"
Jul 16 22:36:31.398948 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:36:31.398843    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89w2m\" (UniqueName: \"kubernetes.io/projected/3f1b3d4f-79ad-4c24-808f-3cb9d52fd14f-kube-api-access-89w2m\") pod \"kuadrant-operator-controller-manager-86878c769f-mxnn2\" (UID: \"3f1b3d4f-79ad-4c24-808f-3cb9d52fd14f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mxnn2"
Jul 16 22:36:31.499978 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:36:31.499897    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3f1b3d4f-79ad-4c24-808f-3cb9d52fd14f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-mxnn2\" (UID: \"3f1b3d4f-79ad-4c24-808f-3cb9d52fd14f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mxnn2"
Jul 16 22:36:31.499978 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:36:31.499946    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-89w2m\" (UniqueName: \"kubernetes.io/projected/3f1b3d4f-79ad-4c24-808f-3cb9d52fd14f-kube-api-access-89w2m\") pod \"kuadrant-operator-controller-manager-86878c769f-mxnn2\" (UID: \"3f1b3d4f-79ad-4c24-808f-3cb9d52fd14f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mxnn2"
Jul 16 22:36:31.500295 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:36:31.500275    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3f1b3d4f-79ad-4c24-808f-3cb9d52fd14f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-mxnn2\" (UID: \"3f1b3d4f-79ad-4c24-808f-3cb9d52fd14f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mxnn2"
Jul 16 22:36:31.509838 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:36:31.509813    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-89w2m\" (UniqueName: \"kubernetes.io/projected/3f1b3d4f-79ad-4c24-808f-3cb9d52fd14f-kube-api-access-89w2m\") pod \"kuadrant-operator-controller-manager-86878c769f-mxnn2\" (UID: \"3f1b3d4f-79ad-4c24-808f-3cb9d52fd14f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mxnn2"
Jul 16 22:36:31.547343 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:36:31.547314    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mxnn2"
Jul 16 22:36:31.690545 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:36:31.690521    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mxnn2"]
Jul 16 22:36:31.693615 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:36:31.693581    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f1b3d4f_79ad_4c24_808f_3cb9d52fd14f.slice/crio-d235983c22fff544b1178dd4604a9436eea62c863e3df049601be9301fb72846 WatchSource:0}: Error finding container d235983c22fff544b1178dd4604a9436eea62c863e3df049601be9301fb72846: Status 404 returned error can't find the container with id d235983c22fff544b1178dd4604a9436eea62c863e3df049601be9301fb72846
Jul 16 22:36:32.489372 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:36:32.489335    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mxnn2" event={"ID":"3f1b3d4f-79ad-4c24-808f-3cb9d52fd14f","Type":"ContainerStarted","Data":"9f88b5e0acc983d8e48dfb3f3ec5510825116e617ceedf3b31316eef4e31a1aa"}
Jul 16 22:36:32.489921 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:36:32.489392    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mxnn2" event={"ID":"3f1b3d4f-79ad-4c24-808f-3cb9d52fd14f","Type":"ContainerStarted","Data":"d235983c22fff544b1178dd4604a9436eea62c863e3df049601be9301fb72846"}
Jul 16 22:36:32.489921 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:36:32.489452    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mxnn2"
Jul 16 22:36:32.513528 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:36:32.513471    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mxnn2" podStartSLOduration=1.51345299 podStartE2EDuration="1.51345299s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:36:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:36:32.511347969 +0000 UTC m=+1366.726129130" watchObservedRunningTime="2026-07-16 22:36:32.51345299 +0000 UTC m=+1366.728234151"
Jul 16 22:36:43.496856 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:36:43.496820    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mxnn2"
Jul 16 22:42:55.591999 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:42:55.591959    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-f24d3bde-5bfd6c968f-6zzrr"]
Jul 16 22:42:55.595390 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:42:55.595370    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f24d3bde-5bfd6c968f-6zzrr"
Jul 16 22:42:55.598730 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:42:55.598711    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-f24d3bde-serving-cert\""
Jul 16 22:42:55.611649 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:42:55.611598    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-f24d3bde-5bfd6c968f-6zzrr"]
Jul 16 22:42:55.709030 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:42:55.709000    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/54c5fbf4-aa44-43c4-a750-fffe5916b7ac-maas-api-tls\") pod \"maas-api-e2e-ait-f24d3bde-5bfd6c968f-6zzrr\" (UID: \"54c5fbf4-aa44-43c4-a750-fffe5916b7ac\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f24d3bde-5bfd6c968f-6zzrr"
Jul 16 22:42:55.709162 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:42:55.709036    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwdb6\" (UniqueName: \"kubernetes.io/projected/54c5fbf4-aa44-43c4-a750-fffe5916b7ac-kube-api-access-zwdb6\") pod \"maas-api-e2e-ait-f24d3bde-5bfd6c968f-6zzrr\" (UID: \"54c5fbf4-aa44-43c4-a750-fffe5916b7ac\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f24d3bde-5bfd6c968f-6zzrr"
Jul 16 22:42:55.709162 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:42:55.709073    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/54c5fbf4-aa44-43c4-a750-fffe5916b7ac-openshift-service-ca\") pod \"maas-api-e2e-ait-f24d3bde-5bfd6c968f-6zzrr\" (UID: \"54c5fbf4-aa44-43c4-a750-fffe5916b7ac\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f24d3bde-5bfd6c968f-6zzrr"
Jul 16 22:42:55.809792 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:42:55.809753    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/54c5fbf4-aa44-43c4-a750-fffe5916b7ac-openshift-service-ca\") pod \"maas-api-e2e-ait-f24d3bde-5bfd6c968f-6zzrr\" (UID: \"54c5fbf4-aa44-43c4-a750-fffe5916b7ac\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f24d3bde-5bfd6c968f-6zzrr"
Jul 16 22:42:55.809972 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:42:55.809860    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/54c5fbf4-aa44-43c4-a750-fffe5916b7ac-maas-api-tls\") pod \"maas-api-e2e-ait-f24d3bde-5bfd6c968f-6zzrr\" (UID: \"54c5fbf4-aa44-43c4-a750-fffe5916b7ac\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f24d3bde-5bfd6c968f-6zzrr"
Jul 16 22:42:55.809972 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:42:55.809891    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwdb6\" (UniqueName: \"kubernetes.io/projected/54c5fbf4-aa44-43c4-a750-fffe5916b7ac-kube-api-access-zwdb6\") pod \"maas-api-e2e-ait-f24d3bde-5bfd6c968f-6zzrr\" (UID: \"54c5fbf4-aa44-43c4-a750-fffe5916b7ac\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f24d3bde-5bfd6c968f-6zzrr"
Jul 16 22:42:55.810424 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:42:55.810397    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/54c5fbf4-aa44-43c4-a750-fffe5916b7ac-openshift-service-ca\") pod \"maas-api-e2e-ait-f24d3bde-5bfd6c968f-6zzrr\" (UID: \"54c5fbf4-aa44-43c4-a750-fffe5916b7ac\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f24d3bde-5bfd6c968f-6zzrr"
Jul 16 22:42:55.812332 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:42:55.812310    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/54c5fbf4-aa44-43c4-a750-fffe5916b7ac-maas-api-tls\") pod \"maas-api-e2e-ait-f24d3bde-5bfd6c968f-6zzrr\" (UID: \"54c5fbf4-aa44-43c4-a750-fffe5916b7ac\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f24d3bde-5bfd6c968f-6zzrr"
Jul 16 22:42:55.821017 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:42:55.820997    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwdb6\" (UniqueName: \"kubernetes.io/projected/54c5fbf4-aa44-43c4-a750-fffe5916b7ac-kube-api-access-zwdb6\") pod \"maas-api-e2e-ait-f24d3bde-5bfd6c968f-6zzrr\" (UID: \"54c5fbf4-aa44-43c4-a750-fffe5916b7ac\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f24d3bde-5bfd6c968f-6zzrr"
Jul 16 22:42:55.905058 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:42:55.904982    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f24d3bde-5bfd6c968f-6zzrr"
Jul 16 22:42:56.058598 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:42:56.058576    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-f24d3bde-5bfd6c968f-6zzrr"]
Jul 16 22:42:56.060609 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:42:56.060581    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54c5fbf4_aa44_43c4_a750_fffe5916b7ac.slice/crio-01e6f44f24c71b2d7f5de57e03e6bfad8393bcbf1fe8dd0ad68e43920c60396d WatchSource:0}: Error finding container 01e6f44f24c71b2d7f5de57e03e6bfad8393bcbf1fe8dd0ad68e43920c60396d: Status 404 returned error can't find the container with id 01e6f44f24c71b2d7f5de57e03e6bfad8393bcbf1fe8dd0ad68e43920c60396d
Jul 16 22:42:56.062269 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:42:56.062251    2552 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 16 22:42:56.436768 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:42:56.436726    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f24d3bde-5bfd6c968f-6zzrr" event={"ID":"54c5fbf4-aa44-43c4-a750-fffe5916b7ac","Type":"ContainerStarted","Data":"01e6f44f24c71b2d7f5de57e03e6bfad8393bcbf1fe8dd0ad68e43920c60396d"}
Jul 16 22:42:57.442743 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:42:57.442708    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f24d3bde-5bfd6c968f-6zzrr" event={"ID":"54c5fbf4-aa44-43c4-a750-fffe5916b7ac","Type":"ContainerStarted","Data":"e516e9730d7f86ab93ce043834d174d009ec8392a87456e1357c555b620677a0"}
Jul 16 22:42:57.443203 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:42:57.442806    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f24d3bde-5bfd6c968f-6zzrr"
Jul 16 22:42:57.461368 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:42:57.461320    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f24d3bde-5bfd6c968f-6zzrr" podStartSLOduration=2.013662349 podStartE2EDuration="2.461301907s" totalImagesPullingTime="447.639558ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:42:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:42:57.460417055 +0000 UTC m=+1751.675198216" watchObservedRunningTime="2026-07-16 22:42:57.461301907 +0000 UTC m=+1751.676083067"
Jul 16 22:43:03.452855 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:43:03.452826    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f24d3bde-5bfd6c968f-6zzrr"
Jul 16 22:44:01.483356 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:44:01.483320    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-f24d3bde-5bfd6c968f-6zzrr"]
Jul 16 22:44:01.483896 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:44:01.483586    2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f24d3bde-5bfd6c968f-6zzrr" podUID="54c5fbf4-aa44-43c4-a750-fffe5916b7ac" containerName="maas-api" containerID="cri-o://e516e9730d7f86ab93ce043834d174d009ec8392a87456e1357c555b620677a0" gracePeriod=30
Jul 16 22:44:01.732043 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:44:01.732018    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f24d3bde-5bfd6c968f-6zzrr"
Jul 16 22:44:01.760263 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:44:01.760183    2552 generic.go:356] "Generic (PLEG): container finished" podID="54c5fbf4-aa44-43c4-a750-fffe5916b7ac" containerID="e516e9730d7f86ab93ce043834d174d009ec8392a87456e1357c555b620677a0" exitCode=0
Jul 16 22:44:01.760263 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:44:01.760223    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f24d3bde-5bfd6c968f-6zzrr"
Jul 16 22:44:01.760471 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:44:01.760224    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f24d3bde-5bfd6c968f-6zzrr" event={"ID":"54c5fbf4-aa44-43c4-a750-fffe5916b7ac","Type":"ContainerDied","Data":"e516e9730d7f86ab93ce043834d174d009ec8392a87456e1357c555b620677a0"}
Jul 16 22:44:01.760471 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:44:01.760363    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f24d3bde-5bfd6c968f-6zzrr" event={"ID":"54c5fbf4-aa44-43c4-a750-fffe5916b7ac","Type":"ContainerDied","Data":"01e6f44f24c71b2d7f5de57e03e6bfad8393bcbf1fe8dd0ad68e43920c60396d"}
Jul 16 22:44:01.760471 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:44:01.760399    2552 scope.go:117] "RemoveContainer" containerID="e516e9730d7f86ab93ce043834d174d009ec8392a87456e1357c555b620677a0"
Jul 16 22:44:01.768880 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:44:01.768861    2552 scope.go:117] "RemoveContainer" containerID="e516e9730d7f86ab93ce043834d174d009ec8392a87456e1357c555b620677a0"
Jul 16 22:44:01.769159 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:44:01.769137    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e516e9730d7f86ab93ce043834d174d009ec8392a87456e1357c555b620677a0\": container with ID starting with e516e9730d7f86ab93ce043834d174d009ec8392a87456e1357c555b620677a0 not found: ID does not exist" containerID="e516e9730d7f86ab93ce043834d174d009ec8392a87456e1357c555b620677a0"
Jul 16 22:44:01.769233 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:44:01.769172    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e516e9730d7f86ab93ce043834d174d009ec8392a87456e1357c555b620677a0"} err="failed to get container status \"e516e9730d7f86ab93ce043834d174d009ec8392a87456e1357c555b620677a0\": rpc error: code = NotFound desc = could not find container \"e516e9730d7f86ab93ce043834d174d009ec8392a87456e1357c555b620677a0\": container with ID starting with e516e9730d7f86ab93ce043834d174d009ec8392a87456e1357c555b620677a0 not found: ID does not exist"
Jul 16 22:44:01.801468 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:44:01.801434    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/54c5fbf4-aa44-43c4-a750-fffe5916b7ac-maas-api-tls\") pod \"54c5fbf4-aa44-43c4-a750-fffe5916b7ac\" (UID: \"54c5fbf4-aa44-43c4-a750-fffe5916b7ac\") "
Jul 16 22:44:01.801613 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:44:01.801547    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/54c5fbf4-aa44-43c4-a750-fffe5916b7ac-openshift-service-ca\") pod \"54c5fbf4-aa44-43c4-a750-fffe5916b7ac\" (UID: \"54c5fbf4-aa44-43c4-a750-fffe5916b7ac\") "
Jul 16 22:44:01.801613 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:44:01.801568    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zwdb6\" (UniqueName: \"kubernetes.io/projected/54c5fbf4-aa44-43c4-a750-fffe5916b7ac-kube-api-access-zwdb6\") pod \"54c5fbf4-aa44-43c4-a750-fffe5916b7ac\" (UID: \"54c5fbf4-aa44-43c4-a750-fffe5916b7ac\") "
Jul 16 22:44:01.801943 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:44:01.801916    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/54c5fbf4-aa44-43c4-a750-fffe5916b7ac-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "54c5fbf4-aa44-43c4-a750-fffe5916b7ac" (UID: "54c5fbf4-aa44-43c4-a750-fffe5916b7ac"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 22:44:01.803528 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:44:01.803508    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/54c5fbf4-aa44-43c4-a750-fffe5916b7ac-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "54c5fbf4-aa44-43c4-a750-fffe5916b7ac" (UID: "54c5fbf4-aa44-43c4-a750-fffe5916b7ac"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 22:44:01.803670 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:44:01.803650    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54c5fbf4-aa44-43c4-a750-fffe5916b7ac-kube-api-access-zwdb6" (OuterVolumeSpecName: "kube-api-access-zwdb6") pod "54c5fbf4-aa44-43c4-a750-fffe5916b7ac" (UID: "54c5fbf4-aa44-43c4-a750-fffe5916b7ac"). InnerVolumeSpecName "kube-api-access-zwdb6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:44:01.902301 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:44:01.902271    2552 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/54c5fbf4-aa44-43c4-a750-fffe5916b7ac-openshift-service-ca\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 16 22:44:01.902301 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:44:01.902296    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zwdb6\" (UniqueName: \"kubernetes.io/projected/54c5fbf4-aa44-43c4-a750-fffe5916b7ac-kube-api-access-zwdb6\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 16 22:44:01.902301 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:44:01.902308    2552 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/54c5fbf4-aa44-43c4-a750-fffe5916b7ac-maas-api-tls\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 16 22:44:02.098089 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:44:02.098058    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-f24d3bde-5bfd6c968f-6zzrr"]
Jul 16 22:44:02.107479 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:44:02.107455    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-f24d3bde-5bfd6c968f-6zzrr"]
Jul 16 22:44:02.276060 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:44:02.276030    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="54c5fbf4-aa44-43c4-a750-fffe5916b7ac" path="/var/lib/kubelet/pods/54c5fbf4-aa44-43c4-a750-fffe5916b7ac/volumes"
Jul 16 22:44:14.514886 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:44:14.514854    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-907fee31-6c445479dd-pphmr"]
Jul 16 22:44:14.515354 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:44:14.515254    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54c5fbf4-aa44-43c4-a750-fffe5916b7ac" containerName="maas-api"
Jul 16 22:44:14.515354 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:44:14.515271    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="54c5fbf4-aa44-43c4-a750-fffe5916b7ac" containerName="maas-api"
Jul 16 22:44:14.515428 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:44:14.515402    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="54c5fbf4-aa44-43c4-a750-fffe5916b7ac" containerName="maas-api"
Jul 16 22:44:14.519929 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:44:14.519903    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-907fee31-6c445479dd-pphmr"
Jul 16 22:44:14.528210 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:44:14.528182    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-907fee31-serving-cert\""
Jul 16 22:44:14.542037 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:44:14.542004    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-907fee31-6c445479dd-pphmr"]
Jul 16 22:44:14.615865 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:44:14.615830    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bbecac14-d761-4a04-bdc3-b42c6dbcdcb0-maas-api-tls\") pod \"maas-api-e2e-migrate-907fee31-6c445479dd-pphmr\" (UID: \"bbecac14-d761-4a04-bdc3-b42c6dbcdcb0\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-907fee31-6c445479dd-pphmr"
Jul 16 22:44:14.616042 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:44:14.615911    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cx9tk\" (UniqueName: \"kubernetes.io/projected/bbecac14-d761-4a04-bdc3-b42c6dbcdcb0-kube-api-access-cx9tk\") pod \"maas-api-e2e-migrate-907fee31-6c445479dd-pphmr\" (UID: \"bbecac14-d761-4a04-bdc3-b42c6dbcdcb0\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-907fee31-6c445479dd-pphmr"
Jul 16 22:44:14.616042 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:44:14.615945    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bbecac14-d761-4a04-bdc3-b42c6dbcdcb0-openshift-service-ca\") pod \"maas-api-e2e-migrate-907fee31-6c445479dd-pphmr\" (UID: \"bbecac14-d761-4a04-bdc3-b42c6dbcdcb0\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-907fee31-6c445479dd-pphmr"
Jul 16 22:44:14.717140 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:44:14.717103    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bbecac14-d761-4a04-bdc3-b42c6dbcdcb0-openshift-service-ca\") pod \"maas-api-e2e-migrate-907fee31-6c445479dd-pphmr\" (UID: \"bbecac14-d761-4a04-bdc3-b42c6dbcdcb0\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-907fee31-6c445479dd-pphmr"
Jul 16 22:44:14.717438 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:44:14.717164    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bbecac14-d761-4a04-bdc3-b42c6dbcdcb0-maas-api-tls\") pod \"maas-api-e2e-migrate-907fee31-6c445479dd-pphmr\" (UID: \"bbecac14-d761-4a04-bdc3-b42c6dbcdcb0\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-907fee31-6c445479dd-pphmr"
Jul 16 22:44:14.717438 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:44:14.717207    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cx9tk\" (UniqueName: \"kubernetes.io/projected/bbecac14-d761-4a04-bdc3-b42c6dbcdcb0-kube-api-access-cx9tk\") pod \"maas-api-e2e-migrate-907fee31-6c445479dd-pphmr\" (UID: \"bbecac14-d761-4a04-bdc3-b42c6dbcdcb0\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-907fee31-6c445479dd-pphmr"
Jul 16 22:44:14.717438 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:44:14.717323    2552 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-907fee31-serving-cert: secret "maas-api-e2e-migrate-907fee31-serving-cert" not found
Jul 16 22:44:14.717438 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:44:14.717397    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bbecac14-d761-4a04-bdc3-b42c6dbcdcb0-maas-api-tls podName:bbecac14-d761-4a04-bdc3-b42c6dbcdcb0 nodeName:}" failed. No retries permitted until 2026-07-16 22:44:15.217379513 +0000 UTC m=+1829.432160650 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/bbecac14-d761-4a04-bdc3-b42c6dbcdcb0-maas-api-tls") pod "maas-api-e2e-migrate-907fee31-6c445479dd-pphmr" (UID: "bbecac14-d761-4a04-bdc3-b42c6dbcdcb0") : secret "maas-api-e2e-migrate-907fee31-serving-cert" not found
Jul 16 22:44:14.717933 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:44:14.717912    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bbecac14-d761-4a04-bdc3-b42c6dbcdcb0-openshift-service-ca\") pod \"maas-api-e2e-migrate-907fee31-6c445479dd-pphmr\" (UID: \"bbecac14-d761-4a04-bdc3-b42c6dbcdcb0\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-907fee31-6c445479dd-pphmr"
Jul 16 22:44:14.732686 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:44:14.732656    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cx9tk\" (UniqueName: \"kubernetes.io/projected/bbecac14-d761-4a04-bdc3-b42c6dbcdcb0-kube-api-access-cx9tk\") pod \"maas-api-e2e-migrate-907fee31-6c445479dd-pphmr\" (UID: \"bbecac14-d761-4a04-bdc3-b42c6dbcdcb0\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-907fee31-6c445479dd-pphmr"
Jul 16 22:44:15.222406 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:44:15.222370    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bbecac14-d761-4a04-bdc3-b42c6dbcdcb0-maas-api-tls\") pod \"maas-api-e2e-migrate-907fee31-6c445479dd-pphmr\" (UID: \"bbecac14-d761-4a04-bdc3-b42c6dbcdcb0\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-907fee31-6c445479dd-pphmr"
Jul 16 22:44:15.224886 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:44:15.224866    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bbecac14-d761-4a04-bdc3-b42c6dbcdcb0-maas-api-tls\") pod \"maas-api-e2e-migrate-907fee31-6c445479dd-pphmr\" (UID: \"bbecac14-d761-4a04-bdc3-b42c6dbcdcb0\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-907fee31-6c445479dd-pphmr"
Jul 16 22:44:15.434094 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:44:15.434059    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-907fee31-6c445479dd-pphmr"
Jul 16 22:44:15.810872 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:44:15.810788    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-907fee31-6c445479dd-pphmr"]
Jul 16 22:44:15.814441 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:44:15.814414    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbecac14_d761_4a04_bdc3_b42c6dbcdcb0.slice/crio-8da27279ec088f44b42f4ec1f6e537bc6331ae7b5a7decbe8980a70f084fba18 WatchSource:0}: Error finding container 8da27279ec088f44b42f4ec1f6e537bc6331ae7b5a7decbe8980a70f084fba18: Status 404 returned error can't find the container with id 8da27279ec088f44b42f4ec1f6e537bc6331ae7b5a7decbe8980a70f084fba18
Jul 16 22:44:15.832499 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:44:15.832465    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-907fee31-6c445479dd-pphmr" event={"ID":"bbecac14-d761-4a04-bdc3-b42c6dbcdcb0","Type":"ContainerStarted","Data":"8da27279ec088f44b42f4ec1f6e537bc6331ae7b5a7decbe8980a70f084fba18"}
Jul 16 22:44:16.839427 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:44:16.839391    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-907fee31-6c445479dd-pphmr" event={"ID":"bbecac14-d761-4a04-bdc3-b42c6dbcdcb0","Type":"ContainerStarted","Data":"f6426b5e69bc485ce7db3f2f237f6d74e77ec2e35dfa3440f4ca660929773551"}
Jul 16 22:44:16.839815 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:44:16.839486    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-907fee31-6c445479dd-pphmr"
Jul 16 22:44:16.861194 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:44:16.861148    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-907fee31-6c445479dd-pphmr" podStartSLOduration=2.420450344 podStartE2EDuration="2.86113348s" totalImagesPullingTime="440.683136ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:44:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:44:16.859032225 +0000 UTC m=+1831.073813384" watchObservedRunningTime="2026-07-16 22:44:16.86113348 +0000 UTC m=+1831.075914673"
Jul 16 22:44:22.851810 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:44:22.851778    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-907fee31-6c445479dd-pphmr"
Jul 16 22:45:25.216984 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:45:25.216942    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-907fee31-6c445479dd-pphmr"]
Jul 16 22:45:25.217488 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:45:25.217178    2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-907fee31-6c445479dd-pphmr" podUID="bbecac14-d761-4a04-bdc3-b42c6dbcdcb0" containerName="maas-api" containerID="cri-o://f6426b5e69bc485ce7db3f2f237f6d74e77ec2e35dfa3440f4ca660929773551" gracePeriod=30
Jul 16 22:45:25.454256 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:45:25.454232    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-907fee31-6c445479dd-pphmr"
Jul 16 22:45:25.545645 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:45:25.545577    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cx9tk\" (UniqueName: \"kubernetes.io/projected/bbecac14-d761-4a04-bdc3-b42c6dbcdcb0-kube-api-access-cx9tk\") pod \"bbecac14-d761-4a04-bdc3-b42c6dbcdcb0\" (UID: \"bbecac14-d761-4a04-bdc3-b42c6dbcdcb0\") "
Jul 16 22:45:25.545645 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:45:25.545619    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bbecac14-d761-4a04-bdc3-b42c6dbcdcb0-maas-api-tls\") pod \"bbecac14-d761-4a04-bdc3-b42c6dbcdcb0\" (UID: \"bbecac14-d761-4a04-bdc3-b42c6dbcdcb0\") "
Jul 16 22:45:25.545879 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:45:25.545650    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bbecac14-d761-4a04-bdc3-b42c6dbcdcb0-openshift-service-ca\") pod \"bbecac14-d761-4a04-bdc3-b42c6dbcdcb0\" (UID: \"bbecac14-d761-4a04-bdc3-b42c6dbcdcb0\") "
Jul 16 22:45:25.545984 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:45:25.545961    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bbecac14-d761-4a04-bdc3-b42c6dbcdcb0-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "bbecac14-d761-4a04-bdc3-b42c6dbcdcb0" (UID: "bbecac14-d761-4a04-bdc3-b42c6dbcdcb0"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 22:45:25.547709 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:45:25.547679    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bbecac14-d761-4a04-bdc3-b42c6dbcdcb0-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "bbecac14-d761-4a04-bdc3-b42c6dbcdcb0" (UID: "bbecac14-d761-4a04-bdc3-b42c6dbcdcb0"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 22:45:25.547788 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:45:25.547736    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bbecac14-d761-4a04-bdc3-b42c6dbcdcb0-kube-api-access-cx9tk" (OuterVolumeSpecName: "kube-api-access-cx9tk") pod "bbecac14-d761-4a04-bdc3-b42c6dbcdcb0" (UID: "bbecac14-d761-4a04-bdc3-b42c6dbcdcb0"). InnerVolumeSpecName "kube-api-access-cx9tk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:45:25.647131 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:45:25.647105    2552 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bbecac14-d761-4a04-bdc3-b42c6dbcdcb0-maas-api-tls\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 16 22:45:25.647131 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:45:25.647129    2552 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bbecac14-d761-4a04-bdc3-b42c6dbcdcb0-openshift-service-ca\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 16 22:45:25.647267 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:45:25.647138    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cx9tk\" (UniqueName: \"kubernetes.io/projected/bbecac14-d761-4a04-bdc3-b42c6dbcdcb0-kube-api-access-cx9tk\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 16 22:45:26.197898 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:45:26.197868    2552 generic.go:356] "Generic (PLEG): container finished" podID="bbecac14-d761-4a04-bdc3-b42c6dbcdcb0" containerID="f6426b5e69bc485ce7db3f2f237f6d74e77ec2e35dfa3440f4ca660929773551" exitCode=0
Jul 16 22:45:26.198105 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:45:26.197929    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-907fee31-6c445479dd-pphmr"
Jul 16 22:45:26.198105 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:45:26.197956    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-907fee31-6c445479dd-pphmr" event={"ID":"bbecac14-d761-4a04-bdc3-b42c6dbcdcb0","Type":"ContainerDied","Data":"f6426b5e69bc485ce7db3f2f237f6d74e77ec2e35dfa3440f4ca660929773551"}
Jul 16 22:45:26.198105 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:45:26.198035    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-907fee31-6c445479dd-pphmr" event={"ID":"bbecac14-d761-4a04-bdc3-b42c6dbcdcb0","Type":"ContainerDied","Data":"8da27279ec088f44b42f4ec1f6e537bc6331ae7b5a7decbe8980a70f084fba18"}
Jul 16 22:45:26.198105 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:45:26.198059    2552 scope.go:117] "RemoveContainer" containerID="f6426b5e69bc485ce7db3f2f237f6d74e77ec2e35dfa3440f4ca660929773551"
Jul 16 22:45:26.207798 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:45:26.207778    2552 scope.go:117] "RemoveContainer" containerID="f6426b5e69bc485ce7db3f2f237f6d74e77ec2e35dfa3440f4ca660929773551"
Jul 16 22:45:26.208069 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:45:26.208049    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f6426b5e69bc485ce7db3f2f237f6d74e77ec2e35dfa3440f4ca660929773551\": container with ID starting with f6426b5e69bc485ce7db3f2f237f6d74e77ec2e35dfa3440f4ca660929773551 not found: ID does not exist" containerID="f6426b5e69bc485ce7db3f2f237f6d74e77ec2e35dfa3440f4ca660929773551"
Jul 16 22:45:26.208161 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:45:26.208075    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6426b5e69bc485ce7db3f2f237f6d74e77ec2e35dfa3440f4ca660929773551"} err="failed to get container status \"f6426b5e69bc485ce7db3f2f237f6d74e77ec2e35dfa3440f4ca660929773551\": rpc error: code = NotFound desc = could not find container \"f6426b5e69bc485ce7db3f2f237f6d74e77ec2e35dfa3440f4ca660929773551\": container with ID starting with f6426b5e69bc485ce7db3f2f237f6d74e77ec2e35dfa3440f4ca660929773551 not found: ID does not exist"
Jul 16 22:45:26.223595 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:45:26.223567    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-907fee31-6c445479dd-pphmr"]
Jul 16 22:45:26.225588 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:45:26.225568    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-907fee31-6c445479dd-pphmr"]
Jul 16 22:45:26.276206 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:45:26.276185    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bbecac14-d761-4a04-bdc3-b42c6dbcdcb0" path="/var/lib/kubelet/pods/bbecac14-d761-4a04-bdc3-b42c6dbcdcb0/volumes"
Jul 16 22:45:32.836672 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:45:32.836639    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-667ee841-94987898f-75pzd"]
Jul 16 22:45:32.837140 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:45:32.837065    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bbecac14-d761-4a04-bdc3-b42c6dbcdcb0" containerName="maas-api"
Jul 16 22:45:32.837140 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:45:32.837080    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="bbecac14-d761-4a04-bdc3-b42c6dbcdcb0" containerName="maas-api"
Jul 16 22:45:32.837245 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:45:32.837191    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="bbecac14-d761-4a04-bdc3-b42c6dbcdcb0" containerName="maas-api"
Jul 16 22:45:32.841594 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:45:32.841573    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-667ee841-94987898f-75pzd"
Jul 16 22:45:32.844131 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:45:32.844114    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-667ee841-serving-cert\""
Jul 16 22:45:32.855479 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:45:32.855455    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-667ee841-94987898f-75pzd"]
Jul 16 22:45:32.899875 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:45:32.899844    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxpgv\" (UniqueName: \"kubernetes.io/projected/3a54d089-a807-4a4e-bb64-494460a039a6-kube-api-access-sxpgv\") pod \"maas-api-e2e-ait-667ee841-94987898f-75pzd\" (UID: \"3a54d089-a807-4a4e-bb64-494460a039a6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-667ee841-94987898f-75pzd"
Jul 16 22:45:32.900016 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:45:32.899879    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3a54d089-a807-4a4e-bb64-494460a039a6-maas-api-tls\") pod \"maas-api-e2e-ait-667ee841-94987898f-75pzd\" (UID: \"3a54d089-a807-4a4e-bb64-494460a039a6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-667ee841-94987898f-75pzd"
Jul 16 22:45:32.900016 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:45:32.899939    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3a54d089-a807-4a4e-bb64-494460a039a6-openshift-service-ca\") pod \"maas-api-e2e-ait-667ee841-94987898f-75pzd\" (UID: \"3a54d089-a807-4a4e-bb64-494460a039a6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-667ee841-94987898f-75pzd"
Jul 16 22:45:33.000606 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:45:33.000583    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3a54d089-a807-4a4e-bb64-494460a039a6-openshift-service-ca\") pod \"maas-api-e2e-ait-667ee841-94987898f-75pzd\" (UID: \"3a54d089-a807-4a4e-bb64-494460a039a6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-667ee841-94987898f-75pzd"
Jul 16 22:45:33.000758 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:45:33.000635    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxpgv\" (UniqueName: \"kubernetes.io/projected/3a54d089-a807-4a4e-bb64-494460a039a6-kube-api-access-sxpgv\") pod \"maas-api-e2e-ait-667ee841-94987898f-75pzd\" (UID: \"3a54d089-a807-4a4e-bb64-494460a039a6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-667ee841-94987898f-75pzd"
Jul 16 22:45:33.000758 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:45:33.000665    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3a54d089-a807-4a4e-bb64-494460a039a6-maas-api-tls\") pod \"maas-api-e2e-ait-667ee841-94987898f-75pzd\" (UID: \"3a54d089-a807-4a4e-bb64-494460a039a6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-667ee841-94987898f-75pzd"
Jul 16 22:45:33.001195 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:45:33.001176    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3a54d089-a807-4a4e-bb64-494460a039a6-openshift-service-ca\") pod \"maas-api-e2e-ait-667ee841-94987898f-75pzd\" (UID: \"3a54d089-a807-4a4e-bb64-494460a039a6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-667ee841-94987898f-75pzd"
Jul 16 22:45:33.003084 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:45:33.003065    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3a54d089-a807-4a4e-bb64-494460a039a6-maas-api-tls\") pod \"maas-api-e2e-ait-667ee841-94987898f-75pzd\" (UID: \"3a54d089-a807-4a4e-bb64-494460a039a6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-667ee841-94987898f-75pzd"
Jul 16 22:45:33.020191 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:45:33.020170    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxpgv\" (UniqueName: \"kubernetes.io/projected/3a54d089-a807-4a4e-bb64-494460a039a6-kube-api-access-sxpgv\") pod \"maas-api-e2e-ait-667ee841-94987898f-75pzd\" (UID: \"3a54d089-a807-4a4e-bb64-494460a039a6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-667ee841-94987898f-75pzd"
Jul 16 22:45:33.151743 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:45:33.151656    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-667ee841-94987898f-75pzd"
Jul 16 22:45:33.288402 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:45:33.288367    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-667ee841-94987898f-75pzd"]
Jul 16 22:45:33.289210 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:45:33.289186    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a54d089_a807_4a4e_bb64_494460a039a6.slice/crio-7eba45dd0d9157fe4f307100d28e7f722bd1aef32664cb0f75284e3a5de18328 WatchSource:0}: Error finding container 7eba45dd0d9157fe4f307100d28e7f722bd1aef32664cb0f75284e3a5de18328: Status 404 returned error can't find the container with id 7eba45dd0d9157fe4f307100d28e7f722bd1aef32664cb0f75284e3a5de18328
Jul 16 22:45:34.237445 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:45:34.237410    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-667ee841-94987898f-75pzd" event={"ID":"3a54d089-a807-4a4e-bb64-494460a039a6","Type":"ContainerStarted","Data":"18a515917519934adae7be78cb312602e31fc98ba8ff9e37efdd0a718bc2ca03"}
Jul 16 22:45:34.237838 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:45:34.237474    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-667ee841-94987898f-75pzd" event={"ID":"3a54d089-a807-4a4e-bb64-494460a039a6","Type":"ContainerStarted","Data":"7eba45dd0d9157fe4f307100d28e7f722bd1aef32664cb0f75284e3a5de18328"}
Jul 16 22:45:34.237838 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:45:34.237511    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-667ee841-94987898f-75pzd"
Jul 16 22:45:34.256825 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:45:34.256775    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-667ee841-94987898f-75pzd" podStartSLOduration=1.766532298 podStartE2EDuration="2.256760284s" totalImagesPullingTime="490.227986ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:45:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:45:34.254491806 +0000 UTC m=+1908.469272968" watchObservedRunningTime="2026-07-16 22:45:34.256760284 +0000 UTC m=+1908.471541444"
Jul 16 22:45:40.247959 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:45:40.247930    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-667ee841-94987898f-75pzd"
Jul 16 22:45:48.697970 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:45:48.697936    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-667ee841-94987898f-75pzd"]
Jul 16 22:45:48.698798 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:45:48.698739    2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-667ee841-94987898f-75pzd" podUID="3a54d089-a807-4a4e-bb64-494460a039a6" containerName="maas-api" containerID="cri-o://18a515917519934adae7be78cb312602e31fc98ba8ff9e37efdd0a718bc2ca03" gracePeriod=30
Jul 16 22:45:48.947647 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:45:48.947621    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-667ee841-94987898f-75pzd"
Jul 16 22:45:49.016283 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:45:49.016254    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sxpgv\" (UniqueName: \"kubernetes.io/projected/3a54d089-a807-4a4e-bb64-494460a039a6-kube-api-access-sxpgv\") pod \"3a54d089-a807-4a4e-bb64-494460a039a6\" (UID: \"3a54d089-a807-4a4e-bb64-494460a039a6\") "
Jul 16 22:45:49.016433 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:45:49.016292    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3a54d089-a807-4a4e-bb64-494460a039a6-maas-api-tls\") pod \"3a54d089-a807-4a4e-bb64-494460a039a6\" (UID: \"3a54d089-a807-4a4e-bb64-494460a039a6\") "
Jul 16 22:45:49.016433 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:45:49.016350    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3a54d089-a807-4a4e-bb64-494460a039a6-openshift-service-ca\") pod \"3a54d089-a807-4a4e-bb64-494460a039a6\" (UID: \"3a54d089-a807-4a4e-bb64-494460a039a6\") "
Jul 16 22:45:49.016723 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:45:49.016684    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3a54d089-a807-4a4e-bb64-494460a039a6-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3a54d089-a807-4a4e-bb64-494460a039a6" (UID: "3a54d089-a807-4a4e-bb64-494460a039a6"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 22:45:49.018358 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:45:49.018335    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3a54d089-a807-4a4e-bb64-494460a039a6-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3a54d089-a807-4a4e-bb64-494460a039a6" (UID: "3a54d089-a807-4a4e-bb64-494460a039a6"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 22:45:49.018463 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:45:49.018333    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a54d089-a807-4a4e-bb64-494460a039a6-kube-api-access-sxpgv" (OuterVolumeSpecName: "kube-api-access-sxpgv") pod "3a54d089-a807-4a4e-bb64-494460a039a6" (UID: "3a54d089-a807-4a4e-bb64-494460a039a6"). InnerVolumeSpecName "kube-api-access-sxpgv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:45:49.117250 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:45:49.117226    2552 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3a54d089-a807-4a4e-bb64-494460a039a6-openshift-service-ca\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 16 22:45:49.117250 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:45:49.117249    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sxpgv\" (UniqueName: \"kubernetes.io/projected/3a54d089-a807-4a4e-bb64-494460a039a6-kube-api-access-sxpgv\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 16 22:45:49.117380 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:45:49.117260    2552 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3a54d089-a807-4a4e-bb64-494460a039a6-maas-api-tls\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 16 22:45:49.314059 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:45:49.314032    2552 generic.go:356] "Generic (PLEG): container finished" podID="3a54d089-a807-4a4e-bb64-494460a039a6" containerID="18a515917519934adae7be78cb312602e31fc98ba8ff9e37efdd0a718bc2ca03" exitCode=0
Jul 16 22:45:49.314170 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:45:49.314069    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-667ee841-94987898f-75pzd"
Jul 16 22:45:49.314170 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:45:49.314111    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-667ee841-94987898f-75pzd" event={"ID":"3a54d089-a807-4a4e-bb64-494460a039a6","Type":"ContainerDied","Data":"18a515917519934adae7be78cb312602e31fc98ba8ff9e37efdd0a718bc2ca03"}
Jul 16 22:45:49.314170 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:45:49.314157    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-667ee841-94987898f-75pzd" event={"ID":"3a54d089-a807-4a4e-bb64-494460a039a6","Type":"ContainerDied","Data":"7eba45dd0d9157fe4f307100d28e7f722bd1aef32664cb0f75284e3a5de18328"}
Jul 16 22:45:49.314288 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:45:49.314185    2552 scope.go:117] "RemoveContainer" containerID="18a515917519934adae7be78cb312602e31fc98ba8ff9e37efdd0a718bc2ca03"
Jul 16 22:45:49.323664 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:45:49.323645    2552 scope.go:117] "RemoveContainer" containerID="18a515917519934adae7be78cb312602e31fc98ba8ff9e37efdd0a718bc2ca03"
Jul 16 22:45:49.323939 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:45:49.323920    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"18a515917519934adae7be78cb312602e31fc98ba8ff9e37efdd0a718bc2ca03\": container with ID starting with 18a515917519934adae7be78cb312602e31fc98ba8ff9e37efdd0a718bc2ca03 not found: ID does not exist" containerID="18a515917519934adae7be78cb312602e31fc98ba8ff9e37efdd0a718bc2ca03"
Jul 16 22:45:49.323986 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:45:49.323949    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18a515917519934adae7be78cb312602e31fc98ba8ff9e37efdd0a718bc2ca03"} err="failed to get container status \"18a515917519934adae7be78cb312602e31fc98ba8ff9e37efdd0a718bc2ca03\": rpc error: code = NotFound desc = could not find container \"18a515917519934adae7be78cb312602e31fc98ba8ff9e37efdd0a718bc2ca03\": container with ID starting with 18a515917519934adae7be78cb312602e31fc98ba8ff9e37efdd0a718bc2ca03 not found: ID does not exist"
Jul 16 22:45:49.341024 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:45:49.341003    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-667ee841-94987898f-75pzd"]
Jul 16 22:45:49.346813 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:45:49.346790    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-667ee841-94987898f-75pzd"]
Jul 16 22:45:50.276249 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:45:50.276220    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3a54d089-a807-4a4e-bb64-494460a039a6" path="/var/lib/kubelet/pods/3a54d089-a807-4a4e-bb64-494460a039a6/volumes"
Jul 16 22:46:02.357898 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:46:02.357862    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-67d0ce59-7b8596cb5c-ppvv6"]
Jul 16 22:46:02.358311 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:46:02.358207    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a54d089-a807-4a4e-bb64-494460a039a6" containerName="maas-api"
Jul 16 22:46:02.358311 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:46:02.358218    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a54d089-a807-4a4e-bb64-494460a039a6" containerName="maas-api"
Jul 16 22:46:02.358311 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:46:02.358280    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a54d089-a807-4a4e-bb64-494460a039a6" containerName="maas-api"
Jul 16 22:46:02.361577 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:46:02.361559    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-67d0ce59-7b8596cb5c-ppvv6"
Jul 16 22:46:02.368940 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:46:02.368917    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-67d0ce59-serving-cert\""
Jul 16 22:46:02.387071 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:46:02.387044    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-67d0ce59-7b8596cb5c-ppvv6"]
Jul 16 22:46:02.517073 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:46:02.517040    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vmr77\" (UniqueName: \"kubernetes.io/projected/709e1452-2950-48a2-a145-7c9db1d46af7-kube-api-access-vmr77\") pod \"maas-api-e2e-derive-67d0ce59-7b8596cb5c-ppvv6\" (UID: \"709e1452-2950-48a2-a145-7c9db1d46af7\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-67d0ce59-7b8596cb5c-ppvv6"
Jul 16 22:46:02.517243 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:46:02.517085    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/709e1452-2950-48a2-a145-7c9db1d46af7-openshift-service-ca\") pod \"maas-api-e2e-derive-67d0ce59-7b8596cb5c-ppvv6\" (UID: \"709e1452-2950-48a2-a145-7c9db1d46af7\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-67d0ce59-7b8596cb5c-ppvv6"
Jul 16 22:46:02.517243 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:46:02.517149    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/709e1452-2950-48a2-a145-7c9db1d46af7-maas-api-tls\") pod \"maas-api-e2e-derive-67d0ce59-7b8596cb5c-ppvv6\" (UID: \"709e1452-2950-48a2-a145-7c9db1d46af7\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-67d0ce59-7b8596cb5c-ppvv6"
Jul 16 22:46:02.618052 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:46:02.617970    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/709e1452-2950-48a2-a145-7c9db1d46af7-maas-api-tls\") pod \"maas-api-e2e-derive-67d0ce59-7b8596cb5c-ppvv6\" (UID: \"709e1452-2950-48a2-a145-7c9db1d46af7\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-67d0ce59-7b8596cb5c-ppvv6"
Jul 16 22:46:02.618052 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:46:02.618027    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vmr77\" (UniqueName: \"kubernetes.io/projected/709e1452-2950-48a2-a145-7c9db1d46af7-kube-api-access-vmr77\") pod \"maas-api-e2e-derive-67d0ce59-7b8596cb5c-ppvv6\" (UID: \"709e1452-2950-48a2-a145-7c9db1d46af7\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-67d0ce59-7b8596cb5c-ppvv6"
Jul 16 22:46:02.618052 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:46:02.618054    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/709e1452-2950-48a2-a145-7c9db1d46af7-openshift-service-ca\") pod \"maas-api-e2e-derive-67d0ce59-7b8596cb5c-ppvv6\" (UID: \"709e1452-2950-48a2-a145-7c9db1d46af7\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-67d0ce59-7b8596cb5c-ppvv6"
Jul 16 22:46:02.618272 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:46:02.618120    2552 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-67d0ce59-serving-cert: secret "maas-api-e2e-derive-67d0ce59-serving-cert" not found
Jul 16 22:46:02.618272 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:46:02.618192    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/709e1452-2950-48a2-a145-7c9db1d46af7-maas-api-tls podName:709e1452-2950-48a2-a145-7c9db1d46af7 nodeName:}" failed. No retries permitted until 2026-07-16 22:46:03.118177432 +0000 UTC m=+1937.332958570 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/709e1452-2950-48a2-a145-7c9db1d46af7-maas-api-tls") pod "maas-api-e2e-derive-67d0ce59-7b8596cb5c-ppvv6" (UID: "709e1452-2950-48a2-a145-7c9db1d46af7") : secret "maas-api-e2e-derive-67d0ce59-serving-cert" not found
Jul 16 22:46:02.618658 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:46:02.618641    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/709e1452-2950-48a2-a145-7c9db1d46af7-openshift-service-ca\") pod \"maas-api-e2e-derive-67d0ce59-7b8596cb5c-ppvv6\" (UID: \"709e1452-2950-48a2-a145-7c9db1d46af7\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-67d0ce59-7b8596cb5c-ppvv6"
Jul 16 22:46:02.645496 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:46:02.645464    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vmr77\" (UniqueName: \"kubernetes.io/projected/709e1452-2950-48a2-a145-7c9db1d46af7-kube-api-access-vmr77\") pod \"maas-api-e2e-derive-67d0ce59-7b8596cb5c-ppvv6\" (UID: \"709e1452-2950-48a2-a145-7c9db1d46af7\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-67d0ce59-7b8596cb5c-ppvv6"
Jul 16 22:46:03.123216 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:46:03.123178    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/709e1452-2950-48a2-a145-7c9db1d46af7-maas-api-tls\") pod \"maas-api-e2e-derive-67d0ce59-7b8596cb5c-ppvv6\" (UID: \"709e1452-2950-48a2-a145-7c9db1d46af7\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-67d0ce59-7b8596cb5c-ppvv6"
Jul 16 22:46:03.125531 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:46:03.125499    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/709e1452-2950-48a2-a145-7c9db1d46af7-maas-api-tls\") pod \"maas-api-e2e-derive-67d0ce59-7b8596cb5c-ppvv6\" (UID: \"709e1452-2950-48a2-a145-7c9db1d46af7\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-67d0ce59-7b8596cb5c-ppvv6"
Jul 16 22:46:03.271128 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:46:03.271096    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-67d0ce59-7b8596cb5c-ppvv6"
Jul 16 22:46:03.417147 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:46:03.417124    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-67d0ce59-7b8596cb5c-ppvv6"]
Jul 16 22:46:03.418744 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:46:03.418691    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod709e1452_2950_48a2_a145_7c9db1d46af7.slice/crio-0c44d8f2babe75bfcbdec6814cf765bbd6ac33dcacb8038af25c325d3217c745 WatchSource:0}: Error finding container 0c44d8f2babe75bfcbdec6814cf765bbd6ac33dcacb8038af25c325d3217c745: Status 404 returned error can't find the container with id 0c44d8f2babe75bfcbdec6814cf765bbd6ac33dcacb8038af25c325d3217c745
Jul 16 22:46:04.393239 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:46:04.393207    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-67d0ce59-7b8596cb5c-ppvv6" event={"ID":"709e1452-2950-48a2-a145-7c9db1d46af7","Type":"ContainerStarted","Data":"bc1f19ff30ab193a48c6195437d3dcbef0c3850c7829f8b66f6263924e7b3e76"}
Jul 16 22:46:04.393411 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:46:04.393266    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-67d0ce59-7b8596cb5c-ppvv6" event={"ID":"709e1452-2950-48a2-a145-7c9db1d46af7","Type":"ContainerStarted","Data":"0c44d8f2babe75bfcbdec6814cf765bbd6ac33dcacb8038af25c325d3217c745"}
Jul 16 22:46:04.393411 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:46:04.393295    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-67d0ce59-7b8596cb5c-ppvv6"
Jul 16 22:46:10.402965 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:46:10.402930    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-67d0ce59-7b8596cb5c-ppvv6"
Jul 16 22:46:10.425177 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:46:10.425127    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-67d0ce59-7b8596cb5c-ppvv6" podStartSLOduration=8.119474921 podStartE2EDuration="8.425111542s" totalImagesPullingTime="305.636621ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:46:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:46:04.428740854 +0000 UTC m=+1938.643522011" watchObservedRunningTime="2026-07-16 22:46:10.425111542 +0000 UTC m=+1944.639892703"
Jul 16 22:47:17.522910 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:47:17.522875    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-67d0ce59-7b8596cb5c-ppvv6"]
Jul 16 22:47:17.523506 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:47:17.523099    2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-67d0ce59-7b8596cb5c-ppvv6" podUID="709e1452-2950-48a2-a145-7c9db1d46af7" containerName="maas-api" containerID="cri-o://bc1f19ff30ab193a48c6195437d3dcbef0c3850c7829f8b66f6263924e7b3e76" gracePeriod=30
Jul 16 22:47:17.754836 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:47:17.754739    2552 generic.go:356] "Generic (PLEG): container finished" podID="709e1452-2950-48a2-a145-7c9db1d46af7" containerID="bc1f19ff30ab193a48c6195437d3dcbef0c3850c7829f8b66f6263924e7b3e76" exitCode=0
Jul 16 22:47:17.754836 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:47:17.754786    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-67d0ce59-7b8596cb5c-ppvv6" event={"ID":"709e1452-2950-48a2-a145-7c9db1d46af7","Type":"ContainerDied","Data":"bc1f19ff30ab193a48c6195437d3dcbef0c3850c7829f8b66f6263924e7b3e76"}
Jul 16 22:47:17.769293 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:47:17.769274    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-67d0ce59-7b8596cb5c-ppvv6"
Jul 16 22:47:17.895054 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:47:17.894994    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/709e1452-2950-48a2-a145-7c9db1d46af7-maas-api-tls\") pod \"709e1452-2950-48a2-a145-7c9db1d46af7\" (UID: \"709e1452-2950-48a2-a145-7c9db1d46af7\") "
Jul 16 22:47:17.895054 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:47:17.895027    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/709e1452-2950-48a2-a145-7c9db1d46af7-openshift-service-ca\") pod \"709e1452-2950-48a2-a145-7c9db1d46af7\" (UID: \"709e1452-2950-48a2-a145-7c9db1d46af7\") "
Jul 16 22:47:17.895054 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:47:17.895053    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vmr77\" (UniqueName: \"kubernetes.io/projected/709e1452-2950-48a2-a145-7c9db1d46af7-kube-api-access-vmr77\") pod \"709e1452-2950-48a2-a145-7c9db1d46af7\" (UID: \"709e1452-2950-48a2-a145-7c9db1d46af7\") "
Jul 16 22:47:17.895447 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:47:17.895426    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/709e1452-2950-48a2-a145-7c9db1d46af7-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "709e1452-2950-48a2-a145-7c9db1d46af7" (UID: "709e1452-2950-48a2-a145-7c9db1d46af7"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 22:47:17.896996 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:47:17.896971    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/709e1452-2950-48a2-a145-7c9db1d46af7-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "709e1452-2950-48a2-a145-7c9db1d46af7" (UID: "709e1452-2950-48a2-a145-7c9db1d46af7"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 22:47:17.897130 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:47:17.897111    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/709e1452-2950-48a2-a145-7c9db1d46af7-kube-api-access-vmr77" (OuterVolumeSpecName: "kube-api-access-vmr77") pod "709e1452-2950-48a2-a145-7c9db1d46af7" (UID: "709e1452-2950-48a2-a145-7c9db1d46af7"). InnerVolumeSpecName "kube-api-access-vmr77". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:47:17.995637 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:47:17.995613    2552 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/709e1452-2950-48a2-a145-7c9db1d46af7-maas-api-tls\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 16 22:47:17.995637 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:47:17.995634    2552 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/709e1452-2950-48a2-a145-7c9db1d46af7-openshift-service-ca\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 16 22:47:17.995803 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:47:17.995643    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vmr77\" (UniqueName: \"kubernetes.io/projected/709e1452-2950-48a2-a145-7c9db1d46af7-kube-api-access-vmr77\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 16 22:47:18.760377 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:47:18.760343    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-67d0ce59-7b8596cb5c-ppvv6" event={"ID":"709e1452-2950-48a2-a145-7c9db1d46af7","Type":"ContainerDied","Data":"0c44d8f2babe75bfcbdec6814cf765bbd6ac33dcacb8038af25c325d3217c745"}
Jul 16 22:47:18.760377 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:47:18.760370    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-67d0ce59-7b8596cb5c-ppvv6"
Jul 16 22:47:18.760844 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:47:18.760419    2552 scope.go:117] "RemoveContainer" containerID="bc1f19ff30ab193a48c6195437d3dcbef0c3850c7829f8b66f6263924e7b3e76"
Jul 16 22:47:18.777490 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:47:18.777468    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-67d0ce59-7b8596cb5c-ppvv6"]
Jul 16 22:47:18.784140 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:47:18.784115    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-67d0ce59-7b8596cb5c-ppvv6"]
Jul 16 22:47:20.276103 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:47:20.276072    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="709e1452-2950-48a2-a145-7c9db1d46af7" path="/var/lib/kubelet/pods/709e1452-2950-48a2-a145-7c9db1d46af7/volumes"
Jul 16 22:49:09.929124 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:49:09.929092    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-0f02bfcd-7ccc4866c7-jck55"]
Jul 16 22:49:09.929589 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:49:09.929474    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="709e1452-2950-48a2-a145-7c9db1d46af7" containerName="maas-api"
Jul 16 22:49:09.929589 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:49:09.929485    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="709e1452-2950-48a2-a145-7c9db1d46af7" containerName="maas-api"
Jul 16 22:49:09.929589 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:49:09.929548    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="709e1452-2950-48a2-a145-7c9db1d46af7" containerName="maas-api"
Jul 16 22:49:09.932565 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:49:09.932547    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0f02bfcd-7ccc4866c7-jck55"
Jul 16 22:49:09.935086 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:49:09.935063    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-0f02bfcd-serving-cert\""
Jul 16 22:49:09.945408 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:49:09.945388    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-0f02bfcd-7ccc4866c7-jck55"]
Jul 16 22:49:10.068062 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:49:10.068032    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7mz6\" (UniqueName: \"kubernetes.io/projected/717cdb7d-4044-4a71-84c1-e4ed3bebd40c-kube-api-access-g7mz6\") pod \"maas-api-e2e-mt-0f02bfcd-7ccc4866c7-jck55\" (UID: \"717cdb7d-4044-4a71-84c1-e4ed3bebd40c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0f02bfcd-7ccc4866c7-jck55"
Jul 16 22:49:10.068229 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:49:10.068067    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/717cdb7d-4044-4a71-84c1-e4ed3bebd40c-maas-api-tls\") pod \"maas-api-e2e-mt-0f02bfcd-7ccc4866c7-jck55\" (UID: \"717cdb7d-4044-4a71-84c1-e4ed3bebd40c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0f02bfcd-7ccc4866c7-jck55"
Jul 16 22:49:10.068229 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:49:10.068111    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/717cdb7d-4044-4a71-84c1-e4ed3bebd40c-openshift-service-ca\") pod \"maas-api-e2e-mt-0f02bfcd-7ccc4866c7-jck55\" (UID: \"717cdb7d-4044-4a71-84c1-e4ed3bebd40c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0f02bfcd-7ccc4866c7-jck55"
Jul 16 22:49:10.169202 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:49:10.169174    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/717cdb7d-4044-4a71-84c1-e4ed3bebd40c-openshift-service-ca\") pod \"maas-api-e2e-mt-0f02bfcd-7ccc4866c7-jck55\" (UID: \"717cdb7d-4044-4a71-84c1-e4ed3bebd40c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0f02bfcd-7ccc4866c7-jck55"
Jul 16 22:49:10.169338 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:49:10.169235    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7mz6\" (UniqueName: \"kubernetes.io/projected/717cdb7d-4044-4a71-84c1-e4ed3bebd40c-kube-api-access-g7mz6\") pod \"maas-api-e2e-mt-0f02bfcd-7ccc4866c7-jck55\" (UID: \"717cdb7d-4044-4a71-84c1-e4ed3bebd40c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0f02bfcd-7ccc4866c7-jck55"
Jul 16 22:49:10.169338 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:49:10.169266    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/717cdb7d-4044-4a71-84c1-e4ed3bebd40c-maas-api-tls\") pod \"maas-api-e2e-mt-0f02bfcd-7ccc4866c7-jck55\" (UID: \"717cdb7d-4044-4a71-84c1-e4ed3bebd40c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0f02bfcd-7ccc4866c7-jck55"
Jul 16 22:49:10.169456 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:49:10.169378    2552 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-0f02bfcd-serving-cert: secret "maas-api-e2e-mt-0f02bfcd-serving-cert" not found
Jul 16 22:49:10.169456 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:49:10.169444    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/717cdb7d-4044-4a71-84c1-e4ed3bebd40c-maas-api-tls podName:717cdb7d-4044-4a71-84c1-e4ed3bebd40c nodeName:}" failed. No retries permitted until 2026-07-16 22:49:10.669421076 +0000 UTC m=+2124.884202215 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/717cdb7d-4044-4a71-84c1-e4ed3bebd40c-maas-api-tls") pod "maas-api-e2e-mt-0f02bfcd-7ccc4866c7-jck55" (UID: "717cdb7d-4044-4a71-84c1-e4ed3bebd40c") : secret "maas-api-e2e-mt-0f02bfcd-serving-cert" not found
Jul 16 22:49:10.169872 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:49:10.169854    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/717cdb7d-4044-4a71-84c1-e4ed3bebd40c-openshift-service-ca\") pod \"maas-api-e2e-mt-0f02bfcd-7ccc4866c7-jck55\" (UID: \"717cdb7d-4044-4a71-84c1-e4ed3bebd40c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0f02bfcd-7ccc4866c7-jck55"
Jul 16 22:49:10.181904 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:49:10.181842    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7mz6\" (UniqueName: \"kubernetes.io/projected/717cdb7d-4044-4a71-84c1-e4ed3bebd40c-kube-api-access-g7mz6\") pod \"maas-api-e2e-mt-0f02bfcd-7ccc4866c7-jck55\" (UID: \"717cdb7d-4044-4a71-84c1-e4ed3bebd40c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0f02bfcd-7ccc4866c7-jck55"
Jul 16 22:49:10.672985 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:49:10.672951    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/717cdb7d-4044-4a71-84c1-e4ed3bebd40c-maas-api-tls\") pod \"maas-api-e2e-mt-0f02bfcd-7ccc4866c7-jck55\" (UID: \"717cdb7d-4044-4a71-84c1-e4ed3bebd40c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0f02bfcd-7ccc4866c7-jck55"
Jul 16 22:49:10.675429 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:49:10.675405    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/717cdb7d-4044-4a71-84c1-e4ed3bebd40c-maas-api-tls\") pod \"maas-api-e2e-mt-0f02bfcd-7ccc4866c7-jck55\" (UID: \"717cdb7d-4044-4a71-84c1-e4ed3bebd40c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0f02bfcd-7ccc4866c7-jck55"
Jul 16 22:49:10.843099 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:49:10.843063    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0f02bfcd-7ccc4866c7-jck55"
Jul 16 22:49:11.190882 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:49:11.190854    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-0f02bfcd-7ccc4866c7-jck55"]
Jul 16 22:49:11.192720 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:49:11.192665    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod717cdb7d_4044_4a71_84c1_e4ed3bebd40c.slice/crio-3554905fc4f97c47bd93a976c338f2f6028b5931e3e27b2bd2f5135db855290c WatchSource:0}: Error finding container 3554905fc4f97c47bd93a976c338f2f6028b5931e3e27b2bd2f5135db855290c: Status 404 returned error can't find the container with id 3554905fc4f97c47bd93a976c338f2f6028b5931e3e27b2bd2f5135db855290c
Jul 16 22:49:11.194277 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:49:11.194249    2552 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 16 22:49:11.335108 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:49:11.335078    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0f02bfcd-7ccc4866c7-jck55" event={"ID":"717cdb7d-4044-4a71-84c1-e4ed3bebd40c","Type":"ContainerStarted","Data":"3554905fc4f97c47bd93a976c338f2f6028b5931e3e27b2bd2f5135db855290c"}
Jul 16 22:49:12.341222 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:49:12.341190    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0f02bfcd-7ccc4866c7-jck55" event={"ID":"717cdb7d-4044-4a71-84c1-e4ed3bebd40c","Type":"ContainerStarted","Data":"0cf4947368a4bf9ef42c77ea712481a63bd3a86d7ba85472954b4e80b3890eb6"}
Jul 16 22:49:12.341593 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:49:12.341247    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0f02bfcd-7ccc4866c7-jck55"
Jul 16 22:49:12.363599 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:49:12.363555    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0f02bfcd-7ccc4866c7-jck55" podStartSLOduration=2.904524651 podStartE2EDuration="3.363539864s" totalImagesPullingTime="459.015213ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:49:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:49:12.362668475 +0000 UTC m=+2126.577449654" watchObservedRunningTime="2026-07-16 22:49:12.363539864 +0000 UTC m=+2126.578321024"
Jul 16 22:49:18.352622 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:49:18.352594    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0f02bfcd-7ccc4866c7-jck55"
Jul 16 22:49:32.122300 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:49:32.122266    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-0f02bfcd-7ccc4866c7-jck55"]
Jul 16 22:49:32.122845 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:49:32.122511    2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0f02bfcd-7ccc4866c7-jck55" podUID="717cdb7d-4044-4a71-84c1-e4ed3bebd40c" containerName="maas-api" containerID="cri-o://0cf4947368a4bf9ef42c77ea712481a63bd3a86d7ba85472954b4e80b3890eb6" gracePeriod=30
Jul 16 22:49:32.366187 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:49:32.366160    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0f02bfcd-7ccc4866c7-jck55"
Jul 16 22:49:32.452319 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:49:32.452292    2552 generic.go:356] "Generic (PLEG): container finished" podID="717cdb7d-4044-4a71-84c1-e4ed3bebd40c" containerID="0cf4947368a4bf9ef42c77ea712481a63bd3a86d7ba85472954b4e80b3890eb6" exitCode=0
Jul 16 22:49:32.452444 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:49:32.452336    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0f02bfcd-7ccc4866c7-jck55"
Jul 16 22:49:32.452444 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:49:32.452335    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0f02bfcd-7ccc4866c7-jck55" event={"ID":"717cdb7d-4044-4a71-84c1-e4ed3bebd40c","Type":"ContainerDied","Data":"0cf4947368a4bf9ef42c77ea712481a63bd3a86d7ba85472954b4e80b3890eb6"}
Jul 16 22:49:32.452444 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:49:32.452398    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0f02bfcd-7ccc4866c7-jck55" event={"ID":"717cdb7d-4044-4a71-84c1-e4ed3bebd40c","Type":"ContainerDied","Data":"3554905fc4f97c47bd93a976c338f2f6028b5931e3e27b2bd2f5135db855290c"}
Jul 16 22:49:32.452444 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:49:32.452430    2552 scope.go:117] "RemoveContainer" containerID="0cf4947368a4bf9ef42c77ea712481a63bd3a86d7ba85472954b4e80b3890eb6"
Jul 16 22:49:32.460590 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:49:32.460571    2552 scope.go:117] "RemoveContainer" containerID="0cf4947368a4bf9ef42c77ea712481a63bd3a86d7ba85472954b4e80b3890eb6"
Jul 16 22:49:32.460856 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:49:32.460837    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0cf4947368a4bf9ef42c77ea712481a63bd3a86d7ba85472954b4e80b3890eb6\": container with ID starting with 0cf4947368a4bf9ef42c77ea712481a63bd3a86d7ba85472954b4e80b3890eb6 not found: ID does not exist" containerID="0cf4947368a4bf9ef42c77ea712481a63bd3a86d7ba85472954b4e80b3890eb6"
Jul 16 22:49:32.460968 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:49:32.460869    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0cf4947368a4bf9ef42c77ea712481a63bd3a86d7ba85472954b4e80b3890eb6"} err="failed to get container status \"0cf4947368a4bf9ef42c77ea712481a63bd3a86d7ba85472954b4e80b3890eb6\": rpc error: code = NotFound desc = could not find container \"0cf4947368a4bf9ef42c77ea712481a63bd3a86d7ba85472954b4e80b3890eb6\": container with ID starting with 0cf4947368a4bf9ef42c77ea712481a63bd3a86d7ba85472954b4e80b3890eb6 not found: ID does not exist"
Jul 16 22:49:32.537954 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:49:32.537933    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g7mz6\" (UniqueName: \"kubernetes.io/projected/717cdb7d-4044-4a71-84c1-e4ed3bebd40c-kube-api-access-g7mz6\") pod \"717cdb7d-4044-4a71-84c1-e4ed3bebd40c\" (UID: \"717cdb7d-4044-4a71-84c1-e4ed3bebd40c\") "
Jul 16 22:49:32.538039 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:49:32.537960    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/717cdb7d-4044-4a71-84c1-e4ed3bebd40c-maas-api-tls\") pod \"717cdb7d-4044-4a71-84c1-e4ed3bebd40c\" (UID: \"717cdb7d-4044-4a71-84c1-e4ed3bebd40c\") "
Jul 16 22:49:32.538039 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:49:32.538006    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/717cdb7d-4044-4a71-84c1-e4ed3bebd40c-openshift-service-ca\") pod \"717cdb7d-4044-4a71-84c1-e4ed3bebd40c\" (UID: \"717cdb7d-4044-4a71-84c1-e4ed3bebd40c\") "
Jul 16 22:49:32.538378 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:49:32.538358    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/717cdb7d-4044-4a71-84c1-e4ed3bebd40c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "717cdb7d-4044-4a71-84c1-e4ed3bebd40c" (UID: "717cdb7d-4044-4a71-84c1-e4ed3bebd40c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 22:49:32.539876 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:49:32.539854    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/717cdb7d-4044-4a71-84c1-e4ed3bebd40c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "717cdb7d-4044-4a71-84c1-e4ed3bebd40c" (UID: "717cdb7d-4044-4a71-84c1-e4ed3bebd40c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 22:49:32.540079 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:49:32.540060    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/717cdb7d-4044-4a71-84c1-e4ed3bebd40c-kube-api-access-g7mz6" (OuterVolumeSpecName: "kube-api-access-g7mz6") pod "717cdb7d-4044-4a71-84c1-e4ed3bebd40c" (UID: "717cdb7d-4044-4a71-84c1-e4ed3bebd40c"). InnerVolumeSpecName "kube-api-access-g7mz6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:49:32.638954 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:49:32.638931    2552 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/717cdb7d-4044-4a71-84c1-e4ed3bebd40c-maas-api-tls\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 16 22:49:32.639041 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:49:32.638954    2552 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/717cdb7d-4044-4a71-84c1-e4ed3bebd40c-openshift-service-ca\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 16 22:49:32.639041 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:49:32.638968    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g7mz6\" (UniqueName: \"kubernetes.io/projected/717cdb7d-4044-4a71-84c1-e4ed3bebd40c-kube-api-access-g7mz6\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 16 22:49:32.782333 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:49:32.782305    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-0f02bfcd-7ccc4866c7-jck55"]
Jul 16 22:49:32.787125 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:49:32.787103    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-0f02bfcd-7ccc4866c7-jck55"]
Jul 16 22:49:34.283427 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:49:34.283381    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="717cdb7d-4044-4a71-84c1-e4ed3bebd40c" path="/var/lib/kubelet/pods/717cdb7d-4044-4a71-84c1-e4ed3bebd40c/volumes"
Jul 16 22:50:06.077620 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:50:06.077588    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-8a492916-9676f4db8-zfxrh"]
Jul 16 22:50:06.078125 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:50:06.078000    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="717cdb7d-4044-4a71-84c1-e4ed3bebd40c" containerName="maas-api"
Jul 16 22:50:06.078125 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:50:06.078014    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="717cdb7d-4044-4a71-84c1-e4ed3bebd40c" containerName="maas-api"
Jul 16 22:50:06.078125 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:50:06.078083    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="717cdb7d-4044-4a71-84c1-e4ed3bebd40c" containerName="maas-api"
Jul 16 22:50:06.081281 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:50:06.081256    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8a492916-9676f4db8-zfxrh"
Jul 16 22:50:06.088133 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:50:06.088108    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-8a492916-serving-cert\""
Jul 16 22:50:06.094254 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:50:06.094229    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fcf414f1-c934-46e5-8564-59c0bf7b19c9-openshift-service-ca\") pod \"maas-api-e2e-mt-8a492916-9676f4db8-zfxrh\" (UID: \"fcf414f1-c934-46e5-8564-59c0bf7b19c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8a492916-9676f4db8-zfxrh"
Jul 16 22:50:06.094358 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:50:06.094286    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5fgkv\" (UniqueName: \"kubernetes.io/projected/fcf414f1-c934-46e5-8564-59c0bf7b19c9-kube-api-access-5fgkv\") pod \"maas-api-e2e-mt-8a492916-9676f4db8-zfxrh\" (UID: \"fcf414f1-c934-46e5-8564-59c0bf7b19c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8a492916-9676f4db8-zfxrh"
Jul 16 22:50:06.094358 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:50:06.094303    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fcf414f1-c934-46e5-8564-59c0bf7b19c9-maas-api-tls\") pod \"maas-api-e2e-mt-8a492916-9676f4db8-zfxrh\" (UID: \"fcf414f1-c934-46e5-8564-59c0bf7b19c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8a492916-9676f4db8-zfxrh"
Jul 16 22:50:06.105576 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:50:06.105552    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-8a492916-9676f4db8-zfxrh"]
Jul 16 22:50:06.195397 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:50:06.195362    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fcf414f1-c934-46e5-8564-59c0bf7b19c9-openshift-service-ca\") pod \"maas-api-e2e-mt-8a492916-9676f4db8-zfxrh\" (UID: \"fcf414f1-c934-46e5-8564-59c0bf7b19c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8a492916-9676f4db8-zfxrh"
Jul 16 22:50:06.195565 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:50:06.195426    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5fgkv\" (UniqueName: \"kubernetes.io/projected/fcf414f1-c934-46e5-8564-59c0bf7b19c9-kube-api-access-5fgkv\") pod \"maas-api-e2e-mt-8a492916-9676f4db8-zfxrh\" (UID: \"fcf414f1-c934-46e5-8564-59c0bf7b19c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8a492916-9676f4db8-zfxrh"
Jul 16 22:50:06.195565 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:50:06.195444    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fcf414f1-c934-46e5-8564-59c0bf7b19c9-maas-api-tls\") pod \"maas-api-e2e-mt-8a492916-9676f4db8-zfxrh\" (UID: \"fcf414f1-c934-46e5-8564-59c0bf7b19c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8a492916-9676f4db8-zfxrh"
Jul 16 22:50:06.195565 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:50:06.195555    2552 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-8a492916-serving-cert: secret "maas-api-e2e-mt-8a492916-serving-cert" not found
Jul 16 22:50:06.195769 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:50:06.195604    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fcf414f1-c934-46e5-8564-59c0bf7b19c9-maas-api-tls podName:fcf414f1-c934-46e5-8564-59c0bf7b19c9 nodeName:}" failed. No retries permitted until 2026-07-16 22:50:06.695589241 +0000 UTC m=+2180.910370380 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/fcf414f1-c934-46e5-8564-59c0bf7b19c9-maas-api-tls") pod "maas-api-e2e-mt-8a492916-9676f4db8-zfxrh" (UID: "fcf414f1-c934-46e5-8564-59c0bf7b19c9") : secret "maas-api-e2e-mt-8a492916-serving-cert" not found
Jul 16 22:50:06.196102 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:50:06.196075    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fcf414f1-c934-46e5-8564-59c0bf7b19c9-openshift-service-ca\") pod \"maas-api-e2e-mt-8a492916-9676f4db8-zfxrh\" (UID: \"fcf414f1-c934-46e5-8564-59c0bf7b19c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8a492916-9676f4db8-zfxrh"
Jul 16 22:50:06.207494 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:50:06.207465    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5fgkv\" (UniqueName: \"kubernetes.io/projected/fcf414f1-c934-46e5-8564-59c0bf7b19c9-kube-api-access-5fgkv\") pod \"maas-api-e2e-mt-8a492916-9676f4db8-zfxrh\" (UID: \"fcf414f1-c934-46e5-8564-59c0bf7b19c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8a492916-9676f4db8-zfxrh"
Jul 16 22:50:06.699503 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:50:06.699473    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fcf414f1-c934-46e5-8564-59c0bf7b19c9-maas-api-tls\") pod \"maas-api-e2e-mt-8a492916-9676f4db8-zfxrh\" (UID: \"fcf414f1-c934-46e5-8564-59c0bf7b19c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8a492916-9676f4db8-zfxrh"
Jul 16 22:50:06.702133 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:50:06.702107    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fcf414f1-c934-46e5-8564-59c0bf7b19c9-maas-api-tls\") pod \"maas-api-e2e-mt-8a492916-9676f4db8-zfxrh\" (UID: \"fcf414f1-c934-46e5-8564-59c0bf7b19c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8a492916-9676f4db8-zfxrh"
Jul 16 22:50:06.992590 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:50:06.992557    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8a492916-9676f4db8-zfxrh"
Jul 16 22:50:07.142729 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:50:07.142687    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-8a492916-9676f4db8-zfxrh"]
Jul 16 22:50:07.144753 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:50:07.144725    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfcf414f1_c934_46e5_8564_59c0bf7b19c9.slice/crio-205e653903dbfd09ef680a4332a587cad02f34e409e9b9ca9a1e9e576db4b48d WatchSource:0}: Error finding container 205e653903dbfd09ef680a4332a587cad02f34e409e9b9ca9a1e9e576db4b48d: Status 404 returned error can't find the container with id 205e653903dbfd09ef680a4332a587cad02f34e409e9b9ca9a1e9e576db4b48d
Jul 16 22:50:07.639327 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:50:07.639300    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8a492916-9676f4db8-zfxrh" event={"ID":"fcf414f1-c934-46e5-8564-59c0bf7b19c9","Type":"ContainerStarted","Data":"205e653903dbfd09ef680a4332a587cad02f34e409e9b9ca9a1e9e576db4b48d"}
Jul 16 22:50:08.646154 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:50:08.646122    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8a492916-9676f4db8-zfxrh" event={"ID":"fcf414f1-c934-46e5-8564-59c0bf7b19c9","Type":"ContainerStarted","Data":"908db4b880cc0182bf0795c4220769857c3515715c44c59eea5774b8e55c5dbb"}
Jul 16 22:50:08.646526 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:50:08.646217    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8a492916-9676f4db8-zfxrh"
Jul 16 22:50:08.667129 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:50:08.667084    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8a492916-9676f4db8-zfxrh" podStartSLOduration=2.181727446 podStartE2EDuration="2.667068083s" totalImagesPullingTime="485.340637ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:50:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:50:08.664544334 +0000 UTC m=+2182.879325495" watchObservedRunningTime="2026-07-16 22:50:08.667068083 +0000 UTC m=+2182.881849242"
Jul 16 22:50:14.657432 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:50:14.657404    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8a492916-9676f4db8-zfxrh"
Jul 16 22:51:10.315888 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:51:10.315852    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-8a492916-9676f4db8-zfxrh"]
Jul 16 22:51:10.316539 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:51:10.316129    2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8a492916-9676f4db8-zfxrh" podUID="fcf414f1-c934-46e5-8564-59c0bf7b19c9" containerName="maas-api" containerID="cri-o://908db4b880cc0182bf0795c4220769857c3515715c44c59eea5774b8e55c5dbb" gracePeriod=30
Jul 16 22:51:10.562362 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:51:10.562337    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8a492916-9676f4db8-zfxrh"
Jul 16 22:51:10.711859 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:51:10.711833    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5fgkv\" (UniqueName: \"kubernetes.io/projected/fcf414f1-c934-46e5-8564-59c0bf7b19c9-kube-api-access-5fgkv\") pod \"fcf414f1-c934-46e5-8564-59c0bf7b19c9\" (UID: \"fcf414f1-c934-46e5-8564-59c0bf7b19c9\") "
Jul 16 22:51:10.712006 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:51:10.711868    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fcf414f1-c934-46e5-8564-59c0bf7b19c9-openshift-service-ca\") pod \"fcf414f1-c934-46e5-8564-59c0bf7b19c9\" (UID: \"fcf414f1-c934-46e5-8564-59c0bf7b19c9\") "
Jul 16 22:51:10.712006 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:51:10.711936    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fcf414f1-c934-46e5-8564-59c0bf7b19c9-maas-api-tls\") pod \"fcf414f1-c934-46e5-8564-59c0bf7b19c9\" (UID: \"fcf414f1-c934-46e5-8564-59c0bf7b19c9\") "
Jul 16 22:51:10.712317 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:51:10.712284    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fcf414f1-c934-46e5-8564-59c0bf7b19c9-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "fcf414f1-c934-46e5-8564-59c0bf7b19c9" (UID: "fcf414f1-c934-46e5-8564-59c0bf7b19c9"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 22:51:10.713905 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:51:10.713881    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fcf414f1-c934-46e5-8564-59c0bf7b19c9-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "fcf414f1-c934-46e5-8564-59c0bf7b19c9" (UID: "fcf414f1-c934-46e5-8564-59c0bf7b19c9"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 22:51:10.714005 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:51:10.713963    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fcf414f1-c934-46e5-8564-59c0bf7b19c9-kube-api-access-5fgkv" (OuterVolumeSpecName: "kube-api-access-5fgkv") pod "fcf414f1-c934-46e5-8564-59c0bf7b19c9" (UID: "fcf414f1-c934-46e5-8564-59c0bf7b19c9"). InnerVolumeSpecName "kube-api-access-5fgkv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:51:10.812430 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:51:10.812405    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5fgkv\" (UniqueName: \"kubernetes.io/projected/fcf414f1-c934-46e5-8564-59c0bf7b19c9-kube-api-access-5fgkv\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 16 22:51:10.812430 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:51:10.812425    2552 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fcf414f1-c934-46e5-8564-59c0bf7b19c9-openshift-service-ca\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 16 22:51:10.812576 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:51:10.812437    2552 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fcf414f1-c934-46e5-8564-59c0bf7b19c9-maas-api-tls\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 16 22:51:10.982830 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:51:10.982765    2552 generic.go:356] "Generic (PLEG): container finished" podID="fcf414f1-c934-46e5-8564-59c0bf7b19c9" containerID="908db4b880cc0182bf0795c4220769857c3515715c44c59eea5774b8e55c5dbb" exitCode=0
Jul 16 22:51:10.982830 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:51:10.982808    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8a492916-9676f4db8-zfxrh"
Jul 16 22:51:10.983011 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:51:10.982809    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8a492916-9676f4db8-zfxrh" event={"ID":"fcf414f1-c934-46e5-8564-59c0bf7b19c9","Type":"ContainerDied","Data":"908db4b880cc0182bf0795c4220769857c3515715c44c59eea5774b8e55c5dbb"}
Jul 16 22:51:10.983011 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:51:10.982956    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8a492916-9676f4db8-zfxrh" event={"ID":"fcf414f1-c934-46e5-8564-59c0bf7b19c9","Type":"ContainerDied","Data":"205e653903dbfd09ef680a4332a587cad02f34e409e9b9ca9a1e9e576db4b48d"}
Jul 16 22:51:10.983011 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:51:10.982997    2552 scope.go:117] "RemoveContainer" containerID="908db4b880cc0182bf0795c4220769857c3515715c44c59eea5774b8e55c5dbb"
Jul 16 22:51:10.992443 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:51:10.992428    2552 scope.go:117] "RemoveContainer" containerID="908db4b880cc0182bf0795c4220769857c3515715c44c59eea5774b8e55c5dbb"
Jul 16 22:51:10.992680 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:51:10.992661    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"908db4b880cc0182bf0795c4220769857c3515715c44c59eea5774b8e55c5dbb\": container with ID starting with 908db4b880cc0182bf0795c4220769857c3515715c44c59eea5774b8e55c5dbb not found: ID does not exist" containerID="908db4b880cc0182bf0795c4220769857c3515715c44c59eea5774b8e55c5dbb"
Jul 16 22:51:10.992751 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:51:10.992686    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"908db4b880cc0182bf0795c4220769857c3515715c44c59eea5774b8e55c5dbb"} err="failed to get container status \"908db4b880cc0182bf0795c4220769857c3515715c44c59eea5774b8e55c5dbb\": rpc error: code = NotFound desc = could not find container \"908db4b880cc0182bf0795c4220769857c3515715c44c59eea5774b8e55c5dbb\": container with ID starting with 908db4b880cc0182bf0795c4220769857c3515715c44c59eea5774b8e55c5dbb not found: ID does not exist"
Jul 16 22:51:11.006928 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:51:11.006904    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-8a492916-9676f4db8-zfxrh"]
Jul 16 22:51:11.011542 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:51:11.011522    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-8a492916-9676f4db8-zfxrh"]
Jul 16 22:51:12.275886 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:51:12.275852    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fcf414f1-c934-46e5-8564-59c0bf7b19c9" path="/var/lib/kubelet/pods/fcf414f1-c934-46e5-8564-59c0bf7b19c9/volumes"
Jul 16 22:53:04.915096 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:53:04.915064    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-acf29b-7c4645c98f-8xgnx"]
Jul 16 22:53:04.917930 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:53:04.915447    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fcf414f1-c934-46e5-8564-59c0bf7b19c9" containerName="maas-api"
Jul 16 22:53:04.917930 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:53:04.915461    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="fcf414f1-c934-46e5-8564-59c0bf7b19c9" containerName="maas-api"
Jul 16 22:53:04.917930 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:53:04.915522    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="fcf414f1-c934-46e5-8564-59c0bf7b19c9" containerName="maas-api"
Jul 16 22:53:04.918870 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:53:04.918852    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-acf29b-7c4645c98f-8xgnx"
Jul 16 22:53:04.921689 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:53:04.921666    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-acf29b-serving-cert\""
Jul 16 22:53:04.940448 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:53:04.940422    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-acf29b-7c4645c98f-8xgnx"]
Jul 16 22:53:05.011656 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:53:05.011628    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b381bf9a-51df-4348-9a45-d17b477ef3ae-maas-api-tls\") pod \"maas-api-e2e-inf-a-acf29b-7c4645c98f-8xgnx\" (UID: \"b381bf9a-51df-4348-9a45-d17b477ef3ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-acf29b-7c4645c98f-8xgnx"
Jul 16 22:53:05.011810 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:53:05.011661    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxvv6\" (UniqueName: \"kubernetes.io/projected/b381bf9a-51df-4348-9a45-d17b477ef3ae-kube-api-access-bxvv6\") pod \"maas-api-e2e-inf-a-acf29b-7c4645c98f-8xgnx\" (UID: \"b381bf9a-51df-4348-9a45-d17b477ef3ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-acf29b-7c4645c98f-8xgnx"
Jul 16 22:53:05.011810 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:53:05.011691    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b381bf9a-51df-4348-9a45-d17b477ef3ae-openshift-service-ca\") pod \"maas-api-e2e-inf-a-acf29b-7c4645c98f-8xgnx\" (UID: \"b381bf9a-51df-4348-9a45-d17b477ef3ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-acf29b-7c4645c98f-8xgnx"
Jul 16 22:53:05.113007 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:53:05.112965    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b381bf9a-51df-4348-9a45-d17b477ef3ae-maas-api-tls\") pod \"maas-api-e2e-inf-a-acf29b-7c4645c98f-8xgnx\" (UID: \"b381bf9a-51df-4348-9a45-d17b477ef3ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-acf29b-7c4645c98f-8xgnx"
Jul 16 22:53:05.113163 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:53:05.113021    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bxvv6\" (UniqueName: \"kubernetes.io/projected/b381bf9a-51df-4348-9a45-d17b477ef3ae-kube-api-access-bxvv6\") pod \"maas-api-e2e-inf-a-acf29b-7c4645c98f-8xgnx\" (UID: \"b381bf9a-51df-4348-9a45-d17b477ef3ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-acf29b-7c4645c98f-8xgnx"
Jul 16 22:53:05.113163 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:53:05.113063    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b381bf9a-51df-4348-9a45-d17b477ef3ae-openshift-service-ca\") pod \"maas-api-e2e-inf-a-acf29b-7c4645c98f-8xgnx\" (UID: \"b381bf9a-51df-4348-9a45-d17b477ef3ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-acf29b-7c4645c98f-8xgnx"
Jul 16 22:53:05.113734 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:53:05.113691    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b381bf9a-51df-4348-9a45-d17b477ef3ae-openshift-service-ca\") pod \"maas-api-e2e-inf-a-acf29b-7c4645c98f-8xgnx\" (UID: \"b381bf9a-51df-4348-9a45-d17b477ef3ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-acf29b-7c4645c98f-8xgnx"
Jul 16 22:53:05.115253 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:53:05.115233    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b381bf9a-51df-4348-9a45-d17b477ef3ae-maas-api-tls\") pod \"maas-api-e2e-inf-a-acf29b-7c4645c98f-8xgnx\" (UID: \"b381bf9a-51df-4348-9a45-d17b477ef3ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-acf29b-7c4645c98f-8xgnx"
Jul 16 22:53:05.133080 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:53:05.133053    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxvv6\" (UniqueName: \"kubernetes.io/projected/b381bf9a-51df-4348-9a45-d17b477ef3ae-kube-api-access-bxvv6\") pod \"maas-api-e2e-inf-a-acf29b-7c4645c98f-8xgnx\" (UID: \"b381bf9a-51df-4348-9a45-d17b477ef3ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-acf29b-7c4645c98f-8xgnx"
Jul 16 22:53:05.229136 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:53:05.229110    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-acf29b-7c4645c98f-8xgnx"
Jul 16 22:53:05.367318 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:53:05.367289    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-acf29b-7c4645c98f-8xgnx"]
Jul 16 22:53:05.369031 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:53:05.369003    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb381bf9a_51df_4348_9a45_d17b477ef3ae.slice/crio-f07442ff4478a7989a821e5d633bf56a1781ce7994a1ccd10144b31c70d50fb3 WatchSource:0}: Error finding container f07442ff4478a7989a821e5d633bf56a1781ce7994a1ccd10144b31c70d50fb3: Status 404 returned error can't find the container with id f07442ff4478a7989a821e5d633bf56a1781ce7994a1ccd10144b31c70d50fb3
Jul 16 22:53:05.556877 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:53:05.556809    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-acf29b-7c4645c98f-8xgnx" event={"ID":"b381bf9a-51df-4348-9a45-d17b477ef3ae","Type":"ContainerStarted","Data":"f07442ff4478a7989a821e5d633bf56a1781ce7994a1ccd10144b31c70d50fb3"}
Jul 16 22:53:06.563385 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:53:06.563346    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-acf29b-7c4645c98f-8xgnx" event={"ID":"b381bf9a-51df-4348-9a45-d17b477ef3ae","Type":"ContainerStarted","Data":"b3c2b81818ec35948c60fdc9b1c7656610f24e747d7423a45eb46ed013304563"}
Jul 16 22:53:06.563764 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:53:06.563428    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-acf29b-7c4645c98f-8xgnx"
Jul 16 22:53:06.586877 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:53:06.586832    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-acf29b-7c4645c98f-8xgnx" podStartSLOduration=1.9797079499999999 podStartE2EDuration="2.586819283s" totalImagesPullingTime="607.111333ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:53:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:53:06.584161875 +0000 UTC m=+2360.798943032" watchObservedRunningTime="2026-07-16 22:53:06.586819283 +0000 UTC m=+2360.801600443"
Jul 16 22:53:12.573888 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:53:12.573859    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-acf29b-7c4645c98f-8xgnx"
Jul 16 22:53:13.154215 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:53:13.154179    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-db89db-7b67669474-lrn6h"]
Jul 16 22:53:13.158051 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:53:13.158027    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-db89db-7b67669474-lrn6h"
Jul 16 22:53:13.162169 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:53:13.162143    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-db89db-serving-cert\""
Jul 16 22:53:13.170255 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:53:13.170232    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-db89db-7b67669474-lrn6h"]
Jul 16 22:53:13.274679 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:53:13.274650    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5fccf450-7342-49b3-94d7-96ded2d8ef5b-maas-api-tls\") pod \"maas-api-e2e-inf-b-db89db-7b67669474-lrn6h\" (UID: \"5fccf450-7342-49b3-94d7-96ded2d8ef5b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-db89db-7b67669474-lrn6h"
Jul 16 22:53:13.274831 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:53:13.274687    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5fccf450-7342-49b3-94d7-96ded2d8ef5b-openshift-service-ca\") pod \"maas-api-e2e-inf-b-db89db-7b67669474-lrn6h\" (UID: \"5fccf450-7342-49b3-94d7-96ded2d8ef5b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-db89db-7b67669474-lrn6h"
Jul 16 22:53:13.274831 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:53:13.274769    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2kv5\" (UniqueName: \"kubernetes.io/projected/5fccf450-7342-49b3-94d7-96ded2d8ef5b-kube-api-access-g2kv5\") pod \"maas-api-e2e-inf-b-db89db-7b67669474-lrn6h\" (UID: \"5fccf450-7342-49b3-94d7-96ded2d8ef5b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-db89db-7b67669474-lrn6h"
Jul 16 22:53:13.375063 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:53:13.375036    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5fccf450-7342-49b3-94d7-96ded2d8ef5b-maas-api-tls\") pod \"maas-api-e2e-inf-b-db89db-7b67669474-lrn6h\" (UID: \"5fccf450-7342-49b3-94d7-96ded2d8ef5b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-db89db-7b67669474-lrn6h"
Jul 16 22:53:13.375063 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:53:13.375070    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5fccf450-7342-49b3-94d7-96ded2d8ef5b-openshift-service-ca\") pod \"maas-api-e2e-inf-b-db89db-7b67669474-lrn6h\" (UID: \"5fccf450-7342-49b3-94d7-96ded2d8ef5b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-db89db-7b67669474-lrn6h"
Jul 16 22:53:13.375282 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:53:13.375109    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2kv5\" (UniqueName: \"kubernetes.io/projected/5fccf450-7342-49b3-94d7-96ded2d8ef5b-kube-api-access-g2kv5\") pod \"maas-api-e2e-inf-b-db89db-7b67669474-lrn6h\" (UID: \"5fccf450-7342-49b3-94d7-96ded2d8ef5b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-db89db-7b67669474-lrn6h"
Jul 16 22:53:13.375282 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:53:13.375157    2552 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-db89db-serving-cert: secret "maas-api-e2e-inf-b-db89db-serving-cert" not found
Jul 16 22:53:13.375282 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:53:13.375227    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5fccf450-7342-49b3-94d7-96ded2d8ef5b-maas-api-tls podName:5fccf450-7342-49b3-94d7-96ded2d8ef5b nodeName:}" failed. No retries permitted until 2026-07-16 22:53:13.875206307 +0000 UTC m=+2368.089987447 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/5fccf450-7342-49b3-94d7-96ded2d8ef5b-maas-api-tls") pod "maas-api-e2e-inf-b-db89db-7b67669474-lrn6h" (UID: "5fccf450-7342-49b3-94d7-96ded2d8ef5b") : secret "maas-api-e2e-inf-b-db89db-serving-cert" not found
Jul 16 22:53:13.375750 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:53:13.375730    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5fccf450-7342-49b3-94d7-96ded2d8ef5b-openshift-service-ca\") pod \"maas-api-e2e-inf-b-db89db-7b67669474-lrn6h\" (UID: \"5fccf450-7342-49b3-94d7-96ded2d8ef5b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-db89db-7b67669474-lrn6h"
Jul 16 22:53:13.397182 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:53:13.397152    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2kv5\" (UniqueName: \"kubernetes.io/projected/5fccf450-7342-49b3-94d7-96ded2d8ef5b-kube-api-access-g2kv5\") pod \"maas-api-e2e-inf-b-db89db-7b67669474-lrn6h\" (UID: \"5fccf450-7342-49b3-94d7-96ded2d8ef5b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-db89db-7b67669474-lrn6h"
Jul 16 22:53:13.880396 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:53:13.880362    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5fccf450-7342-49b3-94d7-96ded2d8ef5b-maas-api-tls\") pod \"maas-api-e2e-inf-b-db89db-7b67669474-lrn6h\" (UID: \"5fccf450-7342-49b3-94d7-96ded2d8ef5b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-db89db-7b67669474-lrn6h"
Jul 16 22:53:13.882905 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:53:13.882875    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5fccf450-7342-49b3-94d7-96ded2d8ef5b-maas-api-tls\") pod \"maas-api-e2e-inf-b-db89db-7b67669474-lrn6h\" (UID: \"5fccf450-7342-49b3-94d7-96ded2d8ef5b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-db89db-7b67669474-lrn6h"
Jul 16 22:53:14.068301 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:53:14.068266    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-db89db-7b67669474-lrn6h"
Jul 16 22:53:14.215944 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:53:14.215903    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-db89db-7b67669474-lrn6h"]
Jul 16 22:53:14.218855 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:53:14.218825    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fccf450_7342_49b3_94d7_96ded2d8ef5b.slice/crio-9c45ab382bfd905584d2799ed0ba28102ae4e1b4f63dfeea4a00c18579875c70 WatchSource:0}: Error finding container 9c45ab382bfd905584d2799ed0ba28102ae4e1b4f63dfeea4a00c18579875c70: Status 404 returned error can't find the container with id 9c45ab382bfd905584d2799ed0ba28102ae4e1b4f63dfeea4a00c18579875c70
Jul 16 22:53:14.605350 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:53:14.605319    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-db89db-7b67669474-lrn6h" event={"ID":"5fccf450-7342-49b3-94d7-96ded2d8ef5b","Type":"ContainerStarted","Data":"9c45ab382bfd905584d2799ed0ba28102ae4e1b4f63dfeea4a00c18579875c70"}
Jul 16 22:53:15.612646 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:53:15.612607    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-db89db-7b67669474-lrn6h" event={"ID":"5fccf450-7342-49b3-94d7-96ded2d8ef5b","Type":"ContainerStarted","Data":"65789aeccbe9db6ba42e45d270c4b47f461054831721c8175c32452a332424d7"}
Jul 16 22:53:15.613096 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:53:15.612666    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-db89db-7b67669474-lrn6h"
Jul 16 22:53:15.634365 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:53:15.634325    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-db89db-7b67669474-lrn6h" podStartSLOduration=2.281283236 podStartE2EDuration="2.63431127s" totalImagesPullingTime="353.028034ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:53:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:53:15.633297665 +0000 UTC m=+2369.848078824" watchObservedRunningTime="2026-07-16 22:53:15.63431127 +0000 UTC m=+2369.849092431"
Jul 16 22:53:21.624148 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:53:21.624119    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-db89db-7b67669474-lrn6h"
Jul 16 22:53:52.034483 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:53:52.034448    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-db89db/test-model-db89db-kserve-744f5fd479-vvmwf"]
Jul 16 22:53:52.038425 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:53:52.038399    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-db89db/test-model-db89db-kserve-744f5fd479-vvmwf"
Jul 16 22:53:52.042915 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:53:52.042893    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-db89db\"/\"kube-root-ca.crt\""
Jul 16 22:53:52.043056 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:53:52.042888    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-db89db\"/\"openshift-service-ca.crt\""
Jul 16 22:53:52.043227 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:53:52.043212    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-db89db\"/\"default-dockercfg-q2skz\""
Jul 16 22:53:52.043284 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:53:52.043248    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-db89db\"/\"test-model-db89db-kserve-self-signed-certs\""
Jul 16 22:53:52.050542 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:53:52.050519    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-db89db/test-model-db89db-kserve-744f5fd479-vvmwf"]
Jul 16 22:53:52.179603 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:53:52.179561    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e72b9736-28c6-4eb2-9352-f77a815d48b6-tls-certs\") pod \"test-model-db89db-kserve-744f5fd479-vvmwf\" (UID: \"e72b9736-28c6-4eb2-9352-f77a815d48b6\") " pod="ai-tenant-e2e-inf-b-db89db/test-model-db89db-kserve-744f5fd479-vvmwf"
Jul 16 22:53:52.179822 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:53:52.179667    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e72b9736-28c6-4eb2-9352-f77a815d48b6-home\") pod \"test-model-db89db-kserve-744f5fd479-vvmwf\" (UID: \"e72b9736-28c6-4eb2-9352-f77a815d48b6\") " pod="ai-tenant-e2e-inf-b-db89db/test-model-db89db-kserve-744f5fd479-vvmwf"
Jul 16 22:53:52.179822 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:53:52.179742    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55d5m\" (UniqueName: \"kubernetes.io/projected/e72b9736-28c6-4eb2-9352-f77a815d48b6-kube-api-access-55d5m\") pod \"test-model-db89db-kserve-744f5fd479-vvmwf\" (UID: \"e72b9736-28c6-4eb2-9352-f77a815d48b6\") " pod="ai-tenant-e2e-inf-b-db89db/test-model-db89db-kserve-744f5fd479-vvmwf"
Jul 16 22:53:52.179822 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:53:52.179791    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e72b9736-28c6-4eb2-9352-f77a815d48b6-model-cache\") pod \"test-model-db89db-kserve-744f5fd479-vvmwf\" (UID: \"e72b9736-28c6-4eb2-9352-f77a815d48b6\") " pod="ai-tenant-e2e-inf-b-db89db/test-model-db89db-kserve-744f5fd479-vvmwf"
Jul 16 22:53:52.179988 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:53:52.179842    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e72b9736-28c6-4eb2-9352-f77a815d48b6-tmp-dir\") pod \"test-model-db89db-kserve-744f5fd479-vvmwf\" (UID: \"e72b9736-28c6-4eb2-9352-f77a815d48b6\") " pod="ai-tenant-e2e-inf-b-db89db/test-model-db89db-kserve-744f5fd479-vvmwf"
Jul 16 22:53:52.179988 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:53:52.179911    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e72b9736-28c6-4eb2-9352-f77a815d48b6-dshm\") pod \"test-model-db89db-kserve-744f5fd479-vvmwf\" (UID: \"e72b9736-28c6-4eb2-9352-f77a815d48b6\") " pod="ai-tenant-e2e-inf-b-db89db/test-model-db89db-kserve-744f5fd479-vvmwf"
Jul 16 22:53:52.280395 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:53:52.280360    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55d5m\" (UniqueName: \"kubernetes.io/projected/e72b9736-28c6-4eb2-9352-f77a815d48b6-kube-api-access-55d5m\") pod \"test-model-db89db-kserve-744f5fd479-vvmwf\" (UID: \"e72b9736-28c6-4eb2-9352-f77a815d48b6\") " pod="ai-tenant-e2e-inf-b-db89db/test-model-db89db-kserve-744f5fd479-vvmwf"
Jul 16 22:53:52.280657 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:53:52.280629    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e72b9736-28c6-4eb2-9352-f77a815d48b6-model-cache\") pod \"test-model-db89db-kserve-744f5fd479-vvmwf\" (UID: \"e72b9736-28c6-4eb2-9352-f77a815d48b6\") " pod="ai-tenant-e2e-inf-b-db89db/test-model-db89db-kserve-744f5fd479-vvmwf"
Jul 16 22:53:52.280804 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:53:52.280722    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e72b9736-28c6-4eb2-9352-f77a815d48b6-tmp-dir\") pod \"test-model-db89db-kserve-744f5fd479-vvmwf\" (UID: \"e72b9736-28c6-4eb2-9352-f77a815d48b6\") " pod="ai-tenant-e2e-inf-b-db89db/test-model-db89db-kserve-744f5fd479-vvmwf"
Jul 16 22:53:52.280804 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:53:52.280770    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e72b9736-28c6-4eb2-9352-f77a815d48b6-dshm\") pod \"test-model-db89db-kserve-744f5fd479-vvmwf\" (UID: \"e72b9736-28c6-4eb2-9352-f77a815d48b6\") " pod="ai-tenant-e2e-inf-b-db89db/test-model-db89db-kserve-744f5fd479-vvmwf"
Jul 16 22:53:52.280936 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:53:52.280812    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e72b9736-28c6-4eb2-9352-f77a815d48b6-tls-certs\") pod \"test-model-db89db-kserve-744f5fd479-vvmwf\" (UID: \"e72b9736-28c6-4eb2-9352-f77a815d48b6\") " pod="ai-tenant-e2e-inf-b-db89db/test-model-db89db-kserve-744f5fd479-vvmwf"
Jul 16 22:53:52.280936 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:53:52.280863    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e72b9736-28c6-4eb2-9352-f77a815d48b6-home\") pod \"test-model-db89db-kserve-744f5fd479-vvmwf\" (UID: \"e72b9736-28c6-4eb2-9352-f77a815d48b6\") " pod="ai-tenant-e2e-inf-b-db89db/test-model-db89db-kserve-744f5fd479-vvmwf"
Jul 16 22:53:52.281277 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:53:52.281253    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e72b9736-28c6-4eb2-9352-f77a815d48b6-home\") pod \"test-model-db89db-kserve-744f5fd479-vvmwf\" (UID: \"e72b9736-28c6-4eb2-9352-f77a815d48b6\") " pod="ai-tenant-e2e-inf-b-db89db/test-model-db89db-kserve-744f5fd479-vvmwf"
Jul 16 22:53:52.281363 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:53:52.281313    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e72b9736-28c6-4eb2-9352-f77a815d48b6-tmp-dir\") pod \"test-model-db89db-kserve-744f5fd479-vvmwf\" (UID: \"e72b9736-28c6-4eb2-9352-f77a815d48b6\") " pod="ai-tenant-e2e-inf-b-db89db/test-model-db89db-kserve-744f5fd479-vvmwf"
Jul 16 22:53:52.281426 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:53:52.281406    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e72b9736-28c6-4eb2-9352-f77a815d48b6-model-cache\") pod \"test-model-db89db-kserve-744f5fd479-vvmwf\" (UID: \"e72b9736-28c6-4eb2-9352-f77a815d48b6\") " pod="ai-tenant-e2e-inf-b-db89db/test-model-db89db-kserve-744f5fd479-vvmwf"
Jul 16 22:53:52.283488 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:53:52.283461    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e72b9736-28c6-4eb2-9352-f77a815d48b6-dshm\") pod \"test-model-db89db-kserve-744f5fd479-vvmwf\" (UID: \"e72b9736-28c6-4eb2-9352-f77a815d48b6\") " pod="ai-tenant-e2e-inf-b-db89db/test-model-db89db-kserve-744f5fd479-vvmwf"
Jul 16 22:53:52.284191 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:53:52.284168    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e72b9736-28c6-4eb2-9352-f77a815d48b6-tls-certs\") pod \"test-model-db89db-kserve-744f5fd479-vvmwf\" (UID: \"e72b9736-28c6-4eb2-9352-f77a815d48b6\") " pod="ai-tenant-e2e-inf-b-db89db/test-model-db89db-kserve-744f5fd479-vvmwf"
Jul 16 22:53:52.289402 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:53:52.289341    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-55d5m\" (UniqueName: \"kubernetes.io/projected/e72b9736-28c6-4eb2-9352-f77a815d48b6-kube-api-access-55d5m\") pod \"test-model-db89db-kserve-744f5fd479-vvmwf\" (UID: \"e72b9736-28c6-4eb2-9352-f77a815d48b6\") " pod="ai-tenant-e2e-inf-b-db89db/test-model-db89db-kserve-744f5fd479-vvmwf"
Jul 16 22:53:52.347863 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:53:52.347835    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-db89db/test-model-db89db-kserve-744f5fd479-vvmwf"
Jul 16 22:53:52.494837 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:53:52.494811    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-db89db/test-model-db89db-kserve-744f5fd479-vvmwf"]
Jul 16 22:53:52.496556 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:53:52.496521    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode72b9736_28c6_4eb2_9352_f77a815d48b6.slice/crio-679dc487ea299c4a36c05e245cfa7a15495e88b45e2f139db0ee1a734eee51e3 WatchSource:0}: Error finding container 679dc487ea299c4a36c05e245cfa7a15495e88b45e2f139db0ee1a734eee51e3: Status 404 returned error can't find the container with id 679dc487ea299c4a36c05e245cfa7a15495e88b45e2f139db0ee1a734eee51e3
Jul 16 22:53:52.815879 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:53:52.815788    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-db89db/test-model-db89db-kserve-744f5fd479-vvmwf" event={"ID":"e72b9736-28c6-4eb2-9352-f77a815d48b6","Type":"ContainerStarted","Data":"14e92dae753f5b2d56e42fe1e497d2fc3e608db27943e3235e1c11c9c02f00cc"}
Jul 16 22:53:52.815879 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:53:52.815835    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-db89db/test-model-db89db-kserve-744f5fd479-vvmwf" event={"ID":"e72b9736-28c6-4eb2-9352-f77a815d48b6","Type":"ContainerStarted","Data":"679dc487ea299c4a36c05e245cfa7a15495e88b45e2f139db0ee1a734eee51e3"}
Jul 16 22:53:52.834679 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:53:52.834622    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-db89db/test-model-db89db-kserve-744f5fd479-vvmwf" podStartSLOduration=0.834607459 podStartE2EDuration="834.607459ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:53:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:53:52.832770509 +0000 UTC m=+2407.047551669" watchObservedRunningTime="2026-07-16 22:53:52.834607459 +0000 UTC m=+2407.049388621"
Jul 16 22:54:02.348148 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:54:02.348112    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-db89db/test-model-db89db-kserve-744f5fd479-vvmwf"
Jul 16 22:54:02.348522 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:54:02.348165    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-db89db/test-model-db89db-kserve-744f5fd479-vvmwf"
Jul 16 22:54:02.360296 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:54:02.360271    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-db89db/test-model-db89db-kserve-744f5fd479-vvmwf"
Jul 16 22:54:02.882768 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:54:02.882736    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-db89db/test-model-db89db-kserve-744f5fd479-vvmwf"
Jul 16 22:54:12.323040 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:54:12.323008    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-db89db/test-model-db89db-kserve-744f5fd479-vvmwf"]
Jul 16 22:54:22.938408 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:54:22.938375    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-acf29b-7c4645c98f-8xgnx"]
Jul 16 22:54:22.939116 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:54:22.939079    2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-acf29b-7c4645c98f-8xgnx" podUID="b381bf9a-51df-4348-9a45-d17b477ef3ae" containerName="maas-api" containerID="cri-o://b3c2b81818ec35948c60fdc9b1c7656610f24e747d7423a45eb46ed013304563" gracePeriod=30
Jul 16 22:54:23.189633 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:54:23.189570    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-acf29b-7c4645c98f-8xgnx"
Jul 16 22:54:23.242636 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:54:23.242609    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bxvv6\" (UniqueName: \"kubernetes.io/projected/b381bf9a-51df-4348-9a45-d17b477ef3ae-kube-api-access-bxvv6\") pod \"b381bf9a-51df-4348-9a45-d17b477ef3ae\" (UID: \"b381bf9a-51df-4348-9a45-d17b477ef3ae\") "
Jul 16 22:54:23.242811 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:54:23.242651    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b381bf9a-51df-4348-9a45-d17b477ef3ae-maas-api-tls\") pod \"b381bf9a-51df-4348-9a45-d17b477ef3ae\" (UID: \"b381bf9a-51df-4348-9a45-d17b477ef3ae\") "
Jul 16 22:54:23.242811 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:54:23.242750    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b381bf9a-51df-4348-9a45-d17b477ef3ae-openshift-service-ca\") pod \"b381bf9a-51df-4348-9a45-d17b477ef3ae\" (UID: \"b381bf9a-51df-4348-9a45-d17b477ef3ae\") "
Jul 16 22:54:23.243098 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:54:23.243074    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b381bf9a-51df-4348-9a45-d17b477ef3ae-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b381bf9a-51df-4348-9a45-d17b477ef3ae" (UID: "b381bf9a-51df-4348-9a45-d17b477ef3ae"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 22:54:23.244632 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:54:23.244594    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b381bf9a-51df-4348-9a45-d17b477ef3ae-kube-api-access-bxvv6" (OuterVolumeSpecName: "kube-api-access-bxvv6") pod "b381bf9a-51df-4348-9a45-d17b477ef3ae" (UID: "b381bf9a-51df-4348-9a45-d17b477ef3ae"). InnerVolumeSpecName "kube-api-access-bxvv6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:54:23.244753 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:54:23.244661    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b381bf9a-51df-4348-9a45-d17b477ef3ae-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b381bf9a-51df-4348-9a45-d17b477ef3ae" (UID: "b381bf9a-51df-4348-9a45-d17b477ef3ae"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 22:54:23.343755 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:54:23.343684    2552 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b381bf9a-51df-4348-9a45-d17b477ef3ae-openshift-service-ca\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 16 22:54:23.343755 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:54:23.343745    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bxvv6\" (UniqueName: \"kubernetes.io/projected/b381bf9a-51df-4348-9a45-d17b477ef3ae-kube-api-access-bxvv6\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 16 22:54:23.343755 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:54:23.343760    2552 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b381bf9a-51df-4348-9a45-d17b477ef3ae-maas-api-tls\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 16 22:54:23.979105 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:54:23.979064    2552 generic.go:356] "Generic (PLEG): container finished" podID="b381bf9a-51df-4348-9a45-d17b477ef3ae" containerID="b3c2b81818ec35948c60fdc9b1c7656610f24e747d7423a45eb46ed013304563" exitCode=0
Jul 16 22:54:23.979105 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:54:23.979106    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-acf29b-7c4645c98f-8xgnx"
Jul 16 22:54:23.979553 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:54:23.979118    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-acf29b-7c4645c98f-8xgnx" event={"ID":"b381bf9a-51df-4348-9a45-d17b477ef3ae","Type":"ContainerDied","Data":"b3c2b81818ec35948c60fdc9b1c7656610f24e747d7423a45eb46ed013304563"}
Jul 16 22:54:23.979553 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:54:23.979171    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-acf29b-7c4645c98f-8xgnx" event={"ID":"b381bf9a-51df-4348-9a45-d17b477ef3ae","Type":"ContainerDied","Data":"f07442ff4478a7989a821e5d633bf56a1781ce7994a1ccd10144b31c70d50fb3"}
Jul 16 22:54:23.979553 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:54:23.979200    2552 scope.go:117] "RemoveContainer" containerID="b3c2b81818ec35948c60fdc9b1c7656610f24e747d7423a45eb46ed013304563"
Jul 16 22:54:23.989639 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:54:23.989621    2552 scope.go:117] "RemoveContainer" containerID="b3c2b81818ec35948c60fdc9b1c7656610f24e747d7423a45eb46ed013304563"
Jul 16 22:54:23.989929 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:54:23.989910    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b3c2b81818ec35948c60fdc9b1c7656610f24e747d7423a45eb46ed013304563\": container with ID starting with b3c2b81818ec35948c60fdc9b1c7656610f24e747d7423a45eb46ed013304563 not found: ID does not exist" containerID="b3c2b81818ec35948c60fdc9b1c7656610f24e747d7423a45eb46ed013304563"
Jul 16 22:54:23.989986 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:54:23.989937    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3c2b81818ec35948c60fdc9b1c7656610f24e747d7423a45eb46ed013304563"} err="failed to get container status \"b3c2b81818ec35948c60fdc9b1c7656610f24e747d7423a45eb46ed013304563\": rpc error: code = NotFound desc = could not find container \"b3c2b81818ec35948c60fdc9b1c7656610f24e747d7423a45eb46ed013304563\": container with ID starting with b3c2b81818ec35948c60fdc9b1c7656610f24e747d7423a45eb46ed013304563 not found: ID does not exist"
Jul 16 22:54:24.002934 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:54:24.002914    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-acf29b-7c4645c98f-8xgnx"]
Jul 16 22:54:24.007341 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:54:24.007320    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-acf29b-7c4645c98f-8xgnx"]
Jul 16 22:54:24.276108 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:54:24.276030    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b381bf9a-51df-4348-9a45-d17b477ef3ae" path="/var/lib/kubelet/pods/b381bf9a-51df-4348-9a45-d17b477ef3ae/volumes"
Jul 16 22:54:27.343208 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:54:27.343119    2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-db89db/test-model-db89db-kserve-744f5fd479-vvmwf" podUID="e72b9736-28c6-4eb2-9352-f77a815d48b6" containerName="main" containerID="cri-o://14e92dae753f5b2d56e42fe1e497d2fc3e608db27943e3235e1c11c9c02f00cc" gracePeriod=45
Jul 16 22:54:27.597855 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:54:27.597802    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-db89db/test-model-db89db-kserve-744f5fd479-vvmwf"
Jul 16 22:54:27.680316 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:54:27.680281    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e72b9736-28c6-4eb2-9352-f77a815d48b6-tls-certs\") pod \"e72b9736-28c6-4eb2-9352-f77a815d48b6\" (UID: \"e72b9736-28c6-4eb2-9352-f77a815d48b6\") "
Jul 16 22:54:27.680497 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:54:27.680328    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e72b9736-28c6-4eb2-9352-f77a815d48b6-model-cache\") pod \"e72b9736-28c6-4eb2-9352-f77a815d48b6\" (UID: \"e72b9736-28c6-4eb2-9352-f77a815d48b6\") "
Jul 16 22:54:27.680497 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:54:27.680349    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e72b9736-28c6-4eb2-9352-f77a815d48b6-tmp-dir\") pod \"e72b9736-28c6-4eb2-9352-f77a815d48b6\" (UID: \"e72b9736-28c6-4eb2-9352-f77a815d48b6\") "
Jul 16 22:54:27.680497 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:54:27.680369    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e72b9736-28c6-4eb2-9352-f77a815d48b6-dshm\") pod \"e72b9736-28c6-4eb2-9352-f77a815d48b6\" (UID: \"e72b9736-28c6-4eb2-9352-f77a815d48b6\") "
Jul 16 22:54:27.680497 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:54:27.680414    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-55d5m\" (UniqueName: \"kubernetes.io/projected/e72b9736-28c6-4eb2-9352-f77a815d48b6-kube-api-access-55d5m\") pod \"e72b9736-28c6-4eb2-9352-f77a815d48b6\" (UID: \"e72b9736-28c6-4eb2-9352-f77a815d48b6\") "
Jul 16 22:54:27.680497 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:54:27.680445    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e72b9736-28c6-4eb2-9352-f77a815d48b6-home\") pod \"e72b9736-28c6-4eb2-9352-f77a815d48b6\" (UID: \"e72b9736-28c6-4eb2-9352-f77a815d48b6\") "
Jul 16 22:54:27.680776 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:54:27.680580    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e72b9736-28c6-4eb2-9352-f77a815d48b6-model-cache" (OuterVolumeSpecName: "model-cache") pod "e72b9736-28c6-4eb2-9352-f77a815d48b6" (UID: "e72b9736-28c6-4eb2-9352-f77a815d48b6"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:54:27.680776 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:54:27.680664    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e72b9736-28c6-4eb2-9352-f77a815d48b6-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "e72b9736-28c6-4eb2-9352-f77a815d48b6" (UID: "e72b9736-28c6-4eb2-9352-f77a815d48b6"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:54:27.680859 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:54:27.680785    2552 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e72b9736-28c6-4eb2-9352-f77a815d48b6-model-cache\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 16 22:54:27.680909 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:54:27.680899    2552 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e72b9736-28c6-4eb2-9352-f77a815d48b6-tmp-dir\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 16 22:54:27.680954 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:54:27.680896    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e72b9736-28c6-4eb2-9352-f77a815d48b6-home" (OuterVolumeSpecName: "home") pod "e72b9736-28c6-4eb2-9352-f77a815d48b6" (UID: "e72b9736-28c6-4eb2-9352-f77a815d48b6"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:54:27.682923 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:54:27.682897    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e72b9736-28c6-4eb2-9352-f77a815d48b6-dshm" (OuterVolumeSpecName: "dshm") pod "e72b9736-28c6-4eb2-9352-f77a815d48b6" (UID: "e72b9736-28c6-4eb2-9352-f77a815d48b6"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:54:27.683047 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:54:27.682954    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e72b9736-28c6-4eb2-9352-f77a815d48b6-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "e72b9736-28c6-4eb2-9352-f77a815d48b6" (UID: "e72b9736-28c6-4eb2-9352-f77a815d48b6"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 22:54:27.683047 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:54:27.682967    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e72b9736-28c6-4eb2-9352-f77a815d48b6-kube-api-access-55d5m" (OuterVolumeSpecName: "kube-api-access-55d5m") pod "e72b9736-28c6-4eb2-9352-f77a815d48b6" (UID: "e72b9736-28c6-4eb2-9352-f77a815d48b6"). InnerVolumeSpecName "kube-api-access-55d5m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:54:27.781378 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:54:27.781344    2552 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e72b9736-28c6-4eb2-9352-f77a815d48b6-tls-certs\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 16 22:54:27.781378 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:54:27.781366    2552 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e72b9736-28c6-4eb2-9352-f77a815d48b6-dshm\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 16 22:54:27.781378 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:54:27.781376    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-55d5m\" (UniqueName: \"kubernetes.io/projected/e72b9736-28c6-4eb2-9352-f77a815d48b6-kube-api-access-55d5m\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 16 22:54:27.781378 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:54:27.781384    2552 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e72b9736-28c6-4eb2-9352-f77a815d48b6-home\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 16 22:54:28.001479 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:54:28.001447    2552 generic.go:356] "Generic (PLEG): container finished" podID="e72b9736-28c6-4eb2-9352-f77a815d48b6" containerID="14e92dae753f5b2d56e42fe1e497d2fc3e608db27943e3235e1c11c9c02f00cc" exitCode=0
Jul 16 22:54:28.001682 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:54:28.001498    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-db89db/test-model-db89db-kserve-744f5fd479-vvmwf"
Jul 16 22:54:28.001682 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:54:28.001534    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-db89db/test-model-db89db-kserve-744f5fd479-vvmwf" event={"ID":"e72b9736-28c6-4eb2-9352-f77a815d48b6","Type":"ContainerDied","Data":"14e92dae753f5b2d56e42fe1e497d2fc3e608db27943e3235e1c11c9c02f00cc"}
Jul 16 22:54:28.001682 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:54:28.001579    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-db89db/test-model-db89db-kserve-744f5fd479-vvmwf" event={"ID":"e72b9736-28c6-4eb2-9352-f77a815d48b6","Type":"ContainerDied","Data":"679dc487ea299c4a36c05e245cfa7a15495e88b45e2f139db0ee1a734eee51e3"}
Jul 16 22:54:28.001682 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:54:28.001597    2552 scope.go:117] "RemoveContainer" containerID="14e92dae753f5b2d56e42fe1e497d2fc3e608db27943e3235e1c11c9c02f00cc"
Jul 16 22:54:28.011488 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:54:28.011472    2552 scope.go:117] "RemoveContainer" containerID="14e92dae753f5b2d56e42fe1e497d2fc3e608db27943e3235e1c11c9c02f00cc"
Jul 16 22:54:28.011743 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:54:28.011723    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"14e92dae753f5b2d56e42fe1e497d2fc3e608db27943e3235e1c11c9c02f00cc\": container with ID starting with 14e92dae753f5b2d56e42fe1e497d2fc3e608db27943e3235e1c11c9c02f00cc not found: ID does not exist" containerID="14e92dae753f5b2d56e42fe1e497d2fc3e608db27943e3235e1c11c9c02f00cc"
Jul 16 22:54:28.011814 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:54:28.011750    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14e92dae753f5b2d56e42fe1e497d2fc3e608db27943e3235e1c11c9c02f00cc"} err="failed to get container status \"14e92dae753f5b2d56e42fe1e497d2fc3e608db27943e3235e1c11c9c02f00cc\": rpc error: code = NotFound desc = could not find container \"14e92dae753f5b2d56e42fe1e497d2fc3e608db27943e3235e1c11c9c02f00cc\": container with ID starting with 14e92dae753f5b2d56e42fe1e497d2fc3e608db27943e3235e1c11c9c02f00cc not found: ID does not exist"
Jul 16 22:54:28.024362 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:54:28.024338    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-db89db/test-model-db89db-kserve-744f5fd479-vvmwf"]
Jul 16 22:54:28.028891 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:54:28.028868    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-db89db/test-model-db89db-kserve-744f5fd479-vvmwf"]
Jul 16 22:54:28.276472 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:54:28.276397    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e72b9736-28c6-4eb2-9352-f77a815d48b6" path="/var/lib/kubelet/pods/e72b9736-28c6-4eb2-9352-f77a815d48b6/volumes"
Jul 16 22:54:45.109977 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:54:45.106788    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-db89db-7b67669474-lrn6h"]
Jul 16 22:54:45.109977 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:54:45.107101    2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-db89db-7b67669474-lrn6h" podUID="5fccf450-7342-49b3-94d7-96ded2d8ef5b" containerName="maas-api" containerID="cri-o://65789aeccbe9db6ba42e45d270c4b47f461054831721c8175c32452a332424d7" gracePeriod=30
Jul 16 22:54:45.350951 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:54:45.350928    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-db89db-7b67669474-lrn6h"
Jul 16 22:54:45.422226 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:54:45.422166    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g2kv5\" (UniqueName: \"kubernetes.io/projected/5fccf450-7342-49b3-94d7-96ded2d8ef5b-kube-api-access-g2kv5\") pod \"5fccf450-7342-49b3-94d7-96ded2d8ef5b\" (UID: \"5fccf450-7342-49b3-94d7-96ded2d8ef5b\") "
Jul 16 22:54:45.422226 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:54:45.422223    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5fccf450-7342-49b3-94d7-96ded2d8ef5b-openshift-service-ca\") pod \"5fccf450-7342-49b3-94d7-96ded2d8ef5b\" (UID: \"5fccf450-7342-49b3-94d7-96ded2d8ef5b\") "
Jul 16 22:54:45.422372 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:54:45.422244    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5fccf450-7342-49b3-94d7-96ded2d8ef5b-maas-api-tls\") pod \"5fccf450-7342-49b3-94d7-96ded2d8ef5b\" (UID: \"5fccf450-7342-49b3-94d7-96ded2d8ef5b\") "
Jul 16 22:54:45.422598 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:54:45.422567    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5fccf450-7342-49b3-94d7-96ded2d8ef5b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5fccf450-7342-49b3-94d7-96ded2d8ef5b" (UID: "5fccf450-7342-49b3-94d7-96ded2d8ef5b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 22:54:45.424195 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:54:45.424174    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5fccf450-7342-49b3-94d7-96ded2d8ef5b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5fccf450-7342-49b3-94d7-96ded2d8ef5b" (UID: "5fccf450-7342-49b3-94d7-96ded2d8ef5b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 22:54:45.424273 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:54:45.424255    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5fccf450-7342-49b3-94d7-96ded2d8ef5b-kube-api-access-g2kv5" (OuterVolumeSpecName: "kube-api-access-g2kv5") pod "5fccf450-7342-49b3-94d7-96ded2d8ef5b" (UID: "5fccf450-7342-49b3-94d7-96ded2d8ef5b"). InnerVolumeSpecName "kube-api-access-g2kv5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:54:45.522931 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:54:45.522899    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g2kv5\" (UniqueName: \"kubernetes.io/projected/5fccf450-7342-49b3-94d7-96ded2d8ef5b-kube-api-access-g2kv5\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 16 22:54:45.522931 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:54:45.522930    2552 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5fccf450-7342-49b3-94d7-96ded2d8ef5b-openshift-service-ca\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 16 22:54:45.522931 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:54:45.522939    2552 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5fccf450-7342-49b3-94d7-96ded2d8ef5b-maas-api-tls\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 16 22:54:46.095164 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:54:46.095129    2552 generic.go:356] "Generic (PLEG): container finished" podID="5fccf450-7342-49b3-94d7-96ded2d8ef5b" containerID="65789aeccbe9db6ba42e45d270c4b47f461054831721c8175c32452a332424d7" exitCode=0
Jul 16 22:54:46.095322 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:54:46.095177    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-db89db-7b67669474-lrn6h"
Jul 16 22:54:46.095322 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:54:46.095219    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-db89db-7b67669474-lrn6h" event={"ID":"5fccf450-7342-49b3-94d7-96ded2d8ef5b","Type":"ContainerDied","Data":"65789aeccbe9db6ba42e45d270c4b47f461054831721c8175c32452a332424d7"}
Jul 16 22:54:46.095322 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:54:46.095279    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-db89db-7b67669474-lrn6h" event={"ID":"5fccf450-7342-49b3-94d7-96ded2d8ef5b","Type":"ContainerDied","Data":"9c45ab382bfd905584d2799ed0ba28102ae4e1b4f63dfeea4a00c18579875c70"}
Jul 16 22:54:46.095322 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:54:46.095308    2552 scope.go:117] "RemoveContainer" containerID="65789aeccbe9db6ba42e45d270c4b47f461054831721c8175c32452a332424d7"
Jul 16 22:54:46.104885 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:54:46.104866    2552 scope.go:117] "RemoveContainer" containerID="65789aeccbe9db6ba42e45d270c4b47f461054831721c8175c32452a332424d7"
Jul 16 22:54:46.105130 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:54:46.105112    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"65789aeccbe9db6ba42e45d270c4b47f461054831721c8175c32452a332424d7\": container with ID starting with 65789aeccbe9db6ba42e45d270c4b47f461054831721c8175c32452a332424d7 not found: ID does not exist" containerID="65789aeccbe9db6ba42e45d270c4b47f461054831721c8175c32452a332424d7"
Jul 16 22:54:46.105189 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:54:46.105139    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65789aeccbe9db6ba42e45d270c4b47f461054831721c8175c32452a332424d7"} err="failed to get container status \"65789aeccbe9db6ba42e45d270c4b47f461054831721c8175c32452a332424d7\": rpc error: code = NotFound desc = could not find container \"65789aeccbe9db6ba42e45d270c4b47f461054831721c8175c32452a332424d7\": container with ID starting with 65789aeccbe9db6ba42e45d270c4b47f461054831721c8175c32452a332424d7 not found: ID does not exist"
Jul 16 22:54:46.119796 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:54:46.119774    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-db89db-7b67669474-lrn6h"]
Jul 16 22:54:46.122792 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:54:46.122771    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-db89db-7b67669474-lrn6h"]
Jul 16 22:54:46.276420 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:54:46.276398    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5fccf450-7342-49b3-94d7-96ded2d8ef5b" path="/var/lib/kubelet/pods/5fccf450-7342-49b3-94d7-96ded2d8ef5b/volumes"
Jul 16 22:55:00.627965 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:55:00.627934    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-ddb113-7f988cc674-w728v"]
Jul 16 22:55:00.628472 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:55:00.628287    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5fccf450-7342-49b3-94d7-96ded2d8ef5b" containerName="maas-api"
Jul 16 22:55:00.628472 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:55:00.628299    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="5fccf450-7342-49b3-94d7-96ded2d8ef5b" containerName="maas-api"
Jul 16 22:55:00.628472 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:55:00.628308    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b381bf9a-51df-4348-9a45-d17b477ef3ae" containerName="maas-api"
Jul 16 22:55:00.628472 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:55:00.628315    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="b381bf9a-51df-4348-9a45-d17b477ef3ae" containerName="maas-api"
Jul 16 22:55:00.628472 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:55:00.628337    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e72b9736-28c6-4eb2-9352-f77a815d48b6" containerName="main"
Jul 16 22:55:00.628472 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:55:00.628343    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="e72b9736-28c6-4eb2-9352-f77a815d48b6" containerName="main"
Jul 16 22:55:00.628472 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:55:00.628395    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="5fccf450-7342-49b3-94d7-96ded2d8ef5b" containerName="maas-api"
Jul 16 22:55:00.628472 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:55:00.628405    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="b381bf9a-51df-4348-9a45-d17b477ef3ae" containerName="maas-api"
Jul 16 22:55:00.628472 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:55:00.628412    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="e72b9736-28c6-4eb2-9352-f77a815d48b6" containerName="main"
Jul 16 22:55:00.631446 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:55:00.631429    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ddb113-7f988cc674-w728v"
Jul 16 22:55:00.634736 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:55:00.634718    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-ddb113-serving-cert\""
Jul 16 22:55:00.646640 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:55:00.646614    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-ddb113-7f988cc674-w728v"]
Jul 16 22:55:00.740582 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:55:00.740545    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e70b2b9c-d3ae-4458-94f9-36c5a4ccb619-maas-api-tls\") pod \"maas-api-e2e-api-a-ddb113-7f988cc674-w728v\" (UID: \"e70b2b9c-d3ae-4458-94f9-36c5a4ccb619\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ddb113-7f988cc674-w728v"
Jul 16 22:55:00.740785 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:55:00.740613    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e70b2b9c-d3ae-4458-94f9-36c5a4ccb619-openshift-service-ca\") pod \"maas-api-e2e-api-a-ddb113-7f988cc674-w728v\" (UID: \"e70b2b9c-d3ae-4458-94f9-36c5a4ccb619\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ddb113-7f988cc674-w728v"
Jul 16 22:55:00.740785 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:55:00.740671    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m7lkm\" (UniqueName: \"kubernetes.io/projected/e70b2b9c-d3ae-4458-94f9-36c5a4ccb619-kube-api-access-m7lkm\") pod \"maas-api-e2e-api-a-ddb113-7f988cc674-w728v\" (UID: \"e70b2b9c-d3ae-4458-94f9-36c5a4ccb619\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ddb113-7f988cc674-w728v"
Jul 16 22:55:00.841449 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:55:00.841419    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e70b2b9c-d3ae-4458-94f9-36c5a4ccb619-maas-api-tls\") pod \"maas-api-e2e-api-a-ddb113-7f988cc674-w728v\" (UID: \"e70b2b9c-d3ae-4458-94f9-36c5a4ccb619\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ddb113-7f988cc674-w728v"
Jul 16 22:55:00.841605 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:55:00.841467    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e70b2b9c-d3ae-4458-94f9-36c5a4ccb619-openshift-service-ca\") pod \"maas-api-e2e-api-a-ddb113-7f988cc674-w728v\" (UID: \"e70b2b9c-d3ae-4458-94f9-36c5a4ccb619\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ddb113-7f988cc674-w728v"
Jul 16 22:55:00.841648 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:55:00.841594    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7lkm\" (UniqueName: \"kubernetes.io/projected/e70b2b9c-d3ae-4458-94f9-36c5a4ccb619-kube-api-access-m7lkm\") pod \"maas-api-e2e-api-a-ddb113-7f988cc674-w728v\" (UID: \"e70b2b9c-d3ae-4458-94f9-36c5a4ccb619\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ddb113-7f988cc674-w728v"
Jul 16 22:55:00.842182 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:55:00.842157    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e70b2b9c-d3ae-4458-94f9-36c5a4ccb619-openshift-service-ca\") pod \"maas-api-e2e-api-a-ddb113-7f988cc674-w728v\" (UID: \"e70b2b9c-d3ae-4458-94f9-36c5a4ccb619\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ddb113-7f988cc674-w728v"
Jul 16 22:55:00.843899 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:55:00.843874    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e70b2b9c-d3ae-4458-94f9-36c5a4ccb619-maas-api-tls\") pod \"maas-api-e2e-api-a-ddb113-7f988cc674-w728v\" (UID: \"e70b2b9c-d3ae-4458-94f9-36c5a4ccb619\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ddb113-7f988cc674-w728v"
Jul 16 22:55:00.855395 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:55:00.855369    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7lkm\" (UniqueName: \"kubernetes.io/projected/e70b2b9c-d3ae-4458-94f9-36c5a4ccb619-kube-api-access-m7lkm\") pod \"maas-api-e2e-api-a-ddb113-7f988cc674-w728v\" (UID: \"e70b2b9c-d3ae-4458-94f9-36c5a4ccb619\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ddb113-7f988cc674-w728v"
Jul 16 22:55:00.942159 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:55:00.942072    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ddb113-7f988cc674-w728v"
Jul 16 22:55:01.074749 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:55:01.074724    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-ddb113-7f988cc674-w728v"]
Jul 16 22:55:01.076230 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:55:01.076193    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode70b2b9c_d3ae_4458_94f9_36c5a4ccb619.slice/crio-cea0fec707506ac7a28f0192d0a874ac6ae049158dccba5cf1159205b2aea16d WatchSource:0}: Error finding container cea0fec707506ac7a28f0192d0a874ac6ae049158dccba5cf1159205b2aea16d: Status 404 returned error can't find the container with id cea0fec707506ac7a28f0192d0a874ac6ae049158dccba5cf1159205b2aea16d
Jul 16 22:55:01.077898 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:55:01.077877    2552 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 16 22:55:01.172321 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:55:01.172285    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ddb113-7f988cc674-w728v" event={"ID":"e70b2b9c-d3ae-4458-94f9-36c5a4ccb619","Type":"ContainerStarted","Data":"cea0fec707506ac7a28f0192d0a874ac6ae049158dccba5cf1159205b2aea16d"}
Jul 16 22:55:02.179245 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:55:02.179199    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ddb113-7f988cc674-w728v" event={"ID":"e70b2b9c-d3ae-4458-94f9-36c5a4ccb619","Type":"ContainerStarted","Data":"a303d6683e43df52c431c1109c7af2fbac1b51abe7da1f4e63e57a0d3b735e99"}
Jul 16 22:55:02.180032 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:55:02.180001    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ddb113-7f988cc674-w728v"
Jul 16 22:55:02.199063 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:55:02.199017    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ddb113-7f988cc674-w728v" podStartSLOduration=1.669714581 podStartE2EDuration="2.199001744s" totalImagesPullingTime="529.287163ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:55:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:55:02.197807822 +0000 UTC m=+2476.412588976" watchObservedRunningTime="2026-07-16 22:55:02.199001744 +0000 UTC m=+2476.413782904"
Jul 16 22:55:08.707374 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:55:08.707321    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-ef186c-58659775b9-5j5qg"]
Jul 16 22:55:08.711951 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:55:08.711916    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ef186c-58659775b9-5j5qg"
Jul 16 22:55:08.719541 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:55:08.719275    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-ef186c-serving-cert\""
Jul 16 22:55:08.723261 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:55:08.723236    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-ef186c-58659775b9-5j5qg"]
Jul 16 22:55:08.808309 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:55:08.808278    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/545d5629-7cba-4c75-9d4e-eebb57200fec-maas-api-tls\") pod \"maas-api-e2e-api-b-ef186c-58659775b9-5j5qg\" (UID: \"545d5629-7cba-4c75-9d4e-eebb57200fec\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ef186c-58659775b9-5j5qg"
Jul 16 22:55:08.808463 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:55:08.808324    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwwmv\" (UniqueName: \"kubernetes.io/projected/545d5629-7cba-4c75-9d4e-eebb57200fec-kube-api-access-xwwmv\") pod \"maas-api-e2e-api-b-ef186c-58659775b9-5j5qg\" (UID: \"545d5629-7cba-4c75-9d4e-eebb57200fec\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ef186c-58659775b9-5j5qg"
Jul 16 22:55:08.808463 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:55:08.808412    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/545d5629-7cba-4c75-9d4e-eebb57200fec-openshift-service-ca\") pod \"maas-api-e2e-api-b-ef186c-58659775b9-5j5qg\" (UID: \"545d5629-7cba-4c75-9d4e-eebb57200fec\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ef186c-58659775b9-5j5qg"
Jul 16 22:55:08.909765 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:55:08.909735    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/545d5629-7cba-4c75-9d4e-eebb57200fec-openshift-service-ca\") pod \"maas-api-e2e-api-b-ef186c-58659775b9-5j5qg\" (UID: \"545d5629-7cba-4c75-9d4e-eebb57200fec\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ef186c-58659775b9-5j5qg"
Jul 16 22:55:08.909926 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:55:08.909792    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/545d5629-7cba-4c75-9d4e-eebb57200fec-maas-api-tls\") pod \"maas-api-e2e-api-b-ef186c-58659775b9-5j5qg\" (UID: \"545d5629-7cba-4c75-9d4e-eebb57200fec\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ef186c-58659775b9-5j5qg"
Jul 16 22:55:08.909926 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:55:08.909833    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwwmv\" (UniqueName: \"kubernetes.io/projected/545d5629-7cba-4c75-9d4e-eebb57200fec-kube-api-access-xwwmv\") pod \"maas-api-e2e-api-b-ef186c-58659775b9-5j5qg\" (UID: \"545d5629-7cba-4c75-9d4e-eebb57200fec\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ef186c-58659775b9-5j5qg"
Jul 16 22:55:08.910018 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:55:08.909943    2552 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-ef186c-serving-cert: secret "maas-api-e2e-api-b-ef186c-serving-cert" not found
Jul 16 22:55:08.910063 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:55:08.910017    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/545d5629-7cba-4c75-9d4e-eebb57200fec-maas-api-tls podName:545d5629-7cba-4c75-9d4e-eebb57200fec nodeName:}" failed. No retries permitted until 2026-07-16 22:55:09.40999812 +0000 UTC m=+2483.624779261 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/545d5629-7cba-4c75-9d4e-eebb57200fec-maas-api-tls") pod "maas-api-e2e-api-b-ef186c-58659775b9-5j5qg" (UID: "545d5629-7cba-4c75-9d4e-eebb57200fec") : secret "maas-api-e2e-api-b-ef186c-serving-cert" not found
Jul 16 22:55:08.910439 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:55:08.910417    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/545d5629-7cba-4c75-9d4e-eebb57200fec-openshift-service-ca\") pod \"maas-api-e2e-api-b-ef186c-58659775b9-5j5qg\" (UID: \"545d5629-7cba-4c75-9d4e-eebb57200fec\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ef186c-58659775b9-5j5qg"
Jul 16 22:55:08.919268 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:55:08.919243    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwwmv\" (UniqueName: \"kubernetes.io/projected/545d5629-7cba-4c75-9d4e-eebb57200fec-kube-api-access-xwwmv\") pod \"maas-api-e2e-api-b-ef186c-58659775b9-5j5qg\" (UID: \"545d5629-7cba-4c75-9d4e-eebb57200fec\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ef186c-58659775b9-5j5qg"
Jul 16 22:55:09.199489 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:55:09.199406    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ddb113-7f988cc674-w728v"
Jul 16 22:55:09.414959 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:55:09.414925    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/545d5629-7cba-4c75-9d4e-eebb57200fec-maas-api-tls\") pod \"maas-api-e2e-api-b-ef186c-58659775b9-5j5qg\" (UID: \"545d5629-7cba-4c75-9d4e-eebb57200fec\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ef186c-58659775b9-5j5qg"
Jul 16 22:55:09.417362 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:55:09.417338    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/545d5629-7cba-4c75-9d4e-eebb57200fec-maas-api-tls\") pod \"maas-api-e2e-api-b-ef186c-58659775b9-5j5qg\" (UID: \"545d5629-7cba-4c75-9d4e-eebb57200fec\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ef186c-58659775b9-5j5qg"
Jul 16 22:55:09.630551 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:55:09.630509    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ef186c-58659775b9-5j5qg"
Jul 16 22:55:09.770204 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:55:09.770180    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-ef186c-58659775b9-5j5qg"]
Jul 16 22:55:09.771795 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:55:09.771766    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod545d5629_7cba_4c75_9d4e_eebb57200fec.slice/crio-cac60a25f96fbc2c6c0b70902d005b2206ba256fd348502099495afa13369343 WatchSource:0}: Error finding container cac60a25f96fbc2c6c0b70902d005b2206ba256fd348502099495afa13369343: Status 404 returned error can't find the container with id cac60a25f96fbc2c6c0b70902d005b2206ba256fd348502099495afa13369343
Jul 16 22:55:10.225870 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:55:10.225839    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ef186c-58659775b9-5j5qg" event={"ID":"545d5629-7cba-4c75-9d4e-eebb57200fec","Type":"ContainerStarted","Data":"18ec94bf9a5c4e1c70e1448ef3d67bf7e8021894914e10e2be1378f673abc8db"}
Jul 16 22:55:10.225999 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:55:10.225890    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ef186c-58659775b9-5j5qg" event={"ID":"545d5629-7cba-4c75-9d4e-eebb57200fec","Type":"ContainerStarted","Data":"cac60a25f96fbc2c6c0b70902d005b2206ba256fd348502099495afa13369343"}
Jul 16 22:55:10.225999 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:55:10.225975    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ef186c-58659775b9-5j5qg"
Jul 16 22:55:10.256344 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:55:10.256294    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ef186c-58659775b9-5j5qg" podStartSLOduration=1.905177179 podStartE2EDuration="2.256279656s" totalImagesPullingTime="351.102477ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:55:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:55:10.254755431 +0000 UTC m=+2484.469536592" watchObservedRunningTime="2026-07-16 22:55:10.256279656 +0000 UTC m=+2484.471060816"
Jul 16 22:55:16.236031 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:55:16.235998    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ef186c-58659775b9-5j5qg"
Jul 16 22:55:37.272546 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:55:37.272511    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-ddb113-7f988cc674-w728v"]
Jul 16 22:55:37.273157 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:55:37.272764    2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ddb113-7f988cc674-w728v" podUID="e70b2b9c-d3ae-4458-94f9-36c5a4ccb619" containerName="maas-api" containerID="cri-o://a303d6683e43df52c431c1109c7af2fbac1b51abe7da1f4e63e57a0d3b735e99" gracePeriod=30
Jul 16 22:55:37.520447 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:55:37.520424    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ddb113-7f988cc674-w728v"
Jul 16 22:55:37.617285 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:55:37.617228    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e70b2b9c-d3ae-4458-94f9-36c5a4ccb619-maas-api-tls\") pod \"e70b2b9c-d3ae-4458-94f9-36c5a4ccb619\" (UID: \"e70b2b9c-d3ae-4458-94f9-36c5a4ccb619\") "
Jul 16 22:55:37.617403 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:55:37.617283    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m7lkm\" (UniqueName: \"kubernetes.io/projected/e70b2b9c-d3ae-4458-94f9-36c5a4ccb619-kube-api-access-m7lkm\") pod \"e70b2b9c-d3ae-4458-94f9-36c5a4ccb619\" (UID: \"e70b2b9c-d3ae-4458-94f9-36c5a4ccb619\") "
Jul 16 22:55:37.617403 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:55:37.617388    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e70b2b9c-d3ae-4458-94f9-36c5a4ccb619-openshift-service-ca\") pod \"e70b2b9c-d3ae-4458-94f9-36c5a4ccb619\" (UID: \"e70b2b9c-d3ae-4458-94f9-36c5a4ccb619\") "
Jul 16 22:55:37.617771 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:55:37.617745    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e70b2b9c-d3ae-4458-94f9-36c5a4ccb619-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e70b2b9c-d3ae-4458-94f9-36c5a4ccb619" (UID: "e70b2b9c-d3ae-4458-94f9-36c5a4ccb619"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 22:55:37.619234 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:55:37.619211    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e70b2b9c-d3ae-4458-94f9-36c5a4ccb619-kube-api-access-m7lkm" (OuterVolumeSpecName: "kube-api-access-m7lkm") pod "e70b2b9c-d3ae-4458-94f9-36c5a4ccb619" (UID: "e70b2b9c-d3ae-4458-94f9-36c5a4ccb619"). InnerVolumeSpecName "kube-api-access-m7lkm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:55:37.619329 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:55:37.619238    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e70b2b9c-d3ae-4458-94f9-36c5a4ccb619-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e70b2b9c-d3ae-4458-94f9-36c5a4ccb619" (UID: "e70b2b9c-d3ae-4458-94f9-36c5a4ccb619"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 22:55:37.718600 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:55:37.718568    2552 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e70b2b9c-d3ae-4458-94f9-36c5a4ccb619-maas-api-tls\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 16 22:55:37.718600 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:55:37.718599    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m7lkm\" (UniqueName: \"kubernetes.io/projected/e70b2b9c-d3ae-4458-94f9-36c5a4ccb619-kube-api-access-m7lkm\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 16 22:55:37.718600 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:55:37.718610    2552 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e70b2b9c-d3ae-4458-94f9-36c5a4ccb619-openshift-service-ca\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 16 22:55:38.366736 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:55:38.366685    2552 generic.go:356] "Generic (PLEG): container finished" podID="e70b2b9c-d3ae-4458-94f9-36c5a4ccb619" containerID="a303d6683e43df52c431c1109c7af2fbac1b51abe7da1f4e63e57a0d3b735e99" exitCode=0
Jul 16 22:55:38.367067 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:55:38.366727    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ddb113-7f988cc674-w728v" event={"ID":"e70b2b9c-d3ae-4458-94f9-36c5a4ccb619","Type":"ContainerDied","Data":"a303d6683e43df52c431c1109c7af2fbac1b51abe7da1f4e63e57a0d3b735e99"}
Jul 16 22:55:38.367067 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:55:38.366752    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ddb113-7f988cc674-w728v"
Jul 16 22:55:38.367067 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:55:38.366784    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ddb113-7f988cc674-w728v" event={"ID":"e70b2b9c-d3ae-4458-94f9-36c5a4ccb619","Type":"ContainerDied","Data":"cea0fec707506ac7a28f0192d0a874ac6ae049158dccba5cf1159205b2aea16d"}
Jul 16 22:55:38.367067 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:55:38.366809    2552 scope.go:117] "RemoveContainer" containerID="a303d6683e43df52c431c1109c7af2fbac1b51abe7da1f4e63e57a0d3b735e99"
Jul 16 22:55:38.375460 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:55:38.375436    2552 scope.go:117] "RemoveContainer" containerID="a303d6683e43df52c431c1109c7af2fbac1b51abe7da1f4e63e57a0d3b735e99"
Jul 16 22:55:38.375727 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:55:38.375691    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a303d6683e43df52c431c1109c7af2fbac1b51abe7da1f4e63e57a0d3b735e99\": container with ID starting with a303d6683e43df52c431c1109c7af2fbac1b51abe7da1f4e63e57a0d3b735e99 not found: ID does not exist" containerID="a303d6683e43df52c431c1109c7af2fbac1b51abe7da1f4e63e57a0d3b735e99"
Jul 16 22:55:38.375790 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:55:38.375736    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a303d6683e43df52c431c1109c7af2fbac1b51abe7da1f4e63e57a0d3b735e99"} err="failed to get container status \"a303d6683e43df52c431c1109c7af2fbac1b51abe7da1f4e63e57a0d3b735e99\": rpc error: code = NotFound desc = could not find container \"a303d6683e43df52c431c1109c7af2fbac1b51abe7da1f4e63e57a0d3b735e99\": container with ID starting with a303d6683e43df52c431c1109c7af2fbac1b51abe7da1f4e63e57a0d3b735e99 not found: ID does not exist"
Jul 16 22:55:38.385843 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:55:38.385824    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-ddb113-7f988cc674-w728v"]
Jul 16 22:55:38.388952 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:55:38.388933    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-ddb113-7f988cc674-w728v"]
Jul 16 22:55:40.276516 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:55:40.276484    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e70b2b9c-d3ae-4458-94f9-36c5a4ccb619" path="/var/lib/kubelet/pods/e70b2b9c-d3ae-4458-94f9-36c5a4ccb619/volumes"
Jul 16 22:56:03.843667 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:56:03.843634    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-ef186c-58659775b9-5j5qg"]
Jul 16 22:56:03.844102 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:56:03.843920    2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ef186c-58659775b9-5j5qg" podUID="545d5629-7cba-4c75-9d4e-eebb57200fec" containerName="maas-api" containerID="cri-o://18ec94bf9a5c4e1c70e1448ef3d67bf7e8021894914e10e2be1378f673abc8db" gracePeriod=30
Jul 16 22:56:04.093230 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:56:04.093203    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ef186c-58659775b9-5j5qg"
Jul 16 22:56:04.230909 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:56:04.230878    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xwwmv\" (UniqueName: \"kubernetes.io/projected/545d5629-7cba-4c75-9d4e-eebb57200fec-kube-api-access-xwwmv\") pod \"545d5629-7cba-4c75-9d4e-eebb57200fec\" (UID: \"545d5629-7cba-4c75-9d4e-eebb57200fec\") "
Jul 16 22:56:04.231048 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:56:04.230960    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/545d5629-7cba-4c75-9d4e-eebb57200fec-maas-api-tls\") pod \"545d5629-7cba-4c75-9d4e-eebb57200fec\" (UID: \"545d5629-7cba-4c75-9d4e-eebb57200fec\") "
Jul 16 22:56:04.231048 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:56:04.231021    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/545d5629-7cba-4c75-9d4e-eebb57200fec-openshift-service-ca\") pod \"545d5629-7cba-4c75-9d4e-eebb57200fec\" (UID: \"545d5629-7cba-4c75-9d4e-eebb57200fec\") "
Jul 16 22:56:04.231369 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:56:04.231344    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/545d5629-7cba-4c75-9d4e-eebb57200fec-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "545d5629-7cba-4c75-9d4e-eebb57200fec" (UID: "545d5629-7cba-4c75-9d4e-eebb57200fec"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 22:56:04.232935 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:56:04.232909    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/545d5629-7cba-4c75-9d4e-eebb57200fec-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "545d5629-7cba-4c75-9d4e-eebb57200fec" (UID: "545d5629-7cba-4c75-9d4e-eebb57200fec"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 22:56:04.233028 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:56:04.232975    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/545d5629-7cba-4c75-9d4e-eebb57200fec-kube-api-access-xwwmv" (OuterVolumeSpecName: "kube-api-access-xwwmv") pod "545d5629-7cba-4c75-9d4e-eebb57200fec" (UID: "545d5629-7cba-4c75-9d4e-eebb57200fec"). InnerVolumeSpecName "kube-api-access-xwwmv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:56:04.332019 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:56:04.331996    2552 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/545d5629-7cba-4c75-9d4e-eebb57200fec-openshift-service-ca\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 16 22:56:04.332019 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:56:04.332023    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xwwmv\" (UniqueName: \"kubernetes.io/projected/545d5629-7cba-4c75-9d4e-eebb57200fec-kube-api-access-xwwmv\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 16 22:56:04.332169 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:56:04.332034    2552 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/545d5629-7cba-4c75-9d4e-eebb57200fec-maas-api-tls\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 16 22:56:04.497523 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:56:04.497438    2552 generic.go:356] "Generic (PLEG): container finished" podID="545d5629-7cba-4c75-9d4e-eebb57200fec" containerID="18ec94bf9a5c4e1c70e1448ef3d67bf7e8021894914e10e2be1378f673abc8db" exitCode=0
Jul 16 22:56:04.497523 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:56:04.497483    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ef186c-58659775b9-5j5qg"
Jul 16 22:56:04.497791 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:56:04.497532    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ef186c-58659775b9-5j5qg" event={"ID":"545d5629-7cba-4c75-9d4e-eebb57200fec","Type":"ContainerDied","Data":"18ec94bf9a5c4e1c70e1448ef3d67bf7e8021894914e10e2be1378f673abc8db"}
Jul 16 22:56:04.497791 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:56:04.497584    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ef186c-58659775b9-5j5qg" event={"ID":"545d5629-7cba-4c75-9d4e-eebb57200fec","Type":"ContainerDied","Data":"cac60a25f96fbc2c6c0b70902d005b2206ba256fd348502099495afa13369343"}
Jul 16 22:56:04.497791 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:56:04.497607    2552 scope.go:117] "RemoveContainer" containerID="18ec94bf9a5c4e1c70e1448ef3d67bf7e8021894914e10e2be1378f673abc8db"
Jul 16 22:56:04.506884 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:56:04.506867    2552 scope.go:117] "RemoveContainer" containerID="18ec94bf9a5c4e1c70e1448ef3d67bf7e8021894914e10e2be1378f673abc8db"
Jul 16 22:56:04.507158 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:56:04.507138    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"18ec94bf9a5c4e1c70e1448ef3d67bf7e8021894914e10e2be1378f673abc8db\": container with ID starting with 18ec94bf9a5c4e1c70e1448ef3d67bf7e8021894914e10e2be1378f673abc8db not found: ID does not exist" containerID="18ec94bf9a5c4e1c70e1448ef3d67bf7e8021894914e10e2be1378f673abc8db"
Jul 16 22:56:04.507223 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:56:04.507165    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18ec94bf9a5c4e1c70e1448ef3d67bf7e8021894914e10e2be1378f673abc8db"} err="failed to get container status \"18ec94bf9a5c4e1c70e1448ef3d67bf7e8021894914e10e2be1378f673abc8db\": rpc error: code = NotFound desc = could not find container \"18ec94bf9a5c4e1c70e1448ef3d67bf7e8021894914e10e2be1378f673abc8db\": container with ID starting with 18ec94bf9a5c4e1c70e1448ef3d67bf7e8021894914e10e2be1378f673abc8db not found: ID does not exist"
Jul 16 22:56:04.516183 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:56:04.516160    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-ef186c-58659775b9-5j5qg"]
Jul 16 22:56:04.522910 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:56:04.522881    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-ef186c-58659775b9-5j5qg"]
Jul 16 22:56:06.277041 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:56:06.277008    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="545d5629-7cba-4c75-9d4e-eebb57200fec" path="/var/lib/kubelet/pods/545d5629-7cba-4c75-9d4e-eebb57200fec/volumes"
Jul 16 22:56:18.977425 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:56:18.977388    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-35a77a-6bc966944d-74kq6"]
Jul 16 22:56:18.977968 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:56:18.977812    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="545d5629-7cba-4c75-9d4e-eebb57200fec" containerName="maas-api"
Jul 16 22:56:18.977968 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:56:18.977832    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="545d5629-7cba-4c75-9d4e-eebb57200fec" containerName="maas-api"
Jul 16 22:56:18.977968 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:56:18.977847    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e70b2b9c-d3ae-4458-94f9-36c5a4ccb619" containerName="maas-api"
Jul 16 22:56:18.977968 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:56:18.977855    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="e70b2b9c-d3ae-4458-94f9-36c5a4ccb619" containerName="maas-api"
Jul 16 22:56:18.977968 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:56:18.977957    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="545d5629-7cba-4c75-9d4e-eebb57200fec" containerName="maas-api"
Jul 16 22:56:18.977968 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:56:18.977968    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="e70b2b9c-d3ae-4458-94f9-36c5a4ccb619" containerName="maas-api"
Jul 16 22:56:18.982835 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:56:18.982810    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-35a77a-6bc966944d-74kq6"
Jul 16 22:56:18.985664 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:56:18.985639    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-35a77a-serving-cert\""
Jul 16 22:56:18.993683 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:56:18.993659    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-35a77a-6bc966944d-74kq6"]
Jul 16 22:56:19.158626 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:56:19.158577    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pfw7g\" (UniqueName: \"kubernetes.io/projected/f8046352-4465-45cc-bf38-8b7febe0db34-kube-api-access-pfw7g\") pod \"maas-api-e2e-shared-a-35a77a-6bc966944d-74kq6\" (UID: \"f8046352-4465-45cc-bf38-8b7febe0db34\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-35a77a-6bc966944d-74kq6"
Jul 16 22:56:19.158880 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:56:19.158652    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8046352-4465-45cc-bf38-8b7febe0db34-openshift-service-ca\") pod \"maas-api-e2e-shared-a-35a77a-6bc966944d-74kq6\" (UID: \"f8046352-4465-45cc-bf38-8b7febe0db34\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-35a77a-6bc966944d-74kq6"
Jul 16 22:56:19.158880 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:56:19.158850    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f8046352-4465-45cc-bf38-8b7febe0db34-maas-api-tls\") pod \"maas-api-e2e-shared-a-35a77a-6bc966944d-74kq6\" (UID: \"f8046352-4465-45cc-bf38-8b7febe0db34\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-35a77a-6bc966944d-74kq6"
Jul 16 22:56:19.260161 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:56:19.260081    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f8046352-4465-45cc-bf38-8b7febe0db34-maas-api-tls\") pod \"maas-api-e2e-shared-a-35a77a-6bc966944d-74kq6\" (UID: \"f8046352-4465-45cc-bf38-8b7febe0db34\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-35a77a-6bc966944d-74kq6"
Jul 16 22:56:19.260161 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:56:19.260124    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pfw7g\" (UniqueName: \"kubernetes.io/projected/f8046352-4465-45cc-bf38-8b7febe0db34-kube-api-access-pfw7g\") pod \"maas-api-e2e-shared-a-35a77a-6bc966944d-74kq6\" (UID: \"f8046352-4465-45cc-bf38-8b7febe0db34\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-35a77a-6bc966944d-74kq6"
Jul 16 22:56:19.260161 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:56:19.260161    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8046352-4465-45cc-bf38-8b7febe0db34-openshift-service-ca\") pod \"maas-api-e2e-shared-a-35a77a-6bc966944d-74kq6\" (UID: \"f8046352-4465-45cc-bf38-8b7febe0db34\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-35a77a-6bc966944d-74kq6"
Jul 16 22:56:19.260374 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:56:19.260240    2552 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-35a77a-serving-cert: secret "maas-api-e2e-shared-a-35a77a-serving-cert" not found
Jul 16 22:56:19.260374 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:56:19.260323    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8046352-4465-45cc-bf38-8b7febe0db34-maas-api-tls podName:f8046352-4465-45cc-bf38-8b7febe0db34 nodeName:}" failed. No retries permitted until 2026-07-16 22:56:19.760302229 +0000 UTC m=+2553.975083371 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f8046352-4465-45cc-bf38-8b7febe0db34-maas-api-tls") pod "maas-api-e2e-shared-a-35a77a-6bc966944d-74kq6" (UID: "f8046352-4465-45cc-bf38-8b7febe0db34") : secret "maas-api-e2e-shared-a-35a77a-serving-cert" not found
Jul 16 22:56:19.260849 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:56:19.260830    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8046352-4465-45cc-bf38-8b7febe0db34-openshift-service-ca\") pod \"maas-api-e2e-shared-a-35a77a-6bc966944d-74kq6\" (UID: \"f8046352-4465-45cc-bf38-8b7febe0db34\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-35a77a-6bc966944d-74kq6"
Jul 16 22:56:19.269932 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:56:19.269905    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pfw7g\" (UniqueName: \"kubernetes.io/projected/f8046352-4465-45cc-bf38-8b7febe0db34-kube-api-access-pfw7g\") pod \"maas-api-e2e-shared-a-35a77a-6bc966944d-74kq6\" (UID: \"f8046352-4465-45cc-bf38-8b7febe0db34\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-35a77a-6bc966944d-74kq6"
Jul 16 22:56:19.764841 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:56:19.764799    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f8046352-4465-45cc-bf38-8b7febe0db34-maas-api-tls\") pod \"maas-api-e2e-shared-a-35a77a-6bc966944d-74kq6\" (UID: \"f8046352-4465-45cc-bf38-8b7febe0db34\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-35a77a-6bc966944d-74kq6"
Jul 16 22:56:19.767151 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:56:19.767131    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f8046352-4465-45cc-bf38-8b7febe0db34-maas-api-tls\") pod \"maas-api-e2e-shared-a-35a77a-6bc966944d-74kq6\" (UID: \"f8046352-4465-45cc-bf38-8b7febe0db34\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-35a77a-6bc966944d-74kq6"
Jul 16 22:56:19.894279 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:56:19.894241    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-35a77a-6bc966944d-74kq6"
Jul 16 22:56:20.043021 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:56:20.042970    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8046352_4465_45cc_bf38_8b7febe0db34.slice/crio-521e4ccc238ca991bf42cd12323d5d68152111ba267f67f5bdbaa969ebbccfce WatchSource:0}: Error finding container 521e4ccc238ca991bf42cd12323d5d68152111ba267f67f5bdbaa969ebbccfce: Status 404 returned error can't find the container with id 521e4ccc238ca991bf42cd12323d5d68152111ba267f67f5bdbaa969ebbccfce
Jul 16 22:56:20.045038 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:56:20.044901    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-35a77a-6bc966944d-74kq6"]
Jul 16 22:56:20.580313 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:56:20.580269    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-35a77a-6bc966944d-74kq6" event={"ID":"f8046352-4465-45cc-bf38-8b7febe0db34","Type":"ContainerStarted","Data":"521e4ccc238ca991bf42cd12323d5d68152111ba267f67f5bdbaa969ebbccfce"}
Jul 16 22:56:21.588233 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:56:21.588197    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-35a77a-6bc966944d-74kq6" event={"ID":"f8046352-4465-45cc-bf38-8b7febe0db34","Type":"ContainerStarted","Data":"396360e91d9063e20ecea96d0b0d2527c74964e58770a3a3e57400234a427b76"}
Jul 16 22:56:21.588681 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:56:21.588264    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-35a77a-6bc966944d-74kq6"
Jul 16 22:56:21.610829 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:56:21.610777    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-35a77a-6bc966944d-74kq6" podStartSLOduration=2.787701923 podStartE2EDuration="3.610763482s" totalImagesPullingTime="823.061559ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:56:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:56:21.610473988 +0000 UTC m=+2555.825255155" watchObservedRunningTime="2026-07-16 22:56:21.610763482 +0000 UTC m=+2555.825544641"
Jul 16 22:56:27.003668 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:56:27.003637    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-5159e9-65dccc6d89-95rvm"]
Jul 16 22:56:27.007236 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:56:27.007218    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-5159e9-65dccc6d89-95rvm"
Jul 16 22:56:27.009984 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:56:27.009963    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-5159e9-serving-cert\""
Jul 16 22:56:27.021211 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:56:27.021191    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-5159e9-65dccc6d89-95rvm"]
Jul 16 22:56:27.129580 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:56:27.129545    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f989b3d1-74a8-4173-9343-ecc64ed756fb-openshift-service-ca\") pod \"maas-api-e2e-shared-b-5159e9-65dccc6d89-95rvm\" (UID: \"f989b3d1-74a8-4173-9343-ecc64ed756fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-5159e9-65dccc6d89-95rvm"
Jul 16 22:56:27.129580 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:56:27.129579    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89m5x\" (UniqueName: \"kubernetes.io/projected/f989b3d1-74a8-4173-9343-ecc64ed756fb-kube-api-access-89m5x\") pod \"maas-api-e2e-shared-b-5159e9-65dccc6d89-95rvm\" (UID: \"f989b3d1-74a8-4173-9343-ecc64ed756fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-5159e9-65dccc6d89-95rvm"
Jul 16 22:56:27.129806 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:56:27.129630    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f989b3d1-74a8-4173-9343-ecc64ed756fb-maas-api-tls\") pod \"maas-api-e2e-shared-b-5159e9-65dccc6d89-95rvm\" (UID: \"f989b3d1-74a8-4173-9343-ecc64ed756fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-5159e9-65dccc6d89-95rvm"
Jul 16 22:56:27.231098 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:56:27.231063    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f989b3d1-74a8-4173-9343-ecc64ed756fb-openshift-service-ca\") pod \"maas-api-e2e-shared-b-5159e9-65dccc6d89-95rvm\" (UID: \"f989b3d1-74a8-4173-9343-ecc64ed756fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-5159e9-65dccc6d89-95rvm"
Jul 16 22:56:27.231098 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:56:27.231096    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-89m5x\" (UniqueName: \"kubernetes.io/projected/f989b3d1-74a8-4173-9343-ecc64ed756fb-kube-api-access-89m5x\") pod \"maas-api-e2e-shared-b-5159e9-65dccc6d89-95rvm\" (UID: \"f989b3d1-74a8-4173-9343-ecc64ed756fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-5159e9-65dccc6d89-95rvm"
Jul 16 22:56:27.231299 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:56:27.231126    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f989b3d1-74a8-4173-9343-ecc64ed756fb-maas-api-tls\") pod \"maas-api-e2e-shared-b-5159e9-65dccc6d89-95rvm\" (UID: \"f989b3d1-74a8-4173-9343-ecc64ed756fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-5159e9-65dccc6d89-95rvm"
Jul 16 22:56:27.231299 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:56:27.231257    2552 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-5159e9-serving-cert: secret "maas-api-e2e-shared-b-5159e9-serving-cert" not found
Jul 16 22:56:27.231367 ip-10-0-141-47 kubenswrapper[2552]: E0716 22:56:27.231321    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f989b3d1-74a8-4173-9343-ecc64ed756fb-maas-api-tls podName:f989b3d1-74a8-4173-9343-ecc64ed756fb nodeName:}" failed. No retries permitted until 2026-07-16 22:56:27.731302588 +0000 UTC m=+2561.946083742 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f989b3d1-74a8-4173-9343-ecc64ed756fb-maas-api-tls") pod "maas-api-e2e-shared-b-5159e9-65dccc6d89-95rvm" (UID: "f989b3d1-74a8-4173-9343-ecc64ed756fb") : secret "maas-api-e2e-shared-b-5159e9-serving-cert" not found
Jul 16 22:56:27.231736 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:56:27.231691    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f989b3d1-74a8-4173-9343-ecc64ed756fb-openshift-service-ca\") pod \"maas-api-e2e-shared-b-5159e9-65dccc6d89-95rvm\" (UID: \"f989b3d1-74a8-4173-9343-ecc64ed756fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-5159e9-65dccc6d89-95rvm"
Jul 16 22:56:27.242047 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:56:27.242019    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-89m5x\" (UniqueName: \"kubernetes.io/projected/f989b3d1-74a8-4173-9343-ecc64ed756fb-kube-api-access-89m5x\") pod \"maas-api-e2e-shared-b-5159e9-65dccc6d89-95rvm\" (UID: \"f989b3d1-74a8-4173-9343-ecc64ed756fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-5159e9-65dccc6d89-95rvm"
Jul 16 22:56:27.599170 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:56:27.599139    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-35a77a-6bc966944d-74kq6"
Jul 16 22:56:27.734692 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:56:27.734644    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f989b3d1-74a8-4173-9343-ecc64ed756fb-maas-api-tls\") pod \"maas-api-e2e-shared-b-5159e9-65dccc6d89-95rvm\" (UID: \"f989b3d1-74a8-4173-9343-ecc64ed756fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-5159e9-65dccc6d89-95rvm"
Jul 16 22:56:27.737052 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:56:27.737028    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f989b3d1-74a8-4173-9343-ecc64ed756fb-maas-api-tls\") pod \"maas-api-e2e-shared-b-5159e9-65dccc6d89-95rvm\" (UID: \"f989b3d1-74a8-4173-9343-ecc64ed756fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-5159e9-65dccc6d89-95rvm"
Jul 16 22:56:27.917649 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:56:27.917575    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-5159e9-65dccc6d89-95rvm"
Jul 16 22:56:28.056965 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:56:28.056939    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-5159e9-65dccc6d89-95rvm"]
Jul 16 22:56:28.059512 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:56:28.059479    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf989b3d1_74a8_4173_9343_ecc64ed756fb.slice/crio-0f550f9b0fa8725dd1fd165bcb93cf8766416105e3c037aff21a5e5a98c5f2e3 WatchSource:0}: Error finding container 0f550f9b0fa8725dd1fd165bcb93cf8766416105e3c037aff21a5e5a98c5f2e3: Status 404 returned error can't find the container with id 0f550f9b0fa8725dd1fd165bcb93cf8766416105e3c037aff21a5e5a98c5f2e3
Jul 16 22:56:28.624610 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:56:28.624572    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-5159e9-65dccc6d89-95rvm" event={"ID":"f989b3d1-74a8-4173-9343-ecc64ed756fb","Type":"ContainerStarted","Data":"c6586f38cb6e5139be529bcb69716260dc4606203b4b5b8f9803f70f9734e276"}
Jul 16 22:56:28.624809 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:56:28.624636    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-5159e9-65dccc6d89-95rvm" event={"ID":"f989b3d1-74a8-4173-9343-ecc64ed756fb","Type":"ContainerStarted","Data":"0f550f9b0fa8725dd1fd165bcb93cf8766416105e3c037aff21a5e5a98c5f2e3"}
Jul 16 22:56:28.624809 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:56:28.624755    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-5159e9-65dccc6d89-95rvm"
Jul 16 22:56:28.643120 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:56:28.643071    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-5159e9-65dccc6d89-95rvm" podStartSLOduration=2.303272157 podStartE2EDuration="2.643056911s" totalImagesPullingTime="339.784754ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:56:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:56:28.64083585 +0000 UTC m=+2562.855617029" watchObservedRunningTime="2026-07-16 22:56:28.643056911 +0000 UTC m=+2562.857838070"
Jul 16 22:56:34.636096 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:56:34.636068    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-5159e9-65dccc6d89-95rvm"
Jul 16 22:59:27.155257 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:59:27.155225    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-35a77a/sub-test-model-35a77a-kserve-6f97dc787f-bfrr7"]
Jul 16 22:59:27.158866 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:59:27.158849    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-35a77a/sub-test-model-35a77a-kserve-6f97dc787f-bfrr7"
Jul 16 22:59:27.162923 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:59:27.162900    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-35a77a\"/\"sub-test-model-35a77a-kserve-self-signed-certs\""
Jul 16 22:59:27.163082 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:59:27.162968    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-35a77a\"/\"kube-root-ca.crt\""
Jul 16 22:59:27.163082 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:59:27.163020    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-35a77a\"/\"openshift-service-ca.crt\""
Jul 16 22:59:27.163082 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:59:27.163027    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-35a77a\"/\"default-dockercfg-l8g85\""
Jul 16 22:59:27.171673 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:59:27.171652    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-35a77a/sub-test-model-35a77a-kserve-6f97dc787f-bfrr7"]
Jul 16 22:59:27.233461 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:59:27.233437    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3c6c26ae-d9ed-446b-bd20-d339b9ed6944-home\") pod \"sub-test-model-35a77a-kserve-6f97dc787f-bfrr7\" (UID: \"3c6c26ae-d9ed-446b-bd20-d339b9ed6944\") " pod="ai-tenant-e2e-shared-a-35a77a/sub-test-model-35a77a-kserve-6f97dc787f-bfrr7"
Jul 16 22:59:27.233938 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:59:27.233906    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3c6c26ae-d9ed-446b-bd20-d339b9ed6944-tls-certs\") pod \"sub-test-model-35a77a-kserve-6f97dc787f-bfrr7\" (UID: \"3c6c26ae-d9ed-446b-bd20-d339b9ed6944\") " pod="ai-tenant-e2e-shared-a-35a77a/sub-test-model-35a77a-kserve-6f97dc787f-bfrr7"
Jul 16 22:59:27.234057 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:59:27.234022    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c6c26ae-d9ed-446b-bd20-d339b9ed6944-tmp-dir\") pod \"sub-test-model-35a77a-kserve-6f97dc787f-bfrr7\" (UID: \"3c6c26ae-d9ed-446b-bd20-d339b9ed6944\") " pod="ai-tenant-e2e-shared-a-35a77a/sub-test-model-35a77a-kserve-6f97dc787f-bfrr7"
Jul 16 22:59:27.234120 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:59:27.234073    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3c6c26ae-d9ed-446b-bd20-d339b9ed6944-model-cache\") pod \"sub-test-model-35a77a-kserve-6f97dc787f-bfrr7\" (UID: \"3c6c26ae-d9ed-446b-bd20-d339b9ed6944\") " pod="ai-tenant-e2e-shared-a-35a77a/sub-test-model-35a77a-kserve-6f97dc787f-bfrr7"
Jul 16 22:59:27.234181 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:59:27.234131    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3c6c26ae-d9ed-446b-bd20-d339b9ed6944-dshm\") pod \"sub-test-model-35a77a-kserve-6f97dc787f-bfrr7\" (UID: \"3c6c26ae-d9ed-446b-bd20-d339b9ed6944\") " pod="ai-tenant-e2e-shared-a-35a77a/sub-test-model-35a77a-kserve-6f97dc787f-bfrr7"
Jul 16 22:59:27.234245 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:59:27.234177    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ktsmw\" (UniqueName: \"kubernetes.io/projected/3c6c26ae-d9ed-446b-bd20-d339b9ed6944-kube-api-access-ktsmw\") pod \"sub-test-model-35a77a-kserve-6f97dc787f-bfrr7\" (UID: \"3c6c26ae-d9ed-446b-bd20-d339b9ed6944\") " pod="ai-tenant-e2e-shared-a-35a77a/sub-test-model-35a77a-kserve-6f97dc787f-bfrr7"
Jul 16 22:59:27.334535 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:59:27.334508    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3c6c26ae-d9ed-446b-bd20-d339b9ed6944-dshm\") pod \"sub-test-model-35a77a-kserve-6f97dc787f-bfrr7\" (UID: \"3c6c26ae-d9ed-446b-bd20-d339b9ed6944\") " pod="ai-tenant-e2e-shared-a-35a77a/sub-test-model-35a77a-kserve-6f97dc787f-bfrr7"
Jul 16 22:59:27.334647 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:59:27.334540    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktsmw\" (UniqueName: \"kubernetes.io/projected/3c6c26ae-d9ed-446b-bd20-d339b9ed6944-kube-api-access-ktsmw\") pod \"sub-test-model-35a77a-kserve-6f97dc787f-bfrr7\" (UID: \"3c6c26ae-d9ed-446b-bd20-d339b9ed6944\") " pod="ai-tenant-e2e-shared-a-35a77a/sub-test-model-35a77a-kserve-6f97dc787f-bfrr7"
Jul 16 22:59:27.334647 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:59:27.334568    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3c6c26ae-d9ed-446b-bd20-d339b9ed6944-home\") pod \"sub-test-model-35a77a-kserve-6f97dc787f-bfrr7\" (UID: \"3c6c26ae-d9ed-446b-bd20-d339b9ed6944\") " pod="ai-tenant-e2e-shared-a-35a77a/sub-test-model-35a77a-kserve-6f97dc787f-bfrr7"
Jul 16 22:59:27.334647 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:59:27.334588    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3c6c26ae-d9ed-446b-bd20-d339b9ed6944-tls-certs\") pod \"sub-test-model-35a77a-kserve-6f97dc787f-bfrr7\" (UID: \"3c6c26ae-d9ed-446b-bd20-d339b9ed6944\") " pod="ai-tenant-e2e-shared-a-35a77a/sub-test-model-35a77a-kserve-6f97dc787f-bfrr7"
Jul 16 22:59:27.334863 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:59:27.334649    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c6c26ae-d9ed-446b-bd20-d339b9ed6944-tmp-dir\") pod \"sub-test-model-35a77a-kserve-6f97dc787f-bfrr7\" (UID: \"3c6c26ae-d9ed-446b-bd20-d339b9ed6944\") " pod="ai-tenant-e2e-shared-a-35a77a/sub-test-model-35a77a-kserve-6f97dc787f-bfrr7"
Jul 16 22:59:27.334863 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:59:27.334692    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3c6c26ae-d9ed-446b-bd20-d339b9ed6944-model-cache\") pod \"sub-test-model-35a77a-kserve-6f97dc787f-bfrr7\" (UID: \"3c6c26ae-d9ed-446b-bd20-d339b9ed6944\") " pod="ai-tenant-e2e-shared-a-35a77a/sub-test-model-35a77a-kserve-6f97dc787f-bfrr7"
Jul 16 22:59:27.335046 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:59:27.335021    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3c6c26ae-d9ed-446b-bd20-d339b9ed6944-home\") pod \"sub-test-model-35a77a-kserve-6f97dc787f-bfrr7\" (UID: \"3c6c26ae-d9ed-446b-bd20-d339b9ed6944\") " pod="ai-tenant-e2e-shared-a-35a77a/sub-test-model-35a77a-kserve-6f97dc787f-bfrr7"
Jul 16 22:59:27.335112 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:59:27.335070    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3c6c26ae-d9ed-446b-bd20-d339b9ed6944-model-cache\") pod \"sub-test-model-35a77a-kserve-6f97dc787f-bfrr7\" (UID: \"3c6c26ae-d9ed-446b-bd20-d339b9ed6944\") " pod="ai-tenant-e2e-shared-a-35a77a/sub-test-model-35a77a-kserve-6f97dc787f-bfrr7"
Jul 16 22:59:27.335174 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:59:27.335153    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c6c26ae-d9ed-446b-bd20-d339b9ed6944-tmp-dir\") pod \"sub-test-model-35a77a-kserve-6f97dc787f-bfrr7\" (UID: \"3c6c26ae-d9ed-446b-bd20-d339b9ed6944\") " pod="ai-tenant-e2e-shared-a-35a77a/sub-test-model-35a77a-kserve-6f97dc787f-bfrr7"
Jul 16 22:59:27.336772 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:59:27.336752    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3c6c26ae-d9ed-446b-bd20-d339b9ed6944-dshm\") pod \"sub-test-model-35a77a-kserve-6f97dc787f-bfrr7\" (UID: \"3c6c26ae-d9ed-446b-bd20-d339b9ed6944\") " pod="ai-tenant-e2e-shared-a-35a77a/sub-test-model-35a77a-kserve-6f97dc787f-bfrr7"
Jul 16 22:59:27.337106 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:59:27.337085    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3c6c26ae-d9ed-446b-bd20-d339b9ed6944-tls-certs\") pod \"sub-test-model-35a77a-kserve-6f97dc787f-bfrr7\" (UID: \"3c6c26ae-d9ed-446b-bd20-d339b9ed6944\") " pod="ai-tenant-e2e-shared-a-35a77a/sub-test-model-35a77a-kserve-6f97dc787f-bfrr7"
Jul 16 22:59:27.343125 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:59:27.343107    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ktsmw\" (UniqueName: \"kubernetes.io/projected/3c6c26ae-d9ed-446b-bd20-d339b9ed6944-kube-api-access-ktsmw\") pod \"sub-test-model-35a77a-kserve-6f97dc787f-bfrr7\" (UID: \"3c6c26ae-d9ed-446b-bd20-d339b9ed6944\") " pod="ai-tenant-e2e-shared-a-35a77a/sub-test-model-35a77a-kserve-6f97dc787f-bfrr7"
Jul 16 22:59:27.467470 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:59:27.467450    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-35a77a/sub-test-model-35a77a-kserve-6f97dc787f-bfrr7"
Jul 16 22:59:27.599548 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:59:27.599525    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-35a77a/sub-test-model-35a77a-kserve-6f97dc787f-bfrr7"]
Jul 16 22:59:27.601516 ip-10-0-141-47 kubenswrapper[2552]: W0716 22:59:27.601487    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3c6c26ae_d9ed_446b_bd20_d339b9ed6944.slice/crio-40ed94cb16a9dcb3e6c6a72492368d4ce961c3e9ac30fa8fa0a17dfec99acc8c WatchSource:0}: Error finding container 40ed94cb16a9dcb3e6c6a72492368d4ce961c3e9ac30fa8fa0a17dfec99acc8c: Status 404 returned error can't find the container with id 40ed94cb16a9dcb3e6c6a72492368d4ce961c3e9ac30fa8fa0a17dfec99acc8c
Jul 16 22:59:28.602082 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:59:28.602047    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-35a77a/sub-test-model-35a77a-kserve-6f97dc787f-bfrr7" event={"ID":"3c6c26ae-d9ed-446b-bd20-d339b9ed6944","Type":"ContainerStarted","Data":"1ed0514148ad98f976e907ba94c7a0bb3b835d9208b76e5c37b7662e5c064e56"}
Jul 16 22:59:28.602082 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:59:28.602087    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-35a77a/sub-test-model-35a77a-kserve-6f97dc787f-bfrr7" event={"ID":"3c6c26ae-d9ed-446b-bd20-d339b9ed6944","Type":"ContainerStarted","Data":"40ed94cb16a9dcb3e6c6a72492368d4ce961c3e9ac30fa8fa0a17dfec99acc8c"}
Jul 16 22:59:28.620255 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:59:28.620209    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-35a77a/sub-test-model-35a77a-kserve-6f97dc787f-bfrr7" podStartSLOduration=1.620196259 podStartE2EDuration="1.620196259s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:59:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:59:28.619217184 +0000 UTC m=+2742.833998343" watchObservedRunningTime="2026-07-16 22:59:28.620196259 +0000 UTC m=+2742.834977455"
Jul 16 22:59:37.468243 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:59:37.468206    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-35a77a/sub-test-model-35a77a-kserve-6f97dc787f-bfrr7"
Jul 16 22:59:37.468625 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:59:37.468255    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-35a77a/sub-test-model-35a77a-kserve-6f97dc787f-bfrr7"
Jul 16 22:59:37.482298 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:59:37.482273    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-35a77a/sub-test-model-35a77a-kserve-6f97dc787f-bfrr7"
Jul 16 22:59:37.658766 ip-10-0-141-47 kubenswrapper[2552]: I0716 22:59:37.658738    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-35a77a/sub-test-model-35a77a-kserve-6f97dc787f-bfrr7"
Jul 16 23:01:00.701183 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:01:00.701138    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-35a77a/sub-test-model-35a77a-kserve-6f97dc787f-bfrr7"]
Jul 16 23:01:15.721080 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:01:15.721033    2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-35a77a/sub-test-model-35a77a-kserve-6f97dc787f-bfrr7" podUID="3c6c26ae-d9ed-446b-bd20-d339b9ed6944" containerName="main" containerID="cri-o://1ed0514148ad98f976e907ba94c7a0bb3b835d9208b76e5c37b7662e5c064e56" gracePeriod=45
Jul 16 23:01:15.986021 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:01:15.985994    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-35a77a/sub-test-model-35a77a-kserve-6f97dc787f-bfrr7"
Jul 16 23:01:16.075309 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:01:16.075284    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3c6c26ae-d9ed-446b-bd20-d339b9ed6944-home\") pod \"3c6c26ae-d9ed-446b-bd20-d339b9ed6944\" (UID: \"3c6c26ae-d9ed-446b-bd20-d339b9ed6944\") "
Jul 16 23:01:16.075449 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:01:16.075321    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3c6c26ae-d9ed-446b-bd20-d339b9ed6944-model-cache\") pod \"3c6c26ae-d9ed-446b-bd20-d339b9ed6944\" (UID: \"3c6c26ae-d9ed-446b-bd20-d339b9ed6944\") "
Jul 16 23:01:16.075449 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:01:16.075337    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3c6c26ae-d9ed-446b-bd20-d339b9ed6944-dshm\") pod \"3c6c26ae-d9ed-446b-bd20-d339b9ed6944\" (UID: \"3c6c26ae-d9ed-446b-bd20-d339b9ed6944\") "
Jul 16 23:01:16.075449 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:01:16.075357    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ktsmw\" (UniqueName: \"kubernetes.io/projected/3c6c26ae-d9ed-446b-bd20-d339b9ed6944-kube-api-access-ktsmw\") pod \"3c6c26ae-d9ed-446b-bd20-d339b9ed6944\" (UID: \"3c6c26ae-d9ed-446b-bd20-d339b9ed6944\") "
Jul 16 23:01:16.075449 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:01:16.075381    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c6c26ae-d9ed-446b-bd20-d339b9ed6944-tmp-dir\") pod \"3c6c26ae-d9ed-446b-bd20-d339b9ed6944\" (UID: \"3c6c26ae-d9ed-446b-bd20-d339b9ed6944\") "
Jul 16 23:01:16.075449 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:01:16.075427    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3c6c26ae-d9ed-446b-bd20-d339b9ed6944-tls-certs\") pod \"3c6c26ae-d9ed-446b-bd20-d339b9ed6944\" (UID: \"3c6c26ae-d9ed-446b-bd20-d339b9ed6944\") "
Jul 16 23:01:16.075763 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:01:16.075551    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c6c26ae-d9ed-446b-bd20-d339b9ed6944-home" (OuterVolumeSpecName: "home") pod "3c6c26ae-d9ed-446b-bd20-d339b9ed6944" (UID: "3c6c26ae-d9ed-446b-bd20-d339b9ed6944"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 23:01:16.075763 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:01:16.075582    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c6c26ae-d9ed-446b-bd20-d339b9ed6944-model-cache" (OuterVolumeSpecName: "model-cache") pod "3c6c26ae-d9ed-446b-bd20-d339b9ed6944" (UID: "3c6c26ae-d9ed-446b-bd20-d339b9ed6944"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 23:01:16.075763 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:01:16.075690    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c6c26ae-d9ed-446b-bd20-d339b9ed6944-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "3c6c26ae-d9ed-446b-bd20-d339b9ed6944" (UID: "3c6c26ae-d9ed-446b-bd20-d339b9ed6944"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 23:01:16.075872 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:01:16.075758    2552 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3c6c26ae-d9ed-446b-bd20-d339b9ed6944-home\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 16 23:01:16.075872 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:01:16.075777    2552 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3c6c26ae-d9ed-446b-bd20-d339b9ed6944-model-cache\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 16 23:01:16.077558 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:01:16.077529    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c6c26ae-d9ed-446b-bd20-d339b9ed6944-dshm" (OuterVolumeSpecName: "dshm") pod "3c6c26ae-d9ed-446b-bd20-d339b9ed6944" (UID: "3c6c26ae-d9ed-446b-bd20-d339b9ed6944"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 23:01:16.077636 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:01:16.077584    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c6c26ae-d9ed-446b-bd20-d339b9ed6944-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "3c6c26ae-d9ed-446b-bd20-d339b9ed6944" (UID: "3c6c26ae-d9ed-446b-bd20-d339b9ed6944"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 23:01:16.077736 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:01:16.077689    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c6c26ae-d9ed-446b-bd20-d339b9ed6944-kube-api-access-ktsmw" (OuterVolumeSpecName: "kube-api-access-ktsmw") pod "3c6c26ae-d9ed-446b-bd20-d339b9ed6944" (UID: "3c6c26ae-d9ed-446b-bd20-d339b9ed6944"). InnerVolumeSpecName "kube-api-access-ktsmw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 23:01:16.149943 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:01:16.149915    2552 generic.go:356] "Generic (PLEG): container finished" podID="3c6c26ae-d9ed-446b-bd20-d339b9ed6944" containerID="1ed0514148ad98f976e907ba94c7a0bb3b835d9208b76e5c37b7662e5c064e56" exitCode=0
Jul 16 23:01:16.150066 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:01:16.149957    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-35a77a/sub-test-model-35a77a-kserve-6f97dc787f-bfrr7"
Jul 16 23:01:16.150066 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:01:16.149965    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-35a77a/sub-test-model-35a77a-kserve-6f97dc787f-bfrr7" event={"ID":"3c6c26ae-d9ed-446b-bd20-d339b9ed6944","Type":"ContainerDied","Data":"1ed0514148ad98f976e907ba94c7a0bb3b835d9208b76e5c37b7662e5c064e56"}
Jul 16 23:01:16.150066 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:01:16.150004    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-35a77a/sub-test-model-35a77a-kserve-6f97dc787f-bfrr7" event={"ID":"3c6c26ae-d9ed-446b-bd20-d339b9ed6944","Type":"ContainerDied","Data":"40ed94cb16a9dcb3e6c6a72492368d4ce961c3e9ac30fa8fa0a17dfec99acc8c"}
Jul 16 23:01:16.150066 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:01:16.150027    2552 scope.go:117] "RemoveContainer" containerID="1ed0514148ad98f976e907ba94c7a0bb3b835d9208b76e5c37b7662e5c064e56"
Jul 16 23:01:16.158949 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:01:16.158932    2552 scope.go:117] "RemoveContainer" containerID="1ed0514148ad98f976e907ba94c7a0bb3b835d9208b76e5c37b7662e5c064e56"
Jul 16 23:01:16.159196 ip-10-0-141-47 kubenswrapper[2552]: E0716 23:01:16.159178    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1ed0514148ad98f976e907ba94c7a0bb3b835d9208b76e5c37b7662e5c064e56\": container with ID starting with 1ed0514148ad98f976e907ba94c7a0bb3b835d9208b76e5c37b7662e5c064e56 not found: ID does not exist" containerID="1ed0514148ad98f976e907ba94c7a0bb3b835d9208b76e5c37b7662e5c064e56"
Jul 16 23:01:16.159262 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:01:16.159206    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ed0514148ad98f976e907ba94c7a0bb3b835d9208b76e5c37b7662e5c064e56"} err="failed to get container status \"1ed0514148ad98f976e907ba94c7a0bb3b835d9208b76e5c37b7662e5c064e56\": rpc error: code = NotFound desc = could not find container \"1ed0514148ad98f976e907ba94c7a0bb3b835d9208b76e5c37b7662e5c064e56\": container with ID starting with 1ed0514148ad98f976e907ba94c7a0bb3b835d9208b76e5c37b7662e5c064e56 not found: ID does not exist"
Jul 16 23:01:16.174728 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:01:16.174705    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-35a77a/sub-test-model-35a77a-kserve-6f97dc787f-bfrr7"]
Jul 16 23:01:16.177104 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:01:16.177082    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ktsmw\" (UniqueName: \"kubernetes.io/projected/3c6c26ae-d9ed-446b-bd20-d339b9ed6944-kube-api-access-ktsmw\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 16 23:01:16.177204 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:01:16.177109    2552 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c6c26ae-d9ed-446b-bd20-d339b9ed6944-tmp-dir\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 16 23:01:16.177204 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:01:16.177124    2552 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3c6c26ae-d9ed-446b-bd20-d339b9ed6944-tls-certs\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 16 23:01:16.177204 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:01:16.177138    2552 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3c6c26ae-d9ed-446b-bd20-d339b9ed6944-dshm\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 16 23:01:16.178202 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:01:16.178184    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-35a77a/sub-test-model-35a77a-kserve-6f97dc787f-bfrr7"]
Jul 16 23:01:16.277621 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:01:16.277561    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3c6c26ae-d9ed-446b-bd20-d339b9ed6944" path="/var/lib/kubelet/pods/3c6c26ae-d9ed-446b-bd20-d339b9ed6944/volumes"
Jul 16 23:02:33.244709 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:02:33.244658    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7447-139797815064752"]
Jul 16 23:02:33.245292 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:02:33.245264    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c6c26ae-d9ed-446b-bd20-d339b9ed6944" containerName="main"
Jul 16 23:02:33.245292 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:02:33.245285    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c6c26ae-d9ed-446b-bd20-d339b9ed6944" containerName="main"
Jul 16 23:02:33.245420 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:02:33.245391    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c6c26ae-d9ed-446b-bd20-d339b9ed6944" containerName="main"
Jul 16 23:02:33.248648 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:02:33.248628    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7447-139797815064752"
Jul 16 23:02:33.251276 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:02:33.251247    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-56nfd\""
Jul 16 23:02:33.252788 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:02:33.252759    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7447-139797815064752"]
Jul 16 23:02:33.374313 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:02:33.374276    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwh82\" (UniqueName: \"kubernetes.io/projected/c377950a-fd36-427f-9a34-0a12c154d251-kube-api-access-zwh82\") pod \"test-curl-7447-139797815064752\" (UID: \"c377950a-fd36-427f-9a34-0a12c154d251\") " pod="opendatahub/test-curl-7447-139797815064752"
Jul 16 23:02:33.475775 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:02:33.475736    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwh82\" (UniqueName: \"kubernetes.io/projected/c377950a-fd36-427f-9a34-0a12c154d251-kube-api-access-zwh82\") pod \"test-curl-7447-139797815064752\" (UID: \"c377950a-fd36-427f-9a34-0a12c154d251\") " pod="opendatahub/test-curl-7447-139797815064752"
Jul 16 23:02:33.484617 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:02:33.484580    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwh82\" (UniqueName: \"kubernetes.io/projected/c377950a-fd36-427f-9a34-0a12c154d251-kube-api-access-zwh82\") pod \"test-curl-7447-139797815064752\" (UID: \"c377950a-fd36-427f-9a34-0a12c154d251\") " pod="opendatahub/test-curl-7447-139797815064752"
Jul 16 23:02:33.559685 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:02:33.559605    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7447-139797815064752"
Jul 16 23:02:33.694054 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:02:33.694024    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7447-139797815064752"]
Jul 16 23:02:33.700576 ip-10-0-141-47 kubenswrapper[2552]: W0716 23:02:33.700544    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc377950a_fd36_427f_9a34_0a12c154d251.slice/crio-1999fb0268b55c250632e5658c0350f591cdf70ddc1259a29cd368ef5cb49d82 WatchSource:0}: Error finding container 1999fb0268b55c250632e5658c0350f591cdf70ddc1259a29cd368ef5cb49d82: Status 404 returned error can't find the container with id 1999fb0268b55c250632e5658c0350f591cdf70ddc1259a29cd368ef5cb49d82
Jul 16 23:02:33.701851 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:02:33.701832    2552 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 16 23:02:34.558428 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:02:34.558403    2552 generic.go:356] "Generic (PLEG): container finished" podID="c377950a-fd36-427f-9a34-0a12c154d251" containerID="59c09446a86086bf06ada66fad0086fb929626561126c2fdf30ddd0e39f62f37" exitCode=0
Jul 16 23:02:34.558759 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:02:34.558479    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7447-139797815064752" event={"ID":"c377950a-fd36-427f-9a34-0a12c154d251","Type":"ContainerDied","Data":"59c09446a86086bf06ada66fad0086fb929626561126c2fdf30ddd0e39f62f37"}
Jul 16 23:02:34.558759 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:02:34.558518    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7447-139797815064752" event={"ID":"c377950a-fd36-427f-9a34-0a12c154d251","Type":"ContainerStarted","Data":"1999fb0268b55c250632e5658c0350f591cdf70ddc1259a29cd368ef5cb49d82"}
Jul 16 23:02:35.696618 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:02:35.696594    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7447-139797815064752"
Jul 16 23:02:35.732965 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:02:35.732940    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7447-139797815064752_c377950a-fd36-427f-9a34-0a12c154d251/test-curl-7447-139797815064752/0.log"
Jul 16 23:02:35.758071 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:02:35.758039    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7447-139797815064752"]
Jul 16 23:02:35.760609 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:02:35.760589    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7447-139797815064752"]
Jul 16 23:02:35.794135 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:02:35.794112    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zwh82\" (UniqueName: \"kubernetes.io/projected/c377950a-fd36-427f-9a34-0a12c154d251-kube-api-access-zwh82\") pod \"c377950a-fd36-427f-9a34-0a12c154d251\" (UID: \"c377950a-fd36-427f-9a34-0a12c154d251\") "
Jul 16 23:02:35.796035 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:02:35.796011    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c377950a-fd36-427f-9a34-0a12c154d251-kube-api-access-zwh82" (OuterVolumeSpecName: "kube-api-access-zwh82") pod "c377950a-fd36-427f-9a34-0a12c154d251" (UID: "c377950a-fd36-427f-9a34-0a12c154d251"). InnerVolumeSpecName "kube-api-access-zwh82". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 23:02:35.895352 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:02:35.895283    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zwh82\" (UniqueName: \"kubernetes.io/projected/c377950a-fd36-427f-9a34-0a12c154d251-kube-api-access-zwh82\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 16 23:02:35.921314 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:02:35.921291    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7447-139797811995536"]
Jul 16 23:02:35.921678 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:02:35.921664    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c377950a-fd36-427f-9a34-0a12c154d251" containerName="test-curl-7447-139797815064752"
Jul 16 23:02:35.921764 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:02:35.921681    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="c377950a-fd36-427f-9a34-0a12c154d251" containerName="test-curl-7447-139797815064752"
Jul 16 23:02:35.921805 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:02:35.921780    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="c377950a-fd36-427f-9a34-0a12c154d251" containerName="test-curl-7447-139797815064752"
Jul 16 23:02:35.924669 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:02:35.924653    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7447-139797811995536"
Jul 16 23:02:35.932245 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:02:35.932224    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7447-139797811995536"]
Jul 16 23:02:35.996301 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:02:35.996281    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pj29b\" (UniqueName: \"kubernetes.io/projected/2bf16dc4-5a3e-4627-ac52-67a4a16661bd-kube-api-access-pj29b\") pod \"test-curl-7447-139797811995536\" (UID: \"2bf16dc4-5a3e-4627-ac52-67a4a16661bd\") " pod="opendatahub/test-curl-7447-139797811995536"
Jul 16 23:02:36.096969 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:02:36.096946    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pj29b\" (UniqueName: \"kubernetes.io/projected/2bf16dc4-5a3e-4627-ac52-67a4a16661bd-kube-api-access-pj29b\") pod \"test-curl-7447-139797811995536\" (UID: \"2bf16dc4-5a3e-4627-ac52-67a4a16661bd\") " pod="opendatahub/test-curl-7447-139797811995536"
Jul 16 23:02:36.105021 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:02:36.104995    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pj29b\" (UniqueName: \"kubernetes.io/projected/2bf16dc4-5a3e-4627-ac52-67a4a16661bd-kube-api-access-pj29b\") pod \"test-curl-7447-139797811995536\" (UID: \"2bf16dc4-5a3e-4627-ac52-67a4a16661bd\") " pod="opendatahub/test-curl-7447-139797811995536"
Jul 16 23:02:36.234388 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:02:36.234367    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7447-139797811995536"
Jul 16 23:02:36.281838 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:02:36.279983    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c377950a-fd36-427f-9a34-0a12c154d251" path="/var/lib/kubelet/pods/c377950a-fd36-427f-9a34-0a12c154d251/volumes"
Jul 16 23:02:36.370128 ip-10-0-141-47 kubenswrapper[2552]: W0716 23:02:36.370088    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2bf16dc4_5a3e_4627_ac52_67a4a16661bd.slice/crio-865f75e12645832f36e0a6a41304af78d1d993c1e2643554b1edccae85cd0a7a WatchSource:0}: Error finding container 865f75e12645832f36e0a6a41304af78d1d993c1e2643554b1edccae85cd0a7a: Status 404 returned error can't find the container with id 865f75e12645832f36e0a6a41304af78d1d993c1e2643554b1edccae85cd0a7a
Jul 16 23:02:36.370551 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:02:36.370527    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7447-139797811995536"]
Jul 16 23:02:36.569093 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:02:36.569025    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7447-139797815064752"
Jul 16 23:02:36.569093 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:02:36.569024    2552 scope.go:117] "RemoveContainer" containerID="59c09446a86086bf06ada66fad0086fb929626561126c2fdf30ddd0e39f62f37"
Jul 16 23:02:36.570359 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:02:36.570334    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7447-139797811995536" event={"ID":"2bf16dc4-5a3e-4627-ac52-67a4a16661bd","Type":"ContainerStarted","Data":"865f75e12645832f36e0a6a41304af78d1d993c1e2643554b1edccae85cd0a7a"}
Jul 16 23:02:37.578489 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:02:37.578445    2552 generic.go:356] "Generic (PLEG): container finished" podID="2bf16dc4-5a3e-4627-ac52-67a4a16661bd" containerID="31c0f21563f537ee5a1223f186b359c7d1e5fe33f94430fbc08dc2bec64addf4" exitCode=0
Jul 16 23:02:37.578887 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:02:37.578536    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7447-139797811995536" event={"ID":"2bf16dc4-5a3e-4627-ac52-67a4a16661bd","Type":"ContainerDied","Data":"31c0f21563f537ee5a1223f186b359c7d1e5fe33f94430fbc08dc2bec64addf4"}
Jul 16 23:02:38.711655 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:02:38.711627    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7447-139797811995536"
Jul 16 23:02:38.732676 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:02:38.732654    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7447-139797811995536_2bf16dc4-5a3e-4627-ac52-67a4a16661bd/test-curl-7447-139797811995536/0.log"
Jul 16 23:02:38.756388 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:02:38.756357    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7447-139797811995536"]
Jul 16 23:02:38.760486 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:02:38.760457    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7447-139797811995536"]
Jul 16 23:02:38.820606 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:02:38.820581    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pj29b\" (UniqueName: \"kubernetes.io/projected/2bf16dc4-5a3e-4627-ac52-67a4a16661bd-kube-api-access-pj29b\") pod \"2bf16dc4-5a3e-4627-ac52-67a4a16661bd\" (UID: \"2bf16dc4-5a3e-4627-ac52-67a4a16661bd\") "
Jul 16 23:02:38.822500 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:02:38.822474    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2bf16dc4-5a3e-4627-ac52-67a4a16661bd-kube-api-access-pj29b" (OuterVolumeSpecName: "kube-api-access-pj29b") pod "2bf16dc4-5a3e-4627-ac52-67a4a16661bd" (UID: "2bf16dc4-5a3e-4627-ac52-67a4a16661bd"). InnerVolumeSpecName "kube-api-access-pj29b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 23:02:38.887576 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:02:38.887516    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7447-139797811995536"]
Jul 16 23:02:38.888006 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:02:38.887988    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2bf16dc4-5a3e-4627-ac52-67a4a16661bd" containerName="test-curl-7447-139797811995536"
Jul 16 23:02:38.888102 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:02:38.888008    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="2bf16dc4-5a3e-4627-ac52-67a4a16661bd" containerName="test-curl-7447-139797811995536"
Jul 16 23:02:38.888168 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:02:38.888125    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="2bf16dc4-5a3e-4627-ac52-67a4a16661bd" containerName="test-curl-7447-139797811995536"
Jul 16 23:02:38.890949 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:02:38.890931    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7447-139797811995536"
Jul 16 23:02:38.895159 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:02:38.895116    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7447-139797811995536"]
Jul 16 23:02:38.921895 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:02:38.921874    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pj29b\" (UniqueName: \"kubernetes.io/projected/2bf16dc4-5a3e-4627-ac52-67a4a16661bd-kube-api-access-pj29b\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 16 23:02:39.022586 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:02:39.022566    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4gwc\" (UniqueName: \"kubernetes.io/projected/f43fef66-a126-4846-a66c-597c9dc90b5a-kube-api-access-h4gwc\") pod \"test-curl-7447-139797811995536\" (UID: \"f43fef66-a126-4846-a66c-597c9dc90b5a\") " pod="opendatahub/test-curl-7447-139797811995536"
Jul 16 23:02:39.123087 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:02:39.123056    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4gwc\" (UniqueName: \"kubernetes.io/projected/f43fef66-a126-4846-a66c-597c9dc90b5a-kube-api-access-h4gwc\") pod \"test-curl-7447-139797811995536\" (UID: \"f43fef66-a126-4846-a66c-597c9dc90b5a\") " pod="opendatahub/test-curl-7447-139797811995536"
Jul 16 23:02:39.131266 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:02:39.131244    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4gwc\" (UniqueName: \"kubernetes.io/projected/f43fef66-a126-4846-a66c-597c9dc90b5a-kube-api-access-h4gwc\") pod \"test-curl-7447-139797811995536\" (UID: \"f43fef66-a126-4846-a66c-597c9dc90b5a\") " pod="opendatahub/test-curl-7447-139797811995536"
Jul 16 23:02:39.201283 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:02:39.201263    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7447-139797811995536"
Jul 16 23:02:39.328625 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:02:39.328599    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7447-139797811995536"]
Jul 16 23:02:39.330264 ip-10-0-141-47 kubenswrapper[2552]: W0716 23:02:39.330234    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf43fef66_a126_4846_a66c_597c9dc90b5a.slice/crio-a3cea2f2027c361c2f74eb62679b2bd6ccf765d2a635f9dc3422d73aa8d11b8e WatchSource:0}: Error finding container a3cea2f2027c361c2f74eb62679b2bd6ccf765d2a635f9dc3422d73aa8d11b8e: Status 404 returned error can't find the container with id a3cea2f2027c361c2f74eb62679b2bd6ccf765d2a635f9dc3422d73aa8d11b8e
Jul 16 23:02:39.591295 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:02:39.591227    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7447-139797811995536" event={"ID":"f43fef66-a126-4846-a66c-597c9dc90b5a","Type":"ContainerStarted","Data":"a3cea2f2027c361c2f74eb62679b2bd6ccf765d2a635f9dc3422d73aa8d11b8e"}
Jul 16 23:02:39.592434 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:02:39.592418    2552 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="865f75e12645832f36e0a6a41304af78d1d993c1e2643554b1edccae85cd0a7a"
Jul 16 23:02:39.592535 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:02:39.592448    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7447-139797811995536"
Jul 16 23:02:39.604282 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:02:39.604253    2552 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7447-139797811995536" oldPodUID="2bf16dc4-5a3e-4627-ac52-67a4a16661bd" podUID="f43fef66-a126-4846-a66c-597c9dc90b5a"
Jul 16 23:02:40.276457 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:02:40.276428    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2bf16dc4-5a3e-4627-ac52-67a4a16661bd" path="/var/lib/kubelet/pods/2bf16dc4-5a3e-4627-ac52-67a4a16661bd/volumes"
Jul 16 23:02:40.599222 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:02:40.599142    2552 generic.go:356] "Generic (PLEG): container finished" podID="f43fef66-a126-4846-a66c-597c9dc90b5a" containerID="1cd09c8c99063f4b602f055a0ce0f2ac8fd69db8f765b790521604208af81f66" exitCode=0
Jul 16 23:02:40.599380 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:02:40.599230    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7447-139797811995536" event={"ID":"f43fef66-a126-4846-a66c-597c9dc90b5a","Type":"ContainerDied","Data":"1cd09c8c99063f4b602f055a0ce0f2ac8fd69db8f765b790521604208af81f66"}
Jul 16 23:02:41.752949 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:02:41.752926    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7447-139797811995536"
Jul 16 23:02:41.774166 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:02:41.774145    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7447-139797811995536_f43fef66-a126-4846-a66c-597c9dc90b5a/test-curl-7447-139797811995536/0.log"
Jul 16 23:02:41.799457 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:02:41.799430    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7447-139797811995536"]
Jul 16 23:02:41.803313 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:02:41.803292    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7447-139797811995536"]
Jul 16 23:02:41.846013 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:02:41.845991    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h4gwc\" (UniqueName: \"kubernetes.io/projected/f43fef66-a126-4846-a66c-597c9dc90b5a-kube-api-access-h4gwc\") pod \"f43fef66-a126-4846-a66c-597c9dc90b5a\" (UID: \"f43fef66-a126-4846-a66c-597c9dc90b5a\") "
Jul 16 23:02:41.847973 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:02:41.847949    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f43fef66-a126-4846-a66c-597c9dc90b5a-kube-api-access-h4gwc" (OuterVolumeSpecName: "kube-api-access-h4gwc") pod "f43fef66-a126-4846-a66c-597c9dc90b5a" (UID: "f43fef66-a126-4846-a66c-597c9dc90b5a"). InnerVolumeSpecName "kube-api-access-h4gwc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 23:02:41.943060 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:02:41.943005    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7447-139797811996544"]
Jul 16 23:02:41.943365 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:02:41.943352    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f43fef66-a126-4846-a66c-597c9dc90b5a" containerName="test-curl-7447-139797811995536"
Jul 16 23:02:41.943403 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:02:41.943367    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="f43fef66-a126-4846-a66c-597c9dc90b5a" containerName="test-curl-7447-139797811995536"
Jul 16 23:02:41.943448 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:02:41.943439    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="f43fef66-a126-4846-a66c-597c9dc90b5a" containerName="test-curl-7447-139797811995536"
Jul 16 23:02:41.946357 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:02:41.946340    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7447-139797811996544"
Jul 16 23:02:41.946675 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:02:41.946647    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h4gwc\" (UniqueName: \"kubernetes.io/projected/f43fef66-a126-4846-a66c-597c9dc90b5a-kube-api-access-h4gwc\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 16 23:02:41.959468 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:02:41.959447    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7447-139797811996544"]
Jul 16 23:02:42.047412 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:02:42.047384    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xtj2l\" (UniqueName: \"kubernetes.io/projected/38145d2e-6593-4e6b-a174-5dcfa42e6939-kube-api-access-xtj2l\") pod \"test-curl-7447-139797811996544\" (UID: \"38145d2e-6593-4e6b-a174-5dcfa42e6939\") " pod="opendatahub/test-curl-7447-139797811996544"
Jul 16 23:02:42.147944 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:02:42.147910    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtj2l\" (UniqueName: \"kubernetes.io/projected/38145d2e-6593-4e6b-a174-5dcfa42e6939-kube-api-access-xtj2l\") pod \"test-curl-7447-139797811996544\" (UID: \"38145d2e-6593-4e6b-a174-5dcfa42e6939\") " pod="opendatahub/test-curl-7447-139797811996544"
Jul 16 23:02:42.156642 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:02:42.156623    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xtj2l\" (UniqueName: \"kubernetes.io/projected/38145d2e-6593-4e6b-a174-5dcfa42e6939-kube-api-access-xtj2l\") pod \"test-curl-7447-139797811996544\" (UID: \"38145d2e-6593-4e6b-a174-5dcfa42e6939\") " pod="opendatahub/test-curl-7447-139797811996544"
Jul 16 23:02:42.254644 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:02:42.254625    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7447-139797811996544"
Jul 16 23:02:42.276567 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:02:42.276543    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f43fef66-a126-4846-a66c-597c9dc90b5a" path="/var/lib/kubelet/pods/f43fef66-a126-4846-a66c-597c9dc90b5a/volumes"
Jul 16 23:02:42.591253 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:02:42.591229    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7447-139797811996544"]
Jul 16 23:02:42.593145 ip-10-0-141-47 kubenswrapper[2552]: W0716 23:02:42.593119    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod38145d2e_6593_4e6b_a174_5dcfa42e6939.slice/crio-b99fd89631dd2c1ee25b145003badd5cd22829b941e1a1b3a8e5b10f94ac78ef WatchSource:0}: Error finding container b99fd89631dd2c1ee25b145003badd5cd22829b941e1a1b3a8e5b10f94ac78ef: Status 404 returned error can't find the container with id b99fd89631dd2c1ee25b145003badd5cd22829b941e1a1b3a8e5b10f94ac78ef
Jul 16 23:02:42.613480 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:02:42.613451    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7447-139797811996544" event={"ID":"38145d2e-6593-4e6b-a174-5dcfa42e6939","Type":"ContainerStarted","Data":"b99fd89631dd2c1ee25b145003badd5cd22829b941e1a1b3a8e5b10f94ac78ef"}
Jul 16 23:02:42.614601 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:02:42.614585    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7447-139797811995536"
Jul 16 23:02:42.614716 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:02:42.614625    2552 scope.go:117] "RemoveContainer" containerID="1cd09c8c99063f4b602f055a0ce0f2ac8fd69db8f765b790521604208af81f66"
Jul 16 23:02:43.622077 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:02:43.622049    2552 generic.go:356] "Generic (PLEG): container finished" podID="38145d2e-6593-4e6b-a174-5dcfa42e6939" containerID="afcc09444c1f07c27f2b80a2f836624b9ff65014ef9e8546b29853b098bf0e2f" exitCode=0
Jul 16 23:02:43.622458 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:02:43.622134    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7447-139797811996544" event={"ID":"38145d2e-6593-4e6b-a174-5dcfa42e6939","Type":"ContainerDied","Data":"afcc09444c1f07c27f2b80a2f836624b9ff65014ef9e8546b29853b098bf0e2f"}
Jul 16 23:02:44.765040 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:02:44.765017    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7447-139797811996544"
Jul 16 23:02:44.790423 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:02:44.790404    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7447-139797811996544_38145d2e-6593-4e6b-a174-5dcfa42e6939/test-curl-7447-139797811996544/0.log"
Jul 16 23:02:44.818749 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:02:44.818721    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7447-139797811996544"]
Jul 16 23:02:44.822674 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:02:44.822645    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7447-139797811996544"]
Jul 16 23:02:44.872913 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:02:44.872894    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xtj2l\" (UniqueName: \"kubernetes.io/projected/38145d2e-6593-4e6b-a174-5dcfa42e6939-kube-api-access-xtj2l\") pod \"38145d2e-6593-4e6b-a174-5dcfa42e6939\" (UID: \"38145d2e-6593-4e6b-a174-5dcfa42e6939\") "
Jul 16 23:02:44.874809 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:02:44.874779    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38145d2e-6593-4e6b-a174-5dcfa42e6939-kube-api-access-xtj2l" (OuterVolumeSpecName: "kube-api-access-xtj2l") pod "38145d2e-6593-4e6b-a174-5dcfa42e6939" (UID: "38145d2e-6593-4e6b-a174-5dcfa42e6939"). InnerVolumeSpecName "kube-api-access-xtj2l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 23:02:44.973452 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:02:44.973431    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xtj2l\" (UniqueName: \"kubernetes.io/projected/38145d2e-6593-4e6b-a174-5dcfa42e6939-kube-api-access-xtj2l\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 16 23:02:45.635433 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:02:45.635404    2552 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b99fd89631dd2c1ee25b145003badd5cd22829b941e1a1b3a8e5b10f94ac78ef"
Jul 16 23:02:45.635433 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:02:45.635426    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7447-139797811996544"
Jul 16 23:02:45.645124 ip-10-0-141-47 kubenswrapper[2552]: E0716 23:02:45.645098    2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7447-139797811996544\" is forbidden: User \"system:node:ip-10-0-141-47.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-141-47.ec2.internal' and this object" podUID="38145d2e-6593-4e6b-a174-5dcfa42e6939" pod="opendatahub/test-curl-7447-139797811996544"
Jul 16 23:02:46.274785 ip-10-0-141-47 kubenswrapper[2552]: E0716 23:02:46.274751    2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7447-139797811996544\" is forbidden: User \"system:node:ip-10-0-141-47.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-141-47.ec2.internal' and this object" podUID="38145d2e-6593-4e6b-a174-5dcfa42e6939" pod="opendatahub/test-curl-7447-139797811996544"
Jul 16 23:02:46.277033 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:02:46.277008    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="38145d2e-6593-4e6b-a174-5dcfa42e6939" path="/var/lib/kubelet/pods/38145d2e-6593-4e6b-a174-5dcfa42e6939/volumes"
Jul 16 23:02:57.954055 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:02:57.954022    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-35a77a-6bc966944d-74kq6"]
Jul 16 23:02:57.954528 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:02:57.954236    2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-35a77a-6bc966944d-74kq6" podUID="f8046352-4465-45cc-bf38-8b7febe0db34" containerName="maas-api" containerID="cri-o://396360e91d9063e20ecea96d0b0d2527c74964e58770a3a3e57400234a427b76" gracePeriod=30
Jul 16 23:02:58.411709 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:02:58.411673    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-35a77a-6bc966944d-74kq6"
Jul 16 23:02:58.467344 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:02:58.467319    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f8046352-4465-45cc-bf38-8b7febe0db34-maas-api-tls\") pod \"f8046352-4465-45cc-bf38-8b7febe0db34\" (UID: \"f8046352-4465-45cc-bf38-8b7febe0db34\") "
Jul 16 23:02:58.467459 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:02:58.467351    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pfw7g\" (UniqueName: \"kubernetes.io/projected/f8046352-4465-45cc-bf38-8b7febe0db34-kube-api-access-pfw7g\") pod \"f8046352-4465-45cc-bf38-8b7febe0db34\" (UID: \"f8046352-4465-45cc-bf38-8b7febe0db34\") "
Jul 16 23:02:58.467459 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:02:58.467384    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8046352-4465-45cc-bf38-8b7febe0db34-openshift-service-ca\") pod \"f8046352-4465-45cc-bf38-8b7febe0db34\" (UID: \"f8046352-4465-45cc-bf38-8b7febe0db34\") "
Jul 16 23:02:58.467795 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:02:58.467764    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f8046352-4465-45cc-bf38-8b7febe0db34-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f8046352-4465-45cc-bf38-8b7febe0db34" (UID: "f8046352-4465-45cc-bf38-8b7febe0db34"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 23:02:58.469326 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:02:58.469301    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f8046352-4465-45cc-bf38-8b7febe0db34-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f8046352-4465-45cc-bf38-8b7febe0db34" (UID: "f8046352-4465-45cc-bf38-8b7febe0db34"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 23:02:58.469379 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:02:58.469341    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8046352-4465-45cc-bf38-8b7febe0db34-kube-api-access-pfw7g" (OuterVolumeSpecName: "kube-api-access-pfw7g") pod "f8046352-4465-45cc-bf38-8b7febe0db34" (UID: "f8046352-4465-45cc-bf38-8b7febe0db34"). InnerVolumeSpecName "kube-api-access-pfw7g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 23:02:58.568899 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:02:58.568832    2552 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f8046352-4465-45cc-bf38-8b7febe0db34-maas-api-tls\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 16 23:02:58.568899 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:02:58.568857    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pfw7g\" (UniqueName: \"kubernetes.io/projected/f8046352-4465-45cc-bf38-8b7febe0db34-kube-api-access-pfw7g\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 16 23:02:58.568899 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:02:58.568871    2552 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8046352-4465-45cc-bf38-8b7febe0db34-openshift-service-ca\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 16 23:02:58.701170 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:02:58.701141    2552 generic.go:356] "Generic (PLEG): container finished" podID="f8046352-4465-45cc-bf38-8b7febe0db34" containerID="396360e91d9063e20ecea96d0b0d2527c74964e58770a3a3e57400234a427b76" exitCode=0
Jul 16 23:02:58.701298 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:02:58.701175    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-35a77a-6bc966944d-74kq6" event={"ID":"f8046352-4465-45cc-bf38-8b7febe0db34","Type":"ContainerDied","Data":"396360e91d9063e20ecea96d0b0d2527c74964e58770a3a3e57400234a427b76"}
Jul 16 23:02:58.701298 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:02:58.701184    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-35a77a-6bc966944d-74kq6"
Jul 16 23:02:58.701298 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:02:58.701217    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-35a77a-6bc966944d-74kq6" event={"ID":"f8046352-4465-45cc-bf38-8b7febe0db34","Type":"ContainerDied","Data":"521e4ccc238ca991bf42cd12323d5d68152111ba267f67f5bdbaa969ebbccfce"}
Jul 16 23:02:58.701298 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:02:58.701238    2552 scope.go:117] "RemoveContainer" containerID="396360e91d9063e20ecea96d0b0d2527c74964e58770a3a3e57400234a427b76"
Jul 16 23:02:58.710251 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:02:58.710233    2552 scope.go:117] "RemoveContainer" containerID="396360e91d9063e20ecea96d0b0d2527c74964e58770a3a3e57400234a427b76"
Jul 16 23:02:58.710481 ip-10-0-141-47 kubenswrapper[2552]: E0716 23:02:58.710462    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"396360e91d9063e20ecea96d0b0d2527c74964e58770a3a3e57400234a427b76\": container with ID starting with 396360e91d9063e20ecea96d0b0d2527c74964e58770a3a3e57400234a427b76 not found: ID does not exist" containerID="396360e91d9063e20ecea96d0b0d2527c74964e58770a3a3e57400234a427b76"
Jul 16 23:02:58.710529 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:02:58.710491    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"396360e91d9063e20ecea96d0b0d2527c74964e58770a3a3e57400234a427b76"} err="failed to get container status \"396360e91d9063e20ecea96d0b0d2527c74964e58770a3a3e57400234a427b76\": rpc error: code = NotFound desc = could not find container \"396360e91d9063e20ecea96d0b0d2527c74964e58770a3a3e57400234a427b76\": container with ID starting with 396360e91d9063e20ecea96d0b0d2527c74964e58770a3a3e57400234a427b76 not found: ID does not exist"
Jul 16 23:02:58.742146 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:02:58.742122    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-35a77a-6bc966944d-74kq6"]
Jul 16 23:02:58.747674 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:02:58.747653    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-35a77a-6bc966944d-74kq6"]
Jul 16 23:03:00.275566 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:03:00.275531    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f8046352-4465-45cc-bf38-8b7febe0db34" path="/var/lib/kubelet/pods/f8046352-4465-45cc-bf38-8b7febe0db34/volumes"
Jul 16 23:03:19.926265 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:03:19.926227    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-5159e9-65dccc6d89-95rvm"]
Jul 16 23:03:19.929026 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:03:19.926513    2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-5159e9-65dccc6d89-95rvm" podUID="f989b3d1-74a8-4173-9343-ecc64ed756fb" containerName="maas-api" containerID="cri-o://c6586f38cb6e5139be529bcb69716260dc4606203b4b5b8f9803f70f9734e276" gracePeriod=30
Jul 16 23:03:20.197357 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:03:20.197335    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-5159e9-65dccc6d89-95rvm"
Jul 16 23:03:20.217365 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:03:20.217340    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f989b3d1-74a8-4173-9343-ecc64ed756fb-maas-api-tls\") pod \"f989b3d1-74a8-4173-9343-ecc64ed756fb\" (UID: \"f989b3d1-74a8-4173-9343-ecc64ed756fb\") "
Jul 16 23:03:20.217505 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:03:20.217397    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f989b3d1-74a8-4173-9343-ecc64ed756fb-openshift-service-ca\") pod \"f989b3d1-74a8-4173-9343-ecc64ed756fb\" (UID: \"f989b3d1-74a8-4173-9343-ecc64ed756fb\") "
Jul 16 23:03:20.217505 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:03:20.217424    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-89m5x\" (UniqueName: \"kubernetes.io/projected/f989b3d1-74a8-4173-9343-ecc64ed756fb-kube-api-access-89m5x\") pod \"f989b3d1-74a8-4173-9343-ecc64ed756fb\" (UID: \"f989b3d1-74a8-4173-9343-ecc64ed756fb\") "
Jul 16 23:03:20.217967 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:03:20.217936    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f989b3d1-74a8-4173-9343-ecc64ed756fb-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f989b3d1-74a8-4173-9343-ecc64ed756fb" (UID: "f989b3d1-74a8-4173-9343-ecc64ed756fb"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 23:03:20.219399 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:03:20.219372    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f989b3d1-74a8-4173-9343-ecc64ed756fb-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f989b3d1-74a8-4173-9343-ecc64ed756fb" (UID: "f989b3d1-74a8-4173-9343-ecc64ed756fb"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 23:03:20.219835 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:03:20.219813    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f989b3d1-74a8-4173-9343-ecc64ed756fb-kube-api-access-89m5x" (OuterVolumeSpecName: "kube-api-access-89m5x") pod "f989b3d1-74a8-4173-9343-ecc64ed756fb" (UID: "f989b3d1-74a8-4173-9343-ecc64ed756fb"). InnerVolumeSpecName "kube-api-access-89m5x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 23:03:20.318505 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:03:20.318477    2552 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f989b3d1-74a8-4173-9343-ecc64ed756fb-maas-api-tls\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 16 23:03:20.318505 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:03:20.318498    2552 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f989b3d1-74a8-4173-9343-ecc64ed756fb-openshift-service-ca\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 16 23:03:20.318505 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:03:20.318507    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-89m5x\" (UniqueName: \"kubernetes.io/projected/f989b3d1-74a8-4173-9343-ecc64ed756fb-kube-api-access-89m5x\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 16 23:03:20.814490 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:03:20.814460    2552 generic.go:356] "Generic (PLEG): container finished" podID="f989b3d1-74a8-4173-9343-ecc64ed756fb" containerID="c6586f38cb6e5139be529bcb69716260dc4606203b4b5b8f9803f70f9734e276" exitCode=0
Jul 16 23:03:20.814655 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:03:20.814503    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-5159e9-65dccc6d89-95rvm"
Jul 16 23:03:20.814655 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:03:20.814548    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-5159e9-65dccc6d89-95rvm" event={"ID":"f989b3d1-74a8-4173-9343-ecc64ed756fb","Type":"ContainerDied","Data":"c6586f38cb6e5139be529bcb69716260dc4606203b4b5b8f9803f70f9734e276"}
Jul 16 23:03:20.814655 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:03:20.814600    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-5159e9-65dccc6d89-95rvm" event={"ID":"f989b3d1-74a8-4173-9343-ecc64ed756fb","Type":"ContainerDied","Data":"0f550f9b0fa8725dd1fd165bcb93cf8766416105e3c037aff21a5e5a98c5f2e3"}
Jul 16 23:03:20.814655 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:03:20.814622    2552 scope.go:117] "RemoveContainer" containerID="c6586f38cb6e5139be529bcb69716260dc4606203b4b5b8f9803f70f9734e276"
Jul 16 23:03:20.825625 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:03:20.825606    2552 scope.go:117] "RemoveContainer" containerID="c6586f38cb6e5139be529bcb69716260dc4606203b4b5b8f9803f70f9734e276"
Jul 16 23:03:20.825887 ip-10-0-141-47 kubenswrapper[2552]: E0716 23:03:20.825870    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c6586f38cb6e5139be529bcb69716260dc4606203b4b5b8f9803f70f9734e276\": container with ID starting with c6586f38cb6e5139be529bcb69716260dc4606203b4b5b8f9803f70f9734e276 not found: ID does not exist" containerID="c6586f38cb6e5139be529bcb69716260dc4606203b4b5b8f9803f70f9734e276"
Jul 16 23:03:20.825943 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:03:20.825894    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6586f38cb6e5139be529bcb69716260dc4606203b4b5b8f9803f70f9734e276"} err="failed to get container status \"c6586f38cb6e5139be529bcb69716260dc4606203b4b5b8f9803f70f9734e276\": rpc error: code = NotFound desc = could not find container \"c6586f38cb6e5139be529bcb69716260dc4606203b4b5b8f9803f70f9734e276\": container with ID starting with c6586f38cb6e5139be529bcb69716260dc4606203b4b5b8f9803f70f9734e276 not found: ID does not exist"
Jul 16 23:03:20.831450 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:03:20.831427    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-5159e9-65dccc6d89-95rvm"]
Jul 16 23:03:20.834607 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:03:20.834586    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-5159e9-65dccc6d89-95rvm"]
Jul 16 23:03:22.276567 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:03:22.276532    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f989b3d1-74a8-4173-9343-ecc64ed756fb" path="/var/lib/kubelet/pods/f989b3d1-74a8-4173-9343-ecc64ed756fb/volumes"
Jul 16 23:03:31.919904 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:03:31.919874    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-94c4465d5-7fhbm_e93d6eda-f58a-4286-8ace-73400238846b/authorino/0.log"
Jul 16 23:03:37.633148 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:03:37.633116    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-w2jbq_ee481a0b-0f61-46f6-bae6-bb4bc044ee14/manager/0.log"
Jul 16 23:03:37.761025 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:03:37.760997    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-52qmk_15854bde-e31c-4149-b303-c828b0d08949/manager/0.log"
Jul 16 23:03:37.891041 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:03:37.890970    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-695cf7dbbd-8gqp9_052a1331-0c9b-42fe-8f4c-2fe6d7c78ae1/manager/0.log"
Jul 16 23:03:38.012570 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:03:38.012547    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-zdmz9_fc1a8076-017d-48c5-8332-b357545f6098/server/0.log"
Jul 16 23:03:38.141771 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:03:38.141712    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-vq7pc_3a19fc0d-127d-479c-94e6-bd9dd1111513/manager/0.log"
Jul 16 23:03:38.262349 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:03:38.262330    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7846b6849-98rlr_54e0c828-7c8a-46a9-9e14-b9078c26c9f5/copy-manifests/0.log"
Jul 16 23:03:38.275237 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:03:38.275202    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7846b6849-98rlr_54e0c828-7c8a-46a9-9e14-b9078c26c9f5/manager/0.log"
Jul 16 23:03:38.927519 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:03:38.927471    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-578547cd4-r2xmh_85b4d362-b592-44e8-8e3a-76574fcf06b2/maas-api/0.log"
Jul 16 23:03:40.816399 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:03:40.816370    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-9t859_cb3f2801-3f7f-4dd0-b479-e2580cca601c/postgres/0.log"
Jul 16 23:03:41.606266 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:03:41.606236    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5hcq_85210f09-e4c3-4107-90e6-fedf15ae8de3/util/0.log"
Jul 16 23:03:41.613868 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:03:41.613842    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5hcq_85210f09-e4c3-4107-90e6-fedf15ae8de3/pull/0.log"
Jul 16 23:03:41.620842 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:03:41.620824    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5hcq_85210f09-e4c3-4107-90e6-fedf15ae8de3/extract/0.log"
Jul 16 23:03:41.740044 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:03:41.740023    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qcxnf_8f17f275-aa05-4ba8-9344-27f9e4a2b83d/util/0.log"
Jul 16 23:03:41.746895 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:03:41.746877    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qcxnf_8f17f275-aa05-4ba8-9344-27f9e4a2b83d/pull/0.log"
Jul 16 23:03:41.754362 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:03:41.754347    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qcxnf_8f17f275-aa05-4ba8-9344-27f9e4a2b83d/extract/0.log"
Jul 16 23:03:41.869974 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:03:41.869924    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73krvf5_ab2794ae-2618-4c3c-aa15-a998e2001def/util/0.log"
Jul 16 23:03:41.877305 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:03:41.877289    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73krvf5_ab2794ae-2618-4c3c-aa15-a998e2001def/pull/0.log"
Jul 16 23:03:41.883939 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:03:41.883924    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73krvf5_ab2794ae-2618-4c3c-aa15-a998e2001def/extract/0.log"
Jul 16 23:03:41.998750 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:03:41.998688    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fbp87_4c71d1ba-b4ce-41f4-8732-70e585f32271/util/0.log"
Jul 16 23:03:42.005628 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:03:42.005597    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fbp87_4c71d1ba-b4ce-41f4-8732-70e585f32271/pull/0.log"
Jul 16 23:03:42.013071 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:03:42.013058    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fbp87_4c71d1ba-b4ce-41f4-8732-70e585f32271/extract/0.log"
Jul 16 23:03:42.135938 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:03:42.135871    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-94c4465d5-7fhbm_e93d6eda-f58a-4286-8ace-73400238846b/authorino/0.log"
Jul 16 23:03:42.260799 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:03:42.260770    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-kjxfc_951f1766-ba8c-4b56-9116-afa1f71aba6d/manager/0.log"
Jul 16 23:03:42.380391 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:03:42.380340    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-kvdfr_7baecf64-03e6-43a1-84eb-3feb51494edd/manager/0.log"
Jul 16 23:03:42.625248 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:03:42.625226    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-hckbj_18f5a823-80d4-443f-a3a2-166fa88605e5/registry-server/0.log"
Jul 16 23:03:42.760506 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:03:42.760481    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-mxnn2_3f1b3d4f-79ad-4c24-808f-3cb9d52fd14f/manager/0.log"
Jul 16 23:03:43.008112 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:03:43.008090    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-vxzrg_ae48b2fd-aa0d-4398-90e0-dbd8019ce326/manager/0.log"
Jul 16 23:03:43.745363 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:03:43.745340    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5f4cc9ff56-pfq9r_cfefab5d-db7e-499f-88eb-75b6bd8187e4/kube-auth-proxy/0.log"
Jul 16 23:03:43.994194 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:03:43.994172    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-dxwzq_3e30ac18-198e-4c09-9507-1cadf1151f83/payload-pre-processing/0.log"
Jul 16 23:03:44.120479 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:03:44.120425    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-d2vqd_1f686924-d39e-463d-a706-f20c5efe4ed2/payload-processing/0.log"
Jul 16 23:03:44.725888 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:03:44.725862    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-kn5kk_b17bbb5a-01d2-46f7-a480-a9c0c8b676b4/main/0.log"
Jul 16 23:03:44.969910 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:03:44.969883    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6rjrd_4a50d4d0-335a-4381-bf6a-4f87557203cf/main/0.log"
Jul 16 23:03:54.087905 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:03:54.087874    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-qz9r8_cf1b7d07-96ed-44e0-bbb0-aa6bb66378dd/global-pull-secret-syncer/0.log"
Jul 16 23:03:54.173217 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:03:54.173194    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-j7ltc_52a402e0-019f-4e46-8dfa-591613eff6d1/konnectivity-agent/0.log"
Jul 16 23:03:54.290955 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:03:54.290930    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-47.ec2.internal_155d0342127b71289839856a25f3be3f/haproxy/0.log"
Jul 16 23:03:57.745401 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:03:57.745371    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5hcq_85210f09-e4c3-4107-90e6-fedf15ae8de3/extract/0.log"
Jul 16 23:03:57.772587 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:03:57.772564    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5hcq_85210f09-e4c3-4107-90e6-fedf15ae8de3/util/0.log"
Jul 16 23:03:57.806315 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:03:57.806292    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5hcq_85210f09-e4c3-4107-90e6-fedf15ae8de3/pull/0.log"
Jul 16 23:03:57.858112 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:03:57.858090    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qcxnf_8f17f275-aa05-4ba8-9344-27f9e4a2b83d/extract/0.log"
Jul 16 23:03:57.886890 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:03:57.886871    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qcxnf_8f17f275-aa05-4ba8-9344-27f9e4a2b83d/util/0.log"
Jul 16 23:03:57.915780 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:03:57.915761    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qcxnf_8f17f275-aa05-4ba8-9344-27f9e4a2b83d/pull/0.log"
Jul 16 23:03:57.945274 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:03:57.945257    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73krvf5_ab2794ae-2618-4c3c-aa15-a998e2001def/extract/0.log"
Jul 16 23:03:57.970187 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:03:57.970168    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73krvf5_ab2794ae-2618-4c3c-aa15-a998e2001def/util/0.log"
Jul 16 23:03:57.995656 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:03:57.995599    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73krvf5_ab2794ae-2618-4c3c-aa15-a998e2001def/pull/0.log"
Jul 16 23:03:58.031505 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:03:58.031487    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fbp87_4c71d1ba-b4ce-41f4-8732-70e585f32271/extract/0.log"
Jul 16 23:03:58.057523 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:03:58.057493    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fbp87_4c71d1ba-b4ce-41f4-8732-70e585f32271/util/0.log"
Jul 16 23:03:58.093552 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:03:58.093531    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fbp87_4c71d1ba-b4ce-41f4-8732-70e585f32271/pull/0.log"
Jul 16 23:03:58.453803 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:03:58.453779    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-94c4465d5-7fhbm_e93d6eda-f58a-4286-8ace-73400238846b/authorino/0.log"
Jul 16 23:03:58.485419 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:03:58.485371    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-kjxfc_951f1766-ba8c-4b56-9116-afa1f71aba6d/manager/0.log"
Jul 16 23:03:58.515830 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:03:58.515807    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-kvdfr_7baecf64-03e6-43a1-84eb-3feb51494edd/manager/0.log"
Jul 16 23:03:58.599377 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:03:58.599355    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-hckbj_18f5a823-80d4-443f-a3a2-166fa88605e5/registry-server/0.log"
Jul 16 23:03:58.736428 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:03:58.736343    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-mxnn2_3f1b3d4f-79ad-4c24-808f-3cb9d52fd14f/manager/0.log"
Jul 16 23:03:58.834502 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:03:58.834477    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-vxzrg_ae48b2fd-aa0d-4398-90e0-dbd8019ce326/manager/0.log"
Jul 16 23:04:00.933390 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:04:00.933360    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lj9kv_8cd7945c-2e95-4e5a-884c-34d976b1545a/node-exporter/0.log"
Jul 16 23:04:00.962162 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:04:00.962142    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lj9kv_8cd7945c-2e95-4e5a-884c-34d976b1545a/kube-rbac-proxy/0.log"
Jul 16 23:04:00.987334 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:04:00.987312    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lj9kv_8cd7945c-2e95-4e5a-884c-34d976b1545a/init-textfile/0.log"
Jul 16 23:04:03.021652 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:04:03.021610    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-7bc7489cb5-f62bz_ff4f63ba-2036-4f92-a692-4be32674de91/networking-console-plugin/0.log"
Jul 16 23:04:03.914568 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:04:03.914533    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-kj5sf/perf-node-gather-daemonset-twc7n"]
Jul 16 23:04:03.914914 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:04:03.914901    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8046352-4465-45cc-bf38-8b7febe0db34" containerName="maas-api"
Jul 16 23:04:03.915015 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:04:03.914916    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8046352-4465-45cc-bf38-8b7febe0db34" containerName="maas-api"
Jul 16 23:04:03.915015 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:04:03.914926    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f989b3d1-74a8-4173-9343-ecc64ed756fb" containerName="maas-api"
Jul 16 23:04:03.915015 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:04:03.914932    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="f989b3d1-74a8-4173-9343-ecc64ed756fb" containerName="maas-api"
Jul 16 23:04:03.915015 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:04:03.914938    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38145d2e-6593-4e6b-a174-5dcfa42e6939" containerName="test-curl-7447-139797811996544"
Jul 16 23:04:03.915015 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:04:03.914944    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="38145d2e-6593-4e6b-a174-5dcfa42e6939" containerName="test-curl-7447-139797811996544"
Jul 16 23:04:03.915015 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:04:03.915011    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="f989b3d1-74a8-4173-9343-ecc64ed756fb" containerName="maas-api"
Jul 16 23:04:03.915203 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:04:03.915018    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="38145d2e-6593-4e6b-a174-5dcfa42e6939" containerName="test-curl-7447-139797811996544"
Jul 16 23:04:03.915203 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:04:03.915027    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="f8046352-4465-45cc-bf38-8b7febe0db34" containerName="maas-api"
Jul 16 23:04:03.918299 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:04:03.918278    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kj5sf/perf-node-gather-daemonset-twc7n"
Jul 16 23:04:03.920968 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:04:03.920947    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-kj5sf\"/\"kube-root-ca.crt\""
Jul 16 23:04:03.921860 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:04:03.921844    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-kj5sf\"/\"openshift-service-ca.crt\""
Jul 16 23:04:03.921915 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:04:03.921848    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-kj5sf\"/\"default-dockercfg-6lm9r\""
Jul 16 23:04:03.928722 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:04:03.928681    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-kj5sf/perf-node-gather-daemonset-twc7n"]
Jul 16 23:04:04.033217 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:04:04.033188    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0163b760-5c24-4a42-a6b8-2d74abd490ce-podres\") pod \"perf-node-gather-daemonset-twc7n\" (UID: \"0163b760-5c24-4a42-a6b8-2d74abd490ce\") " pod="openshift-must-gather-kj5sf/perf-node-gather-daemonset-twc7n"
Jul 16 23:04:04.033553 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:04:04.033229    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0163b760-5c24-4a42-a6b8-2d74abd490ce-proc\") pod \"perf-node-gather-daemonset-twc7n\" (UID: \"0163b760-5c24-4a42-a6b8-2d74abd490ce\") " pod="openshift-must-gather-kj5sf/perf-node-gather-daemonset-twc7n"
Jul 16 23:04:04.033553 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:04:04.033265    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0163b760-5c24-4a42-a6b8-2d74abd490ce-lib-modules\") pod \"perf-node-gather-daemonset-twc7n\" (UID: \"0163b760-5c24-4a42-a6b8-2d74abd490ce\") " pod="openshift-must-gather-kj5sf/perf-node-gather-daemonset-twc7n"
Jul 16 23:04:04.033553 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:04:04.033302    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0163b760-5c24-4a42-a6b8-2d74abd490ce-sys\") pod \"perf-node-gather-daemonset-twc7n\" (UID: \"0163b760-5c24-4a42-a6b8-2d74abd490ce\") " pod="openshift-must-gather-kj5sf/perf-node-gather-daemonset-twc7n"
Jul 16 23:04:04.033553 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:04:04.033325    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7sqm\" (UniqueName: \"kubernetes.io/projected/0163b760-5c24-4a42-a6b8-2d74abd490ce-kube-api-access-s7sqm\") pod \"perf-node-gather-daemonset-twc7n\" (UID: \"0163b760-5c24-4a42-a6b8-2d74abd490ce\") " pod="openshift-must-gather-kj5sf/perf-node-gather-daemonset-twc7n"
Jul 16 23:04:04.134582 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:04:04.134552    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0163b760-5c24-4a42-a6b8-2d74abd490ce-podres\") pod \"perf-node-gather-daemonset-twc7n\" (UID: \"0163b760-5c24-4a42-a6b8-2d74abd490ce\") " pod="openshift-must-gather-kj5sf/perf-node-gather-daemonset-twc7n"
Jul 16 23:04:04.134754 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:04:04.134589    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0163b760-5c24-4a42-a6b8-2d74abd490ce-proc\") pod \"perf-node-gather-daemonset-twc7n\" (UID: \"0163b760-5c24-4a42-a6b8-2d74abd490ce\") " pod="openshift-must-gather-kj5sf/perf-node-gather-daemonset-twc7n"
Jul 16 23:04:04.134754 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:04:04.134628    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0163b760-5c24-4a42-a6b8-2d74abd490ce-lib-modules\") pod \"perf-node-gather-daemonset-twc7n\" (UID: \"0163b760-5c24-4a42-a6b8-2d74abd490ce\") " pod="openshift-must-gather-kj5sf/perf-node-gather-daemonset-twc7n"
Jul 16 23:04:04.134754 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:04:04.134673    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0163b760-5c24-4a42-a6b8-2d74abd490ce-sys\") pod \"perf-node-gather-daemonset-twc7n\" (UID: \"0163b760-5c24-4a42-a6b8-2d74abd490ce\") " pod="openshift-must-gather-kj5sf/perf-node-gather-daemonset-twc7n"
Jul 16 23:04:04.134754 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:04:04.134713    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7sqm\" (UniqueName: \"kubernetes.io/projected/0163b760-5c24-4a42-a6b8-2d74abd490ce-kube-api-access-s7sqm\") pod \"perf-node-gather-daemonset-twc7n\" (UID: \"0163b760-5c24-4a42-a6b8-2d74abd490ce\") " pod="openshift-must-gather-kj5sf/perf-node-gather-daemonset-twc7n"
Jul 16 23:04:04.134754 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:04:04.134746    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0163b760-5c24-4a42-a6b8-2d74abd490ce-podres\") pod \"perf-node-gather-daemonset-twc7n\" (UID: \"0163b760-5c24-4a42-a6b8-2d74abd490ce\") " pod="openshift-must-gather-kj5sf/perf-node-gather-daemonset-twc7n"
Jul 16 23:04:04.134962 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:04:04.134779    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0163b760-5c24-4a42-a6b8-2d74abd490ce-sys\") pod \"perf-node-gather-daemonset-twc7n\" (UID: \"0163b760-5c24-4a42-a6b8-2d74abd490ce\") " pod="openshift-must-gather-kj5sf/perf-node-gather-daemonset-twc7n"
Jul 16 23:04:04.134962 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:04:04.134792    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0163b760-5c24-4a42-a6b8-2d74abd490ce-proc\") pod \"perf-node-gather-daemonset-twc7n\" (UID: \"0163b760-5c24-4a42-a6b8-2d74abd490ce\") " pod="openshift-must-gather-kj5sf/perf-node-gather-daemonset-twc7n"
Jul 16 23:04:04.134962 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:04:04.134799    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0163b760-5c24-4a42-a6b8-2d74abd490ce-lib-modules\") pod \"perf-node-gather-daemonset-twc7n\" (UID: \"0163b760-5c24-4a42-a6b8-2d74abd490ce\") " pod="openshift-must-gather-kj5sf/perf-node-gather-daemonset-twc7n"
Jul 16 23:04:04.144782 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:04:04.144761    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7sqm\" (UniqueName: \"kubernetes.io/projected/0163b760-5c24-4a42-a6b8-2d74abd490ce-kube-api-access-s7sqm\") pod \"perf-node-gather-daemonset-twc7n\" (UID: \"0163b760-5c24-4a42-a6b8-2d74abd490ce\") " pod="openshift-must-gather-kj5sf/perf-node-gather-daemonset-twc7n"
Jul 16 23:04:04.228947 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:04:04.228923    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kj5sf/perf-node-gather-daemonset-twc7n"
Jul 16 23:04:04.374386 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:04:04.374362    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-kj5sf/perf-node-gather-daemonset-twc7n"]
Jul 16 23:04:04.375970 ip-10-0-141-47 kubenswrapper[2552]: W0716 23:04:04.375941    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod0163b760_5c24_4a42_a6b8_2d74abd490ce.slice/crio-1bc6f36c76752bf21f891ac82541926cb32a08d261b63f8f300bc90b6bfde0ed WatchSource:0}: Error finding container 1bc6f36c76752bf21f891ac82541926cb32a08d261b63f8f300bc90b6bfde0ed: Status 404 returned error can't find the container with id 1bc6f36c76752bf21f891ac82541926cb32a08d261b63f8f300bc90b6bfde0ed
Jul 16 23:04:05.037915 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:04:05.037876    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kj5sf/perf-node-gather-daemonset-twc7n" event={"ID":"0163b760-5c24-4a42-a6b8-2d74abd490ce","Type":"ContainerStarted","Data":"98f7eb20384c739554b37e6fbf5a9fa3dc2a3b76cacc748f39e62aa911a6fbf9"}
Jul 16 23:04:05.038303 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:04:05.037934    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kj5sf/perf-node-gather-daemonset-twc7n" event={"ID":"0163b760-5c24-4a42-a6b8-2d74abd490ce","Type":"ContainerStarted","Data":"1bc6f36c76752bf21f891ac82541926cb32a08d261b63f8f300bc90b6bfde0ed"}
Jul 16 23:04:05.038303 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:04:05.037955    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-kj5sf/perf-node-gather-daemonset-twc7n"
Jul 16 23:04:05.055306 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:04:05.055252    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-kj5sf/perf-node-gather-daemonset-twc7n" podStartSLOduration=2.055236931 podStartE2EDuration="2.055236931s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 23:04:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 23:04:05.053843167 +0000 UTC m=+3019.268624326" watchObservedRunningTime="2026-07-16 23:04:05.055236931 +0000 UTC m=+3019.270018090"
Jul 16 23:04:06.128273 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:04:06.128243    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-st98p_0d79e411-5d34-4159-b507-be3b54b5865f/dns/0.log"
Jul 16 23:04:06.150532 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:04:06.150509    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-st98p_0d79e411-5d34-4159-b507-be3b54b5865f/kube-rbac-proxy/0.log"
Jul 16 23:04:06.280966 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:04:06.280929    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8zcnq_b0bc3969-f63b-4d8d-9616-bfc554866e8f/dns-node-resolver/0.log"
Jul 16 23:04:07.022988 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:04:07.022957    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-t8d4l_80266fce-9ecb-495e-b7ca-fdc237aaa783/node-ca/0.log"
Jul 16 23:04:08.438689 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:04:08.438646    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5f4cc9ff56-pfq9r_cfefab5d-db7e-499f-88eb-75b6bd8187e4/kube-auth-proxy/0.log"
Jul 16 23:04:08.579762 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:04:08.579731    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-dxwzq_3e30ac18-198e-4c09-9507-1cadf1151f83/payload-pre-processing/0.log"
Jul 16 23:04:08.631990 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:04:08.631955    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-d2vqd_1f686924-d39e-463d-a706-f20c5efe4ed2/payload-processing/0.log"
Jul 16 23:04:09.356092 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:04:09.356061    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-92c7g_1309634f-5fad-4855-9795-889d92d5bc67/serve-healthcheck-canary/0.log"
Jul 16 23:04:10.157810 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:04:10.157785    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-j246p_dcd379a6-d615-4c6e-ba6d-ef0b93a174ff/kube-rbac-proxy/0.log"
Jul 16 23:04:10.184819 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:04:10.184797    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-j246p_dcd379a6-d615-4c6e-ba6d-ef0b93a174ff/exporter/0.log"
Jul 16 23:04:10.213423 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:04:10.213400    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-j246p_dcd379a6-d615-4c6e-ba6d-ef0b93a174ff/extractor/0.log"
Jul 16 23:04:11.053719 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:04:11.053679    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-kj5sf/perf-node-gather-daemonset-twc7n"
Jul 16 23:04:12.544157 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:04:12.544129    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-w2jbq_ee481a0b-0f61-46f6-bae6-bb4bc044ee14/manager/0.log"
Jul 16 23:04:12.728558 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:04:12.728522    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-52qmk_15854bde-e31c-4149-b303-c828b0d08949/manager/0.log"
Jul 16 23:04:12.841557 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:04:12.841524    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-695cf7dbbd-8gqp9_052a1331-0c9b-42fe-8f4c-2fe6d7c78ae1/manager/0.log"
Jul 16 23:04:12.867447 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:04:12.867425    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-zdmz9_fc1a8076-017d-48c5-8332-b357545f6098/server/0.log"
Jul 16 23:04:12.935487 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:04:12.935463    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-vq7pc_3a19fc0d-127d-479c-94e6-bd9dd1111513/manager/0.log"
Jul 16 23:04:13.019602 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:04:13.019540    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7846b6849-98rlr_54e0c828-7c8a-46a9-9e14-b9078c26c9f5/manager/0.log"
Jul 16 23:04:13.040638 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:04:13.040621    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7846b6849-98rlr_54e0c828-7c8a-46a9-9e14-b9078c26c9f5/copy-manifests/0.log"
Jul 16 23:04:14.339303 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:04:14.339271    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5f4cc9ff56-pfq9r_cfefab5d-db7e-499f-88eb-75b6bd8187e4/kube-auth-proxy/0.log"
Jul 16 23:04:14.442627 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:04:14.442600    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-dxwzq_3e30ac18-198e-4c09-9507-1cadf1151f83/payload-pre-processing/0.log"
Jul 16 23:04:14.461790 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:04:14.461764    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-d2vqd_1f686924-d39e-463d-a706-f20c5efe4ed2/payload-processing/0.log"
Jul 16 23:04:14.566719 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:04:14.566683    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-k67tq_53bceff6-64ea-4c27-9110-2c6e47fe421c/openshift-lws-operator/0.log"
Jul 16 23:04:15.983117 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:04:15.983084    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5f4cc9ff56-pfq9r_cfefab5d-db7e-499f-88eb-75b6bd8187e4/kube-auth-proxy/0.log"
Jul 16 23:04:16.081612 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:04:16.081582    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-dxwzq_3e30ac18-198e-4c09-9507-1cadf1151f83/payload-pre-processing/0.log"
Jul 16 23:04:16.102045 ip-10-0-141-47 kubenswrapper[2552]: I0716 23:04:16.102005    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-d2vqd_1f686924-d39e-463d-a706-f20c5efe4ed2/payload-processing/0.log"