Jul 30 20:23:01.141142 ip-10-0-142-69 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 30 20:23:01.141150 ip-10-0-142-69 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 30 20:23:01.141158 ip-10-0-142-69 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 30 20:23:01.141378 ip-10-0-142-69 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 30 20:23:11.232470 ip-10-0-142-69 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 30 20:23:11.232493 ip-10-0-142-69 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 8211e673ce8348c09f06e24494d95d63 --
Jul 30 20:24:48.033385 ip-10-0-142-69 systemd[1]: Starting Kubernetes Kubelet...
Jul 30 20:24:48.481277 ip-10-0-142-69 kubenswrapper[2583]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 30 20:24:48.481277 ip-10-0-142-69 kubenswrapper[2583]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 30 20:24:48.481277 ip-10-0-142-69 kubenswrapper[2583]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 30 20:24:48.481277 ip-10-0-142-69 kubenswrapper[2583]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 30 20:24:48.481277 ip-10-0-142-69 kubenswrapper[2583]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 30 20:24:48.482131 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.482038    2583 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 30 20:24:48.486683 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.486668    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 30 20:24:48.486720 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.486684    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 30 20:24:48.486720 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.486688    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 30 20:24:48.486720 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.486691    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 30 20:24:48.486720 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.486696    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 30 20:24:48.486720 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.486699    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 30 20:24:48.486720 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.486701    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 30 20:24:48.486720 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.486704    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 30 20:24:48.486720 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.486707    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 30 20:24:48.486720 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.486710    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 30 20:24:48.486720 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.486712    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 30 20:24:48.486720 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.486715    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 30 20:24:48.486720 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.486717    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 30 20:24:48.486720 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.486720    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 30 20:24:48.486720 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.486722    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 30 20:24:48.486720 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.486725    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 30 20:24:48.486720 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.486728    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 30 20:24:48.487151 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.486730    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 30 20:24:48.487151 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.486733    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 30 20:24:48.487151 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.486736    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 30 20:24:48.487151 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.486738    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 30 20:24:48.487151 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.486741    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 30 20:24:48.487151 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.486743    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 30 20:24:48.487151 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.486746    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 30 20:24:48.487151 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.486749    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 30 20:24:48.487151 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.486751    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 30 20:24:48.487151 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.486754    2583 feature_gate.go:328] unrecognized feature gate: Example2
Jul 30 20:24:48.487151 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.486756    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 30 20:24:48.487151 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.486758    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 30 20:24:48.487151 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.486761    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 30 20:24:48.487151 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.486763    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 30 20:24:48.487151 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.486766    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 30 20:24:48.487151 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.486768    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 30 20:24:48.487151 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.486770    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 30 20:24:48.487151 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.486774    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 30 20:24:48.487151 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.486778    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 30 20:24:48.487697 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.486781    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 30 20:24:48.487697 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.486784    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 30 20:24:48.487697 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.486787    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 30 20:24:48.487697 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.486789    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 30 20:24:48.487697 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.486792    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 30 20:24:48.487697 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.486794    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 30 20:24:48.487697 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.486797    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 30 20:24:48.487697 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.486800    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 30 20:24:48.487697 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.486804    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 30 20:24:48.487697 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.486807    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 30 20:24:48.487697 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.486810    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 30 20:24:48.487697 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.486812    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 30 20:24:48.487697 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.486815    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 30 20:24:48.487697 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.486818    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 30 20:24:48.487697 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.486821    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 30 20:24:48.487697 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.486824    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 30 20:24:48.487697 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.486826    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 30 20:24:48.487697 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.486829    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 30 20:24:48.487697 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.486832    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 30 20:24:48.487697 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.486835    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 30 20:24:48.488248 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.486837    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 30 20:24:48.488248 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.486840    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 30 20:24:48.488248 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.486842    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 30 20:24:48.488248 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.486845    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 30 20:24:48.488248 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.486847    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 30 20:24:48.488248 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.486849    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 30 20:24:48.488248 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.486852    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 30 20:24:48.488248 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.486854    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 30 20:24:48.488248 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.486857    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 30 20:24:48.488248 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.486859    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 30 20:24:48.488248 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.486861    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 30 20:24:48.488248 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.486864    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 30 20:24:48.488248 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.486866    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 30 20:24:48.488248 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.486868    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 30 20:24:48.488248 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.486871    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 30 20:24:48.488248 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.486874    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 30 20:24:48.488248 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.486877    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 30 20:24:48.488248 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.486879    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 30 20:24:48.488248 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.486883    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 30 20:24:48.488694 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.486886    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 30 20:24:48.488694 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.486888    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 30 20:24:48.488694 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.486890    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 30 20:24:48.488694 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.486893    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 30 20:24:48.488694 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.486895    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 30 20:24:48.488694 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.486898    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 30 20:24:48.488694 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.486902    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 30 20:24:48.488694 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.486906    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 30 20:24:48.488694 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.486909    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 30 20:24:48.488694 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.486912    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 30 20:24:48.488694 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.486915    2583 feature_gate.go:328] unrecognized feature gate: Example
Jul 30 20:24:48.488694 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.486918    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 30 20:24:48.488694 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.486920    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 30 20:24:48.488694 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.486923    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 30 20:24:48.488694 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.486926    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 30 20:24:48.488694 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.486928    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 30 20:24:48.488694 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.486931    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 30 20:24:48.488694 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.486933    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 30 20:24:48.488694 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.486936    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 30 20:24:48.488694 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.486938    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 30 20:24:48.489214 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.486941    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 30 20:24:48.489214 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.486943    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 30 20:24:48.489214 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.486946    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 30 20:24:48.489214 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.486948    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 30 20:24:48.489214 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.487653    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 30 20:24:48.489214 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.487659    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 30 20:24:48.489214 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.487662    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 30 20:24:48.489214 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.487665    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 30 20:24:48.489214 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.487668    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 30 20:24:48.489214 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.487671    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 30 20:24:48.489214 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.487674    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 30 20:24:48.489214 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.487676    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 30 20:24:48.489214 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.487679    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 30 20:24:48.489214 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.487682    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 30 20:24:48.489214 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.487684    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 30 20:24:48.489214 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.487687    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 30 20:24:48.489214 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.487690    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 30 20:24:48.489214 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.487692    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 30 20:24:48.489214 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.487695    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 30 20:24:48.489214 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.487698    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 30 20:24:48.489694 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.487701    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 30 20:24:48.489694 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.487703    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 30 20:24:48.489694 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.487706    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 30 20:24:48.489694 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.487708    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 30 20:24:48.489694 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.487712    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 30 20:24:48.489694 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.487716    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 30 20:24:48.489694 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.487720    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 30 20:24:48.489694 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.487723    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 30 20:24:48.489694 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.487726    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 30 20:24:48.489694 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.487728    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 30 20:24:48.489694 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.487731    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 30 20:24:48.489694 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.487733    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 30 20:24:48.489694 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.487736    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 30 20:24:48.489694 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.487738    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 30 20:24:48.489694 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.487741    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 30 20:24:48.489694 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.487743    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 30 20:24:48.489694 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.487746    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 30 20:24:48.489694 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.487748    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 30 20:24:48.489694 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.487751    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 30 20:24:48.490160 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.487753    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 30 20:24:48.490160 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.487755    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 30 20:24:48.490160 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.487758    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 30 20:24:48.490160 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.487761    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 30 20:24:48.490160 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.487763    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 30 20:24:48.490160 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.487766    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 30 20:24:48.490160 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.487768    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 30 20:24:48.490160 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.487771    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 30 20:24:48.490160 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.487775    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 30 20:24:48.490160 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.487779    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 30 20:24:48.490160 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.487781    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 30 20:24:48.490160 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.487783    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 30 20:24:48.490160 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.487786    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 30 20:24:48.490160 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.487790    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 30 20:24:48.490160 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.487792    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 30 20:24:48.490160 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.487795    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 30 20:24:48.490160 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.487797    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 30 20:24:48.490160 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.487800    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 30 20:24:48.490160 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.487802    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 30 20:24:48.490640 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.487807    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 30 20:24:48.490640 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.487809    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 30 20:24:48.490640 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.487812    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 30 20:24:48.490640 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.487814    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 30 20:24:48.490640 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.487816    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 30 20:24:48.490640 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.487820    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 30 20:24:48.490640 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.487824    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 30 20:24:48.490640 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.487827    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 30 20:24:48.490640 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.487829    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 30 20:24:48.490640 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.487832    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 30 20:24:48.490640 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.487835    2583 feature_gate.go:328] unrecognized feature gate: Example
Jul 30 20:24:48.490640 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.487838    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 30 20:24:48.490640 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.487840    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 30 20:24:48.490640 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.487843    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 30 20:24:48.490640 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.487845    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 30 20:24:48.490640 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.487848    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 30 20:24:48.490640 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.487851    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 30 20:24:48.490640 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.487854    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 30 20:24:48.490640 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.487857    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 30 20:24:48.490640 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.487860    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 30 20:24:48.491108 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.487862    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 30 20:24:48.491108 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.487865    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 30 20:24:48.491108 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.487867    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 30 20:24:48.491108 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.487870    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 30 20:24:48.491108 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.487872    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 30 20:24:48.491108 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.487875    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 30 20:24:48.491108 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.487878    2583 feature_gate.go:328] unrecognized feature gate: Example2
Jul 30 20:24:48.491108 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.487881    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 30 20:24:48.491108 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.487884    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 30 20:24:48.491108 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.487886    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 30 20:24:48.491108 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.487889    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 30 20:24:48.491108 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.487891    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 30 20:24:48.491108 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.487893    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 30 20:24:48.491108 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.487896    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 30 20:24:48.491108 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.487898    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 30 20:24:48.491108 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.487901    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 30 20:24:48.491108 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.487903    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 30 20:24:48.491108 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.487905    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 30 20:24:48.491108 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.487908    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 30 20:24:48.491108 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.487911    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 30 20:24:48.491631 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.487913    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 30 20:24:48.491631 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.487915    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 30 20:24:48.491631 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.487918    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 30 20:24:48.491631 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.487920    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 30 20:24:48.491631 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.487923    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 30 20:24:48.491631 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.488300    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 30 20:24:48.491631 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.488306    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 30 20:24:48.491631 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.488309    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 30 20:24:48.491631 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.488313    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 30 20:24:48.491631 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.488317    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 30 20:24:48.491631 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.488319    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 30 20:24:48.491631 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.488322    2583 feature_gate.go:328] unrecognized feature gate: Example2
Jul 30 20:24:48.491631 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.488324    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 30 20:24:48.491631 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.488327    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 30 20:24:48.491631 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.488330    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 30 20:24:48.491631 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.488333    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 30 20:24:48.491631 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.488336    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 30 20:24:48.491631 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.488338    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 30 20:24:48.491631 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.488342    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 30 20:24:48.491631 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.488344    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 30 20:24:48.492115 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.488347    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 30 20:24:48.492115 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.488349    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 30 20:24:48.492115 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.488352    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 30 20:24:48.492115 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.488354    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 30 20:24:48.492115 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.488356    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 30 20:24:48.492115 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.488358    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 30 20:24:48.492115 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.488361    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 30 20:24:48.492115 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.488364    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 30 20:24:48.492115 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.488366    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 30 20:24:48.492115 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.488369    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 30 20:24:48.492115 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.488372    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 30 20:24:48.492115 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.488374    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 30 20:24:48.492115 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.488377    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 30 20:24:48.492115 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.488379    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 30 20:24:48.492115 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.488382    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 30 20:24:48.492115 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.488385    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 30 20:24:48.492115 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.488387    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 30 20:24:48.492115 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.488390    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 30 20:24:48.492115 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.488392    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 30 20:24:48.492584 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.488397    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 30 20:24:48.492584 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.488401    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 30 20:24:48.492584 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.488404    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 30 20:24:48.492584 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.488408    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 30 20:24:48.492584 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.488411    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 30 20:24:48.492584 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.488413    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 30 20:24:48.492584 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.488416    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 30 20:24:48.492584 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.488418    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 30 20:24:48.492584 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.488421    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 30 20:24:48.492584 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.488424    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 30 20:24:48.492584 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.488426    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 30 20:24:48.492584 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.488429    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 30 20:24:48.492584 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.488431    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 30 20:24:48.492584 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.488434    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 30 20:24:48.492584 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.488436    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 30 20:24:48.492584 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.488439    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 30 20:24:48.492584 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.488441    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 30 20:24:48.492584 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.488443    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 30 20:24:48.492584 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.488446    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 30 20:24:48.493039 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.488448    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 30 20:24:48.493039 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.488450    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 30 20:24:48.493039 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.488453    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 30 20:24:48.493039 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.488456    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 30 20:24:48.493039 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.488458    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 30 20:24:48.493039 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.488461    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 30 20:24:48.493039 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.488463    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 30 20:24:48.493039 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.488466    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 30 20:24:48.493039 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.488469    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 30 20:24:48.493039 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.488472    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 30 20:24:48.493039 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.488474    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 30 20:24:48.493039 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.488477    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 30 20:24:48.493039 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.488480    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 30 20:24:48.493039 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.488482    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 30 20:24:48.493039 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.488484    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 30 20:24:48.493039 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.488487    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 30 20:24:48.493039 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.488490    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 30 20:24:48.493039 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.488494    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 30 20:24:48.493039 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.488497    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 30 20:24:48.493527 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.488500    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 30 20:24:48.493527 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.488502    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 30 20:24:48.493527 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.488505    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 30 20:24:48.493527 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.488508    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 30 20:24:48.493527 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.488511    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 30 20:24:48.493527 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.488513    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 30 20:24:48.493527 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.488516    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 30 20:24:48.493527 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.488519    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 30 20:24:48.493527 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.488521    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 30 20:24:48.493527 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.488523    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 30 20:24:48.493527 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.488526    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 30 20:24:48.493527 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.488528    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 30 20:24:48.493527 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.488531    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 30 20:24:48.493527 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.488533    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 30 20:24:48.493527 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.488535    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 30 20:24:48.493527 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.488538    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 30 20:24:48.493527 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.488540    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 30 20:24:48.493527 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.488543    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 30 20:24:48.493527 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.488546    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 30 20:24:48.493527 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.488548    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 30 20:24:48.493999 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.488551    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 30 20:24:48.493999 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.488554    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 30 20:24:48.493999 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.488556    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 30 20:24:48.493999 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.488558    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 30 20:24:48.493999 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.488561    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 30 20:24:48.493999 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.488563    2583 feature_gate.go:328] unrecognized feature gate: Example
Jul 30 20:24:48.493999 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.488566    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 30 20:24:48.493999 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.488627    2583 flags.go:64] FLAG: --address="0.0.0.0"
Jul 30 20:24:48.493999 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.488633    2583 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 30 20:24:48.493999 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.488639    2583 flags.go:64] FLAG: --anonymous-auth="true"
Jul 30 20:24:48.493999 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.488644    2583 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 30 20:24:48.493999 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.488649    2583 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 30 20:24:48.493999 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.488652    2583 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 30 20:24:48.493999 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.488656    2583 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 30 20:24:48.493999 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.488663    2583 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 30 20:24:48.493999 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.488666    2583 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 30 20:24:48.493999 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.488669    2583 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 30 20:24:48.493999 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.488672    2583 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 30 20:24:48.493999 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.488675    2583 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 30 20:24:48.493999 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.488678    2583 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 30 20:24:48.493999 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.488681    2583 flags.go:64] FLAG: --cgroup-root=""
Jul 30 20:24:48.493999 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.488684    2583 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 30 20:24:48.494545 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.488686    2583 flags.go:64] FLAG: --client-ca-file=""
Jul 30 20:24:48.494545 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.488689    2583 flags.go:64] FLAG: --cloud-provider="external"
Jul 30 20:24:48.494545 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.488692    2583 flags.go:64] FLAG: --cluster-dns="[]"
Jul 30 20:24:48.494545 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.488696    2583 flags.go:64] FLAG: --cluster-domain=""
Jul 30 20:24:48.494545 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.488699    2583 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 30 20:24:48.494545 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.488702    2583 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 30 20:24:48.494545 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.488705    2583 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 30 20:24:48.494545 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.488710    2583 flags.go:64] FLAG: --container-log-max-files="5"
Jul 30 20:24:48.494545 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.488713    2583 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 30 20:24:48.494545 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.488716    2583 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 30 20:24:48.494545 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.488720    2583 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 30 20:24:48.494545 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.488722    2583 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 30 20:24:48.494545 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.488725    2583 flags.go:64] FLAG: --contention-profiling="false"
Jul 30 20:24:48.494545 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.488728    2583 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 30 20:24:48.494545 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.488731    2583 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 30 20:24:48.494545 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.488733    2583 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 30 20:24:48.494545 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.488736    2583 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 30 20:24:48.494545 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.488740    2583 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 30 20:24:48.494545 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.488743    2583 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 30 20:24:48.494545 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.488746    2583 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 30 20:24:48.494545 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.488748    2583 flags.go:64] FLAG: --enable-load-reader="false"
Jul 30 20:24:48.494545 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.488751    2583 flags.go:64] FLAG: --enable-server="true"
Jul 30 20:24:48.494545 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.488754    2583 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 30 20:24:48.494545 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.488758    2583 flags.go:64] FLAG: --event-burst="100"
Jul 30 20:24:48.494545 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.488761    2583 flags.go:64] FLAG: --event-qps="50"
Jul 30 20:24:48.495158 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.488766    2583 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 30 20:24:48.495158 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.488769    2583 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 30 20:24:48.495158 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.488771    2583 flags.go:64] FLAG: --eviction-hard=""
Jul 30 20:24:48.495158 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.488775    2583 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 30 20:24:48.495158 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.488777    2583 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 30 20:24:48.495158 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.488780    2583 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 30 20:24:48.495158 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.488783    2583 flags.go:64] FLAG: --eviction-soft=""
Jul 30 20:24:48.495158 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.488786    2583 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 30 20:24:48.495158 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.488789    2583 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 30 20:24:48.495158 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.488791    2583 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 30 20:24:48.495158 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.488794    2583 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 30 20:24:48.495158 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.488797    2583 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 30 20:24:48.495158 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.488799    2583 flags.go:64] FLAG: --fail-swap-on="true"
Jul 30 20:24:48.495158 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.488802    2583 flags.go:64] FLAG: --feature-gates=""
Jul 30 20:24:48.495158 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.488807    2583 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 30 20:24:48.495158 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.488810    2583 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 30 20:24:48.495158 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.488813    2583 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 30 20:24:48.495158 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.488815    2583 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 30 20:24:48.495158 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.488818    2583 flags.go:64] FLAG: --healthz-port="10248"
Jul 30 20:24:48.495158 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.488821    2583 flags.go:64] FLAG: --help="false"
Jul 30 20:24:48.495158 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.488824    2583 flags.go:64] FLAG: --hostname-override="ip-10-0-142-69.ec2.internal"
Jul 30 20:24:48.495158 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.488827    2583 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 30 20:24:48.495158 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.488829    2583 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 30 20:24:48.495158 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.488832    2583 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 30 20:24:48.495799 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.488835    2583 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 30 20:24:48.495799 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.488839    2583 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 30 20:24:48.495799 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.488841    2583 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 30 20:24:48.495799 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.488844    2583 flags.go:64] FLAG: --image-service-endpoint=""
Jul 30 20:24:48.495799 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.488847    2583 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 30 20:24:48.495799 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.488850    2583 flags.go:64] FLAG: --kube-api-burst="100"
Jul 30 20:24:48.495799 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.488853    2583 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 30 20:24:48.495799 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.488856    2583 flags.go:64] FLAG: --kube-api-qps="50"
Jul 30 20:24:48.495799 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.488860    2583 flags.go:64] FLAG: --kube-reserved=""
Jul 30 20:24:48.495799 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.488863    2583 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 30 20:24:48.495799 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.488866    2583 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 30 20:24:48.495799 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.488869    2583 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 30 20:24:48.495799 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.488871    2583 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 30 20:24:48.495799 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.488874    2583 flags.go:64] FLAG: --lock-file=""
Jul 30 20:24:48.495799 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.488876    2583 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 30 20:24:48.495799 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.488879    2583 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 30 20:24:48.495799 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.488882    2583 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 30 20:24:48.495799 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.488887    2583 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 30 20:24:48.495799 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.488889    2583 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 30 20:24:48.495799 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.488892    2583 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 30 20:24:48.495799 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.488894    2583 flags.go:64] FLAG: --logging-format="text"
Jul 30 20:24:48.495799 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.488897    2583 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 30 20:24:48.495799 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.488901    2583 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 30 20:24:48.495799 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.488904    2583 flags.go:64] FLAG: --manifest-url=""
Jul 30 20:24:48.496400 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.488907    2583 flags.go:64] FLAG: --manifest-url-header=""
Jul 30 20:24:48.496400 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.488911    2583 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 30 20:24:48.496400 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.488913    2583 flags.go:64] FLAG: --max-open-files="1000000"
Jul 30 20:24:48.496400 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.488917    2583 flags.go:64] FLAG: --max-pods="110"
Jul 30 20:24:48.496400 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.488920    2583 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 30 20:24:48.496400 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.488923    2583 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 30 20:24:48.496400 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.488925    2583 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 30 20:24:48.496400 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.488928    2583 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 30 20:24:48.496400 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.488931    2583 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 30 20:24:48.496400 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.488934    2583 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 30 20:24:48.496400 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.488936    2583 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 30 20:24:48.496400 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.488942    2583 flags.go:64] FLAG: --node-status-max-images="50"
Jul 30 20:24:48.496400 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.488945    2583 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 30 20:24:48.496400 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.488948    2583 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 30 20:24:48.496400 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.488951    2583 flags.go:64] FLAG: --pod-cidr=""
Jul 30 20:24:48.496400 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.488954    2583 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:267c8c33005f5dc3d4121af550b1c396e30e2928a13624d7362adfbfb7f440f8"
Jul 30 20:24:48.496400 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.488962    2583 flags.go:64] FLAG: --pod-manifest-path=""
Jul 30 20:24:48.496400 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.488964    2583 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 30 20:24:48.496400 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.488967    2583 flags.go:64] FLAG: --pods-per-core="0"
Jul 30 20:24:48.496400 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.488970    2583 flags.go:64] FLAG: --port="10250"
Jul 30 20:24:48.496400 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.488973    2583 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 30 20:24:48.496400 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.488975    2583 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-09c036a7e3e8a4597"
Jul 30 20:24:48.496400 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.488978    2583 flags.go:64] FLAG: --qos-reserved=""
Jul 30 20:24:48.496400 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.488981    2583 flags.go:64] FLAG: --read-only-port="10255"
Jul 30 20:24:48.496975 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.488984    2583 flags.go:64] FLAG: --register-node="true"
Jul 30 20:24:48.496975 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.488986    2583 flags.go:64] FLAG: --register-with-taints=""
Jul 30 20:24:48.496975 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.488990    2583 flags.go:64] FLAG: --registry-burst="10"
Jul 30 20:24:48.496975 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.488993    2583 flags.go:64] FLAG: --registry-qps="5"
Jul 30 20:24:48.496975 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.488995    2583 flags.go:64] FLAG: --reserved-cpus=""
Jul 30 20:24:48.496975 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.488998    2583 flags.go:64] FLAG: --reserved-memory=""
Jul 30 20:24:48.496975 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.489001    2583 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 30 20:24:48.496975 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.489006    2583 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 30 20:24:48.496975 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.489009    2583 flags.go:64] FLAG: --rotate-certificates="false"
Jul 30 20:24:48.496975 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.489011    2583 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 30 20:24:48.496975 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.489014    2583 flags.go:64] FLAG: --runonce="false"
Jul 30 20:24:48.496975 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.489017    2583 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 30 20:24:48.496975 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.489020    2583 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 30 20:24:48.496975 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.489023    2583 flags.go:64] FLAG: --seccomp-default="false"
Jul 30 20:24:48.496975 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.489025    2583 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 30 20:24:48.496975 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.489028    2583 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 30 20:24:48.496975 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.489031    2583 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 30 20:24:48.496975 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.489034    2583 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 30 20:24:48.496975 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.489037    2583 flags.go:64] FLAG: --storage-driver-password="root"
Jul 30 20:24:48.496975 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.489040    2583 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 30 20:24:48.496975 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.489042    2583 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 30 20:24:48.496975 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.489045    2583 flags.go:64] FLAG: --storage-driver-user="root"
Jul 30 20:24:48.496975 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.489048    2583 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 30 20:24:48.496975 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.489051    2583 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 30 20:24:48.496975 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.489055    2583 flags.go:64] FLAG: --system-cgroups=""
Jul 30 20:24:48.497608 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.489058    2583 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 30 20:24:48.497608 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.489063    2583 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 30 20:24:48.497608 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.489066    2583 flags.go:64] FLAG: --tls-cert-file=""
Jul 30 20:24:48.497608 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.489068    2583 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 30 20:24:48.497608 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.489072    2583 flags.go:64] FLAG: --tls-min-version=""
Jul 30 20:24:48.497608 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.489075    2583 flags.go:64] FLAG: --tls-private-key-file=""
Jul 30 20:24:48.497608 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.489077    2583 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 30 20:24:48.497608 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.489080    2583 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 30 20:24:48.497608 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.489083    2583 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 30 20:24:48.497608 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.489086    2583 flags.go:64] FLAG: --v="2"
Jul 30 20:24:48.497608 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.489089    2583 flags.go:64] FLAG: --version="false"
Jul 30 20:24:48.497608 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.489093    2583 flags.go:64] FLAG: --vmodule=""
Jul 30 20:24:48.497608 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.489096    2583 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 30 20:24:48.497608 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.489108    2583 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 30 20:24:48.497608 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.489231    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 30 20:24:48.497608 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.489235    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 30 20:24:48.497608 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.489238    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 30 20:24:48.497608 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.489241    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 30 20:24:48.497608 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.489244    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 30 20:24:48.497608 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.489247    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 30 20:24:48.497608 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.489249    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 30 20:24:48.497608 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.489252    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 30 20:24:48.497608 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.489255    2583 feature_gate.go:328] unrecognized feature gate: Example
Jul 30 20:24:48.498179 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.489257    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 30 20:24:48.498179 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.489260    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 30 20:24:48.498179 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.489264    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 30 20:24:48.498179 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.489267    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 30 20:24:48.498179 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.489270    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 30 20:24:48.498179 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.489273    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 30 20:24:48.498179 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.489276    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 30 20:24:48.498179 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.489278    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 30 20:24:48.498179 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.489282    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 30 20:24:48.498179 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.489286    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 30 20:24:48.498179 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.489288    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 30 20:24:48.498179 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.489291    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 30 20:24:48.498179 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.489293    2583 feature_gate.go:328] unrecognized feature gate: Example2
Jul 30 20:24:48.498179 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.489296    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 30 20:24:48.498179 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.489298    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 30 20:24:48.498179 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.489301    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 30 20:24:48.498179 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.489303    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 30 20:24:48.498179 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.489306    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 30 20:24:48.498179 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.489308    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 30 20:24:48.498179 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.489311    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 30 20:24:48.498658 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.489313    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 30 20:24:48.498658 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.489316    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 30 20:24:48.498658 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.489318    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 30 20:24:48.498658 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.489321    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 30 20:24:48.498658 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.489323    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 30 20:24:48.498658 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.489326    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 30 20:24:48.498658 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.489328    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 30 20:24:48.498658 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.489331    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 30 20:24:48.498658 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.489333    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 30 20:24:48.498658 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.489335    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 30 20:24:48.498658 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.489338    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 30 20:24:48.498658 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.489340    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 30 20:24:48.498658 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.489343    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 30 20:24:48.498658 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.489345    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 30 20:24:48.498658 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.489348    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 30 20:24:48.498658 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.489350    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 30 20:24:48.498658 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.489352    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 30 20:24:48.498658 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.489355    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 30 20:24:48.498658 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.489357    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 30 20:24:48.499124 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.489359    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 30 20:24:48.499124 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.489363    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 30 20:24:48.499124 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.489365    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 30 20:24:48.499124 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.489368    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 30 20:24:48.499124 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.489371    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 30 20:24:48.499124 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.489373    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 30 20:24:48.499124 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.489375    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 30 20:24:48.499124 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.489378    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 30 20:24:48.499124 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.489380    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 30 20:24:48.499124 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.489384    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 30 20:24:48.499124 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.489387    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 30 20:24:48.499124 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.489390    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 30 20:24:48.499124 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.489392    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 30 20:24:48.499124 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.489395    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 30 20:24:48.499124 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.489397    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 30 20:24:48.499124 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.489400    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 30 20:24:48.499124 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.489402    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 30 20:24:48.499124 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.489405    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 30 20:24:48.499124 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.489407    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 30 20:24:48.499627 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.489410    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 30 20:24:48.499627 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.489412    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 30 20:24:48.499627 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.489415    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 30 20:24:48.499627 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.489417    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 30 20:24:48.499627 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.489419    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 30 20:24:48.499627 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.489422    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 30 20:24:48.499627 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.489424    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 30 20:24:48.499627 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.489427    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 30 20:24:48.499627 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.489429    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 30 20:24:48.499627 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.489431    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 30 20:24:48.499627 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.489434    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 30 20:24:48.499627 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.489436    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 30 20:24:48.499627 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.489439    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 30 20:24:48.499627 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.489441    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 30 20:24:48.499627 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.489446    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 30 20:24:48.499627 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.489448    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 30 20:24:48.499627 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.489452    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 30 20:24:48.499627 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.489456    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 30 20:24:48.499627 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.489458    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 30 20:24:48.500114 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.489460    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 30 20:24:48.500114 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.489463    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 30 20:24:48.500114 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.489465    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 30 20:24:48.500114 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.489468    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 30 20:24:48.500114 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.489470    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 30 20:24:48.500114 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.489472    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 30 20:24:48.500114 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.489475    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 30 20:24:48.500114 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.489478    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 30 20:24:48.500114 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.489480    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 30 20:24:48.500114 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.489482    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 30 20:24:48.500114 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.489485    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 30 20:24:48.500114 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.489487    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 30 20:24:48.500114 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.489490    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 30 20:24:48.500114 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.489495    2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 30 20:24:48.500114 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.497227    2583 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 30 20:24:48.500669 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.497241    2583 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 30 20:24:48.500669 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.497260    2583 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 30 20:24:48.500669 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.497265    2583 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 30 20:24:48.500669 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497330    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 30 20:24:48.500669 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497335    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 30 20:24:48.500669 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497339    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 30 20:24:48.500669 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497342    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 30 20:24:48.500669 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497345    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 30 20:24:48.500669 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497349    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 30 20:24:48.500669 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497352    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 30 20:24:48.500669 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497355    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 30 20:24:48.500669 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497358    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 30 20:24:48.500669 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497361    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 30 20:24:48.500669 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497363    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 30 20:24:48.500669 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497366    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 30 20:24:48.500669 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497369    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 30 20:24:48.500669 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497372    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 30 20:24:48.500669 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497374    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 30 20:24:48.500669 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497377    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 30 20:24:48.501328 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497380    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 30 20:24:48.501328 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497382    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 30 20:24:48.501328 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497385    2583 feature_gate.go:328] unrecognized feature gate: Example2
Jul 30 20:24:48.501328 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497387    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 30 20:24:48.501328 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497389    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 30 20:24:48.501328 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497392    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 30 20:24:48.501328 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497394    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 30 20:24:48.501328 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497397    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 30 20:24:48.501328 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497400    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 30 20:24:48.501328 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497402    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 30 20:24:48.501328 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497405    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 30 20:24:48.501328 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497408    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 30 20:24:48.501328 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497411    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 30 20:24:48.501328 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497413    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 30 20:24:48.501328 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497416    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 30 20:24:48.501328 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497418    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 30 20:24:48.501328 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497421    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 30 20:24:48.501328 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497423    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 30 20:24:48.501328 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497425    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 30 20:24:48.501328 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497428    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 30 20:24:48.501819 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497431    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 30 20:24:48.501819 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497433    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 30 20:24:48.501819 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497435    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 30 20:24:48.501819 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497438    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 30 20:24:48.501819 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497440    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 30 20:24:48.501819 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497442    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 30 20:24:48.501819 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497445    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 30 20:24:48.501819 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497447    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 30 20:24:48.501819 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497450    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 30 20:24:48.501819 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497452    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 30 20:24:48.501819 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497455    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 30 20:24:48.501819 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497457    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 30 20:24:48.501819 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497461    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 30 20:24:48.501819 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497465    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 30 20:24:48.501819 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497468    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 30 20:24:48.501819 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497470    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 30 20:24:48.501819 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497472    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 30 20:24:48.501819 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497475    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 30 20:24:48.501819 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497477    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 30 20:24:48.501819 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497479    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 30 20:24:48.502335 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497482    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 30 20:24:48.502335 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497485    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 30 20:24:48.502335 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497487    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 30 20:24:48.502335 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497489    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 30 20:24:48.502335 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497492    2583 feature_gate.go:328] unrecognized feature gate: Example
Jul 30 20:24:48.502335 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497494    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 30 20:24:48.502335 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497497    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 30 20:24:48.502335 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497499    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 30 20:24:48.502335 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497502    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 30 20:24:48.502335 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497504    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 30 20:24:48.502335 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497506    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 30 20:24:48.502335 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497509    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 30 20:24:48.502335 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497511    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 30 20:24:48.502335 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497513    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 30 20:24:48.502335 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497516    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 30 20:24:48.502335 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497518    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 30 20:24:48.502335 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497521    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 30 20:24:48.502335 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497523    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 30 20:24:48.502335 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497525    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 30 20:24:48.502335 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497528    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 30 20:24:48.502915 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497530    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 30 20:24:48.502915 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497532    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 30 20:24:48.502915 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497535    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 30 20:24:48.502915 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497537    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 30 20:24:48.502915 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497540    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 30 20:24:48.502915 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497542    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 30 20:24:48.502915 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497546    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 30 20:24:48.502915 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497550    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 30 20:24:48.502915 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497553    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 30 20:24:48.502915 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497555    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 30 20:24:48.502915 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497558    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 30 20:24:48.502915 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497561    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 30 20:24:48.502915 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497563    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 30 20:24:48.502915 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497566    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 30 20:24:48.502915 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497568    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 30 20:24:48.502915 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497571    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 30 20:24:48.502915 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497574    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 30 20:24:48.502915 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497577    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 30 20:24:48.502915 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497581    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 30 20:24:48.503426 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497583    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 30 20:24:48.503426 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497586    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 30 20:24:48.503426 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497589    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 30 20:24:48.503426 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497591    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 30 20:24:48.503426 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.497596    2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 30 20:24:48.503426 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497703    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 30 20:24:48.503426 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497708    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 30 20:24:48.503426 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497711    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 30 20:24:48.503426 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497714    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 30 20:24:48.503426 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497718    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 30 20:24:48.503426 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497721    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 30 20:24:48.503426 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497724    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 30 20:24:48.503426 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497727    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 30 20:24:48.503426 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497730    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 30 20:24:48.503762 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497732    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 30 20:24:48.503762 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497735    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 30 20:24:48.503762 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497738    2583 feature_gate.go:328] unrecognized feature gate: Example
Jul 30 20:24:48.503762 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497740    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 30 20:24:48.503762 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497743    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 30 20:24:48.503762 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497746    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 30 20:24:48.503762 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497748    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 30 20:24:48.503762 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497751    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 30 20:24:48.503762 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497753    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 30 20:24:48.503762 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497756    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 30 20:24:48.503762 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497758    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 30 20:24:48.503762 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497760    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 30 20:24:48.503762 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497763    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 30 20:24:48.503762 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497765    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 30 20:24:48.503762 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497769    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 30 20:24:48.503762 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497772    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 30 20:24:48.503762 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497776    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 30 20:24:48.503762 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497778    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 30 20:24:48.503762 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497781    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 30 20:24:48.504335 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497783    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 30 20:24:48.504335 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497786    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 30 20:24:48.504335 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497788    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 30 20:24:48.504335 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497790    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 30 20:24:48.504335 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497793    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 30 20:24:48.504335 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497795    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 30 20:24:48.504335 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497798    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 30 20:24:48.504335 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497800    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 30 20:24:48.504335 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497802    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 30 20:24:48.504335 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497805    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 30 20:24:48.504335 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497807    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 30 20:24:48.504335 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497809    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 30 20:24:48.504335 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497812    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 30 20:24:48.504335 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497814    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 30 20:24:48.504335 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497816    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 30 20:24:48.504335 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497819    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 30 20:24:48.504335 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497822    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 30 20:24:48.504335 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497824    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 30 20:24:48.504335 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497826    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 30 20:24:48.504335 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497829    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 30 20:24:48.504854 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497832    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 30 20:24:48.504854 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497834    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 30 20:24:48.504854 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497837    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 30 20:24:48.504854 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497839    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 30 20:24:48.504854 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497841    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 30 20:24:48.504854 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497843    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 30 20:24:48.504854 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497846    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 30 20:24:48.504854 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497848    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 30 20:24:48.504854 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497851    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 30 20:24:48.504854 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497854    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 30 20:24:48.504854 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497857    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 30 20:24:48.504854 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497859    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 30 20:24:48.504854 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497862    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 30 20:24:48.504854 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497864    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 30 20:24:48.504854 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497867    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 30 20:24:48.504854 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497869    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 30 20:24:48.504854 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497872    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 30 20:24:48.504854 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497874    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 30 20:24:48.504854 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497876    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 30 20:24:48.505340 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497879    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 30 20:24:48.505340 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497882    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 30 20:24:48.505340 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497884    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 30 20:24:48.505340 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497886    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 30 20:24:48.505340 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497889    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 30 20:24:48.505340 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497891    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 30 20:24:48.505340 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497894    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 30 20:24:48.505340 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497896    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 30 20:24:48.505340 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497898    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 30 20:24:48.505340 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497901    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 30 20:24:48.505340 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497904    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 30 20:24:48.505340 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497906    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 30 20:24:48.505340 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497911    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 30 20:24:48.505340 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497913    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 30 20:24:48.505340 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497916    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 30 20:24:48.505340 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497918    2583 feature_gate.go:328] unrecognized feature gate: Example2
Jul 30 20:24:48.505340 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497921    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 30 20:24:48.505340 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497923    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 30 20:24:48.505340 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497926    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 30 20:24:48.505340 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497928    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 30 20:24:48.505800 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497931    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 30 20:24:48.505800 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497933    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 30 20:24:48.505800 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497936    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 30 20:24:48.505800 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497938    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 30 20:24:48.505800 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497941    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 30 20:24:48.505800 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497943    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 30 20:24:48.505800 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497945    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 30 20:24:48.505800 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497948    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 30 20:24:48.505800 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497950    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 30 20:24:48.505800 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497953    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 30 20:24:48.505800 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497955    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 30 20:24:48.505800 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:48.497958    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 30 20:24:48.505800 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.497963    2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 30 20:24:48.505800 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.498048    2583 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 30 20:24:48.506151 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.503755    2583 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 30 20:24:48.506151 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.506084    2583 server.go:1019] "Starting client certificate rotation"
Jul 30 20:24:48.506210 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.506170    2583 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 30 20:24:48.506210 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.506202    2583 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 30 20:24:48.509200 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.509188    2583 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 30 20:24:48.510276 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.510257    2583 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 30 20:24:48.520498 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.520476    2583 log.go:25] "Validated CRI v1 runtime API"
Jul 30 20:24:48.523530 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.523511    2583 log.go:25] "Validated CRI v1 image API"
Jul 30 20:24:48.524263 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.524249    2583 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 30 20:24:48.527646 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.527629    2583 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 8ed9f5e5-89fb-4489-a1af-bf69f4fbdd82:/dev/nvme0n1p3 cc69904e-c0eb-4405-8ed2-9a9a3a62e4fb:/dev/nvme0n1p4]
Jul 30 20:24:48.527703 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.527647    2583 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 30 20:24:48.533284 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.533176    2583 manager.go:216] Machine: {Timestamp:2026-07-30 20:24:48.532128373 +0000 UTC m=+0.373603986 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3115160 MemoryCapacity:32812171264 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec24f26e6fefb8fa0d333a55f575497e SystemUUID:ec24f26e-6fef-b8fa-0d33-3a55f575497e BootID:8211e673-ce83-48c0-9f06-e24494d95d63 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:3c:d1:69:5e:13 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:3c:d1:69:5e:13 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:52:33:54:6b:89:ab Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812171264 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 30 20:24:48.533284 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.533279    2583 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 30 20:24:48.533396 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.533347    2583 manager.go:232] Version: {KernelVersion:5.14.0-570.131.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260727-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 30 20:24:48.534948 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.534932    2583 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 30 20:24:48.536845 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.536825    2583 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 30 20:24:48.536978 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.536849    2583 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-69.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 30 20:24:48.537526 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.537516    2583 topology_manager.go:138] "Creating topology manager with none policy"
Jul 30 20:24:48.537557 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.537537    2583 container_manager_linux.go:309] "Creating device plugin manager"
Jul 30 20:24:48.537557 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.537545    2583 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 30 20:24:48.538333 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.538323    2583 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 30 20:24:48.539009 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.539001    2583 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 30 20:24:48.542458 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.542448    2583 state_mem.go:36] "Initialized new in-memory state store"
Jul 30 20:24:48.542578 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.542570    2583 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 30 20:24:48.542606 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.542597    2583 kubelet.go:486] "Attempting to sync node with API server"
Jul 30 20:24:48.542638 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.542612    2583 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 30 20:24:48.542638 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.542629    2583 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 30 20:24:48.542638 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.542637    2583 kubelet.go:398] "Adding apiserver pod source"
Jul 30 20:24:48.542742 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.542660    2583 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 30 20:24:48.543174 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.543161    2583 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 30 20:24:48.543220 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.543210    2583 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 30 20:24:48.549710 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.549693    2583 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 30 20:24:48.552328 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.552310    2583 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 30 20:24:48.552419 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.552349    2583 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 30 20:24:48.553656 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.553636    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 30 20:24:48.553656 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:24:48.553645    2583 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-69.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 30 20:24:48.553774 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.553683    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 30 20:24:48.553774 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.553699    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 30 20:24:48.553774 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.553716    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 30 20:24:48.553774 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.553730    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 30 20:24:48.553774 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.553773    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 30 20:24:48.553946 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:24:48.553694    2583 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 30 20:24:48.553946 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.553819    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 30 20:24:48.554062 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.554049    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 30 20:24:48.554114 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.554067    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 30 20:24:48.554114 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.554076    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 30 20:24:48.554114 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.554090    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 30 20:24:48.554114 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.554098    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 30 20:24:48.555312 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.555300    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 30 20:24:48.555312 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.555312    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 30 20:24:48.557337 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.557321    2583 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-69.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 30 20:24:48.558219 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.558207    2583 server.go:1268] "Started kubelet"
Jul 30 20:24:48.558355 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.558316    2583 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 30 20:24:48.558421 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.558283    2583 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 30 20:24:48.558421 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.558379    2583 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 30 20:24:48.558963 ip-10-0-142-69 systemd[1]: Started Kubernetes Kubelet.
Jul 30 20:24:48.559951 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.559926    2583 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 30 20:24:48.561462 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.561445    2583 server.go:310] "Adding debug handlers to kubelet server"
Jul 30 20:24:48.564843 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:24:48.564824    2583 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 30 20:24:48.566247 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.566227    2583 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 30 20:24:48.566345 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:24:48.566325    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-69.ec2.internal\" not found"
Jul 30 20:24:48.566463 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.566233    2583 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 30 20:24:48.567056 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.567015    2583 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 30 20:24:48.567056 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.567036    2583 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 30 20:24:48.567056 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.567015    2583 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 30 20:24:48.567400 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.567119    2583 reconstruct.go:97] "Volume reconstruction finished"
Jul 30 20:24:48.567400 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.567127    2583 reconciler.go:29] "Reconciler: start to sync state"
Jul 30 20:24:48.567400 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.567230    2583 factory.go:55] Registering systemd factory
Jul 30 20:24:48.567400 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.567267    2583 factory.go:223] Registration of the systemd container factory successfully
Jul 30 20:24:48.567562 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.567460    2583 factory.go:153] Registering CRI-O factory
Jul 30 20:24:48.567562 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.567475    2583 factory.go:223] Registration of the crio container factory successfully
Jul 30 20:24:48.567562 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.567518    2583 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 30 20:24:48.567562 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.567538    2583 factory.go:103] Registering Raw factory
Jul 30 20:24:48.567562 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.567549    2583 manager.go:1196] Started watching for new ooms in manager
Jul 30 20:24:48.568438 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.568419    2583 manager.go:349] Starting recovery of all containers
Jul 30 20:24:48.570554 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:24:48.570502    2583 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 30 20:24:48.570554 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:24:48.570505    2583 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-69.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 30 20:24:48.571896 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:24:48.570866    2583 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-69.ec2.internal.18c72b07842fc69e  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-69.ec2.internal,UID:ip-10-0-142-69.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-69.ec2.internal,},FirstTimestamp:2026-07-30 20:24:48.558179998 +0000 UTC m=+0.399655611,LastTimestamp:2026-07-30 20:24:48.558179998 +0000 UTC m=+0.399655611,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-69.ec2.internal,}"
Jul 30 20:24:48.579678 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.579655    2583 manager.go:354] Recovery completed
Jul 30 20:24:48.581392 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.581372    2583 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jf5gk"
Jul 30 20:24:48.584685 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.584668    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 30 20:24:48.586329 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.586313    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-69.ec2.internal" event="NodeHasSufficientMemory"
Jul 30 20:24:48.586393 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.586345    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-69.ec2.internal" event="NodeHasNoDiskPressure"
Jul 30 20:24:48.586393 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.586356    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-69.ec2.internal" event="NodeHasSufficientPID"
Jul 30 20:24:48.586811 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.586798    2583 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 30 20:24:48.586811 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.586811    2583 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 30 20:24:48.586897 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.586824    2583 state_mem.go:36] "Initialized new in-memory state store"
Jul 30 20:24:48.586897 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.586853    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 30 20:24:48.587663 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.587646    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-69.ec2.internal" event="NodeHasSufficientMemory"
Jul 30 20:24:48.587734 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.587681    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-69.ec2.internal" event="NodeHasNoDiskPressure"
Jul 30 20:24:48.587734 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.587695    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-69.ec2.internal" event="NodeHasSufficientPID"
Jul 30 20:24:48.587881 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.587839    2583 policy_none.go:49] "None policy: Start"
Jul 30 20:24:48.587881 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.587854    2583 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 30 20:24:48.587881 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.587868    2583 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 30 20:24:48.588447 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.588427    2583 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jf5gk"
Jul 30 20:24:48.588525 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:24:48.588441    2583 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-69.ec2.internal.18c72b0785dd5130  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-69.ec2.internal,UID:ip-10-0-142-69.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-142-69.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-142-69.ec2.internal,},FirstTimestamp:2026-07-30 20:24:48.586330416 +0000 UTC m=+0.427806032,LastTimestamp:2026-07-30 20:24:48.586330416 +0000 UTC m=+0.427806032,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-69.ec2.internal,}"
Jul 30 20:24:48.589385 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.589372    2583 policy_none.go:47] "Start"
Jul 30 20:24:48.627816 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.627707    2583 manager.go:337] "Starting Device Plugin manager"
Jul 30 20:24:48.635639 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:24:48.627836    2583 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 30 20:24:48.635639 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.627849    2583 server.go:87] "Starting device plugin registration server"
Jul 30 20:24:48.635639 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.628081    2583 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 30 20:24:48.635639 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.628092    2583 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 30 20:24:48.635639 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.628200    2583 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 30 20:24:48.635639 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.628274    2583 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 30 20:24:48.635639 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.628285    2583 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 30 20:24:48.635639 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:24:48.628764    2583 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 30 20:24:48.635639 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:24:48.628829    2583 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-69.ec2.internal\" not found"
Jul 30 20:24:48.667528 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.667504    2583 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 30 20:24:48.668884 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.668869    2583 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 30 20:24:48.668947 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.668904    2583 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 30 20:24:48.668947 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.668920    2583 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 30 20:24:48.669017 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:24:48.668952    2583 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 30 20:24:48.671549 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.671531    2583 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 30 20:24:48.728421 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.728393    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 30 20:24:48.729162 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.729128    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-69.ec2.internal" event="NodeHasSufficientMemory"
Jul 30 20:24:48.729220 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.729177    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-69.ec2.internal" event="NodeHasNoDiskPressure"
Jul 30 20:24:48.729220 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.729192    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-69.ec2.internal" event="NodeHasSufficientPID"
Jul 30 20:24:48.729279 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.729222    2583 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-69.ec2.internal"
Jul 30 20:24:48.738802 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.738764    2583 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-69.ec2.internal"
Jul 30 20:24:48.738802 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:24:48.738785    2583 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-69.ec2.internal\": node \"ip-10-0-142-69.ec2.internal\" not found"
Jul 30 20:24:48.766118 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:24:48.766100    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-69.ec2.internal\" not found"
Jul 30 20:24:48.769338 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.769322    2583 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-69.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-69.ec2.internal"]
Jul 30 20:24:48.769391 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.769376    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 30 20:24:48.770019 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.770007    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-69.ec2.internal" event="NodeHasSufficientMemory"
Jul 30 20:24:48.770065 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.770032    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-69.ec2.internal" event="NodeHasNoDiskPressure"
Jul 30 20:24:48.770065 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.770041    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-69.ec2.internal" event="NodeHasSufficientPID"
Jul 30 20:24:48.771108 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.771095    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 30 20:24:48.771235 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.771222    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-69.ec2.internal"
Jul 30 20:24:48.771274 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.771254    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 30 20:24:48.771726 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.771712    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-69.ec2.internal" event="NodeHasSufficientMemory"
Jul 30 20:24:48.771806 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.771731    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-69.ec2.internal" event="NodeHasNoDiskPressure"
Jul 30 20:24:48.771806 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.771740    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-69.ec2.internal" event="NodeHasSufficientPID"
Jul 30 20:24:48.771806 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.771785    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-69.ec2.internal" event="NodeHasSufficientMemory"
Jul 30 20:24:48.771806 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.771801    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-69.ec2.internal" event="NodeHasNoDiskPressure"
Jul 30 20:24:48.771953 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.771810    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-69.ec2.internal" event="NodeHasSufficientPID"
Jul 30 20:24:48.772832 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.772817    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-69.ec2.internal"
Jul 30 20:24:48.772891 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.772850    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 30 20:24:48.773559 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.773541    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-69.ec2.internal" event="NodeHasSufficientMemory"
Jul 30 20:24:48.773653 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.773570    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-69.ec2.internal" event="NodeHasNoDiskPressure"
Jul 30 20:24:48.773653 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.773580    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-69.ec2.internal" event="NodeHasSufficientPID"
Jul 30 20:24:48.801653 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:24:48.801632    2583 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-69.ec2.internal\" not found" node="ip-10-0-142-69.ec2.internal"
Jul 30 20:24:48.805805 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:24:48.805790    2583 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-69.ec2.internal\" not found" node="ip-10-0-142-69.ec2.internal"
Jul 30 20:24:48.867176 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:24:48.867152    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-69.ec2.internal\" not found"
Jul 30 20:24:48.869373 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.869357    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/080196fcbe11403b01fd40375d60e083-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-69.ec2.internal\" (UID: \"080196fcbe11403b01fd40375d60e083\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-69.ec2.internal"
Jul 30 20:24:48.869423 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.869382    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/080196fcbe11403b01fd40375d60e083-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-69.ec2.internal\" (UID: \"080196fcbe11403b01fd40375d60e083\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-69.ec2.internal"
Jul 30 20:24:48.869423 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.869400    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2601b49689453982163e65b62bf2dbc3-config\") pod \"kube-apiserver-proxy-ip-10-0-142-69.ec2.internal\" (UID: \"2601b49689453982163e65b62bf2dbc3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-69.ec2.internal"
Jul 30 20:24:48.967335 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:24:48.967302    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-69.ec2.internal\" not found"
Jul 30 20:24:48.970537 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.970519    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/080196fcbe11403b01fd40375d60e083-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-69.ec2.internal\" (UID: \"080196fcbe11403b01fd40375d60e083\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-69.ec2.internal"
Jul 30 20:24:48.970616 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.970567    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/080196fcbe11403b01fd40375d60e083-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-69.ec2.internal\" (UID: \"080196fcbe11403b01fd40375d60e083\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-69.ec2.internal"
Jul 30 20:24:48.970616 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.970605    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2601b49689453982163e65b62bf2dbc3-config\") pod \"kube-apiserver-proxy-ip-10-0-142-69.ec2.internal\" (UID: \"2601b49689453982163e65b62bf2dbc3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-69.ec2.internal"
Jul 30 20:24:48.970714 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.970629    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/080196fcbe11403b01fd40375d60e083-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-69.ec2.internal\" (UID: \"080196fcbe11403b01fd40375d60e083\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-69.ec2.internal"
Jul 30 20:24:48.970714 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.970672    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/080196fcbe11403b01fd40375d60e083-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-69.ec2.internal\" (UID: \"080196fcbe11403b01fd40375d60e083\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-69.ec2.internal"
Jul 30 20:24:48.970714 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:48.970695    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2601b49689453982163e65b62bf2dbc3-config\") pod \"kube-apiserver-proxy-ip-10-0-142-69.ec2.internal\" (UID: \"2601b49689453982163e65b62bf2dbc3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-69.ec2.internal"
Jul 30 20:24:49.068044 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:24:49.067993    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-69.ec2.internal\" not found"
Jul 30 20:24:49.104332 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:49.104311    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-69.ec2.internal"
Jul 30 20:24:49.108628 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:49.108426    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-69.ec2.internal"
Jul 30 20:24:49.168484 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:24:49.168460    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-69.ec2.internal\" not found"
Jul 30 20:24:49.268960 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:24:49.268929    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-69.ec2.internal\" not found"
Jul 30 20:24:49.369470 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:24:49.369398    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-69.ec2.internal\" not found"
Jul 30 20:24:49.470081 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:24:49.470051    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-69.ec2.internal\" not found"
Jul 30 20:24:49.488655 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:49.488635    2583 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 30 20:24:49.504474 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:49.504452    2583 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 30 20:24:49.504581 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:49.504561    2583 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 30 20:24:49.504620 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:49.504563    2583 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 30 20:24:49.548128 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:49.548105    2583 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 30 20:24:49.570591 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:24:49.570572    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-69.ec2.internal\" not found"
Jul 30 20:24:49.592871 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:49.592843    2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-29 20:19:49 +0000 UTC" deadline="2028-01-12 04:57:48.438090517 +0000 UTC"
Jul 30 20:24:49.592871 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:49.592869    2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12728h32m58.845223783s"
Jul 30 20:24:49.670282 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:49.670254    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2601b49689453982163e65b62bf2dbc3.slice/crio-b9126d239132de571cf75c90aa8673f3c9d6d5cd93fa1465615e5beb9950f7e0 WatchSource:0}: Error finding container b9126d239132de571cf75c90aa8673f3c9d6d5cd93fa1465615e5beb9950f7e0: Status 404 returned error can't find the container with id b9126d239132de571cf75c90aa8673f3c9d6d5cd93fa1465615e5beb9950f7e0
Jul 30 20:24:49.670728 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:24:49.670700    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-69.ec2.internal\" not found"
Jul 30 20:24:49.670916 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:49.670894    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod080196fcbe11403b01fd40375d60e083.slice/crio-b40adc743c6705a1d7dcd1e56c07de815ccd11862e76b5633faa0d6aeaf4e480 WatchSource:0}: Error finding container b40adc743c6705a1d7dcd1e56c07de815ccd11862e76b5633faa0d6aeaf4e480: Status 404 returned error can't find the container with id b40adc743c6705a1d7dcd1e56c07de815ccd11862e76b5633faa0d6aeaf4e480
Jul 30 20:24:49.675688 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:49.675670    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 30 20:24:49.771054 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:24:49.771026    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-69.ec2.internal\" not found"
Jul 30 20:24:49.871565 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:24:49.871519    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-69.ec2.internal\" not found"
Jul 30 20:24:49.972182 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:24:49.972075    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-69.ec2.internal\" not found"
Jul 30 20:24:50.035632 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.034401    2583 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 30 20:24:50.067041 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.066693    2583 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-69.ec2.internal"
Jul 30 20:24:50.074630 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.074604    2583 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 30 20:24:50.075553 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.075540    2583 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-69.ec2.internal"
Jul 30 20:24:50.086997 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.086979    2583 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 30 20:24:50.543253 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.543220    2583 apiserver.go:52] "Watching apiserver"
Jul 30 20:24:50.549669 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.549642    2583 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 30 20:24:50.550090 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.550056    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-88nf2","openshift-dns/node-resolver-26tfg","openshift-image-registry/node-ca-czmdm","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-69.ec2.internal","openshift-multus/multus-additional-cni-plugins-nlpd2","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xjbjh","openshift-multus/multus-gdkdh","openshift-multus/network-metrics-daemon-jfpt4","openshift-network-diagnostics/network-check-target-k8jg9","openshift-network-operator/iptables-alerter-8rsxs","openshift-ovn-kubernetes/ovnkube-node-j8dzm","kube-system/global-pull-secret-syncer-8g9tl","kube-system/konnectivity-agent-hkpd5","kube-system/kube-apiserver-proxy-ip-10-0-142-69.ec2.internal"]
Jul 30 20:24:50.551700 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.551678    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8rsxs"
Jul 30 20:24:50.553117 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.553093    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hkpd5"
Jul 30 20:24:50.553874 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.553854    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 30 20:24:50.554078 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.554062    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 30 20:24:50.554398 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.554379    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-x8kxw\""
Jul 30 20:24:50.554582 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.554567    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 30 20:24:50.555718 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.555699    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-czmdm"
Jul 30 20:24:50.555814 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.555768    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 30 20:24:50.556527 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.556508    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-7pkgc\""
Jul 30 20:24:50.556617 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.556600    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 30 20:24:50.556896 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.556879    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jfpt4"
Jul 30 20:24:50.556996 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:24:50.556972    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jfpt4" podUID="9c27cd9e-72be-4a13-8deb-f4c3ffe3ecea"
Jul 30 20:24:50.558430 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.558408    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-nlpd2"
Jul 30 20:24:50.560029 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.559651    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 30 20:24:50.560029 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.559736    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 30 20:24:50.560029 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.559758    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 30 20:24:50.560029 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.559995    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-qpn86\""
Jul 30 20:24:50.560305 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.560288    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xjbjh"
Jul 30 20:24:50.560359 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.560330    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 30 20:24:50.560570 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.560547    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 30 20:24:50.560971 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.560949    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 30 20:24:50.560971 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.560962    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 30 20:24:50.561110 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.561093    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 30 20:24:50.561398 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.561379    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-q4kff\""
Jul 30 20:24:50.561481 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.561447    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k8jg9"
Jul 30 20:24:50.561540 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:24:50.561505    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k8jg9" podUID="97b781c0-bbe8-42ae-b54b-b42b759c87b4"
Jul 30 20:24:50.564133 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.562652    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 30 20:24:50.564133 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.562902    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 30 20:24:50.564133 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.563113    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-bhccz\""
Jul 30 20:24:50.564133 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.563360    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 30 20:24:50.564133 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.563590    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-gdkdh"
Jul 30 20:24:50.564709 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.564687    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-26tfg"
Jul 30 20:24:50.565531 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.565511    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-jglz7\""
Jul 30 20:24:50.565691 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.565672    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 30 20:24:50.566509 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.566490    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 30 20:24:50.566656 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.566628    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 30 20:24:50.566730 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.566673    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-nqhdg\""
Jul 30 20:24:50.567688 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.567664    2583 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 30 20:24:50.567837 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.567790    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-88nf2"
Jul 30 20:24:50.570831 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.570800    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-j8dzm"
Jul 30 20:24:50.571121 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.571102    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 30 20:24:50.572846 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.572826    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 30 20:24:50.573141 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.573116    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 30 20:24:50.573390 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.573351    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 30 20:24:50.573514 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.573464    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 30 20:24:50.573514 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.573470    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 30 20:24:50.573514 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.573464    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 30 20:24:50.573710 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.573636    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-wnzl9\""
Jul 30 20:24:50.573821 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.573759    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 30 20:24:50.573883 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.573765    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8g9tl"
Jul 30 20:24:50.573963 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:24:50.573936    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8g9tl" podUID="01f71a23-f22f-44f3-b7d6-3ba3050b69fa"
Jul 30 20:24:50.574200 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.574112    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-5qfsx\""
Jul 30 20:24:50.578041 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.578019    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfvh2\" (UniqueName: \"kubernetes.io/projected/99b20953-23a6-4c80-b4ec-2376753942d9-kube-api-access-mfvh2\") pod \"tuned-88nf2\" (UID: \"99b20953-23a6-4c80-b4ec-2376753942d9\") " pod="openshift-cluster-node-tuning-operator/tuned-88nf2"
Jul 30 20:24:50.578163 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.578054    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e5d61971-62cc-436c-9d5c-a3abec7a47d4-host\") pod \"node-ca-czmdm\" (UID: \"e5d61971-62cc-436c-9d5c-a3abec7a47d4\") " pod="openshift-image-registry/node-ca-czmdm"
Jul 30 20:24:50.578163 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.578080    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b5ea3ceb-c9e3-4ef4-920c-9b618c947bee-os-release\") pod \"multus-additional-cni-plugins-nlpd2\" (UID: \"b5ea3ceb-c9e3-4ef4-920c-9b618c947bee\") " pod="openshift-multus/multus-additional-cni-plugins-nlpd2"
Jul 30 20:24:50.578163 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.578097    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/208efd11-d3ba-46c5-8afb-269d1fbf7217-host-var-lib-cni-multus\") pod \"multus-gdkdh\" (UID: \"208efd11-d3ba-46c5-8afb-269d1fbf7217\") " pod="openshift-multus/multus-gdkdh"
Jul 30 20:24:50.578163 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.578118    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/208efd11-d3ba-46c5-8afb-269d1fbf7217-host-var-lib-kubelet\") pod \"multus-gdkdh\" (UID: \"208efd11-d3ba-46c5-8afb-269d1fbf7217\") " pod="openshift-multus/multus-gdkdh"
Jul 30 20:24:50.578163 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.578141    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zb84s\" (UniqueName: \"kubernetes.io/projected/208efd11-d3ba-46c5-8afb-269d1fbf7217-kube-api-access-zb84s\") pod \"multus-gdkdh\" (UID: \"208efd11-d3ba-46c5-8afb-269d1fbf7217\") " pod="openshift-multus/multus-gdkdh"
Jul 30 20:24:50.578377 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.578162    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/99b20953-23a6-4c80-b4ec-2376753942d9-sys\") pod \"tuned-88nf2\" (UID: \"99b20953-23a6-4c80-b4ec-2376753942d9\") " pod="openshift-cluster-node-tuning-operator/tuned-88nf2"
Jul 30 20:24:50.578377 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.578188    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b5ea3ceb-c9e3-4ef4-920c-9b618c947bee-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nlpd2\" (UID: \"b5ea3ceb-c9e3-4ef4-920c-9b618c947bee\") " pod="openshift-multus/multus-additional-cni-plugins-nlpd2"
Jul 30 20:24:50.578377 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.578206    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/346ac985-5c0d-4134-bc10-7727a294ef1f-tmp-dir\") pod \"node-resolver-26tfg\" (UID: \"346ac985-5c0d-4134-bc10-7727a294ef1f\") " pod="openshift-dns/node-resolver-26tfg"
Jul 30 20:24:50.578377 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.578257    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/99b20953-23a6-4c80-b4ec-2376753942d9-etc-sysconfig\") pod \"tuned-88nf2\" (UID: \"99b20953-23a6-4c80-b4ec-2376753942d9\") " pod="openshift-cluster-node-tuning-operator/tuned-88nf2"
Jul 30 20:24:50.578377 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.578272    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/99b20953-23a6-4c80-b4ec-2376753942d9-etc-sysctl-d\") pod \"tuned-88nf2\" (UID: \"99b20953-23a6-4c80-b4ec-2376753942d9\") " pod="openshift-cluster-node-tuning-operator/tuned-88nf2"
Jul 30 20:24:50.578377 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.578295    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/208efd11-d3ba-46c5-8afb-269d1fbf7217-multus-daemon-config\") pod \"multus-gdkdh\" (UID: \"208efd11-d3ba-46c5-8afb-269d1fbf7217\") " pod="openshift-multus/multus-gdkdh"
Jul 30 20:24:50.578377 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.578321    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tnh6n\" (UniqueName: \"kubernetes.io/projected/97b781c0-bbe8-42ae-b54b-b42b759c87b4-kube-api-access-tnh6n\") pod \"network-check-target-k8jg9\" (UID: \"97b781c0-bbe8-42ae-b54b-b42b759c87b4\") " pod="openshift-network-diagnostics/network-check-target-k8jg9"
Jul 30 20:24:50.578377 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.578348    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/99b20953-23a6-4c80-b4ec-2376753942d9-host\") pod \"tuned-88nf2\" (UID: \"99b20953-23a6-4c80-b4ec-2376753942d9\") " pod="openshift-cluster-node-tuning-operator/tuned-88nf2"
Jul 30 20:24:50.578377 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.578370    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/208efd11-d3ba-46c5-8afb-269d1fbf7217-cnibin\") pod \"multus-gdkdh\" (UID: \"208efd11-d3ba-46c5-8afb-269d1fbf7217\") " pod="openshift-multus/multus-gdkdh"
Jul 30 20:24:50.578823 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.578395    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/208efd11-d3ba-46c5-8afb-269d1fbf7217-host-var-lib-cni-bin\") pod \"multus-gdkdh\" (UID: \"208efd11-d3ba-46c5-8afb-269d1fbf7217\") " pod="openshift-multus/multus-gdkdh"
Jul 30 20:24:50.578823 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.578449    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2nw8c\" (UniqueName: \"kubernetes.io/projected/9c27cd9e-72be-4a13-8deb-f4c3ffe3ecea-kube-api-access-2nw8c\") pod \"network-metrics-daemon-jfpt4\" (UID: \"9c27cd9e-72be-4a13-8deb-f4c3ffe3ecea\") " pod="openshift-multus/network-metrics-daemon-jfpt4"
Jul 30 20:24:50.578823 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.578481    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b6859022-31c0-4474-afa1-e362c870ba13-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xjbjh\" (UID: \"b6859022-31c0-4474-afa1-e362c870ba13\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xjbjh"
Jul 30 20:24:50.578823 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.578515    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b6859022-31c0-4474-afa1-e362c870ba13-socket-dir\") pod \"aws-ebs-csi-driver-node-xjbjh\" (UID: \"b6859022-31c0-4474-afa1-e362c870ba13\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xjbjh"
Jul 30 20:24:50.578823 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.578547    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9f8z\" (UniqueName: \"kubernetes.io/projected/346ac985-5c0d-4134-bc10-7727a294ef1f-kube-api-access-b9f8z\") pod \"node-resolver-26tfg\" (UID: \"346ac985-5c0d-4134-bc10-7727a294ef1f\") " pod="openshift-dns/node-resolver-26tfg"
Jul 30 20:24:50.578823 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.578569    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/99b20953-23a6-4c80-b4ec-2376753942d9-var-lib-kubelet\") pod \"tuned-88nf2\" (UID: \"99b20953-23a6-4c80-b4ec-2376753942d9\") " pod="openshift-cluster-node-tuning-operator/tuned-88nf2"
Jul 30 20:24:50.578823 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.578584    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/99b20953-23a6-4c80-b4ec-2376753942d9-tmp\") pod \"tuned-88nf2\" (UID: \"99b20953-23a6-4c80-b4ec-2376753942d9\") " pod="openshift-cluster-node-tuning-operator/tuned-88nf2"
Jul 30 20:24:50.578823 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.578624    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b6859022-31c0-4474-afa1-e362c870ba13-etc-selinux\") pod \"aws-ebs-csi-driver-node-xjbjh\" (UID: \"b6859022-31c0-4474-afa1-e362c870ba13\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xjbjh"
Jul 30 20:24:50.578823 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.578662    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/208efd11-d3ba-46c5-8afb-269d1fbf7217-system-cni-dir\") pod \"multus-gdkdh\" (UID: \"208efd11-d3ba-46c5-8afb-269d1fbf7217\") " pod="openshift-multus/multus-gdkdh"
Jul 30 20:24:50.578823 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.578688    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b5ea3ceb-c9e3-4ef4-920c-9b618c947bee-system-cni-dir\") pod \"multus-additional-cni-plugins-nlpd2\" (UID: \"b5ea3ceb-c9e3-4ef4-920c-9b618c947bee\") " pod="openshift-multus/multus-additional-cni-plugins-nlpd2"
Jul 30 20:24:50.578823 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.578711    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b6859022-31c0-4474-afa1-e362c870ba13-sys-fs\") pod \"aws-ebs-csi-driver-node-xjbjh\" (UID: \"b6859022-31c0-4474-afa1-e362c870ba13\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xjbjh"
Jul 30 20:24:50.578823 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.578736    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h65ck\" (UniqueName: \"kubernetes.io/projected/b6859022-31c0-4474-afa1-e362c870ba13-kube-api-access-h65ck\") pod \"aws-ebs-csi-driver-node-xjbjh\" (UID: \"b6859022-31c0-4474-afa1-e362c870ba13\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xjbjh"
Jul 30 20:24:50.578823 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.578765    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b5ea3ceb-c9e3-4ef4-920c-9b618c947bee-cni-binary-copy\") pod \"multus-additional-cni-plugins-nlpd2\" (UID: \"b5ea3ceb-c9e3-4ef4-920c-9b618c947bee\") " pod="openshift-multus/multus-additional-cni-plugins-nlpd2"
Jul 30 20:24:50.578823 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.578788    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/208efd11-d3ba-46c5-8afb-269d1fbf7217-host-run-netns\") pod \"multus-gdkdh\" (UID: \"208efd11-d3ba-46c5-8afb-269d1fbf7217\") " pod="openshift-multus/multus-gdkdh"
Jul 30 20:24:50.578823 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.578809    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2kkv\" (UniqueName: \"kubernetes.io/projected/990f6547-5422-4136-b3e1-39982c7f3660-kube-api-access-x2kkv\") pod \"iptables-alerter-8rsxs\" (UID: \"990f6547-5422-4136-b3e1-39982c7f3660\") " pod="openshift-network-operator/iptables-alerter-8rsxs"
Jul 30 20:24:50.578823 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.578833    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4c453060-5f5c-4686-846e-a8875d6d9ead-konnectivity-ca\") pod \"konnectivity-agent-hkpd5\" (UID: \"4c453060-5f5c-4686-846e-a8875d6d9ead\") " pod="kube-system/konnectivity-agent-hkpd5"
Jul 30 20:24:50.579716 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.578875    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/346ac985-5c0d-4134-bc10-7727a294ef1f-hosts-file\") pod \"node-resolver-26tfg\" (UID: \"346ac985-5c0d-4134-bc10-7727a294ef1f\") " pod="openshift-dns/node-resolver-26tfg"
Jul 30 20:24:50.579716 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.578911    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/99b20953-23a6-4c80-b4ec-2376753942d9-run\") pod \"tuned-88nf2\" (UID: \"99b20953-23a6-4c80-b4ec-2376753942d9\") " pod="openshift-cluster-node-tuning-operator/tuned-88nf2"
Jul 30 20:24:50.579716 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.578939    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b5ea3ceb-c9e3-4ef4-920c-9b618c947bee-cnibin\") pod \"multus-additional-cni-plugins-nlpd2\" (UID: \"b5ea3ceb-c9e3-4ef4-920c-9b618c947bee\") " pod="openshift-multus/multus-additional-cni-plugins-nlpd2"
Jul 30 20:24:50.579716 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.578964    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4c453060-5f5c-4686-846e-a8875d6d9ead-agent-certs\") pod \"konnectivity-agent-hkpd5\" (UID: \"4c453060-5f5c-4686-846e-a8875d6d9ead\") " pod="kube-system/konnectivity-agent-hkpd5"
Jul 30 20:24:50.579716 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.578990    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e5d61971-62cc-436c-9d5c-a3abec7a47d4-serviceca\") pod \"node-ca-czmdm\" (UID: \"e5d61971-62cc-436c-9d5c-a3abec7a47d4\") " pod="openshift-image-registry/node-ca-czmdm"
Jul 30 20:24:50.579716 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.579017    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b6859022-31c0-4474-afa1-e362c870ba13-registration-dir\") pod \"aws-ebs-csi-driver-node-xjbjh\" (UID: \"b6859022-31c0-4474-afa1-e362c870ba13\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xjbjh"
Jul 30 20:24:50.579716 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.579044    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/208efd11-d3ba-46c5-8afb-269d1fbf7217-os-release\") pod \"multus-gdkdh\" (UID: \"208efd11-d3ba-46c5-8afb-269d1fbf7217\") " pod="openshift-multus/multus-gdkdh"
Jul 30 20:24:50.579716 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.579070    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/99b20953-23a6-4c80-b4ec-2376753942d9-etc-tuned\") pod \"tuned-88nf2\" (UID: \"99b20953-23a6-4c80-b4ec-2376753942d9\") " pod="openshift-cluster-node-tuning-operator/tuned-88nf2"
Jul 30 20:24:50.579716 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.579095    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/208efd11-d3ba-46c5-8afb-269d1fbf7217-multus-socket-dir-parent\") pod \"multus-gdkdh\" (UID: \"208efd11-d3ba-46c5-8afb-269d1fbf7217\") " pod="openshift-multus/multus-gdkdh"
Jul 30 20:24:50.579716 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.579122    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/99b20953-23a6-4c80-b4ec-2376753942d9-etc-modprobe-d\") pod \"tuned-88nf2\" (UID: \"99b20953-23a6-4c80-b4ec-2376753942d9\") " pod="openshift-cluster-node-tuning-operator/tuned-88nf2"
Jul 30 20:24:50.579716 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.579146    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/208efd11-d3ba-46c5-8afb-269d1fbf7217-cni-binary-copy\") pod \"multus-gdkdh\" (UID: \"208efd11-d3ba-46c5-8afb-269d1fbf7217\") " pod="openshift-multus/multus-gdkdh"
Jul 30 20:24:50.579716 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.579174    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b5ea3ceb-c9e3-4ef4-920c-9b618c947bee-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nlpd2\" (UID: \"b5ea3ceb-c9e3-4ef4-920c-9b618c947bee\") " pod="openshift-multus/multus-additional-cni-plugins-nlpd2"
Jul 30 20:24:50.579716 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.579224    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b6859022-31c0-4474-afa1-e362c870ba13-device-dir\") pod \"aws-ebs-csi-driver-node-xjbjh\" (UID: \"b6859022-31c0-4474-afa1-e362c870ba13\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xjbjh"
Jul 30 20:24:50.579716 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.579251    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/208efd11-d3ba-46c5-8afb-269d1fbf7217-hostroot\") pod \"multus-gdkdh\" (UID: \"208efd11-d3ba-46c5-8afb-269d1fbf7217\") " pod="openshift-multus/multus-gdkdh"
Jul 30 20:24:50.579716 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.579278    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/208efd11-d3ba-46c5-8afb-269d1fbf7217-etc-kubernetes\") pod \"multus-gdkdh\" (UID: \"208efd11-d3ba-46c5-8afb-269d1fbf7217\") " pod="openshift-multus/multus-gdkdh"
Jul 30 20:24:50.579716 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.579304    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/99b20953-23a6-4c80-b4ec-2376753942d9-etc-systemd\") pod \"tuned-88nf2\" (UID: \"99b20953-23a6-4c80-b4ec-2376753942d9\") " pod="openshift-cluster-node-tuning-operator/tuned-88nf2"
Jul 30 20:24:50.580291 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.579334    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b5ea3ceb-c9e3-4ef4-920c-9b618c947bee-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nlpd2\" (UID: \"b5ea3ceb-c9e3-4ef4-920c-9b618c947bee\") " pod="openshift-multus/multus-additional-cni-plugins-nlpd2"
Jul 30 20:24:50.580291 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.579365    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jr8t6\" (UniqueName: \"kubernetes.io/projected/b5ea3ceb-c9e3-4ef4-920c-9b618c947bee-kube-api-access-jr8t6\") pod \"multus-additional-cni-plugins-nlpd2\" (UID: \"b5ea3ceb-c9e3-4ef4-920c-9b618c947bee\") " pod="openshift-multus/multus-additional-cni-plugins-nlpd2"
Jul 30 20:24:50.580291 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.579392    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/990f6547-5422-4136-b3e1-39982c7f3660-iptables-alerter-script\") pod \"iptables-alerter-8rsxs\" (UID: \"990f6547-5422-4136-b3e1-39982c7f3660\") " pod="openshift-network-operator/iptables-alerter-8rsxs"
Jul 30 20:24:50.580291 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.579434    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c27cd9e-72be-4a13-8deb-f4c3ffe3ecea-metrics-certs\") pod \"network-metrics-daemon-jfpt4\" (UID: \"9c27cd9e-72be-4a13-8deb-f4c3ffe3ecea\") " pod="openshift-multus/network-metrics-daemon-jfpt4"
Jul 30 20:24:50.580291 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.579464    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/99b20953-23a6-4c80-b4ec-2376753942d9-etc-sysctl-conf\") pod \"tuned-88nf2\" (UID: \"99b20953-23a6-4c80-b4ec-2376753942d9\") " pod="openshift-cluster-node-tuning-operator/tuned-88nf2"
Jul 30 20:24:50.580291 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.579498    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2zssg\" (UniqueName: \"kubernetes.io/projected/e5d61971-62cc-436c-9d5c-a3abec7a47d4-kube-api-access-2zssg\") pod \"node-ca-czmdm\" (UID: \"e5d61971-62cc-436c-9d5c-a3abec7a47d4\") " pod="openshift-image-registry/node-ca-czmdm"
Jul 30 20:24:50.580291 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.579526    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/208efd11-d3ba-46c5-8afb-269d1fbf7217-multus-cni-dir\") pod \"multus-gdkdh\" (UID: \"208efd11-d3ba-46c5-8afb-269d1fbf7217\") " pod="openshift-multus/multus-gdkdh"
Jul 30 20:24:50.580291 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.579555    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/208efd11-d3ba-46c5-8afb-269d1fbf7217-host-run-k8s-cni-cncf-io\") pod \"multus-gdkdh\" (UID: \"208efd11-d3ba-46c5-8afb-269d1fbf7217\") " pod="openshift-multus/multus-gdkdh"
Jul 30 20:24:50.580291 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.579582    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/208efd11-d3ba-46c5-8afb-269d1fbf7217-multus-conf-dir\") pod \"multus-gdkdh\" (UID: \"208efd11-d3ba-46c5-8afb-269d1fbf7217\") " pod="openshift-multus/multus-gdkdh"
Jul 30 20:24:50.580291 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.579611    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/208efd11-d3ba-46c5-8afb-269d1fbf7217-host-run-multus-certs\") pod \"multus-gdkdh\" (UID: \"208efd11-d3ba-46c5-8afb-269d1fbf7217\") " pod="openshift-multus/multus-gdkdh"
Jul 30 20:24:50.580291 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.579638    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/990f6547-5422-4136-b3e1-39982c7f3660-host-slash\") pod \"iptables-alerter-8rsxs\" (UID: \"990f6547-5422-4136-b3e1-39982c7f3660\") " pod="openshift-network-operator/iptables-alerter-8rsxs"
Jul 30 20:24:50.580291 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.579676    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/99b20953-23a6-4c80-b4ec-2376753942d9-etc-kubernetes\") pod \"tuned-88nf2\" (UID: \"99b20953-23a6-4c80-b4ec-2376753942d9\") " pod="openshift-cluster-node-tuning-operator/tuned-88nf2"
Jul 30 20:24:50.580291 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.579748    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/99b20953-23a6-4c80-b4ec-2376753942d9-lib-modules\") pod \"tuned-88nf2\" (UID: \"99b20953-23a6-4c80-b4ec-2376753942d9\") " pod="openshift-cluster-node-tuning-operator/tuned-88nf2"
Jul 30 20:24:50.581080 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.581056    2583 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 30 20:24:50.605583 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.605548    2583 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-7s4zd"
Jul 30 20:24:50.616803 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.616425    2583 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-7s4zd"
Jul 30 20:24:50.668049 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.668025    2583 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 30 20:24:50.673996 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.673955    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-69.ec2.internal" event={"ID":"080196fcbe11403b01fd40375d60e083","Type":"ContainerStarted","Data":"b40adc743c6705a1d7dcd1e56c07de815ccd11862e76b5633faa0d6aeaf4e480"}
Jul 30 20:24:50.675417 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.675390    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-69.ec2.internal" event={"ID":"2601b49689453982163e65b62bf2dbc3","Type":"ContainerStarted","Data":"b9126d239132de571cf75c90aa8673f3c9d6d5cd93fa1465615e5beb9950f7e0"}
Jul 30 20:24:50.680998 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.680953    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b6859022-31c0-4474-afa1-e362c870ba13-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xjbjh\" (UID: \"b6859022-31c0-4474-afa1-e362c870ba13\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xjbjh"
Jul 30 20:24:50.681100 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.681020    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b6859022-31c0-4474-afa1-e362c870ba13-socket-dir\") pod \"aws-ebs-csi-driver-node-xjbjh\" (UID: \"b6859022-31c0-4474-afa1-e362c870ba13\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xjbjh"
Jul 30 20:24:50.681100 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.681055    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9f8z\" (UniqueName: \"kubernetes.io/projected/346ac985-5c0d-4134-bc10-7727a294ef1f-kube-api-access-b9f8z\") pod \"node-resolver-26tfg\" (UID: \"346ac985-5c0d-4134-bc10-7727a294ef1f\") " pod="openshift-dns/node-resolver-26tfg"
Jul 30 20:24:50.681100 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.681095    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/99b20953-23a6-4c80-b4ec-2376753942d9-var-lib-kubelet\") pod \"tuned-88nf2\" (UID: \"99b20953-23a6-4c80-b4ec-2376753942d9\") " pod="openshift-cluster-node-tuning-operator/tuned-88nf2"
Jul 30 20:24:50.681278 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.681126    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/99b20953-23a6-4c80-b4ec-2376753942d9-tmp\") pod \"tuned-88nf2\" (UID: \"99b20953-23a6-4c80-b4ec-2376753942d9\") " pod="openshift-cluster-node-tuning-operator/tuned-88nf2"
Jul 30 20:24:50.681278 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.681154    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b6859022-31c0-4474-afa1-e362c870ba13-etc-selinux\") pod \"aws-ebs-csi-driver-node-xjbjh\" (UID: \"b6859022-31c0-4474-afa1-e362c870ba13\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xjbjh"
Jul 30 20:24:50.681278 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.681208    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/208efd11-d3ba-46c5-8afb-269d1fbf7217-system-cni-dir\") pod \"multus-gdkdh\" (UID: \"208efd11-d3ba-46c5-8afb-269d1fbf7217\") " pod="openshift-multus/multus-gdkdh"
Jul 30 20:24:50.681278 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.681248    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a4829105-a873-467c-bfcb-88999090f719-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-j8dzm\" (UID: \"a4829105-a873-467c-bfcb-88999090f719\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8dzm"
Jul 30 20:24:50.681473 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.681285    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a4829105-a873-467c-bfcb-88999090f719-ovnkube-script-lib\") pod \"ovnkube-node-j8dzm\" (UID: \"a4829105-a873-467c-bfcb-88999090f719\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8dzm"
Jul 30 20:24:50.681473 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.681342    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hs8wg\" (UniqueName: \"kubernetes.io/projected/a4829105-a873-467c-bfcb-88999090f719-kube-api-access-hs8wg\") pod \"ovnkube-node-j8dzm\" (UID: \"a4829105-a873-467c-bfcb-88999090f719\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8dzm"
Jul 30 20:24:50.681473 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.681381    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/01f71a23-f22f-44f3-b7d6-3ba3050b69fa-dbus\") pod \"global-pull-secret-syncer-8g9tl\" (UID: \"01f71a23-f22f-44f3-b7d6-3ba3050b69fa\") " pod="kube-system/global-pull-secret-syncer-8g9tl"
Jul 30 20:24:50.681473 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.681443    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b5ea3ceb-c9e3-4ef4-920c-9b618c947bee-system-cni-dir\") pod \"multus-additional-cni-plugins-nlpd2\" (UID: \"b5ea3ceb-c9e3-4ef4-920c-9b618c947bee\") " pod="openshift-multus/multus-additional-cni-plugins-nlpd2"
Jul 30 20:24:50.681660 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.681555    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b6859022-31c0-4474-afa1-e362c870ba13-sys-fs\") pod \"aws-ebs-csi-driver-node-xjbjh\" (UID: \"b6859022-31c0-4474-afa1-e362c870ba13\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xjbjh"
Jul 30 20:24:50.681660 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.681647    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b6859022-31c0-4474-afa1-e362c870ba13-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xjbjh\" (UID: \"b6859022-31c0-4474-afa1-e362c870ba13\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xjbjh"
Jul 30 20:24:50.681793 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.681772    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b6859022-31c0-4474-afa1-e362c870ba13-socket-dir\") pod \"aws-ebs-csi-driver-node-xjbjh\" (UID: \"b6859022-31c0-4474-afa1-e362c870ba13\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xjbjh"
Jul 30 20:24:50.682164 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.682143    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/99b20953-23a6-4c80-b4ec-2376753942d9-var-lib-kubelet\") pod \"tuned-88nf2\" (UID: \"99b20953-23a6-4c80-b4ec-2376753942d9\") " pod="openshift-cluster-node-tuning-operator/tuned-88nf2"
Jul 30 20:24:50.682355 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.682326    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b6859022-31c0-4474-afa1-e362c870ba13-etc-selinux\") pod \"aws-ebs-csi-driver-node-xjbjh\" (UID: \"b6859022-31c0-4474-afa1-e362c870ba13\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xjbjh"
Jul 30 20:24:50.682432 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.682403    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/208efd11-d3ba-46c5-8afb-269d1fbf7217-system-cni-dir\") pod \"multus-gdkdh\" (UID: \"208efd11-d3ba-46c5-8afb-269d1fbf7217\") " pod="openshift-multus/multus-gdkdh"
Jul 30 20:24:50.682550 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.682527    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b5ea3ceb-c9e3-4ef4-920c-9b618c947bee-system-cni-dir\") pod \"multus-additional-cni-plugins-nlpd2\" (UID: \"b5ea3ceb-c9e3-4ef4-920c-9b618c947bee\") " pod="openshift-multus/multus-additional-cni-plugins-nlpd2"
Jul 30 20:24:50.682768 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.681477    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b6859022-31c0-4474-afa1-e362c870ba13-sys-fs\") pod \"aws-ebs-csi-driver-node-xjbjh\" (UID: \"b6859022-31c0-4474-afa1-e362c870ba13\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xjbjh"
Jul 30 20:24:50.682851 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.682804    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h65ck\" (UniqueName: \"kubernetes.io/projected/b6859022-31c0-4474-afa1-e362c870ba13-kube-api-access-h65ck\") pod \"aws-ebs-csi-driver-node-xjbjh\" (UID: \"b6859022-31c0-4474-afa1-e362c870ba13\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xjbjh"
Jul 30 20:24:50.682946 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.682926    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a4829105-a873-467c-bfcb-88999090f719-host-cni-netd\") pod \"ovnkube-node-j8dzm\" (UID: \"a4829105-a873-467c-bfcb-88999090f719\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8dzm"
Jul 30 20:24:50.683034 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.683018    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b5ea3ceb-c9e3-4ef4-920c-9b618c947bee-cni-binary-copy\") pod \"multus-additional-cni-plugins-nlpd2\" (UID: \"b5ea3ceb-c9e3-4ef4-920c-9b618c947bee\") " pod="openshift-multus/multus-additional-cni-plugins-nlpd2"
Jul 30 20:24:50.683082 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.683061    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/208efd11-d3ba-46c5-8afb-269d1fbf7217-host-run-netns\") pod \"multus-gdkdh\" (UID: \"208efd11-d3ba-46c5-8afb-269d1fbf7217\") " pod="openshift-multus/multus-gdkdh"
Jul 30 20:24:50.683137 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.683088    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2kkv\" (UniqueName: \"kubernetes.io/projected/990f6547-5422-4136-b3e1-39982c7f3660-kube-api-access-x2kkv\") pod \"iptables-alerter-8rsxs\" (UID: \"990f6547-5422-4136-b3e1-39982c7f3660\") " pod="openshift-network-operator/iptables-alerter-8rsxs"
Jul 30 20:24:50.683137 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.683085    2583 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 30 20:24:50.683137 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.683120    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4c453060-5f5c-4686-846e-a8875d6d9ead-konnectivity-ca\") pod \"konnectivity-agent-hkpd5\" (UID: \"4c453060-5f5c-4686-846e-a8875d6d9ead\") " pod="kube-system/konnectivity-agent-hkpd5"
Jul 30 20:24:50.683306 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.683162    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a4829105-a873-467c-bfcb-88999090f719-run-ovn\") pod \"ovnkube-node-j8dzm\" (UID: \"a4829105-a873-467c-bfcb-88999090f719\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8dzm"
Jul 30 20:24:50.683306 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.683212    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/01f71a23-f22f-44f3-b7d6-3ba3050b69fa-kubelet-config\") pod \"global-pull-secret-syncer-8g9tl\" (UID: \"01f71a23-f22f-44f3-b7d6-3ba3050b69fa\") " pod="kube-system/global-pull-secret-syncer-8g9tl"
Jul 30 20:24:50.683306 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.683245    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/346ac985-5c0d-4134-bc10-7727a294ef1f-hosts-file\") pod \"node-resolver-26tfg\" (UID: \"346ac985-5c0d-4134-bc10-7727a294ef1f\") " pod="openshift-dns/node-resolver-26tfg"
Jul 30 20:24:50.683306 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.683282    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a4829105-a873-467c-bfcb-88999090f719-host-cni-bin\") pod \"ovnkube-node-j8dzm\" (UID: \"a4829105-a873-467c-bfcb-88999090f719\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8dzm"
Jul 30 20:24:50.683476 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.683324    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/99b20953-23a6-4c80-b4ec-2376753942d9-run\") pod \"tuned-88nf2\" (UID: \"99b20953-23a6-4c80-b4ec-2376753942d9\") " pod="openshift-cluster-node-tuning-operator/tuned-88nf2"
Jul 30 20:24:50.683476 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.683354    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b5ea3ceb-c9e3-4ef4-920c-9b618c947bee-cnibin\") pod \"multus-additional-cni-plugins-nlpd2\" (UID: \"b5ea3ceb-c9e3-4ef4-920c-9b618c947bee\") " pod="openshift-multus/multus-additional-cni-plugins-nlpd2"
Jul 30 20:24:50.683476 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.683384    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a4829105-a873-467c-bfcb-88999090f719-log-socket\") pod \"ovnkube-node-j8dzm\" (UID: \"a4829105-a873-467c-bfcb-88999090f719\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8dzm"
Jul 30 20:24:50.683476 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.683414    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4c453060-5f5c-4686-846e-a8875d6d9ead-agent-certs\") pod \"konnectivity-agent-hkpd5\" (UID: \"4c453060-5f5c-4686-846e-a8875d6d9ead\") " pod="kube-system/konnectivity-agent-hkpd5"
Jul 30 20:24:50.683476 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.683465    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e5d61971-62cc-436c-9d5c-a3abec7a47d4-serviceca\") pod \"node-ca-czmdm\" (UID: \"e5d61971-62cc-436c-9d5c-a3abec7a47d4\") " pod="openshift-image-registry/node-ca-czmdm"
Jul 30 20:24:50.683733 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.683495    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b6859022-31c0-4474-afa1-e362c870ba13-registration-dir\") pod \"aws-ebs-csi-driver-node-xjbjh\" (UID: \"b6859022-31c0-4474-afa1-e362c870ba13\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xjbjh"
Jul 30 20:24:50.683733 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.683534    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/208efd11-d3ba-46c5-8afb-269d1fbf7217-os-release\") pod \"multus-gdkdh\" (UID: \"208efd11-d3ba-46c5-8afb-269d1fbf7217\") " pod="openshift-multus/multus-gdkdh"
Jul 30 20:24:50.683733 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.683581    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/01f71a23-f22f-44f3-b7d6-3ba3050b69fa-original-pull-secret\") pod \"global-pull-secret-syncer-8g9tl\" (UID: \"01f71a23-f22f-44f3-b7d6-3ba3050b69fa\") " pod="kube-system/global-pull-secret-syncer-8g9tl"
Jul 30 20:24:50.683733 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.683691    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/99b20953-23a6-4c80-b4ec-2376753942d9-etc-tuned\") pod \"tuned-88nf2\" (UID: \"99b20953-23a6-4c80-b4ec-2376753942d9\") " pod="openshift-cluster-node-tuning-operator/tuned-88nf2"
Jul 30 20:24:50.683733 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.683721    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/208efd11-d3ba-46c5-8afb-269d1fbf7217-multus-socket-dir-parent\") pod \"multus-gdkdh\" (UID: \"208efd11-d3ba-46c5-8afb-269d1fbf7217\") " pod="openshift-multus/multus-gdkdh"
Jul 30 20:24:50.683947 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.683779    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a4829105-a873-467c-bfcb-88999090f719-node-log\") pod \"ovnkube-node-j8dzm\" (UID: \"a4829105-a873-467c-bfcb-88999090f719\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8dzm"
Jul 30 20:24:50.683947 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.683833    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a4829105-a873-467c-bfcb-88999090f719-host-run-ovn-kubernetes\") pod \"ovnkube-node-j8dzm\" (UID: \"a4829105-a873-467c-bfcb-88999090f719\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8dzm"
Jul 30 20:24:50.683947 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.683863    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a4829105-a873-467c-bfcb-88999090f719-ovnkube-config\") pod \"ovnkube-node-j8dzm\" (UID: \"a4829105-a873-467c-bfcb-88999090f719\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8dzm"
Jul 30 20:24:50.683947 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.683913    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a4829105-a873-467c-bfcb-88999090f719-env-overrides\") pod \"ovnkube-node-j8dzm\" (UID: \"a4829105-a873-467c-bfcb-88999090f719\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8dzm"
Jul 30 20:24:50.683947 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.683943    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/99b20953-23a6-4c80-b4ec-2376753942d9-etc-modprobe-d\") pod \"tuned-88nf2\" (UID: \"99b20953-23a6-4c80-b4ec-2376753942d9\") " pod="openshift-cluster-node-tuning-operator/tuned-88nf2"
Jul 30 20:24:50.684151 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.683973    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/208efd11-d3ba-46c5-8afb-269d1fbf7217-cni-binary-copy\") pod \"multus-gdkdh\" (UID: \"208efd11-d3ba-46c5-8afb-269d1fbf7217\") " pod="openshift-multus/multus-gdkdh"
Jul 30 20:24:50.684151 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.684011    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a4829105-a873-467c-bfcb-88999090f719-var-lib-openvswitch\") pod \"ovnkube-node-j8dzm\" (UID: \"a4829105-a873-467c-bfcb-88999090f719\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8dzm"
Jul 30 20:24:50.684151 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.684051    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b5ea3ceb-c9e3-4ef4-920c-9b618c947bee-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nlpd2\" (UID: \"b5ea3ceb-c9e3-4ef4-920c-9b618c947bee\") " pod="openshift-multus/multus-additional-cni-plugins-nlpd2"
Jul 30 20:24:50.684151 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.684088    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b6859022-31c0-4474-afa1-e362c870ba13-device-dir\") pod \"aws-ebs-csi-driver-node-xjbjh\" (UID: \"b6859022-31c0-4474-afa1-e362c870ba13\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xjbjh"
Jul 30 20:24:50.684151 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.684119    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/208efd11-d3ba-46c5-8afb-269d1fbf7217-hostroot\") pod \"multus-gdkdh\" (UID: \"208efd11-d3ba-46c5-8afb-269d1fbf7217\") " pod="openshift-multus/multus-gdkdh"
Jul 30 20:24:50.684399 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.684167    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/208efd11-d3ba-46c5-8afb-269d1fbf7217-etc-kubernetes\") pod \"multus-gdkdh\" (UID: \"208efd11-d3ba-46c5-8afb-269d1fbf7217\") " pod="openshift-multus/multus-gdkdh"
Jul 30 20:24:50.684399 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.684196    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a4829105-a873-467c-bfcb-88999090f719-run-openvswitch\") pod \"ovnkube-node-j8dzm\" (UID: \"a4829105-a873-467c-bfcb-88999090f719\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8dzm"
Jul 30 20:24:50.684399 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.684263    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/99b20953-23a6-4c80-b4ec-2376753942d9-etc-systemd\") pod \"tuned-88nf2\" (UID: \"99b20953-23a6-4c80-b4ec-2376753942d9\") " pod="openshift-cluster-node-tuning-operator/tuned-88nf2"
Jul 30 20:24:50.684399 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.684305    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b5ea3ceb-c9e3-4ef4-920c-9b618c947bee-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nlpd2\" (UID: \"b5ea3ceb-c9e3-4ef4-920c-9b618c947bee\") " pod="openshift-multus/multus-additional-cni-plugins-nlpd2"
Jul 30 20:24:50.684588 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.684442    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jr8t6\" (UniqueName: \"kubernetes.io/projected/b5ea3ceb-c9e3-4ef4-920c-9b618c947bee-kube-api-access-jr8t6\") pod \"multus-additional-cni-plugins-nlpd2\" (UID: \"b5ea3ceb-c9e3-4ef4-920c-9b618c947bee\") " pod="openshift-multus/multus-additional-cni-plugins-nlpd2"
Jul 30 20:24:50.684588 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.684474    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/990f6547-5422-4136-b3e1-39982c7f3660-iptables-alerter-script\") pod \"iptables-alerter-8rsxs\" (UID: \"990f6547-5422-4136-b3e1-39982c7f3660\") " pod="openshift-network-operator/iptables-alerter-8rsxs"
Jul 30 20:24:50.684588 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.684515    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c27cd9e-72be-4a13-8deb-f4c3ffe3ecea-metrics-certs\") pod \"network-metrics-daemon-jfpt4\" (UID: \"9c27cd9e-72be-4a13-8deb-f4c3ffe3ecea\") " pod="openshift-multus/network-metrics-daemon-jfpt4"
Jul 30 20:24:50.684588 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.684563    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a4829105-a873-467c-bfcb-88999090f719-run-systemd\") pod \"ovnkube-node-j8dzm\" (UID: \"a4829105-a873-467c-bfcb-88999090f719\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8dzm"
Jul 30 20:24:50.684756 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.684630    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/99b20953-23a6-4c80-b4ec-2376753942d9-etc-sysctl-conf\") pod \"tuned-88nf2\" (UID: \"99b20953-23a6-4c80-b4ec-2376753942d9\") " pod="openshift-cluster-node-tuning-operator/tuned-88nf2"
Jul 30 20:24:50.684756 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.684666    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2zssg\" (UniqueName: \"kubernetes.io/projected/e5d61971-62cc-436c-9d5c-a3abec7a47d4-kube-api-access-2zssg\") pod \"node-ca-czmdm\" (UID: \"e5d61971-62cc-436c-9d5c-a3abec7a47d4\") " pod="openshift-image-registry/node-ca-czmdm"
Jul 30 20:24:50.684756 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.684696    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/208efd11-d3ba-46c5-8afb-269d1fbf7217-multus-cni-dir\") pod \"multus-gdkdh\" (UID: \"208efd11-d3ba-46c5-8afb-269d1fbf7217\") " pod="openshift-multus/multus-gdkdh"
Jul 30 20:24:50.684756 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.684726    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/208efd11-d3ba-46c5-8afb-269d1fbf7217-host-run-k8s-cni-cncf-io\") pod \"multus-gdkdh\" (UID: \"208efd11-d3ba-46c5-8afb-269d1fbf7217\") " pod="openshift-multus/multus-gdkdh"
Jul 30 20:24:50.684934 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.684758    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/208efd11-d3ba-46c5-8afb-269d1fbf7217-multus-conf-dir\") pod \"multus-gdkdh\" (UID: \"208efd11-d3ba-46c5-8afb-269d1fbf7217\") " pod="openshift-multus/multus-gdkdh"
Jul 30 20:24:50.684934 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.684800    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/208efd11-d3ba-46c5-8afb-269d1fbf7217-host-run-multus-certs\") pod \"multus-gdkdh\" (UID: \"208efd11-d3ba-46c5-8afb-269d1fbf7217\") " pod="openshift-multus/multus-gdkdh"
Jul 30 20:24:50.684934 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.684834    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/990f6547-5422-4136-b3e1-39982c7f3660-host-slash\") pod \"iptables-alerter-8rsxs\" (UID: \"990f6547-5422-4136-b3e1-39982c7f3660\") " pod="openshift-network-operator/iptables-alerter-8rsxs"
Jul 30 20:24:50.684934 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.684884    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a4829105-a873-467c-bfcb-88999090f719-host-kubelet\") pod \"ovnkube-node-j8dzm\" (UID: \"a4829105-a873-467c-bfcb-88999090f719\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8dzm"
Jul 30 20:24:50.684934 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.684916    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/99b20953-23a6-4c80-b4ec-2376753942d9-etc-kubernetes\") pod \"tuned-88nf2\" (UID: \"99b20953-23a6-4c80-b4ec-2376753942d9\") " pod="openshift-cluster-node-tuning-operator/tuned-88nf2"
Jul 30 20:24:50.685145 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.684946    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/99b20953-23a6-4c80-b4ec-2376753942d9-lib-modules\") pod \"tuned-88nf2\" (UID: \"99b20953-23a6-4c80-b4ec-2376753942d9\") " pod="openshift-cluster-node-tuning-operator/tuned-88nf2"
Jul 30 20:24:50.685145 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.684971    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mfvh2\" (UniqueName: \"kubernetes.io/projected/99b20953-23a6-4c80-b4ec-2376753942d9-kube-api-access-mfvh2\") pod \"tuned-88nf2\" (UID: \"99b20953-23a6-4c80-b4ec-2376753942d9\") " pod="openshift-cluster-node-tuning-operator/tuned-88nf2"
Jul 30 20:24:50.685145 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.685000    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e5d61971-62cc-436c-9d5c-a3abec7a47d4-host\") pod \"node-ca-czmdm\" (UID: \"e5d61971-62cc-436c-9d5c-a3abec7a47d4\") " pod="openshift-image-registry/node-ca-czmdm"
Jul 30 20:24:50.685145 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.685097    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b5ea3ceb-c9e3-4ef4-920c-9b618c947bee-os-release\") pod \"multus-additional-cni-plugins-nlpd2\" (UID: \"b5ea3ceb-c9e3-4ef4-920c-9b618c947bee\") " pod="openshift-multus/multus-additional-cni-plugins-nlpd2"
Jul 30 20:24:50.685311 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.685145    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/208efd11-d3ba-46c5-8afb-269d1fbf7217-host-var-lib-cni-multus\") pod \"multus-gdkdh\" (UID: \"208efd11-d3ba-46c5-8afb-269d1fbf7217\") " pod="openshift-multus/multus-gdkdh"
Jul 30 20:24:50.685311 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.685185    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/208efd11-d3ba-46c5-8afb-269d1fbf7217-host-var-lib-kubelet\") pod \"multus-gdkdh\" (UID: \"208efd11-d3ba-46c5-8afb-269d1fbf7217\") " pod="openshift-multus/multus-gdkdh"
Jul 30 20:24:50.685311 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.685236    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zb84s\" (UniqueName: \"kubernetes.io/projected/208efd11-d3ba-46c5-8afb-269d1fbf7217-kube-api-access-zb84s\") pod \"multus-gdkdh\" (UID: \"208efd11-d3ba-46c5-8afb-269d1fbf7217\") " pod="openshift-multus/multus-gdkdh"
Jul 30 20:24:50.685311 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.685284    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/99b20953-23a6-4c80-b4ec-2376753942d9-sys\") pod \"tuned-88nf2\" (UID: \"99b20953-23a6-4c80-b4ec-2376753942d9\") " pod="openshift-cluster-node-tuning-operator/tuned-88nf2"
Jul 30 20:24:50.685485 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.685315    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b5ea3ceb-c9e3-4ef4-920c-9b618c947bee-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nlpd2\" (UID: \"b5ea3ceb-c9e3-4ef4-920c-9b618c947bee\") " pod="openshift-multus/multus-additional-cni-plugins-nlpd2"
Jul 30 20:24:50.685485 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.685372    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/346ac985-5c0d-4134-bc10-7727a294ef1f-tmp-dir\") pod \"node-resolver-26tfg\" (UID: \"346ac985-5c0d-4134-bc10-7727a294ef1f\") " pod="openshift-dns/node-resolver-26tfg"
Jul 30 20:24:50.685485 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.685409    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a4829105-a873-467c-bfcb-88999090f719-host-slash\") pod \"ovnkube-node-j8dzm\" (UID: \"a4829105-a873-467c-bfcb-88999090f719\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8dzm"
Jul 30 20:24:50.685485 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.685435    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a4829105-a873-467c-bfcb-88999090f719-host-run-netns\") pod \"ovnkube-node-j8dzm\" (UID: \"a4829105-a873-467c-bfcb-88999090f719\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8dzm"
Jul 30 20:24:50.685485 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.685473    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a4829105-a873-467c-bfcb-88999090f719-ovn-node-metrics-cert\") pod \"ovnkube-node-j8dzm\" (UID: \"a4829105-a873-467c-bfcb-88999090f719\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8dzm"
Jul 30 20:24:50.685730 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.685514    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/99b20953-23a6-4c80-b4ec-2376753942d9-etc-sysconfig\") pod \"tuned-88nf2\" (UID: \"99b20953-23a6-4c80-b4ec-2376753942d9\") " pod="openshift-cluster-node-tuning-operator/tuned-88nf2"
Jul 30 20:24:50.685730 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.685545    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/99b20953-23a6-4c80-b4ec-2376753942d9-etc-sysctl-d\") pod \"tuned-88nf2\" (UID: \"99b20953-23a6-4c80-b4ec-2376753942d9\") " pod="openshift-cluster-node-tuning-operator/tuned-88nf2"
Jul 30 20:24:50.685730 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.685580    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/208efd11-d3ba-46c5-8afb-269d1fbf7217-multus-daemon-config\") pod \"multus-gdkdh\" (UID: \"208efd11-d3ba-46c5-8afb-269d1fbf7217\") " pod="openshift-multus/multus-gdkdh"
Jul 30 20:24:50.685730 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.685620    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tnh6n\" (UniqueName: \"kubernetes.io/projected/97b781c0-bbe8-42ae-b54b-b42b759c87b4-kube-api-access-tnh6n\") pod \"network-check-target-k8jg9\" (UID: \"97b781c0-bbe8-42ae-b54b-b42b759c87b4\") " pod="openshift-network-diagnostics/network-check-target-k8jg9"
Jul 30 20:24:50.685730 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.685651    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a4829105-a873-467c-bfcb-88999090f719-systemd-units\") pod \"ovnkube-node-j8dzm\" (UID: \"a4829105-a873-467c-bfcb-88999090f719\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8dzm"
Jul 30 20:24:50.685730 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.685703    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a4829105-a873-467c-bfcb-88999090f719-etc-openvswitch\") pod \"ovnkube-node-j8dzm\" (UID: \"a4829105-a873-467c-bfcb-88999090f719\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8dzm"
Jul 30 20:24:50.685979 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.685847    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/99b20953-23a6-4c80-b4ec-2376753942d9-host\") pod \"tuned-88nf2\" (UID: \"99b20953-23a6-4c80-b4ec-2376753942d9\") " pod="openshift-cluster-node-tuning-operator/tuned-88nf2"
Jul 30 20:24:50.685979 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.685894    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/208efd11-d3ba-46c5-8afb-269d1fbf7217-cnibin\") pod \"multus-gdkdh\" (UID: \"208efd11-d3ba-46c5-8afb-269d1fbf7217\") " pod="openshift-multus/multus-gdkdh"
Jul 30 20:24:50.685979 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.685938    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/208efd11-d3ba-46c5-8afb-269d1fbf7217-host-var-lib-cni-bin\") pod \"multus-gdkdh\" (UID: \"208efd11-d3ba-46c5-8afb-269d1fbf7217\") " pod="openshift-multus/multus-gdkdh"
Jul 30 20:24:50.685979 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.685972    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2nw8c\" (UniqueName: \"kubernetes.io/projected/9c27cd9e-72be-4a13-8deb-f4c3ffe3ecea-kube-api-access-2nw8c\") pod \"network-metrics-daemon-jfpt4\" (UID: \"9c27cd9e-72be-4a13-8deb-f4c3ffe3ecea\") " pod="openshift-multus/network-metrics-daemon-jfpt4"
Jul 30 20:24:50.686823 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.686799    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/208efd11-d3ba-46c5-8afb-269d1fbf7217-host-var-lib-kubelet\") pod \"multus-gdkdh\" (UID: \"208efd11-d3ba-46c5-8afb-269d1fbf7217\") " pod="openshift-multus/multus-gdkdh"
Jul 30 20:24:50.686938 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:24:50.686915    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 20:24:50.687006 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.686945    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/990f6547-5422-4136-b3e1-39982c7f3660-iptables-alerter-script\") pod \"iptables-alerter-8rsxs\" (UID: \"990f6547-5422-4136-b3e1-39982c7f3660\") " pod="openshift-network-operator/iptables-alerter-8rsxs"
Jul 30 20:24:50.687400 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.687318    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b5ea3ceb-c9e3-4ef4-920c-9b618c947bee-cni-binary-copy\") pod \"multus-additional-cni-plugins-nlpd2\" (UID: \"b5ea3ceb-c9e3-4ef4-920c-9b618c947bee\") " pod="openshift-multus/multus-additional-cni-plugins-nlpd2"
Jul 30 20:24:50.687512 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.687470    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/208efd11-d3ba-46c5-8afb-269d1fbf7217-host-run-netns\") pod \"multus-gdkdh\" (UID: \"208efd11-d3ba-46c5-8afb-269d1fbf7217\") " pod="openshift-multus/multus-gdkdh"
Jul 30 20:24:50.687632 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.687615    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/99b20953-23a6-4c80-b4ec-2376753942d9-sys\") pod \"tuned-88nf2\" (UID: \"99b20953-23a6-4c80-b4ec-2376753942d9\") " pod="openshift-cluster-node-tuning-operator/tuned-88nf2"
Jul 30 20:24:50.688126 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.688106    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/346ac985-5c0d-4134-bc10-7727a294ef1f-hosts-file\") pod \"node-resolver-26tfg\" (UID: \"346ac985-5c0d-4134-bc10-7727a294ef1f\") " pod="openshift-dns/node-resolver-26tfg"
Jul 30 20:24:50.688252 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.688183    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/99b20953-23a6-4c80-b4ec-2376753942d9-run\") pod \"tuned-88nf2\" (UID: \"99b20953-23a6-4c80-b4ec-2376753942d9\") " pod="openshift-cluster-node-tuning-operator/tuned-88nf2"
Jul 30 20:24:50.688531 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.688507    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/99b20953-23a6-4c80-b4ec-2376753942d9-etc-sysconfig\") pod \"tuned-88nf2\" (UID: \"99b20953-23a6-4c80-b4ec-2376753942d9\") " pod="openshift-cluster-node-tuning-operator/tuned-88nf2"
Jul 30 20:24:50.688801 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.688545    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b5ea3ceb-c9e3-4ef4-920c-9b618c947bee-cnibin\") pod \"multus-additional-cni-plugins-nlpd2\" (UID: \"b5ea3ceb-c9e3-4ef4-920c-9b618c947bee\") " pod="openshift-multus/multus-additional-cni-plugins-nlpd2"
Jul 30 20:24:50.688801 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.688779    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/208efd11-d3ba-46c5-8afb-269d1fbf7217-cnibin\") pod \"multus-gdkdh\" (UID: \"208efd11-d3ba-46c5-8afb-269d1fbf7217\") " pod="openshift-multus/multus-gdkdh"
Jul 30 20:24:50.688985 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.688957    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/208efd11-d3ba-46c5-8afb-269d1fbf7217-host-var-lib-cni-bin\") pod \"multus-gdkdh\" (UID: \"208efd11-d3ba-46c5-8afb-269d1fbf7217\") " pod="openshift-multus/multus-gdkdh"
Jul 30 20:24:50.689060 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.689034    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4c453060-5f5c-4686-846e-a8875d6d9ead-konnectivity-ca\") pod \"konnectivity-agent-hkpd5\" (UID: \"4c453060-5f5c-4686-846e-a8875d6d9ead\") " pod="kube-system/konnectivity-agent-hkpd5"
Jul 30 20:24:50.689531 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.689504    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/99b20953-23a6-4c80-b4ec-2376753942d9-etc-sysctl-d\") pod \"tuned-88nf2\" (UID: \"99b20953-23a6-4c80-b4ec-2376753942d9\") " pod="openshift-cluster-node-tuning-operator/tuned-88nf2"
Jul 30 20:24:50.689677 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.689634    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/208efd11-d3ba-46c5-8afb-269d1fbf7217-multus-daemon-config\") pod \"multus-gdkdh\" (UID: \"208efd11-d3ba-46c5-8afb-269d1fbf7217\") " pod="openshift-multus/multus-gdkdh"
Jul 30 20:24:50.689785 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.689759    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/208efd11-d3ba-46c5-8afb-269d1fbf7217-etc-kubernetes\") pod \"multus-gdkdh\" (UID: \"208efd11-d3ba-46c5-8afb-269d1fbf7217\") " pod="openshift-multus/multus-gdkdh"
Jul 30 20:24:50.689876 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.689860    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/99b20953-23a6-4c80-b4ec-2376753942d9-host\") pod \"tuned-88nf2\" (UID: \"99b20953-23a6-4c80-b4ec-2376753942d9\") " pod="openshift-cluster-node-tuning-operator/tuned-88nf2"
Jul 30 20:24:50.689940 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.689864    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b5ea3ceb-c9e3-4ef4-920c-9b618c947bee-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nlpd2\" (UID: \"b5ea3ceb-c9e3-4ef4-920c-9b618c947bee\") " pod="openshift-multus/multus-additional-cni-plugins-nlpd2"
Jul 30 20:24:50.689940 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.689862    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b6859022-31c0-4474-afa1-e362c870ba13-registration-dir\") pod \"aws-ebs-csi-driver-node-xjbjh\" (UID: \"b6859022-31c0-4474-afa1-e362c870ba13\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xjbjh"
Jul 30 20:24:50.690041 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.689936    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/208efd11-d3ba-46c5-8afb-269d1fbf7217-os-release\") pod \"multus-gdkdh\" (UID: \"208efd11-d3ba-46c5-8afb-269d1fbf7217\") " pod="openshift-multus/multus-gdkdh"
Jul 30 20:24:50.690125 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.690094    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/346ac985-5c0d-4134-bc10-7727a294ef1f-tmp-dir\") pod \"node-resolver-26tfg\" (UID: \"346ac985-5c0d-4134-bc10-7727a294ef1f\") " pod="openshift-dns/node-resolver-26tfg"
Jul 30 20:24:50.690283 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.690264    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/208efd11-d3ba-46c5-8afb-269d1fbf7217-hostroot\") pod \"multus-gdkdh\" (UID: \"208efd11-d3ba-46c5-8afb-269d1fbf7217\") " pod="openshift-multus/multus-gdkdh"
Jul 30 20:24:50.690798 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.690770    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e5d61971-62cc-436c-9d5c-a3abec7a47d4-serviceca\") pod \"node-ca-czmdm\" (UID: \"e5d61971-62cc-436c-9d5c-a3abec7a47d4\") " pod="openshift-image-registry/node-ca-czmdm"
Jul 30 20:24:50.690955 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.690778    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b5ea3ceb-c9e3-4ef4-920c-9b618c947bee-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nlpd2\" (UID: \"b5ea3ceb-c9e3-4ef4-920c-9b618c947bee\") " pod="openshift-multus/multus-additional-cni-plugins-nlpd2"
Jul 30 20:24:50.691030 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.691013    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/990f6547-5422-4136-b3e1-39982c7f3660-host-slash\") pod \"iptables-alerter-8rsxs\" (UID: \"990f6547-5422-4136-b3e1-39982c7f3660\") " pod="openshift-network-operator/iptables-alerter-8rsxs"
Jul 30 20:24:50.692846 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.691166    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/99b20953-23a6-4c80-b4ec-2376753942d9-etc-sysctl-conf\") pod \"tuned-88nf2\" (UID: \"99b20953-23a6-4c80-b4ec-2376753942d9\") " pod="openshift-cluster-node-tuning-operator/tuned-88nf2"
Jul 30 20:24:50.692846 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.691414    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/208efd11-d3ba-46c5-8afb-269d1fbf7217-multus-cni-dir\") pod \"multus-gdkdh\" (UID: \"208efd11-d3ba-46c5-8afb-269d1fbf7217\") " pod="openshift-multus/multus-gdkdh"
Jul 30 20:24:50.692846 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.691475    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/208efd11-d3ba-46c5-8afb-269d1fbf7217-host-run-k8s-cni-cncf-io\") pod \"multus-gdkdh\" (UID: \"208efd11-d3ba-46c5-8afb-269d1fbf7217\") " pod="openshift-multus/multus-gdkdh"
Jul 30 20:24:50.692846 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.691558    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/208efd11-d3ba-46c5-8afb-269d1fbf7217-multus-conf-dir\") pod \"multus-gdkdh\" (UID: \"208efd11-d3ba-46c5-8afb-269d1fbf7217\") " pod="openshift-multus/multus-gdkdh"
Jul 30 20:24:50.692846 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.691560    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/208efd11-d3ba-46c5-8afb-269d1fbf7217-host-run-multus-certs\") pod \"multus-gdkdh\" (UID: \"208efd11-d3ba-46c5-8afb-269d1fbf7217\") " pod="openshift-multus/multus-gdkdh"
Jul 30 20:24:50.692846 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.691759    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/208efd11-d3ba-46c5-8afb-269d1fbf7217-multus-socket-dir-parent\") pod \"multus-gdkdh\" (UID: \"208efd11-d3ba-46c5-8afb-269d1fbf7217\") " pod="openshift-multus/multus-gdkdh"
Jul 30 20:24:50.692846 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.691769    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/99b20953-23a6-4c80-b4ec-2376753942d9-tmp\") pod \"tuned-88nf2\" (UID: \"99b20953-23a6-4c80-b4ec-2376753942d9\") " pod="openshift-cluster-node-tuning-operator/tuned-88nf2"
Jul 30 20:24:50.692846 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.691831    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/99b20953-23a6-4c80-b4ec-2376753942d9-etc-systemd\") pod \"tuned-88nf2\" (UID: \"99b20953-23a6-4c80-b4ec-2376753942d9\") " pod="openshift-cluster-node-tuning-operator/tuned-88nf2"
Jul 30 20:24:50.692846 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.691965    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/99b20953-23a6-4c80-b4ec-2376753942d9-etc-modprobe-d\") pod \"tuned-88nf2\" (UID: \"99b20953-23a6-4c80-b4ec-2376753942d9\") " pod="openshift-cluster-node-tuning-operator/tuned-88nf2"
Jul 30 20:24:50.692846 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.691972    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/99b20953-23a6-4c80-b4ec-2376753942d9-lib-modules\") pod \"tuned-88nf2\" (UID: \"99b20953-23a6-4c80-b4ec-2376753942d9\") " pod="openshift-cluster-node-tuning-operator/tuned-88nf2"
Jul 30 20:24:50.692846 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.692560    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/208efd11-d3ba-46c5-8afb-269d1fbf7217-cni-binary-copy\") pod \"multus-gdkdh\" (UID: \"208efd11-d3ba-46c5-8afb-269d1fbf7217\") " pod="openshift-multus/multus-gdkdh"
Jul 30 20:24:50.692846 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.692571    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e5d61971-62cc-436c-9d5c-a3abec7a47d4-host\") pod \"node-ca-czmdm\" (UID: \"e5d61971-62cc-436c-9d5c-a3abec7a47d4\") " pod="openshift-image-registry/node-ca-czmdm"
Jul 30 20:24:50.692846 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.692585    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b5ea3ceb-c9e3-4ef4-920c-9b618c947bee-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nlpd2\" (UID: \"b5ea3ceb-c9e3-4ef4-920c-9b618c947bee\") " pod="openshift-multus/multus-additional-cni-plugins-nlpd2"
Jul 30 20:24:50.692846 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:24:50.692619    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c27cd9e-72be-4a13-8deb-f4c3ffe3ecea-metrics-certs podName:9c27cd9e-72be-4a13-8deb-f4c3ffe3ecea nodeName:}" failed. No retries permitted until 2026-07-30 20:24:51.18696171 +0000 UTC m=+3.028437326 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9c27cd9e-72be-4a13-8deb-f4c3ffe3ecea-metrics-certs") pod "network-metrics-daemon-jfpt4" (UID: "9c27cd9e-72be-4a13-8deb-f4c3ffe3ecea") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 20:24:50.692846 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.692642    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b6859022-31c0-4474-afa1-e362c870ba13-device-dir\") pod \"aws-ebs-csi-driver-node-xjbjh\" (UID: \"b6859022-31c0-4474-afa1-e362c870ba13\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xjbjh"
Jul 30 20:24:50.692846 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.692649    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b5ea3ceb-c9e3-4ef4-920c-9b618c947bee-os-release\") pod \"multus-additional-cni-plugins-nlpd2\" (UID: \"b5ea3ceb-c9e3-4ef4-920c-9b618c947bee\") " pod="openshift-multus/multus-additional-cni-plugins-nlpd2"
Jul 30 20:24:50.692846 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.692697    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/208efd11-d3ba-46c5-8afb-269d1fbf7217-host-var-lib-cni-multus\") pod \"multus-gdkdh\" (UID: \"208efd11-d3ba-46c5-8afb-269d1fbf7217\") " pod="openshift-multus/multus-gdkdh"
Jul 30 20:24:50.693835 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.692742    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9f8z\" (UniqueName: \"kubernetes.io/projected/346ac985-5c0d-4134-bc10-7727a294ef1f-kube-api-access-b9f8z\") pod \"node-resolver-26tfg\" (UID: \"346ac985-5c0d-4134-bc10-7727a294ef1f\") " pod="openshift-dns/node-resolver-26tfg"
Jul 30 20:24:50.693835 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.692766    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/99b20953-23a6-4c80-b4ec-2376753942d9-etc-kubernetes\") pod \"tuned-88nf2\" (UID: \"99b20953-23a6-4c80-b4ec-2376753942d9\") " pod="openshift-cluster-node-tuning-operator/tuned-88nf2"
Jul 30 20:24:50.693949 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.693859    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/99b20953-23a6-4c80-b4ec-2376753942d9-etc-tuned\") pod \"tuned-88nf2\" (UID: \"99b20953-23a6-4c80-b4ec-2376753942d9\") " pod="openshift-cluster-node-tuning-operator/tuned-88nf2"
Jul 30 20:24:50.693949 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.693938    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4c453060-5f5c-4686-846e-a8875d6d9ead-agent-certs\") pod \"konnectivity-agent-hkpd5\" (UID: \"4c453060-5f5c-4686-846e-a8875d6d9ead\") " pod="kube-system/konnectivity-agent-hkpd5"
Jul 30 20:24:50.705180 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:24:50.705137    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 30 20:24:50.705296 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:24:50.705223    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 30 20:24:50.705367 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:24:50.705300    2583 projected.go:196] Error preparing data for projected volume kube-api-access-tnh6n for pod openshift-network-diagnostics/network-check-target-k8jg9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 20:24:50.705656 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:24:50.705434    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/97b781c0-bbe8-42ae-b54b-b42b759c87b4-kube-api-access-tnh6n podName:97b781c0-bbe8-42ae-b54b-b42b759c87b4 nodeName:}" failed. No retries permitted until 2026-07-30 20:24:51.20541521 +0000 UTC m=+3.046890835 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-tnh6n" (UniqueName: "kubernetes.io/projected/97b781c0-bbe8-42ae-b54b-b42b759c87b4-kube-api-access-tnh6n") pod "network-check-target-k8jg9" (UID: "97b781c0-bbe8-42ae-b54b-b42b759c87b4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 20:24:50.706312 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.706201    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2nw8c\" (UniqueName: \"kubernetes.io/projected/9c27cd9e-72be-4a13-8deb-f4c3ffe3ecea-kube-api-access-2nw8c\") pod \"network-metrics-daemon-jfpt4\" (UID: \"9c27cd9e-72be-4a13-8deb-f4c3ffe3ecea\") " pod="openshift-multus/network-metrics-daemon-jfpt4"
Jul 30 20:24:50.707393 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.707366    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zb84s\" (UniqueName: \"kubernetes.io/projected/208efd11-d3ba-46c5-8afb-269d1fbf7217-kube-api-access-zb84s\") pod \"multus-gdkdh\" (UID: \"208efd11-d3ba-46c5-8afb-269d1fbf7217\") " pod="openshift-multus/multus-gdkdh"
Jul 30 20:24:50.707393 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.707384    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jr8t6\" (UniqueName: \"kubernetes.io/projected/b5ea3ceb-c9e3-4ef4-920c-9b618c947bee-kube-api-access-jr8t6\") pod \"multus-additional-cni-plugins-nlpd2\" (UID: \"b5ea3ceb-c9e3-4ef4-920c-9b618c947bee\") " pod="openshift-multus/multus-additional-cni-plugins-nlpd2"
Jul 30 20:24:50.708273 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.708247    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h65ck\" (UniqueName: \"kubernetes.io/projected/b6859022-31c0-4474-afa1-e362c870ba13-kube-api-access-h65ck\") pod \"aws-ebs-csi-driver-node-xjbjh\" (UID: \"b6859022-31c0-4474-afa1-e362c870ba13\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xjbjh"
Jul 30 20:24:50.708413 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.708353    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2zssg\" (UniqueName: \"kubernetes.io/projected/e5d61971-62cc-436c-9d5c-a3abec7a47d4-kube-api-access-2zssg\") pod \"node-ca-czmdm\" (UID: \"e5d61971-62cc-436c-9d5c-a3abec7a47d4\") " pod="openshift-image-registry/node-ca-czmdm"
Jul 30 20:24:50.709098 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.709077    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2kkv\" (UniqueName: \"kubernetes.io/projected/990f6547-5422-4136-b3e1-39982c7f3660-kube-api-access-x2kkv\") pod \"iptables-alerter-8rsxs\" (UID: \"990f6547-5422-4136-b3e1-39982c7f3660\") " pod="openshift-network-operator/iptables-alerter-8rsxs"
Jul 30 20:24:50.709397 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.709354    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfvh2\" (UniqueName: \"kubernetes.io/projected/99b20953-23a6-4c80-b4ec-2376753942d9-kube-api-access-mfvh2\") pod \"tuned-88nf2\" (UID: \"99b20953-23a6-4c80-b4ec-2376753942d9\") " pod="openshift-cluster-node-tuning-operator/tuned-88nf2"
Jul 30 20:24:50.786510 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.786485    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a4829105-a873-467c-bfcb-88999090f719-run-systemd\") pod \"ovnkube-node-j8dzm\" (UID: \"a4829105-a873-467c-bfcb-88999090f719\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8dzm"
Jul 30 20:24:50.786657 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.786518    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a4829105-a873-467c-bfcb-88999090f719-host-kubelet\") pod \"ovnkube-node-j8dzm\" (UID: \"a4829105-a873-467c-bfcb-88999090f719\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8dzm"
Jul 30 20:24:50.786657 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.786547    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a4829105-a873-467c-bfcb-88999090f719-host-slash\") pod \"ovnkube-node-j8dzm\" (UID: \"a4829105-a873-467c-bfcb-88999090f719\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8dzm"
Jul 30 20:24:50.786657 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.786611    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a4829105-a873-467c-bfcb-88999090f719-host-slash\") pod \"ovnkube-node-j8dzm\" (UID: \"a4829105-a873-467c-bfcb-88999090f719\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8dzm"
Jul 30 20:24:50.786657 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.786615    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a4829105-a873-467c-bfcb-88999090f719-run-systemd\") pod \"ovnkube-node-j8dzm\" (UID: \"a4829105-a873-467c-bfcb-88999090f719\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8dzm"
Jul 30 20:24:50.786657 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.786632    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a4829105-a873-467c-bfcb-88999090f719-host-kubelet\") pod \"ovnkube-node-j8dzm\" (UID: \"a4829105-a873-467c-bfcb-88999090f719\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8dzm"
Jul 30 20:24:50.786879 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.786667    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a4829105-a873-467c-bfcb-88999090f719-host-run-netns\") pod \"ovnkube-node-j8dzm\" (UID: \"a4829105-a873-467c-bfcb-88999090f719\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8dzm"
Jul 30 20:24:50.786879 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.786698    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a4829105-a873-467c-bfcb-88999090f719-ovn-node-metrics-cert\") pod \"ovnkube-node-j8dzm\" (UID: \"a4829105-a873-467c-bfcb-88999090f719\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8dzm"
Jul 30 20:24:50.786879 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.786741    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a4829105-a873-467c-bfcb-88999090f719-systemd-units\") pod \"ovnkube-node-j8dzm\" (UID: \"a4829105-a873-467c-bfcb-88999090f719\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8dzm"
Jul 30 20:24:50.786879 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.786767    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a4829105-a873-467c-bfcb-88999090f719-etc-openvswitch\") pod \"ovnkube-node-j8dzm\" (UID: \"a4829105-a873-467c-bfcb-88999090f719\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8dzm"
Jul 30 20:24:50.786879 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.786743    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a4829105-a873-467c-bfcb-88999090f719-host-run-netns\") pod \"ovnkube-node-j8dzm\" (UID: \"a4829105-a873-467c-bfcb-88999090f719\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8dzm"
Jul 30 20:24:50.786879 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.786807    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a4829105-a873-467c-bfcb-88999090f719-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-j8dzm\" (UID: \"a4829105-a873-467c-bfcb-88999090f719\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8dzm"
Jul 30 20:24:50.786879 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.786835    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a4829105-a873-467c-bfcb-88999090f719-ovnkube-script-lib\") pod \"ovnkube-node-j8dzm\" (UID: \"a4829105-a873-467c-bfcb-88999090f719\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8dzm"
Jul 30 20:24:50.786879 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.786858    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a4829105-a873-467c-bfcb-88999090f719-systemd-units\") pod \"ovnkube-node-j8dzm\" (UID: \"a4829105-a873-467c-bfcb-88999090f719\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8dzm"
Jul 30 20:24:50.786879 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.786861    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hs8wg\" (UniqueName: \"kubernetes.io/projected/a4829105-a873-467c-bfcb-88999090f719-kube-api-access-hs8wg\") pod \"ovnkube-node-j8dzm\" (UID: \"a4829105-a873-467c-bfcb-88999090f719\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8dzm"
Jul 30 20:24:50.787362 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.786902    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/01f71a23-f22f-44f3-b7d6-3ba3050b69fa-dbus\") pod \"global-pull-secret-syncer-8g9tl\" (UID: \"01f71a23-f22f-44f3-b7d6-3ba3050b69fa\") " pod="kube-system/global-pull-secret-syncer-8g9tl"
Jul 30 20:24:50.787362 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.786933    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a4829105-a873-467c-bfcb-88999090f719-host-cni-netd\") pod \"ovnkube-node-j8dzm\" (UID: \"a4829105-a873-467c-bfcb-88999090f719\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8dzm"
Jul 30 20:24:50.787362 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.786985    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a4829105-a873-467c-bfcb-88999090f719-run-ovn\") pod \"ovnkube-node-j8dzm\" (UID: \"a4829105-a873-467c-bfcb-88999090f719\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8dzm"
Jul 30 20:24:50.787362 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.787012    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/01f71a23-f22f-44f3-b7d6-3ba3050b69fa-kubelet-config\") pod \"global-pull-secret-syncer-8g9tl\" (UID: \"01f71a23-f22f-44f3-b7d6-3ba3050b69fa\") " pod="kube-system/global-pull-secret-syncer-8g9tl"
Jul 30 20:24:50.787362 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.787039    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a4829105-a873-467c-bfcb-88999090f719-host-cni-bin\") pod \"ovnkube-node-j8dzm\" (UID: \"a4829105-a873-467c-bfcb-88999090f719\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8dzm"
Jul 30 20:24:50.787362 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.787064    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a4829105-a873-467c-bfcb-88999090f719-log-socket\") pod \"ovnkube-node-j8dzm\" (UID: \"a4829105-a873-467c-bfcb-88999090f719\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8dzm"
Jul 30 20:24:50.787362 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.787083    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a4829105-a873-467c-bfcb-88999090f719-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-j8dzm\" (UID: \"a4829105-a873-467c-bfcb-88999090f719\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8dzm"
Jul 30 20:24:50.787362 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.787094    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/01f71a23-f22f-44f3-b7d6-3ba3050b69fa-original-pull-secret\") pod \"global-pull-secret-syncer-8g9tl\" (UID: \"01f71a23-f22f-44f3-b7d6-3ba3050b69fa\") " pod="kube-system/global-pull-secret-syncer-8g9tl"
Jul 30 20:24:50.787362 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.787163    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a4829105-a873-467c-bfcb-88999090f719-etc-openvswitch\") pod \"ovnkube-node-j8dzm\" (UID: \"a4829105-a873-467c-bfcb-88999090f719\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8dzm"
Jul 30 20:24:50.787362 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.787194    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a4829105-a873-467c-bfcb-88999090f719-node-log\") pod \"ovnkube-node-j8dzm\" (UID: \"a4829105-a873-467c-bfcb-88999090f719\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8dzm"
Jul 30 20:24:50.787362 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.787226    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a4829105-a873-467c-bfcb-88999090f719-host-run-ovn-kubernetes\") pod \"ovnkube-node-j8dzm\" (UID: \"a4829105-a873-467c-bfcb-88999090f719\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8dzm"
Jul 30 20:24:50.787362 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.787221    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/01f71a23-f22f-44f3-b7d6-3ba3050b69fa-dbus\") pod \"global-pull-secret-syncer-8g9tl\" (UID: \"01f71a23-f22f-44f3-b7d6-3ba3050b69fa\") " pod="kube-system/global-pull-secret-syncer-8g9tl"
Jul 30 20:24:50.787362 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.787257    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a4829105-a873-467c-bfcb-88999090f719-ovnkube-config\") pod \"ovnkube-node-j8dzm\" (UID: \"a4829105-a873-467c-bfcb-88999090f719\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8dzm"
Jul 30 20:24:50.787362 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.787284    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a4829105-a873-467c-bfcb-88999090f719-env-overrides\") pod \"ovnkube-node-j8dzm\" (UID: \"a4829105-a873-467c-bfcb-88999090f719\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8dzm"
Jul 30 20:24:50.787362 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.787290    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a4829105-a873-467c-bfcb-88999090f719-host-cni-netd\") pod \"ovnkube-node-j8dzm\" (UID: \"a4829105-a873-467c-bfcb-88999090f719\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8dzm"
Jul 30 20:24:50.787362 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.787315    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a4829105-a873-467c-bfcb-88999090f719-var-lib-openvswitch\") pod \"ovnkube-node-j8dzm\" (UID: \"a4829105-a873-467c-bfcb-88999090f719\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8dzm"
Jul 30 20:24:50.787362 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.787332    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a4829105-a873-467c-bfcb-88999090f719-run-ovn\") pod \"ovnkube-node-j8dzm\" (UID: \"a4829105-a873-467c-bfcb-88999090f719\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8dzm"
Jul 30 20:24:50.788253 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.787347    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a4829105-a873-467c-bfcb-88999090f719-run-openvswitch\") pod \"ovnkube-node-j8dzm\" (UID: \"a4829105-a873-467c-bfcb-88999090f719\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8dzm"
Jul 30 20:24:50.788253 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.787384    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/01f71a23-f22f-44f3-b7d6-3ba3050b69fa-kubelet-config\") pod \"global-pull-secret-syncer-8g9tl\" (UID: \"01f71a23-f22f-44f3-b7d6-3ba3050b69fa\") " pod="kube-system/global-pull-secret-syncer-8g9tl"
Jul 30 20:24:50.788253 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.787419    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a4829105-a873-467c-bfcb-88999090f719-log-socket\") pod \"ovnkube-node-j8dzm\" (UID: \"a4829105-a873-467c-bfcb-88999090f719\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8dzm"
Jul 30 20:24:50.788253 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.787432    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a4829105-a873-467c-bfcb-88999090f719-run-openvswitch\") pod \"ovnkube-node-j8dzm\" (UID: \"a4829105-a873-467c-bfcb-88999090f719\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8dzm"
Jul 30 20:24:50.788253 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.787480    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a4829105-a873-467c-bfcb-88999090f719-host-cni-bin\") pod \"ovnkube-node-j8dzm\" (UID: \"a4829105-a873-467c-bfcb-88999090f719\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8dzm"
Jul 30 20:24:50.788253 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:24:50.787485    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 30 20:24:50.788253 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:24:50.787557    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01f71a23-f22f-44f3-b7d6-3ba3050b69fa-original-pull-secret podName:01f71a23-f22f-44f3-b7d6-3ba3050b69fa nodeName:}" failed. No retries permitted until 2026-07-30 20:24:51.287537506 +0000 UTC m=+3.129013124 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/01f71a23-f22f-44f3-b7d6-3ba3050b69fa-original-pull-secret") pod "global-pull-secret-syncer-8g9tl" (UID: "01f71a23-f22f-44f3-b7d6-3ba3050b69fa") : object "kube-system"/"original-pull-secret" not registered
Jul 30 20:24:50.788253 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.787615    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a4829105-a873-467c-bfcb-88999090f719-node-log\") pod \"ovnkube-node-j8dzm\" (UID: \"a4829105-a873-467c-bfcb-88999090f719\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8dzm"
Jul 30 20:24:50.788253 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.787675    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a4829105-a873-467c-bfcb-88999090f719-host-run-ovn-kubernetes\") pod \"ovnkube-node-j8dzm\" (UID: \"a4829105-a873-467c-bfcb-88999090f719\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8dzm"
Jul 30 20:24:50.788253 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.787687    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a4829105-a873-467c-bfcb-88999090f719-ovnkube-script-lib\") pod \"ovnkube-node-j8dzm\" (UID: \"a4829105-a873-467c-bfcb-88999090f719\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8dzm"
Jul 30 20:24:50.788253 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.787727    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a4829105-a873-467c-bfcb-88999090f719-var-lib-openvswitch\") pod \"ovnkube-node-j8dzm\" (UID: \"a4829105-a873-467c-bfcb-88999090f719\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8dzm"
Jul 30 20:24:50.788253 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.787970    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a4829105-a873-467c-bfcb-88999090f719-ovnkube-config\") pod \"ovnkube-node-j8dzm\" (UID: \"a4829105-a873-467c-bfcb-88999090f719\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8dzm"
Jul 30 20:24:50.788253 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.788083    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a4829105-a873-467c-bfcb-88999090f719-env-overrides\") pod \"ovnkube-node-j8dzm\" (UID: \"a4829105-a873-467c-bfcb-88999090f719\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8dzm"
Jul 30 20:24:50.789391 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.789371    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a4829105-a873-467c-bfcb-88999090f719-ovn-node-metrics-cert\") pod \"ovnkube-node-j8dzm\" (UID: \"a4829105-a873-467c-bfcb-88999090f719\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8dzm"
Jul 30 20:24:50.796600 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.796535    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hs8wg\" (UniqueName: \"kubernetes.io/projected/a4829105-a873-467c-bfcb-88999090f719-kube-api-access-hs8wg\") pod \"ovnkube-node-j8dzm\" (UID: \"a4829105-a873-467c-bfcb-88999090f719\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8dzm"
Jul 30 20:24:50.847900 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.847875    2583 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 30 20:24:50.867554 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.867528    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8rsxs"
Jul 30 20:24:50.878828 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.878804    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hkpd5"
Jul 30 20:24:50.887639 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.887614    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-czmdm"
Jul 30 20:24:50.895370 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.895350    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-nlpd2"
Jul 30 20:24:50.902824 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.902804    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xjbjh"
Jul 30 20:24:50.911482 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.911460    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-gdkdh"
Jul 30 20:24:50.919122 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.919104    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-26tfg"
Jul 30 20:24:50.926750 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.926723    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-88nf2"
Jul 30 20:24:50.933445 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:50.933426    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-j8dzm"
Jul 30 20:24:51.190249 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:51.190207    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c27cd9e-72be-4a13-8deb-f4c3ffe3ecea-metrics-certs\") pod \"network-metrics-daemon-jfpt4\" (UID: \"9c27cd9e-72be-4a13-8deb-f4c3ffe3ecea\") " pod="openshift-multus/network-metrics-daemon-jfpt4"
Jul 30 20:24:51.190447 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:24:51.190372    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 20:24:51.190509 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:24:51.190455    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c27cd9e-72be-4a13-8deb-f4c3ffe3ecea-metrics-certs podName:9c27cd9e-72be-4a13-8deb-f4c3ffe3ecea nodeName:}" failed. No retries permitted until 2026-07-30 20:24:52.190432776 +0000 UTC m=+4.031908393 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9c27cd9e-72be-4a13-8deb-f4c3ffe3ecea-metrics-certs") pod "network-metrics-daemon-jfpt4" (UID: "9c27cd9e-72be-4a13-8deb-f4c3ffe3ecea") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 20:24:51.290706 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:51.290671    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tnh6n\" (UniqueName: \"kubernetes.io/projected/97b781c0-bbe8-42ae-b54b-b42b759c87b4-kube-api-access-tnh6n\") pod \"network-check-target-k8jg9\" (UID: \"97b781c0-bbe8-42ae-b54b-b42b759c87b4\") " pod="openshift-network-diagnostics/network-check-target-k8jg9"
Jul 30 20:24:51.290909 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:51.290721    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/01f71a23-f22f-44f3-b7d6-3ba3050b69fa-original-pull-secret\") pod \"global-pull-secret-syncer-8g9tl\" (UID: \"01f71a23-f22f-44f3-b7d6-3ba3050b69fa\") " pod="kube-system/global-pull-secret-syncer-8g9tl"
Jul 30 20:24:51.290909 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:24:51.290818    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 30 20:24:51.290909 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:24:51.290842    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 30 20:24:51.290909 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:24:51.290868    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 30 20:24:51.290909 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:24:51.290875    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01f71a23-f22f-44f3-b7d6-3ba3050b69fa-original-pull-secret podName:01f71a23-f22f-44f3-b7d6-3ba3050b69fa nodeName:}" failed. No retries permitted until 2026-07-30 20:24:52.290860716 +0000 UTC m=+4.132336318 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/01f71a23-f22f-44f3-b7d6-3ba3050b69fa-original-pull-secret") pod "global-pull-secret-syncer-8g9tl" (UID: "01f71a23-f22f-44f3-b7d6-3ba3050b69fa") : object "kube-system"/"original-pull-secret" not registered
Jul 30 20:24:51.290909 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:24:51.290879    2583 projected.go:196] Error preparing data for projected volume kube-api-access-tnh6n for pod openshift-network-diagnostics/network-check-target-k8jg9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 20:24:51.291311 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:24:51.290925    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/97b781c0-bbe8-42ae-b54b-b42b759c87b4-kube-api-access-tnh6n podName:97b781c0-bbe8-42ae-b54b-b42b759c87b4 nodeName:}" failed. No retries permitted until 2026-07-30 20:24:52.290912123 +0000 UTC m=+4.132387724 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-tnh6n" (UniqueName: "kubernetes.io/projected/97b781c0-bbe8-42ae-b54b-b42b759c87b4-kube-api-access-tnh6n") pod "network-check-target-k8jg9" (UID: "97b781c0-bbe8-42ae-b54b-b42b759c87b4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 20:24:51.619324 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:51.619222    2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-29 20:19:51 +0000 UTC" deadline="2028-02-28 16:49:58.408402434 +0000 UTC"
Jul 30 20:24:51.619324 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:51.619260    2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13868h25m6.789147753s"
Jul 30 20:24:51.669705 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:51.669603    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jfpt4"
Jul 30 20:24:51.669787 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:24:51.669765    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jfpt4" podUID="9c27cd9e-72be-4a13-8deb-f4c3ffe3ecea"
Jul 30 20:24:51.671297 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:51.671271    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5d61971_62cc_436c_9d5c_a3abec7a47d4.slice/crio-3742075bad0cb504d7123d112d58754bc11fd2441ad6f9417c7cc89324b318a6 WatchSource:0}: Error finding container 3742075bad0cb504d7123d112d58754bc11fd2441ad6f9417c7cc89324b318a6: Status 404 returned error can't find the container with id 3742075bad0cb504d7123d112d58754bc11fd2441ad6f9417c7cc89324b318a6
Jul 30 20:24:51.673035 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:51.673013    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod990f6547_5422_4136_b3e1_39982c7f3660.slice/crio-4f77f6fe43780e62bcbae73a4b87711f6f460ccff0afedf8c64bd04153385da8 WatchSource:0}: Error finding container 4f77f6fe43780e62bcbae73a4b87711f6f460ccff0afedf8c64bd04153385da8: Status 404 returned error can't find the container with id 4f77f6fe43780e62bcbae73a4b87711f6f460ccff0afedf8c64bd04153385da8
Jul 30 20:24:51.673851 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:51.673825    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod208efd11_d3ba_46c5_8afb_269d1fbf7217.slice/crio-456ce3e2537cf3ca1e511db590e4015d81f75fd10aafd123a32bfb88c526a397 WatchSource:0}: Error finding container 456ce3e2537cf3ca1e511db590e4015d81f75fd10aafd123a32bfb88c526a397: Status 404 returned error can't find the container with id 456ce3e2537cf3ca1e511db590e4015d81f75fd10aafd123a32bfb88c526a397
Jul 30 20:24:51.675697 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:51.675604    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c453060_5f5c_4686_846e_a8875d6d9ead.slice/crio-c7501c2887755b4ca8fe931aa70d98d1f53eab2edaaa7ffc34062575df17b5d9 WatchSource:0}: Error finding container c7501c2887755b4ca8fe931aa70d98d1f53eab2edaaa7ffc34062575df17b5d9: Status 404 returned error can't find the container with id c7501c2887755b4ca8fe931aa70d98d1f53eab2edaaa7ffc34062575df17b5d9
Jul 30 20:24:51.677182 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:51.677129    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6859022_31c0_4474_afa1_e362c870ba13.slice/crio-ab0ad753b6a3fe0ea268c49103e2ca001e46c7e487cd9321e1366503e42a7bfa WatchSource:0}: Error finding container ab0ad753b6a3fe0ea268c49103e2ca001e46c7e487cd9321e1366503e42a7bfa: Status 404 returned error can't find the container with id ab0ad753b6a3fe0ea268c49103e2ca001e46c7e487cd9321e1366503e42a7bfa
Jul 30 20:24:51.679010 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:51.678980    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-gdkdh" event={"ID":"208efd11-d3ba-46c5-8afb-269d1fbf7217","Type":"ContainerStarted","Data":"456ce3e2537cf3ca1e511db590e4015d81f75fd10aafd123a32bfb88c526a397"}
Jul 30 20:24:51.679626 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:51.679490    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4829105_a873_467c_bfcb_88999090f719.slice/crio-602f432bfb18eb6e32309a7f288b9b83c46e768915e9ce7a7bd2befba4e9d546 WatchSource:0}: Error finding container 602f432bfb18eb6e32309a7f288b9b83c46e768915e9ce7a7bd2befba4e9d546: Status 404 returned error can't find the container with id 602f432bfb18eb6e32309a7f288b9b83c46e768915e9ce7a7bd2befba4e9d546
Jul 30 20:24:51.681490 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:51.681460    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8rsxs" event={"ID":"990f6547-5422-4136-b3e1-39982c7f3660","Type":"ContainerStarted","Data":"4f77f6fe43780e62bcbae73a4b87711f6f460ccff0afedf8c64bd04153385da8"}
Jul 30 20:24:51.682542 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:51.682188    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99b20953_23a6_4c80_b4ec_2376753942d9.slice/crio-89daf3fffe514272d86bec22f8886bffb14cb5a4dc65eef57c23657f518d222e WatchSource:0}: Error finding container 89daf3fffe514272d86bec22f8886bffb14cb5a4dc65eef57c23657f518d222e: Status 404 returned error can't find the container with id 89daf3fffe514272d86bec22f8886bffb14cb5a4dc65eef57c23657f518d222e
Jul 30 20:24:51.684507 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:24:51.683845    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod346ac985_5c0d_4134_bc10_7727a294ef1f.slice/crio-bad38ecb53b3d378438f8d0d384d9a00460821567595cdf9b81dbdbd8449e922 WatchSource:0}: Error finding container bad38ecb53b3d378438f8d0d384d9a00460821567595cdf9b81dbdbd8449e922: Status 404 returned error can't find the container with id bad38ecb53b3d378438f8d0d384d9a00460821567595cdf9b81dbdbd8449e922
Jul 30 20:24:51.685269 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:51.685242    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-czmdm" event={"ID":"e5d61971-62cc-436c-9d5c-a3abec7a47d4","Type":"ContainerStarted","Data":"3742075bad0cb504d7123d112d58754bc11fd2441ad6f9417c7cc89324b318a6"}
Jul 30 20:24:52.110873 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:52.110487    2583 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 30 20:24:52.199369 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:52.199287    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c27cd9e-72be-4a13-8deb-f4c3ffe3ecea-metrics-certs\") pod \"network-metrics-daemon-jfpt4\" (UID: \"9c27cd9e-72be-4a13-8deb-f4c3ffe3ecea\") " pod="openshift-multus/network-metrics-daemon-jfpt4"
Jul 30 20:24:52.199550 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:24:52.199437    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 20:24:52.199550 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:24:52.199503    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c27cd9e-72be-4a13-8deb-f4c3ffe3ecea-metrics-certs podName:9c27cd9e-72be-4a13-8deb-f4c3ffe3ecea nodeName:}" failed. No retries permitted until 2026-07-30 20:24:54.199483726 +0000 UTC m=+6.040959349 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9c27cd9e-72be-4a13-8deb-f4c3ffe3ecea-metrics-certs") pod "network-metrics-daemon-jfpt4" (UID: "9c27cd9e-72be-4a13-8deb-f4c3ffe3ecea") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 20:24:52.300832 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:52.299935    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/01f71a23-f22f-44f3-b7d6-3ba3050b69fa-original-pull-secret\") pod \"global-pull-secret-syncer-8g9tl\" (UID: \"01f71a23-f22f-44f3-b7d6-3ba3050b69fa\") " pod="kube-system/global-pull-secret-syncer-8g9tl"
Jul 30 20:24:52.300832 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:52.300024    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tnh6n\" (UniqueName: \"kubernetes.io/projected/97b781c0-bbe8-42ae-b54b-b42b759c87b4-kube-api-access-tnh6n\") pod \"network-check-target-k8jg9\" (UID: \"97b781c0-bbe8-42ae-b54b-b42b759c87b4\") " pod="openshift-network-diagnostics/network-check-target-k8jg9"
Jul 30 20:24:52.300832 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:24:52.300168    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 30 20:24:52.300832 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:24:52.300209    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 30 20:24:52.300832 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:24:52.300223    2583 projected.go:196] Error preparing data for projected volume kube-api-access-tnh6n for pod openshift-network-diagnostics/network-check-target-k8jg9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 20:24:52.300832 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:24:52.300289    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/97b781c0-bbe8-42ae-b54b-b42b759c87b4-kube-api-access-tnh6n podName:97b781c0-bbe8-42ae-b54b-b42b759c87b4 nodeName:}" failed. No retries permitted until 2026-07-30 20:24:54.300268658 +0000 UTC m=+6.141744261 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-tnh6n" (UniqueName: "kubernetes.io/projected/97b781c0-bbe8-42ae-b54b-b42b759c87b4-kube-api-access-tnh6n") pod "network-check-target-k8jg9" (UID: "97b781c0-bbe8-42ae-b54b-b42b759c87b4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 20:24:52.300832 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:24:52.300742    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 30 20:24:52.300832 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:24:52.300798    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01f71a23-f22f-44f3-b7d6-3ba3050b69fa-original-pull-secret podName:01f71a23-f22f-44f3-b7d6-3ba3050b69fa nodeName:}" failed. No retries permitted until 2026-07-30 20:24:54.30078052 +0000 UTC m=+6.142256137 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/01f71a23-f22f-44f3-b7d6-3ba3050b69fa-original-pull-secret") pod "global-pull-secret-syncer-8g9tl" (UID: "01f71a23-f22f-44f3-b7d6-3ba3050b69fa") : object "kube-system"/"original-pull-secret" not registered
Jul 30 20:24:52.620484 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:52.620327    2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-29 20:19:51 +0000 UTC" deadline="2028-01-20 17:00:44.190146201 +0000 UTC"
Jul 30 20:24:52.620484 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:52.620401    2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12932h35m51.569750409s"
Jul 30 20:24:52.671009 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:52.670330    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k8jg9"
Jul 30 20:24:52.671009 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:24:52.670458    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k8jg9" podUID="97b781c0-bbe8-42ae-b54b-b42b759c87b4"
Jul 30 20:24:52.671009 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:52.670861    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8g9tl"
Jul 30 20:24:52.671009 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:24:52.670957    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8g9tl" podUID="01f71a23-f22f-44f3-b7d6-3ba3050b69fa"
Jul 30 20:24:52.697868 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:52.697833    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-69.ec2.internal" event={"ID":"2601b49689453982163e65b62bf2dbc3","Type":"ContainerStarted","Data":"721c2eaa8b370a92a5c4bd794cecfbc91730865c80839917e59eaf5592944153"}
Jul 30 20:24:52.709920 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:52.709854    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-26tfg" event={"ID":"346ac985-5c0d-4134-bc10-7727a294ef1f","Type":"ContainerStarted","Data":"bad38ecb53b3d378438f8d0d384d9a00460821567595cdf9b81dbdbd8449e922"}
Jul 30 20:24:52.713928 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:52.713865    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nlpd2" event={"ID":"b5ea3ceb-c9e3-4ef4-920c-9b618c947bee","Type":"ContainerStarted","Data":"fe48af975e0cfc90dba4123f55e48de025c44ae21f13bf41eb2610c408313ff5"}
Jul 30 20:24:52.716718 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:52.716581    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-69.ec2.internal" podStartSLOduration=2.716563447 podStartE2EDuration="2.716563447s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 20:24:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:24:52.715169469 +0000 UTC m=+4.556645095" watchObservedRunningTime="2026-07-30 20:24:52.716563447 +0000 UTC m=+4.558039075"
Jul 30 20:24:52.717902 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:52.717791    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j8dzm" event={"ID":"a4829105-a873-467c-bfcb-88999090f719","Type":"ContainerStarted","Data":"602f432bfb18eb6e32309a7f288b9b83c46e768915e9ce7a7bd2befba4e9d546"}
Jul 30 20:24:52.721850 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:52.721749    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xjbjh" event={"ID":"b6859022-31c0-4474-afa1-e362c870ba13","Type":"ContainerStarted","Data":"ab0ad753b6a3fe0ea268c49103e2ca001e46c7e487cd9321e1366503e42a7bfa"}
Jul 30 20:24:52.728069 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:52.727986    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-88nf2" event={"ID":"99b20953-23a6-4c80-b4ec-2376753942d9","Type":"ContainerStarted","Data":"89daf3fffe514272d86bec22f8886bffb14cb5a4dc65eef57c23657f518d222e"}
Jul 30 20:24:52.733341 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:52.733267    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hkpd5" event={"ID":"4c453060-5f5c-4686-846e-a8875d6d9ead","Type":"ContainerStarted","Data":"c7501c2887755b4ca8fe931aa70d98d1f53eab2edaaa7ffc34062575df17b5d9"}
Jul 30 20:24:52.748274 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:52.748109    2583 generic.go:356] "Generic (PLEG): container finished" podID="080196fcbe11403b01fd40375d60e083" containerID="cf4c56449098649f6c2e850cf4c803ee28e3b530536ed5fee5da748853d41d29" exitCode=0
Jul 30 20:24:52.748274 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:52.748140    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-69.ec2.internal" event={"ID":"080196fcbe11403b01fd40375d60e083","Type":"ContainerDied","Data":"cf4c56449098649f6c2e850cf4c803ee28e3b530536ed5fee5da748853d41d29"}
Jul 30 20:24:53.669516 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:53.669480    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jfpt4"
Jul 30 20:24:53.669995 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:24:53.669626    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jfpt4" podUID="9c27cd9e-72be-4a13-8deb-f4c3ffe3ecea"
Jul 30 20:24:53.781737 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:53.781701    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-69.ec2.internal" event={"ID":"080196fcbe11403b01fd40375d60e083","Type":"ContainerStarted","Data":"7c9d919ea8a1fe4627f3dcc4961ceaa4ce8a7147597ac26771183826a21110ef"}
Jul 30 20:24:54.218137 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:54.217514    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c27cd9e-72be-4a13-8deb-f4c3ffe3ecea-metrics-certs\") pod \"network-metrics-daemon-jfpt4\" (UID: \"9c27cd9e-72be-4a13-8deb-f4c3ffe3ecea\") " pod="openshift-multus/network-metrics-daemon-jfpt4"
Jul 30 20:24:54.218137 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:24:54.217697    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 20:24:54.218137 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:24:54.217775    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c27cd9e-72be-4a13-8deb-f4c3ffe3ecea-metrics-certs podName:9c27cd9e-72be-4a13-8deb-f4c3ffe3ecea nodeName:}" failed. No retries permitted until 2026-07-30 20:24:58.21775373 +0000 UTC m=+10.059229334 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9c27cd9e-72be-4a13-8deb-f4c3ffe3ecea-metrics-certs") pod "network-metrics-daemon-jfpt4" (UID: "9c27cd9e-72be-4a13-8deb-f4c3ffe3ecea") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 20:24:54.318558 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:54.318519    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tnh6n\" (UniqueName: \"kubernetes.io/projected/97b781c0-bbe8-42ae-b54b-b42b759c87b4-kube-api-access-tnh6n\") pod \"network-check-target-k8jg9\" (UID: \"97b781c0-bbe8-42ae-b54b-b42b759c87b4\") " pod="openshift-network-diagnostics/network-check-target-k8jg9"
Jul 30 20:24:54.318769 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:54.318603    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/01f71a23-f22f-44f3-b7d6-3ba3050b69fa-original-pull-secret\") pod \"global-pull-secret-syncer-8g9tl\" (UID: \"01f71a23-f22f-44f3-b7d6-3ba3050b69fa\") " pod="kube-system/global-pull-secret-syncer-8g9tl"
Jul 30 20:24:54.318833 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:24:54.318771    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 30 20:24:54.318900 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:24:54.318839    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01f71a23-f22f-44f3-b7d6-3ba3050b69fa-original-pull-secret podName:01f71a23-f22f-44f3-b7d6-3ba3050b69fa nodeName:}" failed. No retries permitted until 2026-07-30 20:24:58.318817667 +0000 UTC m=+10.160293275 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/01f71a23-f22f-44f3-b7d6-3ba3050b69fa-original-pull-secret") pod "global-pull-secret-syncer-8g9tl" (UID: "01f71a23-f22f-44f3-b7d6-3ba3050b69fa") : object "kube-system"/"original-pull-secret" not registered
Jul 30 20:24:54.318969 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:24:54.318930    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 30 20:24:54.318969 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:24:54.318950    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 30 20:24:54.319064 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:24:54.318974    2583 projected.go:196] Error preparing data for projected volume kube-api-access-tnh6n for pod openshift-network-diagnostics/network-check-target-k8jg9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 20:24:54.319064 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:24:54.319012    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/97b781c0-bbe8-42ae-b54b-b42b759c87b4-kube-api-access-tnh6n podName:97b781c0-bbe8-42ae-b54b-b42b759c87b4 nodeName:}" failed. No retries permitted until 2026-07-30 20:24:58.318999037 +0000 UTC m=+10.160474658 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-tnh6n" (UniqueName: "kubernetes.io/projected/97b781c0-bbe8-42ae-b54b-b42b759c87b4-kube-api-access-tnh6n") pod "network-check-target-k8jg9" (UID: "97b781c0-bbe8-42ae-b54b-b42b759c87b4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 20:24:54.671366 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:54.671338    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8g9tl"
Jul 30 20:24:54.671841 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:24:54.671473    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8g9tl" podUID="01f71a23-f22f-44f3-b7d6-3ba3050b69fa"
Jul 30 20:24:54.671912 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:54.671858    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k8jg9"
Jul 30 20:24:54.672039 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:24:54.671963    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k8jg9" podUID="97b781c0-bbe8-42ae-b54b-b42b759c87b4"
Jul 30 20:24:55.669222 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:55.669178    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jfpt4"
Jul 30 20:24:55.669381 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:24:55.669302    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jfpt4" podUID="9c27cd9e-72be-4a13-8deb-f4c3ffe3ecea"
Jul 30 20:24:56.670742 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:56.670236    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8g9tl"
Jul 30 20:24:56.670742 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:24:56.670382    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8g9tl" podUID="01f71a23-f22f-44f3-b7d6-3ba3050b69fa"
Jul 30 20:24:56.670742 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:56.670462    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k8jg9"
Jul 30 20:24:56.670742 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:24:56.670581    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k8jg9" podUID="97b781c0-bbe8-42ae-b54b-b42b759c87b4"
Jul 30 20:24:57.669686 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:57.669647    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jfpt4"
Jul 30 20:24:57.669847 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:24:57.669801    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jfpt4" podUID="9c27cd9e-72be-4a13-8deb-f4c3ffe3ecea"
Jul 30 20:24:58.250871 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:58.250838    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c27cd9e-72be-4a13-8deb-f4c3ffe3ecea-metrics-certs\") pod \"network-metrics-daemon-jfpt4\" (UID: \"9c27cd9e-72be-4a13-8deb-f4c3ffe3ecea\") " pod="openshift-multus/network-metrics-daemon-jfpt4"
Jul 30 20:24:58.251412 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:24:58.250975    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 20:24:58.251412 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:24:58.251042    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c27cd9e-72be-4a13-8deb-f4c3ffe3ecea-metrics-certs podName:9c27cd9e-72be-4a13-8deb-f4c3ffe3ecea nodeName:}" failed. No retries permitted until 2026-07-30 20:25:06.251021317 +0000 UTC m=+18.092496921 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9c27cd9e-72be-4a13-8deb-f4c3ffe3ecea-metrics-certs") pod "network-metrics-daemon-jfpt4" (UID: "9c27cd9e-72be-4a13-8deb-f4c3ffe3ecea") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 20:24:58.351696 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:58.351649    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/01f71a23-f22f-44f3-b7d6-3ba3050b69fa-original-pull-secret\") pod \"global-pull-secret-syncer-8g9tl\" (UID: \"01f71a23-f22f-44f3-b7d6-3ba3050b69fa\") " pod="kube-system/global-pull-secret-syncer-8g9tl"
Jul 30 20:24:58.351876 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:58.351733    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tnh6n\" (UniqueName: \"kubernetes.io/projected/97b781c0-bbe8-42ae-b54b-b42b759c87b4-kube-api-access-tnh6n\") pod \"network-check-target-k8jg9\" (UID: \"97b781c0-bbe8-42ae-b54b-b42b759c87b4\") " pod="openshift-network-diagnostics/network-check-target-k8jg9"
Jul 30 20:24:58.351876 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:24:58.351862    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 30 20:24:58.351876 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:24:58.351878    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 30 20:24:58.352056 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:24:58.351888    2583 projected.go:196] Error preparing data for projected volume kube-api-access-tnh6n for pod openshift-network-diagnostics/network-check-target-k8jg9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 20:24:58.352056 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:24:58.351951    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/97b781c0-bbe8-42ae-b54b-b42b759c87b4-kube-api-access-tnh6n podName:97b781c0-bbe8-42ae-b54b-b42b759c87b4 nodeName:}" failed. No retries permitted until 2026-07-30 20:25:06.351930096 +0000 UTC m=+18.193405716 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-tnh6n" (UniqueName: "kubernetes.io/projected/97b781c0-bbe8-42ae-b54b-b42b759c87b4-kube-api-access-tnh6n") pod "network-check-target-k8jg9" (UID: "97b781c0-bbe8-42ae-b54b-b42b759c87b4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 20:24:58.352474 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:24:58.352452    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 30 20:24:58.352550 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:24:58.352516    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01f71a23-f22f-44f3-b7d6-3ba3050b69fa-original-pull-secret podName:01f71a23-f22f-44f3-b7d6-3ba3050b69fa nodeName:}" failed. No retries permitted until 2026-07-30 20:25:06.352499353 +0000 UTC m=+18.193974958 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/01f71a23-f22f-44f3-b7d6-3ba3050b69fa-original-pull-secret") pod "global-pull-secret-syncer-8g9tl" (UID: "01f71a23-f22f-44f3-b7d6-3ba3050b69fa") : object "kube-system"/"original-pull-secret" not registered
Jul 30 20:24:58.671535 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:58.671050    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k8jg9"
Jul 30 20:24:58.671535 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:24:58.671160    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k8jg9" podUID="97b781c0-bbe8-42ae-b54b-b42b759c87b4"
Jul 30 20:24:58.671969 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:58.671819    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8g9tl"
Jul 30 20:24:58.671969 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:24:58.671931    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8g9tl" podUID="01f71a23-f22f-44f3-b7d6-3ba3050b69fa"
Jul 30 20:24:59.669642 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:24:59.669604    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jfpt4"
Jul 30 20:24:59.670037 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:24:59.669764    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jfpt4" podUID="9c27cd9e-72be-4a13-8deb-f4c3ffe3ecea"
Jul 30 20:25:00.669823 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:00.669411    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8g9tl"
Jul 30 20:25:00.669823 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:25:00.669527    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8g9tl" podUID="01f71a23-f22f-44f3-b7d6-3ba3050b69fa"
Jul 30 20:25:00.669823 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:00.669590    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k8jg9"
Jul 30 20:25:00.669823 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:25:00.669711    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k8jg9" podUID="97b781c0-bbe8-42ae-b54b-b42b759c87b4"
Jul 30 20:25:01.669118 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:01.669084    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jfpt4"
Jul 30 20:25:01.669347 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:25:01.669255    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jfpt4" podUID="9c27cd9e-72be-4a13-8deb-f4c3ffe3ecea"
Jul 30 20:25:02.670085 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:02.670054    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8g9tl"
Jul 30 20:25:02.670517 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:25:02.670185    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8g9tl" podUID="01f71a23-f22f-44f3-b7d6-3ba3050b69fa"
Jul 30 20:25:02.670517 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:02.670253    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k8jg9"
Jul 30 20:25:02.670517 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:25:02.670378    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k8jg9" podUID="97b781c0-bbe8-42ae-b54b-b42b759c87b4"
Jul 30 20:25:03.669329 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:03.669293    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jfpt4"
Jul 30 20:25:03.669507 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:25:03.669433    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jfpt4" podUID="9c27cd9e-72be-4a13-8deb-f4c3ffe3ecea"
Jul 30 20:25:04.669722 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:04.669689    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8g9tl"
Jul 30 20:25:04.670117 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:25:04.669818    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8g9tl" podUID="01f71a23-f22f-44f3-b7d6-3ba3050b69fa"
Jul 30 20:25:04.670117 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:04.669878    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k8jg9"
Jul 30 20:25:04.670117 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:25:04.669977    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k8jg9" podUID="97b781c0-bbe8-42ae-b54b-b42b759c87b4"
Jul 30 20:25:05.669614 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:05.669581    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jfpt4"
Jul 30 20:25:05.669835 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:25:05.669803    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jfpt4" podUID="9c27cd9e-72be-4a13-8deb-f4c3ffe3ecea"
Jul 30 20:25:06.318751 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:06.318723    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c27cd9e-72be-4a13-8deb-f4c3ffe3ecea-metrics-certs\") pod \"network-metrics-daemon-jfpt4\" (UID: \"9c27cd9e-72be-4a13-8deb-f4c3ffe3ecea\") " pod="openshift-multus/network-metrics-daemon-jfpt4"
Jul 30 20:25:06.318958 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:25:06.318836    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 20:25:06.318958 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:25:06.318890    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c27cd9e-72be-4a13-8deb-f4c3ffe3ecea-metrics-certs podName:9c27cd9e-72be-4a13-8deb-f4c3ffe3ecea nodeName:}" failed. No retries permitted until 2026-07-30 20:25:22.31887474 +0000 UTC m=+34.160350360 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9c27cd9e-72be-4a13-8deb-f4c3ffe3ecea-metrics-certs") pod "network-metrics-daemon-jfpt4" (UID: "9c27cd9e-72be-4a13-8deb-f4c3ffe3ecea") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 20:25:06.419215 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:06.419178    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/01f71a23-f22f-44f3-b7d6-3ba3050b69fa-original-pull-secret\") pod \"global-pull-secret-syncer-8g9tl\" (UID: \"01f71a23-f22f-44f3-b7d6-3ba3050b69fa\") " pod="kube-system/global-pull-secret-syncer-8g9tl"
Jul 30 20:25:06.419402 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:06.419265    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tnh6n\" (UniqueName: \"kubernetes.io/projected/97b781c0-bbe8-42ae-b54b-b42b759c87b4-kube-api-access-tnh6n\") pod \"network-check-target-k8jg9\" (UID: \"97b781c0-bbe8-42ae-b54b-b42b759c87b4\") " pod="openshift-network-diagnostics/network-check-target-k8jg9"
Jul 30 20:25:06.419402 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:25:06.419366    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 30 20:25:06.419402 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:25:06.419393    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 30 20:25:06.419545 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:25:06.419412    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 30 20:25:06.419545 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:25:06.419425    2583 projected.go:196] Error preparing data for projected volume kube-api-access-tnh6n for pod openshift-network-diagnostics/network-check-target-k8jg9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 20:25:06.419545 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:25:06.419436    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01f71a23-f22f-44f3-b7d6-3ba3050b69fa-original-pull-secret podName:01f71a23-f22f-44f3-b7d6-3ba3050b69fa nodeName:}" failed. No retries permitted until 2026-07-30 20:25:22.419417504 +0000 UTC m=+34.260893121 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/01f71a23-f22f-44f3-b7d6-3ba3050b69fa-original-pull-secret") pod "global-pull-secret-syncer-8g9tl" (UID: "01f71a23-f22f-44f3-b7d6-3ba3050b69fa") : object "kube-system"/"original-pull-secret" not registered
Jul 30 20:25:06.419545 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:25:06.419463    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/97b781c0-bbe8-42ae-b54b-b42b759c87b4-kube-api-access-tnh6n podName:97b781c0-bbe8-42ae-b54b-b42b759c87b4 nodeName:}" failed. No retries permitted until 2026-07-30 20:25:22.419452831 +0000 UTC m=+34.260928435 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-tnh6n" (UniqueName: "kubernetes.io/projected/97b781c0-bbe8-42ae-b54b-b42b759c87b4-kube-api-access-tnh6n") pod "network-check-target-k8jg9" (UID: "97b781c0-bbe8-42ae-b54b-b42b759c87b4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 20:25:06.669536 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:06.669503    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k8jg9"
Jul 30 20:25:06.669682 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:25:06.669627    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k8jg9" podUID="97b781c0-bbe8-42ae-b54b-b42b759c87b4"
Jul 30 20:25:06.669682 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:06.669512    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8g9tl"
Jul 30 20:25:06.669747 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:25:06.669725    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8g9tl" podUID="01f71a23-f22f-44f3-b7d6-3ba3050b69fa"
Jul 30 20:25:07.669874 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:07.669843    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jfpt4"
Jul 30 20:25:07.670255 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:25:07.669978    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jfpt4" podUID="9c27cd9e-72be-4a13-8deb-f4c3ffe3ecea"
Jul 30 20:25:08.671187 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:08.670732    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8g9tl"
Jul 30 20:25:08.671187 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:08.670821    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k8jg9"
Jul 30 20:25:08.671187 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:25:08.670845    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8g9tl" podUID="01f71a23-f22f-44f3-b7d6-3ba3050b69fa"
Jul 30 20:25:08.671187 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:25:08.670901    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k8jg9" podUID="97b781c0-bbe8-42ae-b54b-b42b759c87b4"
Jul 30 20:25:09.669867 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:09.669840    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jfpt4"
Jul 30 20:25:09.670053 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:25:09.669966    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jfpt4" podUID="9c27cd9e-72be-4a13-8deb-f4c3ffe3ecea"
Jul 30 20:25:10.669946 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:10.669909    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k8jg9"
Jul 30 20:25:10.670400 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:25:10.670051    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k8jg9" podUID="97b781c0-bbe8-42ae-b54b-b42b759c87b4"
Jul 30 20:25:10.670400 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:10.670103    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8g9tl"
Jul 30 20:25:10.670400 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:25:10.670236    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8g9tl" podUID="01f71a23-f22f-44f3-b7d6-3ba3050b69fa"
Jul 30 20:25:11.670175 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:11.669853    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jfpt4"
Jul 30 20:25:11.670758 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:25:11.670257    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jfpt4" podUID="9c27cd9e-72be-4a13-8deb-f4c3ffe3ecea"
Jul 30 20:25:11.819787 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:11.819758    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-88nf2" event={"ID":"99b20953-23a6-4c80-b4ec-2376753942d9","Type":"ContainerStarted","Data":"083d255c629ae724cd7323a4966f24c141f8e843d100540f5abf8cb8988b59f0"}
Jul 30 20:25:11.821342 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:11.821315    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hkpd5" event={"ID":"4c453060-5f5c-4686-846e-a8875d6d9ead","Type":"ContainerStarted","Data":"0d33ab9cbf96a35edbe4dfefaa54bfdacee9cdf54973331ca9f5a35914a17839"}
Jul 30 20:25:11.822748 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:11.822720    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-gdkdh" event={"ID":"208efd11-d3ba-46c5-8afb-269d1fbf7217","Type":"ContainerStarted","Data":"8a1e7e2391f724a313ab6388faf45daea499df38cca56d45a8289c061e180085"}
Jul 30 20:25:11.824582 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:11.824564    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-26tfg" event={"ID":"346ac985-5c0d-4134-bc10-7727a294ef1f","Type":"ContainerStarted","Data":"3aa1549648004caae1e92c884cf600b20c8a182d008f650409a771b0a296b244"}
Jul 30 20:25:11.825972 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:11.825954    2583 generic.go:356] "Generic (PLEG): container finished" podID="b5ea3ceb-c9e3-4ef4-920c-9b618c947bee" containerID="d83d9f2070792b5103844f5980fcc45e1cde96d996a0594257145e68fcfc88e6" exitCode=0
Jul 30 20:25:11.826043 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:11.826012    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nlpd2" event={"ID":"b5ea3ceb-c9e3-4ef4-920c-9b618c947bee","Type":"ContainerDied","Data":"d83d9f2070792b5103844f5980fcc45e1cde96d996a0594257145e68fcfc88e6"}
Jul 30 20:25:11.829186 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:11.829164    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j8dzm" event={"ID":"a4829105-a873-467c-bfcb-88999090f719","Type":"ContainerStarted","Data":"f429280757ded27f324670548f84f76b9aa6cdde84307116bf7da619de430744"}
Jul 30 20:25:11.829278 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:11.829239    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j8dzm" event={"ID":"a4829105-a873-467c-bfcb-88999090f719","Type":"ContainerStarted","Data":"9b7b3ac488de5768c4adf4d5234b80bf6c15d86c75342c55eee0236f1bed0f2f"}
Jul 30 20:25:11.829334 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:11.829292    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j8dzm" event={"ID":"a4829105-a873-467c-bfcb-88999090f719","Type":"ContainerStarted","Data":"83cc53cc153356c06297752be52674951070d533f20f46d4ff92bdc3a9b80f14"}
Jul 30 20:25:11.829400 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:11.829341    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j8dzm" event={"ID":"a4829105-a873-467c-bfcb-88999090f719","Type":"ContainerStarted","Data":"de8ff1a793dedf033fa26edea48059de50ee58d191aa7b7239119c8effdeb313"}
Jul 30 20:25:11.829400 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:11.829387    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j8dzm" event={"ID":"a4829105-a873-467c-bfcb-88999090f719","Type":"ContainerStarted","Data":"32221787524de8979e345fc791b7e755b802ce77229d3b8480cfc322d712a438"}
Jul 30 20:25:11.829494 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:11.829434    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j8dzm" event={"ID":"a4829105-a873-467c-bfcb-88999090f719","Type":"ContainerStarted","Data":"f2fd3c8ae3b3c42646cc70bb63d742662b59f6eb59d1be30d274f958a05d5a30"}
Jul 30 20:25:11.830515 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:11.830495    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xjbjh" event={"ID":"b6859022-31c0-4474-afa1-e362c870ba13","Type":"ContainerStarted","Data":"55e6ef61b6c7cc662b96e09ffe3f419288ff361e2a0bc7b9b362840494792cb8"}
Jul 30 20:25:11.832100 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:11.832070    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-czmdm" event={"ID":"e5d61971-62cc-436c-9d5c-a3abec7a47d4","Type":"ContainerStarted","Data":"7c2dbe77f10945e6bd3265c629ba4267528889b92455b5c50b3952ed16a3e457"}
Jul 30 20:25:11.834967 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:11.834937    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-69.ec2.internal" podStartSLOduration=20.834926939 podStartE2EDuration="20.834926939s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 20:24:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:24:53.798305732 +0000 UTC m=+5.639781359" watchObservedRunningTime="2026-07-30 20:25:11.834926939 +0000 UTC m=+23.676402560"
Jul 30 20:25:11.836122 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:11.836076    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-88nf2" podStartSLOduration=3.300308506 podStartE2EDuration="22.83606135s" totalImagesPullingTime="19.535752844s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 20:24:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:25:11.834784381 +0000 UTC m=+23.676260002" watchObservedRunningTime="2026-07-30 20:25:11.83606135 +0000 UTC m=+23.677536975"
Jul 30 20:25:11.849456 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:11.849428    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-26tfg" podStartSLOduration=3.303925581 podStartE2EDuration="22.849418622s" totalImagesPullingTime="19.545493041s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 20:24:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:25:11.849263472 +0000 UTC m=+23.690739098" watchObservedRunningTime="2026-07-30 20:25:11.849418622 +0000 UTC m=+23.690894243"
Jul 30 20:25:11.863928 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:11.863899    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-hkpd5" podStartSLOduration=3.325056627 podStartE2EDuration="22.863891262s" totalImagesPullingTime="19.538834635s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:24:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:25:11.863559866 +0000 UTC m=+23.705035489" watchObservedRunningTime="2026-07-30 20:25:11.863891262 +0000 UTC m=+23.705366884"
Jul 30 20:25:11.877881 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:11.877853    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-czmdm" podStartSLOduration=3.333103765 podStartE2EDuration="22.877843244s" totalImagesPullingTime="19.544739479s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 20:24:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:25:11.877694367 +0000 UTC m=+23.719169988" watchObservedRunningTime="2026-07-30 20:25:11.877843244 +0000 UTC m=+23.719318866"
Jul 30 20:25:11.912736 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:11.912688    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-gdkdh" podStartSLOduration=3.30005051 podStartE2EDuration="22.912671106s" totalImagesPullingTime="19.612620596s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 20:24:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:25:11.912268306 +0000 UTC m=+23.753743930" watchObservedRunningTime="2026-07-30 20:25:11.912671106 +0000 UTC m=+23.754146733"
Jul 30 20:25:12.140569 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:12.140491    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-hkpd5"
Jul 30 20:25:12.141035 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:12.141019    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-hkpd5"
Jul 30 20:25:12.669460 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:12.669438    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8g9tl"
Jul 30 20:25:12.669583 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:25:12.669553    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8g9tl" podUID="01f71a23-f22f-44f3-b7d6-3ba3050b69fa"
Jul 30 20:25:12.669882 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:12.669866    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k8jg9"
Jul 30 20:25:12.669971 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:25:12.669948    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k8jg9" podUID="97b781c0-bbe8-42ae-b54b-b42b759c87b4"
Jul 30 20:25:12.763064 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:12.763038    2583 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 30 20:25:12.835713 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:12.835640    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8rsxs" event={"ID":"990f6547-5422-4136-b3e1-39982c7f3660","Type":"ContainerStarted","Data":"17375cd9da8f966aaeaacb81fde81e1749c93a071af1a25f01e962698fd40190"}
Jul 30 20:25:12.837645 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:12.837617    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xjbjh" event={"ID":"b6859022-31c0-4474-afa1-e362c870ba13","Type":"ContainerStarted","Data":"c0600c25e16390ccd2f19a697af1db7123519ad7ef59b28c6ec7784f6623baa7"}
Jul 30 20:25:12.837938 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:12.837918    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-hkpd5"
Jul 30 20:25:12.838449 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:12.838429    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-hkpd5"
Jul 30 20:25:12.850568 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:12.850534    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-8rsxs" podStartSLOduration=4.300060513 podStartE2EDuration="23.850522128s" totalImagesPullingTime="19.550461615s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 20:24:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:25:12.85022578 +0000 UTC m=+24.691701400" watchObservedRunningTime="2026-07-30 20:25:12.850522128 +0000 UTC m=+24.691997749"
Jul 30 20:25:13.642477 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:13.642264    2583 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-30T20:25:12.763059098Z","UUID":"8ed1df50-3275-4c69-b45c-fd1f19f959a3","Handler":null,"Name":"","Endpoint":""}
Jul 30 20:25:13.644058 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:13.644038    2583 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 30 20:25:13.644206 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:13.644072    2583 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 30 20:25:13.669244 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:13.669211    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jfpt4"
Jul 30 20:25:13.669400 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:25:13.669349    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jfpt4" podUID="9c27cd9e-72be-4a13-8deb-f4c3ffe3ecea"
Jul 30 20:25:14.669956 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:14.669930    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k8jg9"
Jul 30 20:25:14.670338 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:25:14.670026    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k8jg9" podUID="97b781c0-bbe8-42ae-b54b-b42b759c87b4"
Jul 30 20:25:14.670338 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:14.670115    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8g9tl"
Jul 30 20:25:14.670338 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:25:14.670215    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8g9tl" podUID="01f71a23-f22f-44f3-b7d6-3ba3050b69fa"
Jul 30 20:25:14.844724 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:14.844688    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j8dzm" event={"ID":"a4829105-a873-467c-bfcb-88999090f719","Type":"ContainerStarted","Data":"2915e5caaedcea3fff0a0f1d12c7d1615db7d4cfc2c110bf726bbea493fc0f6f"}
Jul 30 20:25:14.846589 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:14.846566    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xjbjh" event={"ID":"b6859022-31c0-4474-afa1-e362c870ba13","Type":"ContainerStarted","Data":"4003cc0a0a2334265e69ad7444bb66f7632cf18bdf862f3ea4abfd267521500b"}
Jul 30 20:25:14.863520 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:14.863482    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xjbjh" podStartSLOduration=3.9977121 podStartE2EDuration="25.863466508s" totalImagesPullingTime="21.865754408s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 20:24:49 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:25:14.862827072 +0000 UTC m=+26.704302694" watchObservedRunningTime="2026-07-30 20:25:14.863466508 +0000 UTC m=+26.704942128"
Jul 30 20:25:15.669717 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:15.669530    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jfpt4"
Jul 30 20:25:15.669868 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:25:15.669816    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jfpt4" podUID="9c27cd9e-72be-4a13-8deb-f4c3ffe3ecea"
Jul 30 20:25:16.669469 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:16.669442    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8g9tl"
Jul 30 20:25:16.669937 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:25:16.669540    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8g9tl" podUID="01f71a23-f22f-44f3-b7d6-3ba3050b69fa"
Jul 30 20:25:16.669937 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:16.669567    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k8jg9"
Jul 30 20:25:16.669937 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:25:16.669622    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k8jg9" podUID="97b781c0-bbe8-42ae-b54b-b42b759c87b4"
Jul 30 20:25:16.855157 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:16.855096    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j8dzm" event={"ID":"a4829105-a873-467c-bfcb-88999090f719","Type":"ContainerStarted","Data":"dcd90cddc5836f3ee7c14d2b9e97cee11c911f3f35df3f6af4ca6b80fe798703"}
Jul 30 20:25:16.856072 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:16.856045    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-j8dzm"
Jul 30 20:25:16.856201 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:16.856176    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-j8dzm"
Jul 30 20:25:16.874295 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:16.874275    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-j8dzm"
Jul 30 20:25:16.875700 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:16.875681    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-j8dzm"
Jul 30 20:25:16.883471 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:16.883421    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-j8dzm" podStartSLOduration=8.281071774 podStartE2EDuration="27.883409874s" totalImagesPullingTime="19.6023381s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 20:24:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:25:16.883023631 +0000 UTC m=+28.724499252" watchObservedRunningTime="2026-07-30 20:25:16.883409874 +0000 UTC m=+28.724885474"
Jul 30 20:25:17.669505 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:17.669319    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jfpt4"
Jul 30 20:25:17.670348 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:25:17.669625    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jfpt4" podUID="9c27cd9e-72be-4a13-8deb-f4c3ffe3ecea"
Jul 30 20:25:17.859017 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:17.858986    2583 generic.go:356] "Generic (PLEG): container finished" podID="b5ea3ceb-c9e3-4ef4-920c-9b618c947bee" containerID="949d6db6cffdaa62b09c366c9773f94f7310a0630c16ceedf7c67c3094051933" exitCode=0
Jul 30 20:25:17.859121 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:17.859069    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nlpd2" event={"ID":"b5ea3ceb-c9e3-4ef4-920c-9b618c947bee","Type":"ContainerDied","Data":"949d6db6cffdaa62b09c366c9773f94f7310a0630c16ceedf7c67c3094051933"}
Jul 30 20:25:17.859197 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:17.859182    2583 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 30 20:25:18.670670 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:18.670645    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k8jg9"
Jul 30 20:25:18.670972 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:25:18.670736    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k8jg9" podUID="97b781c0-bbe8-42ae-b54b-b42b759c87b4"
Jul 30 20:25:18.670972 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:18.670738    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8g9tl"
Jul 30 20:25:18.670972 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:25:18.670845    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8g9tl" podUID="01f71a23-f22f-44f3-b7d6-3ba3050b69fa"
Jul 30 20:25:18.679128 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:18.679105    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8g9tl"]
Jul 30 20:25:18.682471 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:18.682444    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-jfpt4"]
Jul 30 20:25:18.682554 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:18.682546    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jfpt4"
Jul 30 20:25:18.682648 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:25:18.682632    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jfpt4" podUID="9c27cd9e-72be-4a13-8deb-f4c3ffe3ecea"
Jul 30 20:25:18.682820 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:18.682803    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-k8jg9"]
Jul 30 20:25:18.863535 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:18.863511    2583 generic.go:356] "Generic (PLEG): container finished" podID="b5ea3ceb-c9e3-4ef4-920c-9b618c947bee" containerID="4f900636ddc32ca78f00853afb2a6d5f83dd32d1f7f98c8d1b0a6783e15037ff" exitCode=0
Jul 30 20:25:18.863629 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:18.863616    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nlpd2" event={"ID":"b5ea3ceb-c9e3-4ef4-920c-9b618c947bee","Type":"ContainerDied","Data":"4f900636ddc32ca78f00853afb2a6d5f83dd32d1f7f98c8d1b0a6783e15037ff"}
Jul 30 20:25:18.863784 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:18.863748    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k8jg9"
Jul 30 20:25:18.863893 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:18.863876    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8g9tl"
Jul 30 20:25:18.863934 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:25:18.863894    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k8jg9" podUID="97b781c0-bbe8-42ae-b54b-b42b759c87b4"
Jul 30 20:25:18.864084 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:25:18.864038    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8g9tl" podUID="01f71a23-f22f-44f3-b7d6-3ba3050b69fa"
Jul 30 20:25:18.864602 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:18.864200    2583 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 30 20:25:19.569627 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:19.569592    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-j8dzm"
Jul 30 20:25:20.669953 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:20.669927    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k8jg9"
Jul 30 20:25:20.669953 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:20.669940    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8g9tl"
Jul 30 20:25:20.670422 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:20.669927    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jfpt4"
Jul 30 20:25:20.670422 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:25:20.670022    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k8jg9" podUID="97b781c0-bbe8-42ae-b54b-b42b759c87b4"
Jul 30 20:25:20.670422 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:25:20.670095    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jfpt4" podUID="9c27cd9e-72be-4a13-8deb-f4c3ffe3ecea"
Jul 30 20:25:20.670422 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:25:20.670213    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8g9tl" podUID="01f71a23-f22f-44f3-b7d6-3ba3050b69fa"
Jul 30 20:25:20.869849 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:20.869821    2583 generic.go:356] "Generic (PLEG): container finished" podID="b5ea3ceb-c9e3-4ef4-920c-9b618c947bee" containerID="b5a01d86f6812e44f85184a0834457b4295a222a41b47b656378cb0acdcb59d0" exitCode=0
Jul 30 20:25:20.869987 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:20.869890    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nlpd2" event={"ID":"b5ea3ceb-c9e3-4ef4-920c-9b618c947bee","Type":"ContainerDied","Data":"b5a01d86f6812e44f85184a0834457b4295a222a41b47b656378cb0acdcb59d0"}
Jul 30 20:25:22.335460 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:22.335242    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c27cd9e-72be-4a13-8deb-f4c3ffe3ecea-metrics-certs\") pod \"network-metrics-daemon-jfpt4\" (UID: \"9c27cd9e-72be-4a13-8deb-f4c3ffe3ecea\") " pod="openshift-multus/network-metrics-daemon-jfpt4"
Jul 30 20:25:22.335853 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:25:22.335408    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 20:25:22.335853 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:25:22.335581    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c27cd9e-72be-4a13-8deb-f4c3ffe3ecea-metrics-certs podName:9c27cd9e-72be-4a13-8deb-f4c3ffe3ecea nodeName:}" failed. No retries permitted until 2026-07-30 20:25:54.335562861 +0000 UTC m=+66.177038471 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9c27cd9e-72be-4a13-8deb-f4c3ffe3ecea-metrics-certs") pod "network-metrics-daemon-jfpt4" (UID: "9c27cd9e-72be-4a13-8deb-f4c3ffe3ecea") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 20:25:22.436404 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:22.436323    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tnh6n\" (UniqueName: \"kubernetes.io/projected/97b781c0-bbe8-42ae-b54b-b42b759c87b4-kube-api-access-tnh6n\") pod \"network-check-target-k8jg9\" (UID: \"97b781c0-bbe8-42ae-b54b-b42b759c87b4\") " pod="openshift-network-diagnostics/network-check-target-k8jg9"
Jul 30 20:25:22.436404 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:22.436388    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/01f71a23-f22f-44f3-b7d6-3ba3050b69fa-original-pull-secret\") pod \"global-pull-secret-syncer-8g9tl\" (UID: \"01f71a23-f22f-44f3-b7d6-3ba3050b69fa\") " pod="kube-system/global-pull-secret-syncer-8g9tl"
Jul 30 20:25:22.436737 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:25:22.436515    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 30 20:25:22.436737 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:25:22.436574    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01f71a23-f22f-44f3-b7d6-3ba3050b69fa-original-pull-secret podName:01f71a23-f22f-44f3-b7d6-3ba3050b69fa nodeName:}" failed. No retries permitted until 2026-07-30 20:25:54.43655619 +0000 UTC m=+66.278031802 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/01f71a23-f22f-44f3-b7d6-3ba3050b69fa-original-pull-secret") pod "global-pull-secret-syncer-8g9tl" (UID: "01f71a23-f22f-44f3-b7d6-3ba3050b69fa") : object "kube-system"/"original-pull-secret" not registered
Jul 30 20:25:22.436967 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:25:22.436940    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 30 20:25:22.436967 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:25:22.436969    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 30 20:25:22.437127 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:25:22.436983    2583 projected.go:196] Error preparing data for projected volume kube-api-access-tnh6n for pod openshift-network-diagnostics/network-check-target-k8jg9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 20:25:22.437127 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:25:22.437119    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/97b781c0-bbe8-42ae-b54b-b42b759c87b4-kube-api-access-tnh6n podName:97b781c0-bbe8-42ae-b54b-b42b759c87b4 nodeName:}" failed. No retries permitted until 2026-07-30 20:25:54.437100233 +0000 UTC m=+66.278575853 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-tnh6n" (UniqueName: "kubernetes.io/projected/97b781c0-bbe8-42ae-b54b-b42b759c87b4-kube-api-access-tnh6n") pod "network-check-target-k8jg9" (UID: "97b781c0-bbe8-42ae-b54b-b42b759c87b4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 20:25:22.669728 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:22.669335    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k8jg9"
Jul 30 20:25:22.669728 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:22.669454    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jfpt4"
Jul 30 20:25:22.669728 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:25:22.669579    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jfpt4" podUID="9c27cd9e-72be-4a13-8deb-f4c3ffe3ecea"
Jul 30 20:25:22.669728 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:25:22.669453    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k8jg9" podUID="97b781c0-bbe8-42ae-b54b-b42b759c87b4"
Jul 30 20:25:22.669728 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:22.669647    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8g9tl"
Jul 30 20:25:22.669728 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:25:22.669717    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8g9tl" podUID="01f71a23-f22f-44f3-b7d6-3ba3050b69fa"
Jul 30 20:25:24.669685 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:24.669653    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8g9tl"
Jul 30 20:25:24.669685 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:24.669669    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jfpt4"
Jul 30 20:25:24.670211 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:25:24.669766    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8g9tl" podUID="01f71a23-f22f-44f3-b7d6-3ba3050b69fa"
Jul 30 20:25:24.670211 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:24.669803    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k8jg9"
Jul 30 20:25:24.670211 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:25:24.669873    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k8jg9" podUID="97b781c0-bbe8-42ae-b54b-b42b759c87b4"
Jul 30 20:25:24.670211 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:25:24.669920    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jfpt4" podUID="9c27cd9e-72be-4a13-8deb-f4c3ffe3ecea"
Jul 30 20:25:24.977194 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:24.977099    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-69.ec2.internal" event="NodeReady"
Jul 30 20:25:24.977352 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:24.977297    2583 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 30 20:25:25.011549 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:25.011515    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-f77f48c6d-jljn6"]
Jul 30 20:25:25.016712 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:25.016692    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5b5c7c9c69-f9wj5"]
Jul 30 20:25:25.016841 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:25.016820    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-f77f48c6d-jljn6"
Jul 30 20:25:25.019104 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:25.019085    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-qdbpc\""
Jul 30 20:25:25.019236 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:25.019112    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 30 20:25:25.019236 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:25.019086    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 30 20:25:25.020179 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:25.020157    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5b5c7c9c69-f9wj5"
Jul 30 20:25:25.022804 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:25.022283    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 30 20:25:25.023114 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:25.023097    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-mzftn\""
Jul 30 20:25:25.023349 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:25.023321    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 30 20:25:25.023421 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:25.023382    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-tlhdq"]
Jul 30 20:25:25.023513 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:25.023500    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 30 20:25:25.027025 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:25.027008    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-f77f48c6d-jljn6"]
Jul 30 20:25:25.027120 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:25.027094    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tlhdq"
Jul 30 20:25:25.028957 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:25.028936    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 30 20:25:25.029333 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:25.029315    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-txjtr"]
Jul 30 20:25:25.029668 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:25.029437    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 30 20:25:25.029668 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:25.029448    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-tn7n7\""
Jul 30 20:25:25.030122 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:25.029675    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 30 20:25:25.033036 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:25.033019    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5b5c7c9c69-f9wj5"]
Jul 30 20:25:25.033204 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:25.033095    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-txjtr"
Jul 30 20:25:25.035767 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:25.035377    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-798xg\""
Jul 30 20:25:25.035767 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:25.035543    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 30 20:25:25.035767 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:25.035632    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 30 20:25:25.035767 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:25.035543    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 30 20:25:25.037845 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:25.037827    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-tlhdq"]
Jul 30 20:25:25.040585 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:25.040563    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-txjtr"]
Jul 30 20:25:25.157266 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:25.157234    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fd98fd1e-2a93-4be2-ba8c-21300b318c71-image-registry-private-configuration\") pod \"image-registry-5b5c7c9c69-f9wj5\" (UID: \"fd98fd1e-2a93-4be2-ba8c-21300b318c71\") " pod="openshift-image-registry/image-registry-5b5c7c9c69-f9wj5"
Jul 30 20:25:25.157266 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:25.157270    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fd98fd1e-2a93-4be2-ba8c-21300b318c71-bound-sa-token\") pod \"image-registry-5b5c7c9c69-f9wj5\" (UID: \"fd98fd1e-2a93-4be2-ba8c-21300b318c71\") " pod="openshift-image-registry/image-registry-5b5c7c9c69-f9wj5"
Jul 30 20:25:25.157488 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:25.157306    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fd98fd1e-2a93-4be2-ba8c-21300b318c71-installation-pull-secrets\") pod \"image-registry-5b5c7c9c69-f9wj5\" (UID: \"fd98fd1e-2a93-4be2-ba8c-21300b318c71\") " pod="openshift-image-registry/image-registry-5b5c7c9c69-f9wj5"
Jul 30 20:25:25.157488 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:25.157350    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d00fb7ce-08f2-4e8e-bcb8-78e0d393e74f-nginx-conf\") pod \"networking-console-plugin-f77f48c6d-jljn6\" (UID: \"d00fb7ce-08f2-4e8e-bcb8-78e0d393e74f\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-jljn6"
Jul 30 20:25:25.157488 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:25.157366    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d1d63b84-5b7c-4792-9a2e-79c6b75e7bcf-cert\") pod \"ingress-canary-txjtr\" (UID: \"d1d63b84-5b7c-4792-9a2e-79c6b75e7bcf\") " pod="openshift-ingress-canary/ingress-canary-txjtr"
Jul 30 20:25:25.157488 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:25.157395    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jswhf\" (UniqueName: \"kubernetes.io/projected/de47806e-aced-40b0-a9da-07fd79b4672a-kube-api-access-jswhf\") pod \"dns-default-tlhdq\" (UID: \"de47806e-aced-40b0-a9da-07fd79b4672a\") " pod="openshift-dns/dns-default-tlhdq"
Jul 30 20:25:25.157488 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:25.157449    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d00fb7ce-08f2-4e8e-bcb8-78e0d393e74f-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-jljn6\" (UID: \"d00fb7ce-08f2-4e8e-bcb8-78e0d393e74f\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-jljn6"
Jul 30 20:25:25.157707 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:25.157489    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fd98fd1e-2a93-4be2-ba8c-21300b318c71-ca-trust-extracted\") pod \"image-registry-5b5c7c9c69-f9wj5\" (UID: \"fd98fd1e-2a93-4be2-ba8c-21300b318c71\") " pod="openshift-image-registry/image-registry-5b5c7c9c69-f9wj5"
Jul 30 20:25:25.157707 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:25.157515    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/de47806e-aced-40b0-a9da-07fd79b4672a-tmp-dir\") pod \"dns-default-tlhdq\" (UID: \"de47806e-aced-40b0-a9da-07fd79b4672a\") " pod="openshift-dns/dns-default-tlhdq"
Jul 30 20:25:25.157707 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:25.157559    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grrfz\" (UniqueName: \"kubernetes.io/projected/fd98fd1e-2a93-4be2-ba8c-21300b318c71-kube-api-access-grrfz\") pod \"image-registry-5b5c7c9c69-f9wj5\" (UID: \"fd98fd1e-2a93-4be2-ba8c-21300b318c71\") " pod="openshift-image-registry/image-registry-5b5c7c9c69-f9wj5"
Jul 30 20:25:25.157707 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:25.157627    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7t6zx\" (UniqueName: \"kubernetes.io/projected/d1d63b84-5b7c-4792-9a2e-79c6b75e7bcf-kube-api-access-7t6zx\") pod \"ingress-canary-txjtr\" (UID: \"d1d63b84-5b7c-4792-9a2e-79c6b75e7bcf\") " pod="openshift-ingress-canary/ingress-canary-txjtr"
Jul 30 20:25:25.157707 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:25.157662    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/de47806e-aced-40b0-a9da-07fd79b4672a-config-volume\") pod \"dns-default-tlhdq\" (UID: \"de47806e-aced-40b0-a9da-07fd79b4672a\") " pod="openshift-dns/dns-default-tlhdq"
Jul 30 20:25:25.157922 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:25.157718    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fd98fd1e-2a93-4be2-ba8c-21300b318c71-registry-certificates\") pod \"image-registry-5b5c7c9c69-f9wj5\" (UID: \"fd98fd1e-2a93-4be2-ba8c-21300b318c71\") " pod="openshift-image-registry/image-registry-5b5c7c9c69-f9wj5"
Jul 30 20:25:25.157922 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:25.157739    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fd98fd1e-2a93-4be2-ba8c-21300b318c71-trusted-ca\") pod \"image-registry-5b5c7c9c69-f9wj5\" (UID: \"fd98fd1e-2a93-4be2-ba8c-21300b318c71\") " pod="openshift-image-registry/image-registry-5b5c7c9c69-f9wj5"
Jul 30 20:25:25.157922 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:25.157768    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/de47806e-aced-40b0-a9da-07fd79b4672a-metrics-tls\") pod \"dns-default-tlhdq\" (UID: \"de47806e-aced-40b0-a9da-07fd79b4672a\") " pod="openshift-dns/dns-default-tlhdq"
Jul 30 20:25:25.157922 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:25.157799    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fd98fd1e-2a93-4be2-ba8c-21300b318c71-registry-tls\") pod \"image-registry-5b5c7c9c69-f9wj5\" (UID: \"fd98fd1e-2a93-4be2-ba8c-21300b318c71\") " pod="openshift-image-registry/image-registry-5b5c7c9c69-f9wj5"
Jul 30 20:25:25.258552 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:25.258462    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7t6zx\" (UniqueName: \"kubernetes.io/projected/d1d63b84-5b7c-4792-9a2e-79c6b75e7bcf-kube-api-access-7t6zx\") pod \"ingress-canary-txjtr\" (UID: \"d1d63b84-5b7c-4792-9a2e-79c6b75e7bcf\") " pod="openshift-ingress-canary/ingress-canary-txjtr"
Jul 30 20:25:25.258552 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:25.258524    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/de47806e-aced-40b0-a9da-07fd79b4672a-config-volume\") pod \"dns-default-tlhdq\" (UID: \"de47806e-aced-40b0-a9da-07fd79b4672a\") " pod="openshift-dns/dns-default-tlhdq"
Jul 30 20:25:25.258765 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:25.258579    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fd98fd1e-2a93-4be2-ba8c-21300b318c71-registry-certificates\") pod \"image-registry-5b5c7c9c69-f9wj5\" (UID: \"fd98fd1e-2a93-4be2-ba8c-21300b318c71\") " pod="openshift-image-registry/image-registry-5b5c7c9c69-f9wj5"
Jul 30 20:25:25.258765 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:25.258604    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fd98fd1e-2a93-4be2-ba8c-21300b318c71-trusted-ca\") pod \"image-registry-5b5c7c9c69-f9wj5\" (UID: \"fd98fd1e-2a93-4be2-ba8c-21300b318c71\") " pod="openshift-image-registry/image-registry-5b5c7c9c69-f9wj5"
Jul 30 20:25:25.258765 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:25.258626    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/de47806e-aced-40b0-a9da-07fd79b4672a-metrics-tls\") pod \"dns-default-tlhdq\" (UID: \"de47806e-aced-40b0-a9da-07fd79b4672a\") " pod="openshift-dns/dns-default-tlhdq"
Jul 30 20:25:25.258765 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:25.258653    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fd98fd1e-2a93-4be2-ba8c-21300b318c71-registry-tls\") pod \"image-registry-5b5c7c9c69-f9wj5\" (UID: \"fd98fd1e-2a93-4be2-ba8c-21300b318c71\") " pod="openshift-image-registry/image-registry-5b5c7c9c69-f9wj5"
Jul 30 20:25:25.258765 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:25.258686    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fd98fd1e-2a93-4be2-ba8c-21300b318c71-image-registry-private-configuration\") pod \"image-registry-5b5c7c9c69-f9wj5\" (UID: \"fd98fd1e-2a93-4be2-ba8c-21300b318c71\") " pod="openshift-image-registry/image-registry-5b5c7c9c69-f9wj5"
Jul 30 20:25:25.258765 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:25.258713    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fd98fd1e-2a93-4be2-ba8c-21300b318c71-bound-sa-token\") pod \"image-registry-5b5c7c9c69-f9wj5\" (UID: \"fd98fd1e-2a93-4be2-ba8c-21300b318c71\") " pod="openshift-image-registry/image-registry-5b5c7c9c69-f9wj5"
Jul 30 20:25:25.258765 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:25.258750    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fd98fd1e-2a93-4be2-ba8c-21300b318c71-installation-pull-secrets\") pod \"image-registry-5b5c7c9c69-f9wj5\" (UID: \"fd98fd1e-2a93-4be2-ba8c-21300b318c71\") " pod="openshift-image-registry/image-registry-5b5c7c9c69-f9wj5"
Jul 30 20:25:25.259089 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:25.258792    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d00fb7ce-08f2-4e8e-bcb8-78e0d393e74f-nginx-conf\") pod \"networking-console-plugin-f77f48c6d-jljn6\" (UID: \"d00fb7ce-08f2-4e8e-bcb8-78e0d393e74f\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-jljn6"
Jul 30 20:25:25.259089 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:25:25.258872    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 30 20:25:25.259089 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:25:25.258892    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b5c7c9c69-f9wj5: secret "image-registry-tls" not found
Jul 30 20:25:25.259089 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:25:25.258951    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fd98fd1e-2a93-4be2-ba8c-21300b318c71-registry-tls podName:fd98fd1e-2a93-4be2-ba8c-21300b318c71 nodeName:}" failed. No retries permitted until 2026-07-30 20:25:25.758936769 +0000 UTC m=+37.600412368 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fd98fd1e-2a93-4be2-ba8c-21300b318c71-registry-tls") pod "image-registry-5b5c7c9c69-f9wj5" (UID: "fd98fd1e-2a93-4be2-ba8c-21300b318c71") : secret "image-registry-tls" not found
Jul 30 20:25:25.259290 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:25.259180    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/de47806e-aced-40b0-a9da-07fd79b4672a-config-volume\") pod \"dns-default-tlhdq\" (UID: \"de47806e-aced-40b0-a9da-07fd79b4672a\") " pod="openshift-dns/dns-default-tlhdq"
Jul 30 20:25:25.259290 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:25.258874    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d1d63b84-5b7c-4792-9a2e-79c6b75e7bcf-cert\") pod \"ingress-canary-txjtr\" (UID: \"d1d63b84-5b7c-4792-9a2e-79c6b75e7bcf\") " pod="openshift-ingress-canary/ingress-canary-txjtr"
Jul 30 20:25:25.259290 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:25.259249    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jswhf\" (UniqueName: \"kubernetes.io/projected/de47806e-aced-40b0-a9da-07fd79b4672a-kube-api-access-jswhf\") pod \"dns-default-tlhdq\" (UID: \"de47806e-aced-40b0-a9da-07fd79b4672a\") " pod="openshift-dns/dns-default-tlhdq"
Jul 30 20:25:25.259290 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:25.259276    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fd98fd1e-2a93-4be2-ba8c-21300b318c71-registry-certificates\") pod \"image-registry-5b5c7c9c69-f9wj5\" (UID: \"fd98fd1e-2a93-4be2-ba8c-21300b318c71\") " pod="openshift-image-registry/image-registry-5b5c7c9c69-f9wj5"
Jul 30 20:25:25.259466 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:25:25.259348    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 30 20:25:25.259466 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:25:25.259403    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de47806e-aced-40b0-a9da-07fd79b4672a-metrics-tls podName:de47806e-aced-40b0-a9da-07fd79b4672a nodeName:}" failed. No retries permitted until 2026-07-30 20:25:25.759391868 +0000 UTC m=+37.600867468 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/de47806e-aced-40b0-a9da-07fd79b4672a-metrics-tls") pod "dns-default-tlhdq" (UID: "de47806e-aced-40b0-a9da-07fd79b4672a") : secret "dns-default-metrics-tls" not found
Jul 30 20:25:25.259466 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:25.259281    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d00fb7ce-08f2-4e8e-bcb8-78e0d393e74f-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-jljn6\" (UID: \"d00fb7ce-08f2-4e8e-bcb8-78e0d393e74f\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-jljn6"
Jul 30 20:25:25.259466 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:25.259438    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fd98fd1e-2a93-4be2-ba8c-21300b318c71-ca-trust-extracted\") pod \"image-registry-5b5c7c9c69-f9wj5\" (UID: \"fd98fd1e-2a93-4be2-ba8c-21300b318c71\") " pod="openshift-image-registry/image-registry-5b5c7c9c69-f9wj5"
Jul 30 20:25:25.259466 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:25.259454    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/de47806e-aced-40b0-a9da-07fd79b4672a-tmp-dir\") pod \"dns-default-tlhdq\" (UID: \"de47806e-aced-40b0-a9da-07fd79b4672a\") " pod="openshift-dns/dns-default-tlhdq"
Jul 30 20:25:25.259691 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:25.259487    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grrfz\" (UniqueName: \"kubernetes.io/projected/fd98fd1e-2a93-4be2-ba8c-21300b318c71-kube-api-access-grrfz\") pod \"image-registry-5b5c7c9c69-f9wj5\" (UID: \"fd98fd1e-2a93-4be2-ba8c-21300b318c71\") " pod="openshift-image-registry/image-registry-5b5c7c9c69-f9wj5"
Jul 30 20:25:25.259691 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:25:25.259678    2583 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 30 20:25:25.259764 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:25.259692    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fd98fd1e-2a93-4be2-ba8c-21300b318c71-ca-trust-extracted\") pod \"image-registry-5b5c7c9c69-f9wj5\" (UID: \"fd98fd1e-2a93-4be2-ba8c-21300b318c71\") " pod="openshift-image-registry/image-registry-5b5c7c9c69-f9wj5"
Jul 30 20:25:25.259764 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:25:25.259744    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d00fb7ce-08f2-4e8e-bcb8-78e0d393e74f-networking-console-plugin-cert podName:d00fb7ce-08f2-4e8e-bcb8-78e0d393e74f nodeName:}" failed. No retries permitted until 2026-07-30 20:25:25.75972762 +0000 UTC m=+37.601203242 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d00fb7ce-08f2-4e8e-bcb8-78e0d393e74f-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-jljn6" (UID: "d00fb7ce-08f2-4e8e-bcb8-78e0d393e74f") : secret "networking-console-plugin-cert" not found
Jul 30 20:25:25.259859 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:25.259843    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/de47806e-aced-40b0-a9da-07fd79b4672a-tmp-dir\") pod \"dns-default-tlhdq\" (UID: \"de47806e-aced-40b0-a9da-07fd79b4672a\") " pod="openshift-dns/dns-default-tlhdq"
Jul 30 20:25:25.259889 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:25.259848    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fd98fd1e-2a93-4be2-ba8c-21300b318c71-trusted-ca\") pod \"image-registry-5b5c7c9c69-f9wj5\" (UID: \"fd98fd1e-2a93-4be2-ba8c-21300b318c71\") " pod="openshift-image-registry/image-registry-5b5c7c9c69-f9wj5"
Jul 30 20:25:25.260417 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:25.260394    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d00fb7ce-08f2-4e8e-bcb8-78e0d393e74f-nginx-conf\") pod \"networking-console-plugin-f77f48c6d-jljn6\" (UID: \"d00fb7ce-08f2-4e8e-bcb8-78e0d393e74f\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-jljn6"
Jul 30 20:25:25.263805 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:25.263779    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fd98fd1e-2a93-4be2-ba8c-21300b318c71-image-registry-private-configuration\") pod \"image-registry-5b5c7c9c69-f9wj5\" (UID: \"fd98fd1e-2a93-4be2-ba8c-21300b318c71\") " pod="openshift-image-registry/image-registry-5b5c7c9c69-f9wj5"
Jul 30 20:25:25.263805 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:25.263794    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d1d63b84-5b7c-4792-9a2e-79c6b75e7bcf-cert\") pod \"ingress-canary-txjtr\" (UID: \"d1d63b84-5b7c-4792-9a2e-79c6b75e7bcf\") " pod="openshift-ingress-canary/ingress-canary-txjtr"
Jul 30 20:25:25.263974 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:25.263827    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fd98fd1e-2a93-4be2-ba8c-21300b318c71-installation-pull-secrets\") pod \"image-registry-5b5c7c9c69-f9wj5\" (UID: \"fd98fd1e-2a93-4be2-ba8c-21300b318c71\") " pod="openshift-image-registry/image-registry-5b5c7c9c69-f9wj5"
Jul 30 20:25:25.266928 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:25.266902    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jswhf\" (UniqueName: \"kubernetes.io/projected/de47806e-aced-40b0-a9da-07fd79b4672a-kube-api-access-jswhf\") pod \"dns-default-tlhdq\" (UID: \"de47806e-aced-40b0-a9da-07fd79b4672a\") " pod="openshift-dns/dns-default-tlhdq"
Jul 30 20:25:25.267048 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:25.267023    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7t6zx\" (UniqueName: \"kubernetes.io/projected/d1d63b84-5b7c-4792-9a2e-79c6b75e7bcf-kube-api-access-7t6zx\") pod \"ingress-canary-txjtr\" (UID: \"d1d63b84-5b7c-4792-9a2e-79c6b75e7bcf\") " pod="openshift-ingress-canary/ingress-canary-txjtr"
Jul 30 20:25:25.267464 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:25.267395    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fd98fd1e-2a93-4be2-ba8c-21300b318c71-bound-sa-token\") pod \"image-registry-5b5c7c9c69-f9wj5\" (UID: \"fd98fd1e-2a93-4be2-ba8c-21300b318c71\") " pod="openshift-image-registry/image-registry-5b5c7c9c69-f9wj5"
Jul 30 20:25:25.267617 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:25.267597    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-grrfz\" (UniqueName: \"kubernetes.io/projected/fd98fd1e-2a93-4be2-ba8c-21300b318c71-kube-api-access-grrfz\") pod \"image-registry-5b5c7c9c69-f9wj5\" (UID: \"fd98fd1e-2a93-4be2-ba8c-21300b318c71\") " pod="openshift-image-registry/image-registry-5b5c7c9c69-f9wj5"
Jul 30 20:25:25.354380 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:25.354331    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-txjtr"
Jul 30 20:25:25.763978 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:25.763944    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/de47806e-aced-40b0-a9da-07fd79b4672a-metrics-tls\") pod \"dns-default-tlhdq\" (UID: \"de47806e-aced-40b0-a9da-07fd79b4672a\") " pod="openshift-dns/dns-default-tlhdq"
Jul 30 20:25:25.764654 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:25.763998    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fd98fd1e-2a93-4be2-ba8c-21300b318c71-registry-tls\") pod \"image-registry-5b5c7c9c69-f9wj5\" (UID: \"fd98fd1e-2a93-4be2-ba8c-21300b318c71\") " pod="openshift-image-registry/image-registry-5b5c7c9c69-f9wj5"
Jul 30 20:25:25.764654 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:25.764086    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d00fb7ce-08f2-4e8e-bcb8-78e0d393e74f-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-jljn6\" (UID: \"d00fb7ce-08f2-4e8e-bcb8-78e0d393e74f\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-jljn6"
Jul 30 20:25:25.764654 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:25:25.764112    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 30 20:25:25.764654 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:25:25.764114    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 30 20:25:25.764654 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:25:25.764209    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b5c7c9c69-f9wj5: secret "image-registry-tls" not found
Jul 30 20:25:25.764654 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:25:25.764215    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de47806e-aced-40b0-a9da-07fd79b4672a-metrics-tls podName:de47806e-aced-40b0-a9da-07fd79b4672a nodeName:}" failed. No retries permitted until 2026-07-30 20:25:26.764193643 +0000 UTC m=+38.605669263 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/de47806e-aced-40b0-a9da-07fd79b4672a-metrics-tls") pod "dns-default-tlhdq" (UID: "de47806e-aced-40b0-a9da-07fd79b4672a") : secret "dns-default-metrics-tls" not found
Jul 30 20:25:25.764654 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:25:25.764229    2583 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 30 20:25:25.764654 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:25:25.764268    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fd98fd1e-2a93-4be2-ba8c-21300b318c71-registry-tls podName:fd98fd1e-2a93-4be2-ba8c-21300b318c71 nodeName:}" failed. No retries permitted until 2026-07-30 20:25:26.76425255 +0000 UTC m=+38.605728151 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fd98fd1e-2a93-4be2-ba8c-21300b318c71-registry-tls") pod "image-registry-5b5c7c9c69-f9wj5" (UID: "fd98fd1e-2a93-4be2-ba8c-21300b318c71") : secret "image-registry-tls" not found
Jul 30 20:25:25.764654 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:25:25.764287    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d00fb7ce-08f2-4e8e-bcb8-78e0d393e74f-networking-console-plugin-cert podName:d00fb7ce-08f2-4e8e-bcb8-78e0d393e74f nodeName:}" failed. No retries permitted until 2026-07-30 20:25:26.764276929 +0000 UTC m=+38.605752528 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d00fb7ce-08f2-4e8e-bcb8-78e0d393e74f-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-jljn6" (UID: "d00fb7ce-08f2-4e8e-bcb8-78e0d393e74f") : secret "networking-console-plugin-cert" not found
Jul 30 20:25:25.794522 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:25.794500    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-txjtr"]
Jul 30 20:25:25.797961 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:25:25.797940    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1d63b84_5b7c_4792_9a2e_79c6b75e7bcf.slice/crio-50088ddf369ecf25e1a7b4b6ae7cc2310da8a11445c545cac49950f1c6dffa81 WatchSource:0}: Error finding container 50088ddf369ecf25e1a7b4b6ae7cc2310da8a11445c545cac49950f1c6dffa81: Status 404 returned error can't find the container with id 50088ddf369ecf25e1a7b4b6ae7cc2310da8a11445c545cac49950f1c6dffa81
Jul 30 20:25:25.884163 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:25.884113    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nlpd2" event={"ID":"b5ea3ceb-c9e3-4ef4-920c-9b618c947bee","Type":"ContainerStarted","Data":"cce51dd4d2c888bfe9295378fc8805dcf0d411fd7c67bd7609b5c2f15102987c"}
Jul 30 20:25:25.885222 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:25.885192    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-txjtr" event={"ID":"d1d63b84-5b7c-4792-9a2e-79c6b75e7bcf","Type":"ContainerStarted","Data":"50088ddf369ecf25e1a7b4b6ae7cc2310da8a11445c545cac49950f1c6dffa81"}
Jul 30 20:25:26.669628 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:26.669600    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k8jg9"
Jul 30 20:25:26.669800 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:26.669602    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jfpt4"
Jul 30 20:25:26.669963 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:26.669600    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8g9tl"
Jul 30 20:25:26.673152 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:26.673117    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 30 20:25:26.673736 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:26.673715    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-944cj\""
Jul 30 20:25:26.673845 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:26.673761    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 30 20:25:26.673903 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:26.673865    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 30 20:25:26.673964 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:26.673943    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 30 20:25:26.674074 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:26.674052    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4nz9n\""
Jul 30 20:25:26.773489 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:26.773184    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/de47806e-aced-40b0-a9da-07fd79b4672a-metrics-tls\") pod \"dns-default-tlhdq\" (UID: \"de47806e-aced-40b0-a9da-07fd79b4672a\") " pod="openshift-dns/dns-default-tlhdq"
Jul 30 20:25:26.773489 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:26.773229    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fd98fd1e-2a93-4be2-ba8c-21300b318c71-registry-tls\") pod \"image-registry-5b5c7c9c69-f9wj5\" (UID: \"fd98fd1e-2a93-4be2-ba8c-21300b318c71\") " pod="openshift-image-registry/image-registry-5b5c7c9c69-f9wj5"
Jul 30 20:25:26.773489 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:26.773290    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d00fb7ce-08f2-4e8e-bcb8-78e0d393e74f-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-jljn6\" (UID: \"d00fb7ce-08f2-4e8e-bcb8-78e0d393e74f\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-jljn6"
Jul 30 20:25:26.773489 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:25:26.773335    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 30 20:25:26.773489 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:25:26.773360    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 30 20:25:26.773489 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:25:26.773372    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b5c7c9c69-f9wj5: secret "image-registry-tls" not found
Jul 30 20:25:26.773489 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:25:26.773404    2583 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 30 20:25:26.773489 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:25:26.773405    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de47806e-aced-40b0-a9da-07fd79b4672a-metrics-tls podName:de47806e-aced-40b0-a9da-07fd79b4672a nodeName:}" failed. No retries permitted until 2026-07-30 20:25:28.773383967 +0000 UTC m=+40.614859580 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/de47806e-aced-40b0-a9da-07fd79b4672a-metrics-tls") pod "dns-default-tlhdq" (UID: "de47806e-aced-40b0-a9da-07fd79b4672a") : secret "dns-default-metrics-tls" not found
Jul 30 20:25:26.773489 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:25:26.773462    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fd98fd1e-2a93-4be2-ba8c-21300b318c71-registry-tls podName:fd98fd1e-2a93-4be2-ba8c-21300b318c71 nodeName:}" failed. No retries permitted until 2026-07-30 20:25:28.773450759 +0000 UTC m=+40.614926362 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fd98fd1e-2a93-4be2-ba8c-21300b318c71-registry-tls") pod "image-registry-5b5c7c9c69-f9wj5" (UID: "fd98fd1e-2a93-4be2-ba8c-21300b318c71") : secret "image-registry-tls" not found
Jul 30 20:25:26.773489 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:25:26.773473    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d00fb7ce-08f2-4e8e-bcb8-78e0d393e74f-networking-console-plugin-cert podName:d00fb7ce-08f2-4e8e-bcb8-78e0d393e74f nodeName:}" failed. No retries permitted until 2026-07-30 20:25:28.773466687 +0000 UTC m=+40.614942286 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d00fb7ce-08f2-4e8e-bcb8-78e0d393e74f-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-jljn6" (UID: "d00fb7ce-08f2-4e8e-bcb8-78e0d393e74f") : secret "networking-console-plugin-cert" not found
Jul 30 20:25:26.891624 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:26.891593    2583 generic.go:356] "Generic (PLEG): container finished" podID="b5ea3ceb-c9e3-4ef4-920c-9b618c947bee" containerID="cce51dd4d2c888bfe9295378fc8805dcf0d411fd7c67bd7609b5c2f15102987c" exitCode=0
Jul 30 20:25:26.891766 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:26.891646    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nlpd2" event={"ID":"b5ea3ceb-c9e3-4ef4-920c-9b618c947bee","Type":"ContainerDied","Data":"cce51dd4d2c888bfe9295378fc8805dcf0d411fd7c67bd7609b5c2f15102987c"}
Jul 30 20:25:27.897695 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:27.897660    2583 generic.go:356] "Generic (PLEG): container finished" podID="b5ea3ceb-c9e3-4ef4-920c-9b618c947bee" containerID="444a32d52855fbe3f91ffc18aec6a43d900ab7183e7bac4863d015f21385131e" exitCode=0
Jul 30 20:25:27.898129 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:27.897700    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nlpd2" event={"ID":"b5ea3ceb-c9e3-4ef4-920c-9b618c947bee","Type":"ContainerDied","Data":"444a32d52855fbe3f91ffc18aec6a43d900ab7183e7bac4863d015f21385131e"}
Jul 30 20:25:28.687228 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:28.687202    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:25:28.768806 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:28.768726    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:25:28.790894 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:28.790862    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/de47806e-aced-40b0-a9da-07fd79b4672a-metrics-tls\") pod \"dns-default-tlhdq\" (UID: \"de47806e-aced-40b0-a9da-07fd79b4672a\") " pod="openshift-dns/dns-default-tlhdq"
Jul 30 20:25:28.791009 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:28.790901    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fd98fd1e-2a93-4be2-ba8c-21300b318c71-registry-tls\") pod \"image-registry-5b5c7c9c69-f9wj5\" (UID: \"fd98fd1e-2a93-4be2-ba8c-21300b318c71\") " pod="openshift-image-registry/image-registry-5b5c7c9c69-f9wj5"
Jul 30 20:25:28.791046 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:25:28.791013    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 30 20:25:28.791046 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:25:28.791028    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b5c7c9c69-f9wj5: secret "image-registry-tls" not found
Jul 30 20:25:28.791046 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:25:28.791030    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 30 20:25:28.791166 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:28.791051    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d00fb7ce-08f2-4e8e-bcb8-78e0d393e74f-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-jljn6\" (UID: \"d00fb7ce-08f2-4e8e-bcb8-78e0d393e74f\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-jljn6"
Jul 30 20:25:28.791166 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:25:28.791069    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fd98fd1e-2a93-4be2-ba8c-21300b318c71-registry-tls podName:fd98fd1e-2a93-4be2-ba8c-21300b318c71 nodeName:}" failed. No retries permitted until 2026-07-30 20:25:32.791055803 +0000 UTC m=+44.632531407 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fd98fd1e-2a93-4be2-ba8c-21300b318c71-registry-tls") pod "image-registry-5b5c7c9c69-f9wj5" (UID: "fd98fd1e-2a93-4be2-ba8c-21300b318c71") : secret "image-registry-tls" not found
Jul 30 20:25:28.791166 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:25:28.791082    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de47806e-aced-40b0-a9da-07fd79b4672a-metrics-tls podName:de47806e-aced-40b0-a9da-07fd79b4672a nodeName:}" failed. No retries permitted until 2026-07-30 20:25:32.791077108 +0000 UTC m=+44.632552707 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/de47806e-aced-40b0-a9da-07fd79b4672a-metrics-tls") pod "dns-default-tlhdq" (UID: "de47806e-aced-40b0-a9da-07fd79b4672a") : secret "dns-default-metrics-tls" not found
Jul 30 20:25:28.791166 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:25:28.791126    2583 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 30 20:25:28.791294 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:25:28.791202    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d00fb7ce-08f2-4e8e-bcb8-78e0d393e74f-networking-console-plugin-cert podName:d00fb7ce-08f2-4e8e-bcb8-78e0d393e74f nodeName:}" failed. No retries permitted until 2026-07-30 20:25:32.791189961 +0000 UTC m=+44.632665561 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d00fb7ce-08f2-4e8e-bcb8-78e0d393e74f-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-jljn6" (UID: "d00fb7ce-08f2-4e8e-bcb8-78e0d393e74f") : secret "networking-console-plugin-cert" not found
Jul 30 20:25:28.903150 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:28.903115    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nlpd2" event={"ID":"b5ea3ceb-c9e3-4ef4-920c-9b618c947bee","Type":"ContainerStarted","Data":"79c6063bc77e92d28ab2e49805daa16fc9614e3e0f56a9bcfb7735a8a092a0c6"}
Jul 30 20:25:28.904547 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:28.904520    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-txjtr" event={"ID":"d1d63b84-5b7c-4792-9a2e-79c6b75e7bcf","Type":"ContainerStarted","Data":"48e0eb4d62a91624ce4d6a89a4027a05cb9efca87a4d9583c68e8090818894e5"}
Jul 30 20:25:28.924970 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:28.924928    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-nlpd2" podStartSLOduration=8.587961217 podStartE2EDuration="39.924915549s" totalImagesPullingTime="31.336954332s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 20:24:49 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:25:28.924439264 +0000 UTC m=+40.765914896" watchObservedRunningTime="2026-07-30 20:25:28.924915549 +0000 UTC m=+40.766391169"
Jul 30 20:25:28.938008 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:28.937968    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-txjtr" podStartSLOduration=1.084956098 podStartE2EDuration="3.937951748s" totalImagesPullingTime="2.85299565s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:25:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:25:28.937770323 +0000 UTC m=+40.779245946" watchObservedRunningTime="2026-07-30 20:25:28.937951748 +0000 UTC m=+40.779427373"
Jul 30 20:25:29.049644 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:29.049570    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:25:29.152565 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:29.152523    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:25:32.820067 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:32.820036    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/de47806e-aced-40b0-a9da-07fd79b4672a-metrics-tls\") pod \"dns-default-tlhdq\" (UID: \"de47806e-aced-40b0-a9da-07fd79b4672a\") " pod="openshift-dns/dns-default-tlhdq"
Jul 30 20:25:32.820067 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:32.820067    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fd98fd1e-2a93-4be2-ba8c-21300b318c71-registry-tls\") pod \"image-registry-5b5c7c9c69-f9wj5\" (UID: \"fd98fd1e-2a93-4be2-ba8c-21300b318c71\") " pod="openshift-image-registry/image-registry-5b5c7c9c69-f9wj5"
Jul 30 20:25:32.820538 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:32.820104    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d00fb7ce-08f2-4e8e-bcb8-78e0d393e74f-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-jljn6\" (UID: \"d00fb7ce-08f2-4e8e-bcb8-78e0d393e74f\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-jljn6"
Jul 30 20:25:32.820538 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:25:32.820210    2583 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 30 20:25:32.820538 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:25:32.820217    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 30 20:25:32.820538 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:25:32.820256    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d00fb7ce-08f2-4e8e-bcb8-78e0d393e74f-networking-console-plugin-cert podName:d00fb7ce-08f2-4e8e-bcb8-78e0d393e74f nodeName:}" failed. No retries permitted until 2026-07-30 20:25:40.820243598 +0000 UTC m=+52.661719198 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d00fb7ce-08f2-4e8e-bcb8-78e0d393e74f-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-jljn6" (UID: "d00fb7ce-08f2-4e8e-bcb8-78e0d393e74f") : secret "networking-console-plugin-cert" not found
Jul 30 20:25:32.820538 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:25:32.820279    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de47806e-aced-40b0-a9da-07fd79b4672a-metrics-tls podName:de47806e-aced-40b0-a9da-07fd79b4672a nodeName:}" failed. No retries permitted until 2026-07-30 20:25:40.820261219 +0000 UTC m=+52.661736822 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/de47806e-aced-40b0-a9da-07fd79b4672a-metrics-tls") pod "dns-default-tlhdq" (UID: "de47806e-aced-40b0-a9da-07fd79b4672a") : secret "dns-default-metrics-tls" not found
Jul 30 20:25:32.820538 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:25:32.820220    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 30 20:25:32.820538 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:25:32.820297    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b5c7c9c69-f9wj5: secret "image-registry-tls" not found
Jul 30 20:25:32.820538 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:25:32.820332    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fd98fd1e-2a93-4be2-ba8c-21300b318c71-registry-tls podName:fd98fd1e-2a93-4be2-ba8c-21300b318c71 nodeName:}" failed. No retries permitted until 2026-07-30 20:25:40.820322714 +0000 UTC m=+52.661798319 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fd98fd1e-2a93-4be2-ba8c-21300b318c71-registry-tls") pod "image-registry-5b5c7c9c69-f9wj5" (UID: "fd98fd1e-2a93-4be2-ba8c-21300b318c71") : secret "image-registry-tls" not found
Jul 30 20:25:34.540898 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:34.540854    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:25:34.640927 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:34.640892    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:25:35.014360 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:35.014320    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:25:35.073234 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:35.073205    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:25:36.532343 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:36.532305    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:25:36.587977 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:36.587945    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:25:39.469159 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:39.469113    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:25:40.875991 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:40.875954    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d00fb7ce-08f2-4e8e-bcb8-78e0d393e74f-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-jljn6\" (UID: \"d00fb7ce-08f2-4e8e-bcb8-78e0d393e74f\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-jljn6"
Jul 30 20:25:40.876437 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:40.876022    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/de47806e-aced-40b0-a9da-07fd79b4672a-metrics-tls\") pod \"dns-default-tlhdq\" (UID: \"de47806e-aced-40b0-a9da-07fd79b4672a\") " pod="openshift-dns/dns-default-tlhdq"
Jul 30 20:25:40.876437 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:40.876040    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fd98fd1e-2a93-4be2-ba8c-21300b318c71-registry-tls\") pod \"image-registry-5b5c7c9c69-f9wj5\" (UID: \"fd98fd1e-2a93-4be2-ba8c-21300b318c71\") " pod="openshift-image-registry/image-registry-5b5c7c9c69-f9wj5"
Jul 30 20:25:40.876437 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:25:40.876156    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 30 20:25:40.876437 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:25:40.876168    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b5c7c9c69-f9wj5: secret "image-registry-tls" not found
Jul 30 20:25:40.876437 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:25:40.876171    2583 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 30 20:25:40.876437 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:25:40.876207    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 30 20:25:40.876437 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:25:40.876214    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fd98fd1e-2a93-4be2-ba8c-21300b318c71-registry-tls podName:fd98fd1e-2a93-4be2-ba8c-21300b318c71 nodeName:}" failed. No retries permitted until 2026-07-30 20:25:56.876201351 +0000 UTC m=+68.717676950 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fd98fd1e-2a93-4be2-ba8c-21300b318c71-registry-tls") pod "image-registry-5b5c7c9c69-f9wj5" (UID: "fd98fd1e-2a93-4be2-ba8c-21300b318c71") : secret "image-registry-tls" not found
Jul 30 20:25:40.876437 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:25:40.876266    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d00fb7ce-08f2-4e8e-bcb8-78e0d393e74f-networking-console-plugin-cert podName:d00fb7ce-08f2-4e8e-bcb8-78e0d393e74f nodeName:}" failed. No retries permitted until 2026-07-30 20:25:56.876248319 +0000 UTC m=+68.717723918 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d00fb7ce-08f2-4e8e-bcb8-78e0d393e74f-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-jljn6" (UID: "d00fb7ce-08f2-4e8e-bcb8-78e0d393e74f") : secret "networking-console-plugin-cert" not found
Jul 30 20:25:40.876437 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:25:40.876289    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de47806e-aced-40b0-a9da-07fd79b4672a-metrics-tls podName:de47806e-aced-40b0-a9da-07fd79b4672a nodeName:}" failed. No retries permitted until 2026-07-30 20:25:56.876276478 +0000 UTC m=+68.717752079 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/de47806e-aced-40b0-a9da-07fd79b4672a-metrics-tls") pod "dns-default-tlhdq" (UID: "de47806e-aced-40b0-a9da-07fd79b4672a") : secret "dns-default-metrics-tls" not found
Jul 30 20:25:44.405374 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:44.405336    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:25:44.460282 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:44.460246    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:25:45.373793 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:45.373752    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:25:45.475031 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:45.474996    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:25:46.428892 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:46.428852    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:25:46.483701 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:46.483669    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:25:47.367921 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:47.367890    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:25:49.881348 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:49.881321    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-j8dzm"
Jul 30 20:25:50.027857 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:50.027820    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:25:50.129252 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:50.129205    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:25:50.602458 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:50.602410    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:25:50.660372 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:50.660342    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:25:51.430191 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:51.430156    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:25:51.530578 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:51.530538    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:25:53.942084 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:53.942054    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:25:54.000473 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:54.000433    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:25:54.380543 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:54.380454    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c27cd9e-72be-4a13-8deb-f4c3ffe3ecea-metrics-certs\") pod \"network-metrics-daemon-jfpt4\" (UID: \"9c27cd9e-72be-4a13-8deb-f4c3ffe3ecea\") " pod="openshift-multus/network-metrics-daemon-jfpt4"
Jul 30 20:25:54.382877 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:54.382861    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 30 20:25:54.390747 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:25:54.390729    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 30 20:25:54.390803 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:25:54.390794    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c27cd9e-72be-4a13-8deb-f4c3ffe3ecea-metrics-certs podName:9c27cd9e-72be-4a13-8deb-f4c3ffe3ecea nodeName:}" failed. No retries permitted until 2026-07-30 20:26:58.390777343 +0000 UTC m=+130.232252944 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9c27cd9e-72be-4a13-8deb-f4c3ffe3ecea-metrics-certs") pod "network-metrics-daemon-jfpt4" (UID: "9c27cd9e-72be-4a13-8deb-f4c3ffe3ecea") : secret "metrics-daemon-secret" not found
Jul 30 20:25:54.480939 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:54.480902    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/01f71a23-f22f-44f3-b7d6-3ba3050b69fa-original-pull-secret\") pod \"global-pull-secret-syncer-8g9tl\" (UID: \"01f71a23-f22f-44f3-b7d6-3ba3050b69fa\") " pod="kube-system/global-pull-secret-syncer-8g9tl"
Jul 30 20:25:54.481019 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:54.480973    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tnh6n\" (UniqueName: \"kubernetes.io/projected/97b781c0-bbe8-42ae-b54b-b42b759c87b4-kube-api-access-tnh6n\") pod \"network-check-target-k8jg9\" (UID: \"97b781c0-bbe8-42ae-b54b-b42b759c87b4\") " pod="openshift-network-diagnostics/network-check-target-k8jg9"
Jul 30 20:25:54.483350 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:54.483323    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 30 20:25:54.483508 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:54.483376    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 30 20:25:54.493732 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:54.493705    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 30 20:25:54.496012 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:54.495977    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/01f71a23-f22f-44f3-b7d6-3ba3050b69fa-original-pull-secret\") pod \"global-pull-secret-syncer-8g9tl\" (UID: \"01f71a23-f22f-44f3-b7d6-3ba3050b69fa\") " pod="kube-system/global-pull-secret-syncer-8g9tl"
Jul 30 20:25:54.505281 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:54.505255    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tnh6n\" (UniqueName: \"kubernetes.io/projected/97b781c0-bbe8-42ae-b54b-b42b759c87b4-kube-api-access-tnh6n\") pod \"network-check-target-k8jg9\" (UID: \"97b781c0-bbe8-42ae-b54b-b42b759c87b4\") " pod="openshift-network-diagnostics/network-check-target-k8jg9"
Jul 30 20:25:54.583333 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:54.583302    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-944cj\""
Jul 30 20:25:54.592003 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:54.591978    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k8jg9"
Jul 30 20:25:54.593237 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:54.593216    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8g9tl"
Jul 30 20:25:54.752044 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:54.752006    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8g9tl"]
Jul 30 20:25:54.755358 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:25:54.755335    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01f71a23_f22f_44f3_b7d6_3ba3050b69fa.slice/crio-a643867b18f2b05215ec7507f6f7ba19d12831c9e7f29670c4de3fc56dfc61e6 WatchSource:0}: Error finding container a643867b18f2b05215ec7507f6f7ba19d12831c9e7f29670c4de3fc56dfc61e6: Status 404 returned error can't find the container with id a643867b18f2b05215ec7507f6f7ba19d12831c9e7f29670c4de3fc56dfc61e6
Jul 30 20:25:54.766851 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:54.766816    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-k8jg9"]
Jul 30 20:25:54.769901 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:25:54.769877    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97b781c0_bbe8_42ae_b54b_b42b759c87b4.slice/crio-25404da39b8215a6fa2301cfa1a031497c2f7d682e1691cfba320295ab53f410 WatchSource:0}: Error finding container 25404da39b8215a6fa2301cfa1a031497c2f7d682e1691cfba320295ab53f410: Status 404 returned error can't find the container with id 25404da39b8215a6fa2301cfa1a031497c2f7d682e1691cfba320295ab53f410
Jul 30 20:25:54.963811 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:54.963773    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8g9tl" event={"ID":"01f71a23-f22f-44f3-b7d6-3ba3050b69fa","Type":"ContainerStarted","Data":"a643867b18f2b05215ec7507f6f7ba19d12831c9e7f29670c4de3fc56dfc61e6"}
Jul 30 20:25:54.964865 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:54.964842    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-k8jg9" event={"ID":"97b781c0-bbe8-42ae-b54b-b42b759c87b4","Type":"ContainerStarted","Data":"25404da39b8215a6fa2301cfa1a031497c2f7d682e1691cfba320295ab53f410"}
Jul 30 20:25:56.898640 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:56.898369    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/de47806e-aced-40b0-a9da-07fd79b4672a-metrics-tls\") pod \"dns-default-tlhdq\" (UID: \"de47806e-aced-40b0-a9da-07fd79b4672a\") " pod="openshift-dns/dns-default-tlhdq"
Jul 30 20:25:56.898640 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:56.898449    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fd98fd1e-2a93-4be2-ba8c-21300b318c71-registry-tls\") pod \"image-registry-5b5c7c9c69-f9wj5\" (UID: \"fd98fd1e-2a93-4be2-ba8c-21300b318c71\") " pod="openshift-image-registry/image-registry-5b5c7c9c69-f9wj5"
Jul 30 20:25:56.898640 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:56.898498    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d00fb7ce-08f2-4e8e-bcb8-78e0d393e74f-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-jljn6\" (UID: \"d00fb7ce-08f2-4e8e-bcb8-78e0d393e74f\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-jljn6"
Jul 30 20:25:56.898640 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:25:56.898538    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 30 20:25:56.898640 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:25:56.898613    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de47806e-aced-40b0-a9da-07fd79b4672a-metrics-tls podName:de47806e-aced-40b0-a9da-07fd79b4672a nodeName:}" failed. No retries permitted until 2026-07-30 20:26:28.898591987 +0000 UTC m=+100.740067608 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/de47806e-aced-40b0-a9da-07fd79b4672a-metrics-tls") pod "dns-default-tlhdq" (UID: "de47806e-aced-40b0-a9da-07fd79b4672a") : secret "dns-default-metrics-tls" not found
Jul 30 20:25:56.898640 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:25:56.898612    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 30 20:25:56.898640 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:25:56.898635    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b5c7c9c69-f9wj5: secret "image-registry-tls" not found
Jul 30 20:25:56.899368 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:25:56.898736    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fd98fd1e-2a93-4be2-ba8c-21300b318c71-registry-tls podName:fd98fd1e-2a93-4be2-ba8c-21300b318c71 nodeName:}" failed. No retries permitted until 2026-07-30 20:26:28.898717969 +0000 UTC m=+100.740193582 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fd98fd1e-2a93-4be2-ba8c-21300b318c71-registry-tls") pod "image-registry-5b5c7c9c69-f9wj5" (UID: "fd98fd1e-2a93-4be2-ba8c-21300b318c71") : secret "image-registry-tls" not found
Jul 30 20:25:56.899368 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:25:56.898611    2583 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 30 20:25:56.899368 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:25:56.898777    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d00fb7ce-08f2-4e8e-bcb8-78e0d393e74f-networking-console-plugin-cert podName:d00fb7ce-08f2-4e8e-bcb8-78e0d393e74f nodeName:}" failed. No retries permitted until 2026-07-30 20:26:28.898765959 +0000 UTC m=+100.740241558 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d00fb7ce-08f2-4e8e-bcb8-78e0d393e74f-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-jljn6" (UID: "d00fb7ce-08f2-4e8e-bcb8-78e0d393e74f") : secret "networking-console-plugin-cert" not found
Jul 30 20:25:57.088488 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:57.088454    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:25:57.143324 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:57.143226    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:25:59.979717 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:59.979676    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8g9tl" event={"ID":"01f71a23-f22f-44f3-b7d6-3ba3050b69fa","Type":"ContainerStarted","Data":"f9b6f6954cd2ddfb3596eb2dd3423747f6e6a2bfc9042c7ab1b1ce7d92485482"}
Jul 30 20:25:59.981068 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:59.981045    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-k8jg9" event={"ID":"97b781c0-bbe8-42ae-b54b-b42b759c87b4","Type":"ContainerStarted","Data":"f896a7b1173ade547f4fd66efba0935cb4e65564b7b2cd43b50fa5d4b316ae6f"}
Jul 30 20:25:59.981196 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:59.981100    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-k8jg9"
Jul 30 20:25:59.993362 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:25:59.993310    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-8g9tl" podStartSLOduration=66.382583211 podStartE2EDuration="1m10.993296207s" totalImagesPullingTime="4.610712996s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 20:24:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:25:59.992948548 +0000 UTC m=+71.834424168" watchObservedRunningTime="2026-07-30 20:25:59.993296207 +0000 UTC m=+71.834771822"
Jul 30 20:26:00.006100 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:26:00.005639    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-k8jg9" podStartSLOduration=66.41381144 podStartE2EDuration="1m11.005619409s" totalImagesPullingTime="4.591807969s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:24:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:26:00.005029381 +0000 UTC m=+71.846505002" watchObservedRunningTime="2026-07-30 20:26:00.005619409 +0000 UTC m=+71.847095028"
Jul 30 20:26:00.495471 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:26:00.495426    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:26:00.550657 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:26:00.550620    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:26:02.257518 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:26:02.257481    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:26:13.599666 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:26:13.599534    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:26:13.677254 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:26:13.677205    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:26:23.450008 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:26:23.449960    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:26:23.508383 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:26:23.508339    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:26:23.564299 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:26:23.564265    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:26:28.929713 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:26:28.929666    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/de47806e-aced-40b0-a9da-07fd79b4672a-metrics-tls\") pod \"dns-default-tlhdq\" (UID: \"de47806e-aced-40b0-a9da-07fd79b4672a\") " pod="openshift-dns/dns-default-tlhdq"
Jul 30 20:26:28.929713 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:26:28.929712    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fd98fd1e-2a93-4be2-ba8c-21300b318c71-registry-tls\") pod \"image-registry-5b5c7c9c69-f9wj5\" (UID: \"fd98fd1e-2a93-4be2-ba8c-21300b318c71\") " pod="openshift-image-registry/image-registry-5b5c7c9c69-f9wj5"
Jul 30 20:26:28.930207 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:26:28.929761    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d00fb7ce-08f2-4e8e-bcb8-78e0d393e74f-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-jljn6\" (UID: \"d00fb7ce-08f2-4e8e-bcb8-78e0d393e74f\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-jljn6"
Jul 30 20:26:28.930207 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:26:28.929821    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 30 20:26:28.930207 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:26:28.929858    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 30 20:26:28.930207 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:26:28.929864    2583 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 30 20:26:28.930207 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:26:28.929871    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b5c7c9c69-f9wj5: secret "image-registry-tls" not found
Jul 30 20:26:28.930207 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:26:28.929907    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de47806e-aced-40b0-a9da-07fd79b4672a-metrics-tls podName:de47806e-aced-40b0-a9da-07fd79b4672a nodeName:}" failed. No retries permitted until 2026-07-30 20:27:32.929885717 +0000 UTC m=+164.771361335 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/de47806e-aced-40b0-a9da-07fd79b4672a-metrics-tls") pod "dns-default-tlhdq" (UID: "de47806e-aced-40b0-a9da-07fd79b4672a") : secret "dns-default-metrics-tls" not found
Jul 30 20:26:28.930207 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:26:28.929930    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d00fb7ce-08f2-4e8e-bcb8-78e0d393e74f-networking-console-plugin-cert podName:d00fb7ce-08f2-4e8e-bcb8-78e0d393e74f nodeName:}" failed. No retries permitted until 2026-07-30 20:27:32.929915171 +0000 UTC m=+164.771390784 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d00fb7ce-08f2-4e8e-bcb8-78e0d393e74f-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-jljn6" (UID: "d00fb7ce-08f2-4e8e-bcb8-78e0d393e74f") : secret "networking-console-plugin-cert" not found
Jul 30 20:26:28.930207 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:26:28.929947    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fd98fd1e-2a93-4be2-ba8c-21300b318c71-registry-tls podName:fd98fd1e-2a93-4be2-ba8c-21300b318c71 nodeName:}" failed. No retries permitted until 2026-07-30 20:27:32.929938861 +0000 UTC m=+164.771414466 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fd98fd1e-2a93-4be2-ba8c-21300b318c71-registry-tls") pod "image-registry-5b5c7c9c69-f9wj5" (UID: "fd98fd1e-2a93-4be2-ba8c-21300b318c71") : secret "image-registry-tls" not found
Jul 30 20:26:30.985318 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:26:30.985286    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-k8jg9"
Jul 30 20:26:38.405837 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:26:38.405798    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:26:52.897601 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:26:52.897570    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:26:58.444634 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:26:58.444578    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c27cd9e-72be-4a13-8deb-f4c3ffe3ecea-metrics-certs\") pod \"network-metrics-daemon-jfpt4\" (UID: \"9c27cd9e-72be-4a13-8deb-f4c3ffe3ecea\") " pod="openshift-multus/network-metrics-daemon-jfpt4"
Jul 30 20:26:58.445169 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:26:58.444742    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 30 20:26:58.445169 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:26:58.444824    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c27cd9e-72be-4a13-8deb-f4c3ffe3ecea-metrics-certs podName:9c27cd9e-72be-4a13-8deb-f4c3ffe3ecea nodeName:}" failed. No retries permitted until 2026-07-30 20:29:00.444806932 +0000 UTC m=+252.286282531 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9c27cd9e-72be-4a13-8deb-f4c3ffe3ecea-metrics-certs") pod "network-metrics-daemon-jfpt4" (UID: "9c27cd9e-72be-4a13-8deb-f4c3ffe3ecea") : secret "metrics-daemon-secret" not found
Jul 30 20:27:28.030400 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:27:28.030348    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-f77f48c6d-jljn6" podUID="d00fb7ce-08f2-4e8e-bcb8-78e0d393e74f"
Jul 30 20:27:28.041540 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:27:28.041507    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-5b5c7c9c69-f9wj5" podUID="fd98fd1e-2a93-4be2-ba8c-21300b318c71"
Jul 30 20:27:28.048792 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:27:28.048747    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-tlhdq" podUID="de47806e-aced-40b0-a9da-07fd79b4672a"
Jul 30 20:27:28.190726 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:27:28.190698    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tlhdq"
Jul 30 20:27:28.190865 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:27:28.190698    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5b5c7c9c69-f9wj5"
Jul 30 20:27:28.190904 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:27:28.190698    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-f77f48c6d-jljn6"
Jul 30 20:27:29.688126 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:27:29.688080    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-jfpt4" podUID="9c27cd9e-72be-4a13-8deb-f4c3ffe3ecea"
Jul 30 20:27:33.001250 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:27:33.001220    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d00fb7ce-08f2-4e8e-bcb8-78e0d393e74f-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-jljn6\" (UID: \"d00fb7ce-08f2-4e8e-bcb8-78e0d393e74f\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-jljn6"
Jul 30 20:27:33.001644 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:27:33.001276    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/de47806e-aced-40b0-a9da-07fd79b4672a-metrics-tls\") pod \"dns-default-tlhdq\" (UID: \"de47806e-aced-40b0-a9da-07fd79b4672a\") " pod="openshift-dns/dns-default-tlhdq"
Jul 30 20:27:33.001644 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:27:33.001300    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fd98fd1e-2a93-4be2-ba8c-21300b318c71-registry-tls\") pod \"image-registry-5b5c7c9c69-f9wj5\" (UID: \"fd98fd1e-2a93-4be2-ba8c-21300b318c71\") " pod="openshift-image-registry/image-registry-5b5c7c9c69-f9wj5"
Jul 30 20:27:33.001644 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:27:33.001388    2583 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 30 20:27:33.001644 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:27:33.001392    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 30 20:27:33.001644 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:27:33.001394    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 30 20:27:33.001644 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:27:33.001409    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b5c7c9c69-f9wj5: secret "image-registry-tls" not found
Jul 30 20:27:33.001644 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:27:33.001458    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fd98fd1e-2a93-4be2-ba8c-21300b318c71-registry-tls podName:fd98fd1e-2a93-4be2-ba8c-21300b318c71 nodeName:}" failed. No retries permitted until 2026-07-30 20:29:35.001440815 +0000 UTC m=+286.842916416 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fd98fd1e-2a93-4be2-ba8c-21300b318c71-registry-tls") pod "image-registry-5b5c7c9c69-f9wj5" (UID: "fd98fd1e-2a93-4be2-ba8c-21300b318c71") : secret "image-registry-tls" not found
Jul 30 20:27:33.001644 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:27:33.001475    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d00fb7ce-08f2-4e8e-bcb8-78e0d393e74f-networking-console-plugin-cert podName:d00fb7ce-08f2-4e8e-bcb8-78e0d393e74f nodeName:}" failed. No retries permitted until 2026-07-30 20:29:35.001465417 +0000 UTC m=+286.842941016 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d00fb7ce-08f2-4e8e-bcb8-78e0d393e74f-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-jljn6" (UID: "d00fb7ce-08f2-4e8e-bcb8-78e0d393e74f") : secret "networking-console-plugin-cert" not found
Jul 30 20:27:33.001644 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:27:33.001489    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de47806e-aced-40b0-a9da-07fd79b4672a-metrics-tls podName:de47806e-aced-40b0-a9da-07fd79b4672a nodeName:}" failed. No retries permitted until 2026-07-30 20:29:35.001481234 +0000 UTC m=+286.842956836 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/de47806e-aced-40b0-a9da-07fd79b4672a-metrics-tls") pod "dns-default-tlhdq" (UID: "de47806e-aced-40b0-a9da-07fd79b4672a") : secret "dns-default-metrics-tls" not found
Jul 30 20:27:42.670133 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:27:42.670090    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jfpt4"
Jul 30 20:28:42.359332 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:28:42.359280    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:29:00.493344 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:00.493306    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c27cd9e-72be-4a13-8deb-f4c3ffe3ecea-metrics-certs\") pod \"network-metrics-daemon-jfpt4\" (UID: \"9c27cd9e-72be-4a13-8deb-f4c3ffe3ecea\") " pod="openshift-multus/network-metrics-daemon-jfpt4"
Jul 30 20:29:00.493708 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:29:00.493413    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 30 20:29:00.493708 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:29:00.493471    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c27cd9e-72be-4a13-8deb-f4c3ffe3ecea-metrics-certs podName:9c27cd9e-72be-4a13-8deb-f4c3ffe3ecea nodeName:}" failed. No retries permitted until 2026-07-30 20:31:02.493455985 +0000 UTC m=+374.334931584 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9c27cd9e-72be-4a13-8deb-f4c3ffe3ecea-metrics-certs") pod "network-metrics-daemon-jfpt4" (UID: "9c27cd9e-72be-4a13-8deb-f4c3ffe3ecea") : secret "metrics-daemon-secret" not found
Jul 30 20:29:08.866770 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:08.866739    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-b6prf"]
Jul 30 20:29:08.868449 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:08.868433    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-b6prf"
Jul 30 20:29:08.870547 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:08.870525    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 30 20:29:08.870987 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:08.870970    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-5sbw7\""
Jul 30 20:29:08.871058 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:08.870977    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 30 20:29:08.874713 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:08.874690    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-84jg4"]
Jul 30 20:29:08.876280 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:08.876264    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-77696685b-dqzbs"]
Jul 30 20:29:08.876383 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:08.876367    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-84jg4"
Jul 30 20:29:08.878467 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:08.878445    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-b6prf"]
Jul 30 20:29:08.878603 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:08.878535    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-77696685b-dqzbs"
Jul 30 20:29:08.879057 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:08.879038    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 30 20:29:08.879286 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:08.879263    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 30 20:29:08.879386 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:08.879308    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 30 20:29:08.879440 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:08.879382    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-ld7th\""
Jul 30 20:29:08.880053 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:08.880036    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 30 20:29:08.880738 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:08.880694    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 30 20:29:08.880839 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:08.880762    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 30 20:29:08.881705 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:08.881683    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 30 20:29:08.883436 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:08.883416    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 30 20:29:08.885870 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:08.883821    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-rtndq\""
Jul 30 20:29:08.888861 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:08.888840    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 30 20:29:08.891285 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:08.891266    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-84jg4"]
Jul 30 20:29:08.895289 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:08.895269    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-77696685b-dqzbs"]
Jul 30 20:29:08.947884 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:08.947860    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qhvv\" (UniqueName: \"kubernetes.io/projected/fc525264-4726-43fd-81d6-dd9beb8cf415-kube-api-access-2qhvv\") pod \"volume-data-source-validator-5b8776669-b6prf\" (UID: \"fc525264-4726-43fd-81d6-dd9beb8cf415\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-b6prf"
Jul 30 20:29:08.947976 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:08.947886    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/812ee652-511e-4dab-9074-2628140ca8a3-serving-cert\") pod \"insights-operator-77696685b-dqzbs\" (UID: \"812ee652-511e-4dab-9074-2628140ca8a3\") " pod="openshift-insights/insights-operator-77696685b-dqzbs"
Jul 30 20:29:08.947976 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:08.947916    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/812ee652-511e-4dab-9074-2628140ca8a3-snapshots\") pod \"insights-operator-77696685b-dqzbs\" (UID: \"812ee652-511e-4dab-9074-2628140ca8a3\") " pod="openshift-insights/insights-operator-77696685b-dqzbs"
Jul 30 20:29:08.948059 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:08.948000    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxd6v\" (UniqueName: \"kubernetes.io/projected/3a311c25-3179-42a6-a5cc-99c05ae6c65a-kube-api-access-fxd6v\") pod \"kube-storage-version-migrator-operator-7878f4b88c-84jg4\" (UID: \"3a311c25-3179-42a6-a5cc-99c05ae6c65a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-84jg4"
Jul 30 20:29:08.948059 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:08.948024    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/812ee652-511e-4dab-9074-2628140ca8a3-service-ca-bundle\") pod \"insights-operator-77696685b-dqzbs\" (UID: \"812ee652-511e-4dab-9074-2628140ca8a3\") " pod="openshift-insights/insights-operator-77696685b-dqzbs"
Jul 30 20:29:08.948059 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:08.948046    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3a311c25-3179-42a6-a5cc-99c05ae6c65a-serving-cert\") pod \"kube-storage-version-migrator-operator-7878f4b88c-84jg4\" (UID: \"3a311c25-3179-42a6-a5cc-99c05ae6c65a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-84jg4"
Jul 30 20:29:08.948192 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:08.948060    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/812ee652-511e-4dab-9074-2628140ca8a3-tmp\") pod \"insights-operator-77696685b-dqzbs\" (UID: \"812ee652-511e-4dab-9074-2628140ca8a3\") " pod="openshift-insights/insights-operator-77696685b-dqzbs"
Jul 30 20:29:08.948192 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:08.948101    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/812ee652-511e-4dab-9074-2628140ca8a3-trusted-ca-bundle\") pod \"insights-operator-77696685b-dqzbs\" (UID: \"812ee652-511e-4dab-9074-2628140ca8a3\") " pod="openshift-insights/insights-operator-77696685b-dqzbs"
Jul 30 20:29:08.948192 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:08.948153    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wlfzf\" (UniqueName: \"kubernetes.io/projected/812ee652-511e-4dab-9074-2628140ca8a3-kube-api-access-wlfzf\") pod \"insights-operator-77696685b-dqzbs\" (UID: \"812ee652-511e-4dab-9074-2628140ca8a3\") " pod="openshift-insights/insights-operator-77696685b-dqzbs"
Jul 30 20:29:08.948192 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:08.948171    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3a311c25-3179-42a6-a5cc-99c05ae6c65a-config\") pod \"kube-storage-version-migrator-operator-7878f4b88c-84jg4\" (UID: \"3a311c25-3179-42a6-a5cc-99c05ae6c65a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-84jg4"
Jul 30 20:29:08.963921 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:08.963897    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-65bdbbff45-pdm2k"]
Jul 30 20:29:08.965366 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:08.965352    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-65bdbbff45-pdm2k"
Jul 30 20:29:08.967070 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:08.967054    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-9vrhd\""
Jul 30 20:29:08.970370 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:08.970346    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-784f97bcf6-ss584"]
Jul 30 20:29:08.971890 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:08.971873    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-n7kff"]
Jul 30 20:29:08.971996 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:08.971981    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-ss584"
Jul 30 20:29:08.973324 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:08.973307    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-n7kff"
Jul 30 20:29:08.973774 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:08.973758    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 30 20:29:08.973950 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:08.973937    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 30 20:29:08.974102 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:08.974079    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 30 20:29:08.974319 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:08.974304    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-pczvk\""
Jul 30 20:29:08.974911 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:08.974896    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 30 20:29:08.975240 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:08.975226    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-rqbk8\""
Jul 30 20:29:08.976341 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:08.976325    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 30 20:29:08.976431 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:08.976331    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 30 20:29:08.976431 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:08.976362    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 30 20:29:08.976726 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:08.976711    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 30 20:29:08.978744 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:08.978723    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-65bdbbff45-pdm2k"]
Jul 30 20:29:08.985647 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:08.985631    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-784f97bcf6-ss584"]
Jul 30 20:29:08.986758 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:08.986736    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-n7kff"]
Jul 30 20:29:09.049402 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:09.049366    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/68eefba9-2bbd-4248-8317-842a022ccaea-config\") pod \"service-ca-operator-784f97bcf6-ss584\" (UID: \"68eefba9-2bbd-4248-8317-842a022ccaea\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-ss584"
Jul 30 20:29:09.049402 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:09.049406    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/812ee652-511e-4dab-9074-2628140ca8a3-trusted-ca-bundle\") pod \"insights-operator-77696685b-dqzbs\" (UID: \"812ee652-511e-4dab-9074-2628140ca8a3\") " pod="openshift-insights/insights-operator-77696685b-dqzbs"
Jul 30 20:29:09.049548 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:09.049424    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/812ee652-511e-4dab-9074-2628140ca8a3-serving-cert\") pod \"insights-operator-77696685b-dqzbs\" (UID: \"812ee652-511e-4dab-9074-2628140ca8a3\") " pod="openshift-insights/insights-operator-77696685b-dqzbs"
Jul 30 20:29:09.049548 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:09.049481    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qhvv\" (UniqueName: \"kubernetes.io/projected/fc525264-4726-43fd-81d6-dd9beb8cf415-kube-api-access-2qhvv\") pod \"volume-data-source-validator-5b8776669-b6prf\" (UID: \"fc525264-4726-43fd-81d6-dd9beb8cf415\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-b6prf"
Jul 30 20:29:09.049548 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:09.049533    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxd6v\" (UniqueName: \"kubernetes.io/projected/3a311c25-3179-42a6-a5cc-99c05ae6c65a-kube-api-access-fxd6v\") pod \"kube-storage-version-migrator-operator-7878f4b88c-84jg4\" (UID: \"3a311c25-3179-42a6-a5cc-99c05ae6c65a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-84jg4"
Jul 30 20:29:09.049666 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:09.049557    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/812ee652-511e-4dab-9074-2628140ca8a3-service-ca-bundle\") pod \"insights-operator-77696685b-dqzbs\" (UID: \"812ee652-511e-4dab-9074-2628140ca8a3\") " pod="openshift-insights/insights-operator-77696685b-dqzbs"
Jul 30 20:29:09.049666 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:09.049579    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhmkf\" (UniqueName: \"kubernetes.io/projected/93b4f477-32ac-45e9-8a6a-e80bd8b8e403-kube-api-access-jhmkf\") pod \"cluster-monitoring-operator-6f55c4f58d-n7kff\" (UID: \"93b4f477-32ac-45e9-8a6a-e80bd8b8e403\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-n7kff"
Jul 30 20:29:09.049666 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:09.049608    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/68eefba9-2bbd-4248-8317-842a022ccaea-serving-cert\") pod \"service-ca-operator-784f97bcf6-ss584\" (UID: \"68eefba9-2bbd-4248-8317-842a022ccaea\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-ss584"
Jul 30 20:29:09.049666 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:09.049645    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3a311c25-3179-42a6-a5cc-99c05ae6c65a-config\") pod \"kube-storage-version-migrator-operator-7878f4b88c-84jg4\" (UID: \"3a311c25-3179-42a6-a5cc-99c05ae6c65a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-84jg4"
Jul 30 20:29:09.049855 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:09.049670    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wlfzf\" (UniqueName: \"kubernetes.io/projected/812ee652-511e-4dab-9074-2628140ca8a3-kube-api-access-wlfzf\") pod \"insights-operator-77696685b-dqzbs\" (UID: \"812ee652-511e-4dab-9074-2628140ca8a3\") " pod="openshift-insights/insights-operator-77696685b-dqzbs"
Jul 30 20:29:09.049855 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:09.049742    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7fghx\" (UniqueName: \"kubernetes.io/projected/6aa74d5b-ad78-4bdb-8dff-346df3c5a38f-kube-api-access-7fghx\") pod \"network-check-source-65bdbbff45-pdm2k\" (UID: \"6aa74d5b-ad78-4bdb-8dff-346df3c5a38f\") " pod="openshift-network-diagnostics/network-check-source-65bdbbff45-pdm2k"
Jul 30 20:29:09.049855 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:09.049788    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/93b4f477-32ac-45e9-8a6a-e80bd8b8e403-telemetry-config\") pod \"cluster-monitoring-operator-6f55c4f58d-n7kff\" (UID: \"93b4f477-32ac-45e9-8a6a-e80bd8b8e403\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-n7kff"
Jul 30 20:29:09.049855 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:09.049820    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/812ee652-511e-4dab-9074-2628140ca8a3-snapshots\") pod \"insights-operator-77696685b-dqzbs\" (UID: \"812ee652-511e-4dab-9074-2628140ca8a3\") " pod="openshift-insights/insights-operator-77696685b-dqzbs"
Jul 30 20:29:09.050047 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:09.049860    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pp7bt\" (UniqueName: \"kubernetes.io/projected/68eefba9-2bbd-4248-8317-842a022ccaea-kube-api-access-pp7bt\") pod \"service-ca-operator-784f97bcf6-ss584\" (UID: \"68eefba9-2bbd-4248-8317-842a022ccaea\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-ss584"
Jul 30 20:29:09.050047 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:09.049895    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/93b4f477-32ac-45e9-8a6a-e80bd8b8e403-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-n7kff\" (UID: \"93b4f477-32ac-45e9-8a6a-e80bd8b8e403\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-n7kff"
Jul 30 20:29:09.050047 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:09.049936    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3a311c25-3179-42a6-a5cc-99c05ae6c65a-serving-cert\") pod \"kube-storage-version-migrator-operator-7878f4b88c-84jg4\" (UID: \"3a311c25-3179-42a6-a5cc-99c05ae6c65a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-84jg4"
Jul 30 20:29:09.050047 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:09.049968    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/812ee652-511e-4dab-9074-2628140ca8a3-tmp\") pod \"insights-operator-77696685b-dqzbs\" (UID: \"812ee652-511e-4dab-9074-2628140ca8a3\") " pod="openshift-insights/insights-operator-77696685b-dqzbs"
Jul 30 20:29:09.050288 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:09.050264    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3a311c25-3179-42a6-a5cc-99c05ae6c65a-config\") pod \"kube-storage-version-migrator-operator-7878f4b88c-84jg4\" (UID: \"3a311c25-3179-42a6-a5cc-99c05ae6c65a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-84jg4"
Jul 30 20:29:09.050354 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:09.050335    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/812ee652-511e-4dab-9074-2628140ca8a3-service-ca-bundle\") pod \"insights-operator-77696685b-dqzbs\" (UID: \"812ee652-511e-4dab-9074-2628140ca8a3\") " pod="openshift-insights/insights-operator-77696685b-dqzbs"
Jul 30 20:29:09.050413 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:09.050392    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/812ee652-511e-4dab-9074-2628140ca8a3-trusted-ca-bundle\") pod \"insights-operator-77696685b-dqzbs\" (UID: \"812ee652-511e-4dab-9074-2628140ca8a3\") " pod="openshift-insights/insights-operator-77696685b-dqzbs"
Jul 30 20:29:09.050502 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:09.050484    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/812ee652-511e-4dab-9074-2628140ca8a3-tmp\") pod \"insights-operator-77696685b-dqzbs\" (UID: \"812ee652-511e-4dab-9074-2628140ca8a3\") " pod="openshift-insights/insights-operator-77696685b-dqzbs"
Jul 30 20:29:09.050686 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:09.050666    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/812ee652-511e-4dab-9074-2628140ca8a3-snapshots\") pod \"insights-operator-77696685b-dqzbs\" (UID: \"812ee652-511e-4dab-9074-2628140ca8a3\") " pod="openshift-insights/insights-operator-77696685b-dqzbs"
Jul 30 20:29:09.051817 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:09.051797    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/812ee652-511e-4dab-9074-2628140ca8a3-serving-cert\") pod \"insights-operator-77696685b-dqzbs\" (UID: \"812ee652-511e-4dab-9074-2628140ca8a3\") " pod="openshift-insights/insights-operator-77696685b-dqzbs"
Jul 30 20:29:09.052154 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:09.052122    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3a311c25-3179-42a6-a5cc-99c05ae6c65a-serving-cert\") pod \"kube-storage-version-migrator-operator-7878f4b88c-84jg4\" (UID: \"3a311c25-3179-42a6-a5cc-99c05ae6c65a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-84jg4"
Jul 30 20:29:09.059520 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:09.059501    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wlfzf\" (UniqueName: \"kubernetes.io/projected/812ee652-511e-4dab-9074-2628140ca8a3-kube-api-access-wlfzf\") pod \"insights-operator-77696685b-dqzbs\" (UID: \"812ee652-511e-4dab-9074-2628140ca8a3\") " pod="openshift-insights/insights-operator-77696685b-dqzbs"
Jul 30 20:29:09.059663 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:09.059641    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qhvv\" (UniqueName: \"kubernetes.io/projected/fc525264-4726-43fd-81d6-dd9beb8cf415-kube-api-access-2qhvv\") pod \"volume-data-source-validator-5b8776669-b6prf\" (UID: \"fc525264-4726-43fd-81d6-dd9beb8cf415\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-b6prf"
Jul 30 20:29:09.059710 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:09.059683    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxd6v\" (UniqueName: \"kubernetes.io/projected/3a311c25-3179-42a6-a5cc-99c05ae6c65a-kube-api-access-fxd6v\") pod \"kube-storage-version-migrator-operator-7878f4b88c-84jg4\" (UID: \"3a311c25-3179-42a6-a5cc-99c05ae6c65a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-84jg4"
Jul 30 20:29:09.099953 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:09.099919    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:29:09.150643 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:09.150619    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/93b4f477-32ac-45e9-8a6a-e80bd8b8e403-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-n7kff\" (UID: \"93b4f477-32ac-45e9-8a6a-e80bd8b8e403\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-n7kff"
Jul 30 20:29:09.150801 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:09.150658    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/68eefba9-2bbd-4248-8317-842a022ccaea-config\") pod \"service-ca-operator-784f97bcf6-ss584\" (UID: \"68eefba9-2bbd-4248-8317-842a022ccaea\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-ss584"
Jul 30 20:29:09.150801 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:29:09.150781    2583 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 30 20:29:09.150911 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:09.150859    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhmkf\" (UniqueName: \"kubernetes.io/projected/93b4f477-32ac-45e9-8a6a-e80bd8b8e403-kube-api-access-jhmkf\") pod \"cluster-monitoring-operator-6f55c4f58d-n7kff\" (UID: \"93b4f477-32ac-45e9-8a6a-e80bd8b8e403\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-n7kff"
Jul 30 20:29:09.150911 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:29:09.150885    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93b4f477-32ac-45e9-8a6a-e80bd8b8e403-cluster-monitoring-operator-tls podName:93b4f477-32ac-45e9-8a6a-e80bd8b8e403 nodeName:}" failed. No retries permitted until 2026-07-30 20:29:09.65086104 +0000 UTC m=+261.492336645 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/93b4f477-32ac-45e9-8a6a-e80bd8b8e403-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-n7kff" (UID: "93b4f477-32ac-45e9-8a6a-e80bd8b8e403") : secret "cluster-monitoring-operator-tls" not found
Jul 30 20:29:09.151023 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:09.150922    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/68eefba9-2bbd-4248-8317-842a022ccaea-serving-cert\") pod \"service-ca-operator-784f97bcf6-ss584\" (UID: \"68eefba9-2bbd-4248-8317-842a022ccaea\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-ss584"
Jul 30 20:29:09.151023 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:09.150971    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7fghx\" (UniqueName: \"kubernetes.io/projected/6aa74d5b-ad78-4bdb-8dff-346df3c5a38f-kube-api-access-7fghx\") pod \"network-check-source-65bdbbff45-pdm2k\" (UID: \"6aa74d5b-ad78-4bdb-8dff-346df3c5a38f\") " pod="openshift-network-diagnostics/network-check-source-65bdbbff45-pdm2k"
Jul 30 20:29:09.151023 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:09.151005    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/93b4f477-32ac-45e9-8a6a-e80bd8b8e403-telemetry-config\") pod \"cluster-monitoring-operator-6f55c4f58d-n7kff\" (UID: \"93b4f477-32ac-45e9-8a6a-e80bd8b8e403\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-n7kff"
Jul 30 20:29:09.151184 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:09.151040    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pp7bt\" (UniqueName: \"kubernetes.io/projected/68eefba9-2bbd-4248-8317-842a022ccaea-kube-api-access-pp7bt\") pod \"service-ca-operator-784f97bcf6-ss584\" (UID: \"68eefba9-2bbd-4248-8317-842a022ccaea\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-ss584"
Jul 30 20:29:09.151242 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:09.151197    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/68eefba9-2bbd-4248-8317-842a022ccaea-config\") pod \"service-ca-operator-784f97bcf6-ss584\" (UID: \"68eefba9-2bbd-4248-8317-842a022ccaea\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-ss584"
Jul 30 20:29:09.151763 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:09.151688    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/93b4f477-32ac-45e9-8a6a-e80bd8b8e403-telemetry-config\") pod \"cluster-monitoring-operator-6f55c4f58d-n7kff\" (UID: \"93b4f477-32ac-45e9-8a6a-e80bd8b8e403\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-n7kff"
Jul 30 20:29:09.153045 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:09.153017    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:29:09.153443 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:09.153425    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/68eefba9-2bbd-4248-8317-842a022ccaea-serving-cert\") pod \"service-ca-operator-784f97bcf6-ss584\" (UID: \"68eefba9-2bbd-4248-8317-842a022ccaea\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-ss584"
Jul 30 20:29:09.160529 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:09.160506    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhmkf\" (UniqueName: \"kubernetes.io/projected/93b4f477-32ac-45e9-8a6a-e80bd8b8e403-kube-api-access-jhmkf\") pod \"cluster-monitoring-operator-6f55c4f58d-n7kff\" (UID: \"93b4f477-32ac-45e9-8a6a-e80bd8b8e403\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-n7kff"
Jul 30 20:29:09.160775 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:09.160757    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pp7bt\" (UniqueName: \"kubernetes.io/projected/68eefba9-2bbd-4248-8317-842a022ccaea-kube-api-access-pp7bt\") pod \"service-ca-operator-784f97bcf6-ss584\" (UID: \"68eefba9-2bbd-4248-8317-842a022ccaea\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-ss584"
Jul 30 20:29:09.160882 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:09.160866    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7fghx\" (UniqueName: \"kubernetes.io/projected/6aa74d5b-ad78-4bdb-8dff-346df3c5a38f-kube-api-access-7fghx\") pod \"network-check-source-65bdbbff45-pdm2k\" (UID: \"6aa74d5b-ad78-4bdb-8dff-346df3c5a38f\") " pod="openshift-network-diagnostics/network-check-source-65bdbbff45-pdm2k"
Jul 30 20:29:09.176635 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:09.176621    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-b6prf"
Jul 30 20:29:09.190027 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:09.190012    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-84jg4"
Jul 30 20:29:09.194687 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:09.194675    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-77696685b-dqzbs"
Jul 30 20:29:09.274491 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:09.274444    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-65bdbbff45-pdm2k"
Jul 30 20:29:09.282972 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:09.282950    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-ss584"
Jul 30 20:29:09.328435 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:09.328375    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-b6prf"]
Jul 30 20:29:09.330049 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:29:09.330012    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc525264_4726_43fd_81d6_dd9beb8cf415.slice/crio-5081e5071e633cfb7038092337b0b6c6a7f6a22d3e72651361ff1ba0a96e400a WatchSource:0}: Error finding container 5081e5071e633cfb7038092337b0b6c6a7f6a22d3e72651361ff1ba0a96e400a: Status 404 returned error can't find the container with id 5081e5071e633cfb7038092337b0b6c6a7f6a22d3e72651361ff1ba0a96e400a
Jul 30 20:29:09.342686 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:09.342630    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-84jg4"]
Jul 30 20:29:09.361756 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:09.361732    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-77696685b-dqzbs"]
Jul 30 20:29:09.364724 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:29:09.364702    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod812ee652_511e_4dab_9074_2628140ca8a3.slice/crio-7792ddd0653690928a82b4763cd9c8ee8d049f94767b132ab5de9d9322050d87 WatchSource:0}: Error finding container 7792ddd0653690928a82b4763cd9c8ee8d049f94767b132ab5de9d9322050d87: Status 404 returned error can't find the container with id 7792ddd0653690928a82b4763cd9c8ee8d049f94767b132ab5de9d9322050d87
Jul 30 20:29:09.421667 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:09.418019    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-65bdbbff45-pdm2k"]
Jul 30 20:29:09.423447 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:29:09.423419    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6aa74d5b_ad78_4bdb_8dff_346df3c5a38f.slice/crio-5b7f4732f4124f9961de81c09627bb3916ea79419d40a7acabeef7ac3490d645 WatchSource:0}: Error finding container 5b7f4732f4124f9961de81c09627bb3916ea79419d40a7acabeef7ac3490d645: Status 404 returned error can't find the container with id 5b7f4732f4124f9961de81c09627bb3916ea79419d40a7acabeef7ac3490d645
Jul 30 20:29:09.424205 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:09.424174    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-77696685b-dqzbs" event={"ID":"812ee652-511e-4dab-9074-2628140ca8a3","Type":"ContainerStarted","Data":"7792ddd0653690928a82b4763cd9c8ee8d049f94767b132ab5de9d9322050d87"}
Jul 30 20:29:09.425187 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:09.425162    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-84jg4" event={"ID":"3a311c25-3179-42a6-a5cc-99c05ae6c65a","Type":"ContainerStarted","Data":"8386901c086146727e41c59a309a1a7e7741f55e6dc6721d0b0d3d141d2d32c5"}
Jul 30 20:29:09.426265 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:09.426204    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-b6prf" event={"ID":"fc525264-4726-43fd-81d6-dd9beb8cf415","Type":"ContainerStarted","Data":"5081e5071e633cfb7038092337b0b6c6a7f6a22d3e72651361ff1ba0a96e400a"}
Jul 30 20:29:09.434907 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:09.434885    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-784f97bcf6-ss584"]
Jul 30 20:29:09.437407 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:29:09.437384    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68eefba9_2bbd_4248_8317_842a022ccaea.slice/crio-be4dfc9a7d6a56327ab40cbb0b7d04ee557efa70166e6d829a972cbf9562bf3b WatchSource:0}: Error finding container be4dfc9a7d6a56327ab40cbb0b7d04ee557efa70166e6d829a972cbf9562bf3b: Status 404 returned error can't find the container with id be4dfc9a7d6a56327ab40cbb0b7d04ee557efa70166e6d829a972cbf9562bf3b
Jul 30 20:29:09.655988 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:09.655911    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/93b4f477-32ac-45e9-8a6a-e80bd8b8e403-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-n7kff\" (UID: \"93b4f477-32ac-45e9-8a6a-e80bd8b8e403\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-n7kff"
Jul 30 20:29:09.656128 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:29:09.656097    2583 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 30 20:29:09.656232 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:29:09.656186    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93b4f477-32ac-45e9-8a6a-e80bd8b8e403-cluster-monitoring-operator-tls podName:93b4f477-32ac-45e9-8a6a-e80bd8b8e403 nodeName:}" failed. No retries permitted until 2026-07-30 20:29:10.656167438 +0000 UTC m=+262.497643037 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/93b4f477-32ac-45e9-8a6a-e80bd8b8e403-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-n7kff" (UID: "93b4f477-32ac-45e9-8a6a-e80bd8b8e403") : secret "cluster-monitoring-operator-tls" not found
Jul 30 20:29:10.437158 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:10.437034    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-65bdbbff45-pdm2k" event={"ID":"6aa74d5b-ad78-4bdb-8dff-346df3c5a38f","Type":"ContainerStarted","Data":"8db22b46a7f4bb329fe5e10c96438ac136d00392491064b42ae776a94b6fe940"}
Jul 30 20:29:10.437158 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:10.437098    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-65bdbbff45-pdm2k" event={"ID":"6aa74d5b-ad78-4bdb-8dff-346df3c5a38f","Type":"ContainerStarted","Data":"5b7f4732f4124f9961de81c09627bb3916ea79419d40a7acabeef7ac3490d645"}
Jul 30 20:29:10.439309 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:10.439275    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-ss584" event={"ID":"68eefba9-2bbd-4248-8317-842a022ccaea","Type":"ContainerStarted","Data":"be4dfc9a7d6a56327ab40cbb0b7d04ee557efa70166e6d829a972cbf9562bf3b"}
Jul 30 20:29:10.452242 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:10.451741    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-65bdbbff45-pdm2k" podStartSLOduration=2.451721793 podStartE2EDuration="2.451721793s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:29:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:29:10.450666398 +0000 UTC m=+262.292142021" watchObservedRunningTime="2026-07-30 20:29:10.451721793 +0000 UTC m=+262.293197414"
Jul 30 20:29:10.664512 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:10.664474    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/93b4f477-32ac-45e9-8a6a-e80bd8b8e403-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-n7kff\" (UID: \"93b4f477-32ac-45e9-8a6a-e80bd8b8e403\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-n7kff"
Jul 30 20:29:10.664669 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:29:10.664634    2583 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 30 20:29:10.664726 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:29:10.664714    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93b4f477-32ac-45e9-8a6a-e80bd8b8e403-cluster-monitoring-operator-tls podName:93b4f477-32ac-45e9-8a6a-e80bd8b8e403 nodeName:}" failed. No retries permitted until 2026-07-30 20:29:12.664692697 +0000 UTC m=+264.506168297 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/93b4f477-32ac-45e9-8a6a-e80bd8b8e403-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-n7kff" (UID: "93b4f477-32ac-45e9-8a6a-e80bd8b8e403") : secret "cluster-monitoring-operator-tls" not found
Jul 30 20:29:12.682685 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:12.682650    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/93b4f477-32ac-45e9-8a6a-e80bd8b8e403-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-n7kff\" (UID: \"93b4f477-32ac-45e9-8a6a-e80bd8b8e403\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-n7kff"
Jul 30 20:29:12.683118 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:29:12.682818    2583 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 30 20:29:12.683118 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:29:12.682892    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93b4f477-32ac-45e9-8a6a-e80bd8b8e403-cluster-monitoring-operator-tls podName:93b4f477-32ac-45e9-8a6a-e80bd8b8e403 nodeName:}" failed. No retries permitted until 2026-07-30 20:29:16.682872221 +0000 UTC m=+268.524347835 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/93b4f477-32ac-45e9-8a6a-e80bd8b8e403-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-n7kff" (UID: "93b4f477-32ac-45e9-8a6a-e80bd8b8e403") : secret "cluster-monitoring-operator-tls" not found
Jul 30 20:29:13.353969 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:13.353889    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:29:13.450064 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:13.449346    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-77696685b-dqzbs" event={"ID":"812ee652-511e-4dab-9074-2628140ca8a3","Type":"ContainerStarted","Data":"c7ca75771c3201d3c95800fdb50b1d4bfd8be0bd61eec9ac8f1f6c4b0682c0ce"}
Jul 30 20:29:13.452092 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:13.451872    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-84jg4" event={"ID":"3a311c25-3179-42a6-a5cc-99c05ae6c65a","Type":"ContainerStarted","Data":"4c9681854e436bcbf59b73b88f1218f3f69e79ac403c2ed778389c3382697739"}
Jul 30 20:29:13.453637 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:13.453604    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-ss584" event={"ID":"68eefba9-2bbd-4248-8317-842a022ccaea","Type":"ContainerStarted","Data":"fc591cb47a14f6ca55f9826343283c34cce8bbb4587afaf736d392b3fdc32b37"}
Jul 30 20:29:13.455182 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:13.455159    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-b6prf" event={"ID":"fc525264-4726-43fd-81d6-dd9beb8cf415","Type":"ContainerStarted","Data":"a354fc62c5cf16727c76d0e5704386b570168ccc72c4d759e712e46774a39a3b"}
Jul 30 20:29:13.455441 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:13.455420    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-rr72x"]
Jul 30 20:29:13.457885 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:13.457727    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:29:13.462773 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:13.462754    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-rr72x"
Jul 30 20:29:13.464547 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:13.464529    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 30 20:29:13.464630 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:13.464552    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-h92tr\""
Jul 30 20:29:13.465201 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:13.465186    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 30 20:29:13.467899 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:13.467878    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-rr72x"]
Jul 30 20:29:13.473734 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:13.473696    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-77696685b-dqzbs" podStartSLOduration=2.424418201 podStartE2EDuration="5.47368224s" totalImagesPullingTime="3.049264039s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:29:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:29:13.473247011 +0000 UTC m=+265.314722633" watchObservedRunningTime="2026-07-30 20:29:13.47368224 +0000 UTC m=+265.315157896"
Jul 30 20:29:13.488326 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:13.488290    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-84jg4" podStartSLOduration=2.4337829429999998 podStartE2EDuration="5.488274914s" totalImagesPullingTime="3.054491971s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:29:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:29:13.487543659 +0000 UTC m=+265.329019281" watchObservedRunningTime="2026-07-30 20:29:13.488274914 +0000 UTC m=+265.329750538"
Jul 30 20:29:13.502991 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:13.502951    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-ss584" podStartSLOduration=2.5266522350000002 podStartE2EDuration="5.502939022s" totalImagesPullingTime="2.976286787s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:29:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:29:13.502451257 +0000 UTC m=+265.343926880" watchObservedRunningTime="2026-07-30 20:29:13.502939022 +0000 UTC m=+265.344414669"
Jul 30 20:29:13.522261 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:13.522201    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-b6prf" podStartSLOduration=2.444924619 podStartE2EDuration="5.522181365s" totalImagesPullingTime="3.077256746s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:29:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:29:13.521346222 +0000 UTC m=+265.362821843" watchObservedRunningTime="2026-07-30 20:29:13.522181365 +0000 UTC m=+265.363656985"
Jul 30 20:29:13.525764 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:13.525658    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:29:13.591592 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:13.591570    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/72fcf9b4-8b2b-4143-be8b-52047fc8086c-data-volume\") pod \"insights-runtime-extractor-rr72x\" (UID: \"72fcf9b4-8b2b-4143-be8b-52047fc8086c\") " pod="openshift-insights/insights-runtime-extractor-rr72x"
Jul 30 20:29:13.591713 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:13.591688    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/72fcf9b4-8b2b-4143-be8b-52047fc8086c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rr72x\" (UID: \"72fcf9b4-8b2b-4143-be8b-52047fc8086c\") " pod="openshift-insights/insights-runtime-extractor-rr72x"
Jul 30 20:29:13.591840 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:13.591815    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/72fcf9b4-8b2b-4143-be8b-52047fc8086c-crio-socket\") pod \"insights-runtime-extractor-rr72x\" (UID: \"72fcf9b4-8b2b-4143-be8b-52047fc8086c\") " pod="openshift-insights/insights-runtime-extractor-rr72x"
Jul 30 20:29:13.591960 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:13.591876    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kkn8t\" (UniqueName: \"kubernetes.io/projected/72fcf9b4-8b2b-4143-be8b-52047fc8086c-kube-api-access-kkn8t\") pod \"insights-runtime-extractor-rr72x\" (UID: \"72fcf9b4-8b2b-4143-be8b-52047fc8086c\") " pod="openshift-insights/insights-runtime-extractor-rr72x"
Jul 30 20:29:13.591960 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:13.591947    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/72fcf9b4-8b2b-4143-be8b-52047fc8086c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rr72x\" (UID: \"72fcf9b4-8b2b-4143-be8b-52047fc8086c\") " pod="openshift-insights/insights-runtime-extractor-rr72x"
Jul 30 20:29:13.626039 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:13.625973    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:29:13.684297 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:13.684272    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:29:13.693210 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:13.693184    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/72fcf9b4-8b2b-4143-be8b-52047fc8086c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rr72x\" (UID: \"72fcf9b4-8b2b-4143-be8b-52047fc8086c\") " pod="openshift-insights/insights-runtime-extractor-rr72x"
Jul 30 20:29:13.693308 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:13.693235    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/72fcf9b4-8b2b-4143-be8b-52047fc8086c-data-volume\") pod \"insights-runtime-extractor-rr72x\" (UID: \"72fcf9b4-8b2b-4143-be8b-52047fc8086c\") " pod="openshift-insights/insights-runtime-extractor-rr72x"
Jul 30 20:29:13.693308 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:13.693273    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/72fcf9b4-8b2b-4143-be8b-52047fc8086c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rr72x\" (UID: \"72fcf9b4-8b2b-4143-be8b-52047fc8086c\") " pod="openshift-insights/insights-runtime-extractor-rr72x"
Jul 30 20:29:13.693308 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:13.693290    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/72fcf9b4-8b2b-4143-be8b-52047fc8086c-crio-socket\") pod \"insights-runtime-extractor-rr72x\" (UID: \"72fcf9b4-8b2b-4143-be8b-52047fc8086c\") " pod="openshift-insights/insights-runtime-extractor-rr72x"
Jul 30 20:29:13.693456 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:13.693311    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kkn8t\" (UniqueName: \"kubernetes.io/projected/72fcf9b4-8b2b-4143-be8b-52047fc8086c-kube-api-access-kkn8t\") pod \"insights-runtime-extractor-rr72x\" (UID: \"72fcf9b4-8b2b-4143-be8b-52047fc8086c\") " pod="openshift-insights/insights-runtime-extractor-rr72x"
Jul 30 20:29:13.693456 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:29:13.693323    2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 30 20:29:13.693456 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:29:13.693370    2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 30 20:29:13.693456 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:29:13.693398    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72fcf9b4-8b2b-4143-be8b-52047fc8086c-insights-runtime-extractor-tls podName:72fcf9b4-8b2b-4143-be8b-52047fc8086c nodeName:}" failed. No retries permitted until 2026-07-30 20:29:14.193379681 +0000 UTC m=+266.034855300 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/72fcf9b4-8b2b-4143-be8b-52047fc8086c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rr72x" (UID: "72fcf9b4-8b2b-4143-be8b-52047fc8086c") : secret "insights-runtime-extractor-tls" not found
Jul 30 20:29:13.693456 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:13.693403    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/72fcf9b4-8b2b-4143-be8b-52047fc8086c-crio-socket\") pod \"insights-runtime-extractor-rr72x\" (UID: \"72fcf9b4-8b2b-4143-be8b-52047fc8086c\") " pod="openshift-insights/insights-runtime-extractor-rr72x"
Jul 30 20:29:13.693456 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:29:13.693441    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/72fcf9b4-8b2b-4143-be8b-52047fc8086c-kube-rbac-proxy-cm podName:72fcf9b4-8b2b-4143-be8b-52047fc8086c nodeName:}" failed. No retries permitted until 2026-07-30 20:29:14.193425129 +0000 UTC m=+266.034900743 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/72fcf9b4-8b2b-4143-be8b-52047fc8086c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rr72x" (UID: "72fcf9b4-8b2b-4143-be8b-52047fc8086c") : configmap "kube-rbac-proxy" not found
Jul 30 20:29:13.693663 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:13.693626    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/72fcf9b4-8b2b-4143-be8b-52047fc8086c-data-volume\") pod \"insights-runtime-extractor-rr72x\" (UID: \"72fcf9b4-8b2b-4143-be8b-52047fc8086c\") " pod="openshift-insights/insights-runtime-extractor-rr72x"
Jul 30 20:29:13.703382 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:13.703360    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkn8t\" (UniqueName: \"kubernetes.io/projected/72fcf9b4-8b2b-4143-be8b-52047fc8086c-kube-api-access-kkn8t\") pod \"insights-runtime-extractor-rr72x\" (UID: \"72fcf9b4-8b2b-4143-be8b-52047fc8086c\") " pod="openshift-insights/insights-runtime-extractor-rr72x"
Jul 30 20:29:14.065224 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:14.065188    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:29:14.165235 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:14.165204    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:29:14.197340 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:14.197314    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/72fcf9b4-8b2b-4143-be8b-52047fc8086c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rr72x\" (UID: \"72fcf9b4-8b2b-4143-be8b-52047fc8086c\") " pod="openshift-insights/insights-runtime-extractor-rr72x"
Jul 30 20:29:14.197440 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:14.197425    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/72fcf9b4-8b2b-4143-be8b-52047fc8086c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rr72x\" (UID: \"72fcf9b4-8b2b-4143-be8b-52047fc8086c\") " pod="openshift-insights/insights-runtime-extractor-rr72x"
Jul 30 20:29:14.197485 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:29:14.197442    2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 30 20:29:14.197529 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:29:14.197490    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72fcf9b4-8b2b-4143-be8b-52047fc8086c-insights-runtime-extractor-tls podName:72fcf9b4-8b2b-4143-be8b-52047fc8086c nodeName:}" failed. No retries permitted until 2026-07-30 20:29:15.197477602 +0000 UTC m=+267.038953201 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/72fcf9b4-8b2b-4143-be8b-52047fc8086c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rr72x" (UID: "72fcf9b4-8b2b-4143-be8b-52047fc8086c") : secret "insights-runtime-extractor-tls" not found
Jul 30 20:29:14.197529 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:29:14.197515    2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 30 20:29:14.197612 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:29:14.197564    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/72fcf9b4-8b2b-4143-be8b-52047fc8086c-kube-rbac-proxy-cm podName:72fcf9b4-8b2b-4143-be8b-52047fc8086c nodeName:}" failed. No retries permitted until 2026-07-30 20:29:15.197548702 +0000 UTC m=+267.039024307 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/72fcf9b4-8b2b-4143-be8b-52047fc8086c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rr72x" (UID: "72fcf9b4-8b2b-4143-be8b-52047fc8086c") : configmap "kube-rbac-proxy" not found
Jul 30 20:29:14.613071 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:14.613014    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:29:14.623787 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:14.623756    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-68bc745d87-ntrxv"]
Jul 30 20:29:14.628100 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:14.628082    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-ntrxv"
Jul 30 20:29:14.630082 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:14.630054    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 30 20:29:14.630244 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:14.630062    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 30 20:29:14.630244 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:14.630180    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-px764\""
Jul 30 20:29:14.634021 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:14.633990    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-68bc745d87-ntrxv"]
Jul 30 20:29:14.702802 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:14.702775    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttjll\" (UniqueName: \"kubernetes.io/projected/855c65f8-558f-4da3-8b83-ae508d2f7d62-kube-api-access-ttjll\") pod \"migrator-68bc745d87-ntrxv\" (UID: \"855c65f8-558f-4da3-8b83-ae508d2f7d62\") " pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-ntrxv"
Jul 30 20:29:14.705904 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:14.705882    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:29:14.803659 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:14.803625    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttjll\" (UniqueName: \"kubernetes.io/projected/855c65f8-558f-4da3-8b83-ae508d2f7d62-kube-api-access-ttjll\") pod \"migrator-68bc745d87-ntrxv\" (UID: \"855c65f8-558f-4da3-8b83-ae508d2f7d62\") " pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-ntrxv"
Jul 30 20:29:14.811910 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:14.811887    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttjll\" (UniqueName: \"kubernetes.io/projected/855c65f8-558f-4da3-8b83-ae508d2f7d62-kube-api-access-ttjll\") pod \"migrator-68bc745d87-ntrxv\" (UID: \"855c65f8-558f-4da3-8b83-ae508d2f7d62\") " pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-ntrxv"
Jul 30 20:29:14.860375 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:14.860336    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:29:14.939301 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:14.939273    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-ntrxv"
Jul 30 20:29:15.061240 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:15.061213    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-68bc745d87-ntrxv"]
Jul 30 20:29:15.063866 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:29:15.063841    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod855c65f8_558f_4da3_8b83_ae508d2f7d62.slice/crio-2ca84eca3b0168ef2d9c75889920dc7bd017db1a36b11c519e94f575c4cd9a03 WatchSource:0}: Error finding container 2ca84eca3b0168ef2d9c75889920dc7bd017db1a36b11c519e94f575c4cd9a03: Status 404 returned error can't find the container with id 2ca84eca3b0168ef2d9c75889920dc7bd017db1a36b11c519e94f575c4cd9a03
Jul 30 20:29:15.207578 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:15.207528    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/72fcf9b4-8b2b-4143-be8b-52047fc8086c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rr72x\" (UID: \"72fcf9b4-8b2b-4143-be8b-52047fc8086c\") " pod="openshift-insights/insights-runtime-extractor-rr72x"
Jul 30 20:29:15.207672 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:15.207577    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/72fcf9b4-8b2b-4143-be8b-52047fc8086c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rr72x\" (UID: \"72fcf9b4-8b2b-4143-be8b-52047fc8086c\") " pod="openshift-insights/insights-runtime-extractor-rr72x"
Jul 30 20:29:15.207672 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:29:15.207648    2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 30 20:29:15.207672 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:29:15.207664    2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 30 20:29:15.207768 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:29:15.207708    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/72fcf9b4-8b2b-4143-be8b-52047fc8086c-kube-rbac-proxy-cm podName:72fcf9b4-8b2b-4143-be8b-52047fc8086c nodeName:}" failed. No retries permitted until 2026-07-30 20:29:17.207690433 +0000 UTC m=+269.049166033 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/72fcf9b4-8b2b-4143-be8b-52047fc8086c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rr72x" (UID: "72fcf9b4-8b2b-4143-be8b-52047fc8086c") : configmap "kube-rbac-proxy" not found
Jul 30 20:29:15.207768 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:29:15.207726    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72fcf9b4-8b2b-4143-be8b-52047fc8086c-insights-runtime-extractor-tls podName:72fcf9b4-8b2b-4143-be8b-52047fc8086c nodeName:}" failed. No retries permitted until 2026-07-30 20:29:17.207717947 +0000 UTC m=+269.049193548 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/72fcf9b4-8b2b-4143-be8b-52047fc8086c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rr72x" (UID: "72fcf9b4-8b2b-4143-be8b-52047fc8086c") : secret "insights-runtime-extractor-tls" not found
Jul 30 20:29:15.218465 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:15.218444    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-26tfg_346ac985-5c0d-4134-bc10-7727a294ef1f/dns-node-resolver/0.log"
Jul 30 20:29:15.463459 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:15.463382    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-ntrxv" event={"ID":"855c65f8-558f-4da3-8b83-ae508d2f7d62","Type":"ContainerStarted","Data":"2ca84eca3b0168ef2d9c75889920dc7bd017db1a36b11c519e94f575c4cd9a03"}
Jul 30 20:29:15.683558 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:15.683510    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:29:15.735733 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:15.735669    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:29:16.418812 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:16.418789    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-czmdm_e5d61971-62cc-436c-9d5c-a3abec7a47d4/node-ca/0.log"
Jul 30 20:29:16.548982 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:16.548958    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:29:16.720778 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:16.720721    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/93b4f477-32ac-45e9-8a6a-e80bd8b8e403-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-n7kff\" (UID: \"93b4f477-32ac-45e9-8a6a-e80bd8b8e403\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-n7kff"
Jul 30 20:29:16.720885 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:29:16.720859    2583 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 30 20:29:16.720934 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:29:16.720924    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93b4f477-32ac-45e9-8a6a-e80bd8b8e403-cluster-monitoring-operator-tls podName:93b4f477-32ac-45e9-8a6a-e80bd8b8e403 nodeName:}" failed. No retries permitted until 2026-07-30 20:29:24.720907791 +0000 UTC m=+276.562383391 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/93b4f477-32ac-45e9-8a6a-e80bd8b8e403-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-n7kff" (UID: "93b4f477-32ac-45e9-8a6a-e80bd8b8e403") : secret "cluster-monitoring-operator-tls" not found
Jul 30 20:29:17.224120 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:17.224091    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/72fcf9b4-8b2b-4143-be8b-52047fc8086c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rr72x\" (UID: \"72fcf9b4-8b2b-4143-be8b-52047fc8086c\") " pod="openshift-insights/insights-runtime-extractor-rr72x"
Jul 30 20:29:17.224502 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:17.224163    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/72fcf9b4-8b2b-4143-be8b-52047fc8086c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rr72x\" (UID: \"72fcf9b4-8b2b-4143-be8b-52047fc8086c\") " pod="openshift-insights/insights-runtime-extractor-rr72x"
Jul 30 20:29:17.224502 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:29:17.224211    2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 30 20:29:17.224502 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:29:17.224246    2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 30 20:29:17.224502 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:29:17.224267    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/72fcf9b4-8b2b-4143-be8b-52047fc8086c-kube-rbac-proxy-cm podName:72fcf9b4-8b2b-4143-be8b-52047fc8086c nodeName:}" failed. No retries permitted until 2026-07-30 20:29:21.224251897 +0000 UTC m=+273.065727496 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/72fcf9b4-8b2b-4143-be8b-52047fc8086c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rr72x" (UID: "72fcf9b4-8b2b-4143-be8b-52047fc8086c") : configmap "kube-rbac-proxy" not found
Jul 30 20:29:17.224502 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:29:17.224287    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72fcf9b4-8b2b-4143-be8b-52047fc8086c-insights-runtime-extractor-tls podName:72fcf9b4-8b2b-4143-be8b-52047fc8086c nodeName:}" failed. No retries permitted until 2026-07-30 20:29:21.224275444 +0000 UTC m=+273.065751043 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/72fcf9b4-8b2b-4143-be8b-52047fc8086c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rr72x" (UID: "72fcf9b4-8b2b-4143-be8b-52047fc8086c") : secret "insights-runtime-extractor-tls" not found
Jul 30 20:29:17.419180 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:17.419152    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-txjtr_d1d63b84-5b7c-4792-9a2e-79c6b75e7bcf/serve-healthcheck-canary/0.log"
Jul 30 20:29:17.472091 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:17.472065    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-ntrxv" event={"ID":"855c65f8-558f-4da3-8b83-ae508d2f7d62","Type":"ContainerStarted","Data":"7a4014df428482f59d5a21c2362297a6a94d264615d38186bc3558808c5d6150"}
Jul 30 20:29:17.472236 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:17.472120    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-ntrxv" event={"ID":"855c65f8-558f-4da3-8b83-ae508d2f7d62","Type":"ContainerStarted","Data":"256298a6a330b9d6e497f2400fb4bb3e34a506e7e23f572e6e1a4990545e8909"}
Jul 30 20:29:17.488262 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:17.488189    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-ntrxv" podStartSLOduration=2.105356184 podStartE2EDuration="3.488175899s" totalImagesPullingTime="1.382819715s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:29:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:29:17.487648815 +0000 UTC m=+269.329124438" watchObservedRunningTime="2026-07-30 20:29:17.488175899 +0000 UTC m=+269.329651519"
Jul 30 20:29:18.579279 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:18.579225    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:29:18.711398 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:18.711368    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:29:18.811599 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:18.811562    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:29:18.911650 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:18.911621    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:29:19.012709 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:19.012674    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:29:19.116592 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:19.116558    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:29:19.283443 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:19.283407    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:29:19.633437 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:19.633357    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:29:20.284196 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:20.284134    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:29:20.682732 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:20.682698    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:29:20.877393 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:20.877363    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:29:21.076694 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:21.076608    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:29:21.253595 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:21.253563    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/72fcf9b4-8b2b-4143-be8b-52047fc8086c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rr72x\" (UID: \"72fcf9b4-8b2b-4143-be8b-52047fc8086c\") " pod="openshift-insights/insights-runtime-extractor-rr72x"
Jul 30 20:29:21.253759 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:21.253636    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/72fcf9b4-8b2b-4143-be8b-52047fc8086c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rr72x\" (UID: \"72fcf9b4-8b2b-4143-be8b-52047fc8086c\") " pod="openshift-insights/insights-runtime-extractor-rr72x"
Jul 30 20:29:21.253759 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:29:21.253680    2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 30 20:29:21.253759 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:29:21.253742    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/72fcf9b4-8b2b-4143-be8b-52047fc8086c-kube-rbac-proxy-cm podName:72fcf9b4-8b2b-4143-be8b-52047fc8086c nodeName:}" failed. No retries permitted until 2026-07-30 20:29:29.253727516 +0000 UTC m=+281.095203115 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/72fcf9b4-8b2b-4143-be8b-52047fc8086c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rr72x" (UID: "72fcf9b4-8b2b-4143-be8b-52047fc8086c") : configmap "kube-rbac-proxy" not found
Jul 30 20:29:21.253886 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:29:21.253763    2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 30 20:29:21.253886 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:29:21.253817    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72fcf9b4-8b2b-4143-be8b-52047fc8086c-insights-runtime-extractor-tls podName:72fcf9b4-8b2b-4143-be8b-52047fc8086c nodeName:}" failed. No retries permitted until 2026-07-30 20:29:29.253791445 +0000 UTC m=+281.095267044 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/72fcf9b4-8b2b-4143-be8b-52047fc8086c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rr72x" (UID: "72fcf9b4-8b2b-4143-be8b-52047fc8086c") : secret "insights-runtime-extractor-tls" not found
Jul 30 20:29:21.474443 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:21.474403    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:29:22.280323 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:22.280287    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:29:22.409712 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:22.409677    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:29:22.474762 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:22.474729    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:29:22.529839 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:22.529806    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:29:22.685205 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:22.685176    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:29:22.879441 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:22.879405    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:29:23.884666 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:23.884631    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:29:24.084762 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:24.084728    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:29:24.479580 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:24.479538    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:29:24.670999 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:24.670969    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:29:24.779779 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:24.779716    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/93b4f477-32ac-45e9-8a6a-e80bd8b8e403-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-n7kff\" (UID: \"93b4f477-32ac-45e9-8a6a-e80bd8b8e403\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-n7kff"
Jul 30 20:29:24.779885 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:29:24.779838    2583 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 30 20:29:24.779928 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:29:24.779889    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93b4f477-32ac-45e9-8a6a-e80bd8b8e403-cluster-monitoring-operator-tls podName:93b4f477-32ac-45e9-8a6a-e80bd8b8e403 nodeName:}" failed. No retries permitted until 2026-07-30 20:29:40.779875578 +0000 UTC m=+292.621351177 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/93b4f477-32ac-45e9-8a6a-e80bd8b8e403-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-n7kff" (UID: "93b4f477-32ac-45e9-8a6a-e80bd8b8e403") : secret "cluster-monitoring-operator-tls" not found
Jul 30 20:29:24.973943 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:24.973911    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:29:25.079069 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:25.078977    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:29:25.884422 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:25.884392    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:29:26.280471 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:26.280438    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:29:26.479820 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:26.479795    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:29:26.581755 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:26.581679    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:29:26.682804 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:26.682774    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:29:27.250561 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:27.250525    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:29:27.879185 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:27.879127    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:29:28.046992 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:28.046945    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:29:28.281884 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:28.281853    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:29:28.483723 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:28.483687    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:29:28.745710 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:28.745683    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:29:28.882600 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:28.882573    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:29:29.279721 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:29.279695    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:29:29.315658 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:29.315628    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/72fcf9b4-8b2b-4143-be8b-52047fc8086c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rr72x\" (UID: \"72fcf9b4-8b2b-4143-be8b-52047fc8086c\") " pod="openshift-insights/insights-runtime-extractor-rr72x"
Jul 30 20:29:29.315744 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:29.315687    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/72fcf9b4-8b2b-4143-be8b-52047fc8086c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rr72x\" (UID: \"72fcf9b4-8b2b-4143-be8b-52047fc8086c\") " pod="openshift-insights/insights-runtime-extractor-rr72x"
Jul 30 20:29:29.316130 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:29.316116    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/72fcf9b4-8b2b-4143-be8b-52047fc8086c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rr72x\" (UID: \"72fcf9b4-8b2b-4143-be8b-52047fc8086c\") " pod="openshift-insights/insights-runtime-extractor-rr72x"
Jul 30 20:29:29.317993 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:29.317973    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/72fcf9b4-8b2b-4143-be8b-52047fc8086c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rr72x\" (UID: \"72fcf9b4-8b2b-4143-be8b-52047fc8086c\") " pod="openshift-insights/insights-runtime-extractor-rr72x"
Jul 30 20:29:29.372606 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:29.372583    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-rr72x"
Jul 30 20:29:29.496509 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:29.496475    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-rr72x"]
Jul 30 20:29:29.499679 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:29:29.499639    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72fcf9b4_8b2b_4143_be8b_52047fc8086c.slice/crio-32dd73725cd88db9332a3853e97772c29188da9b606e42dca7408f4a1643a5df WatchSource:0}: Error finding container 32dd73725cd88db9332a3853e97772c29188da9b606e42dca7408f4a1643a5df: Status 404 returned error can't find the container with id 32dd73725cd88db9332a3853e97772c29188da9b606e42dca7408f4a1643a5df
Jul 30 20:29:29.507248 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:29.507218    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rr72x" event={"ID":"72fcf9b4-8b2b-4143-be8b-52047fc8086c","Type":"ContainerStarted","Data":"32dd73725cd88db9332a3853e97772c29188da9b606e42dca7408f4a1643a5df"}
Jul 30 20:29:30.512098 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:30.512067    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rr72x" event={"ID":"72fcf9b4-8b2b-4143-be8b-52047fc8086c","Type":"ContainerStarted","Data":"22edee4d19b199c810d33418efa1ea48f7a169d7c2968e5e6032b6ee9168207d"}
Jul 30 20:29:31.191357 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:29:31.191314    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-tlhdq" podUID="de47806e-aced-40b0-a9da-07fd79b4672a"
Jul 30 20:29:31.191357 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:29:31.191338    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-5b5c7c9c69-f9wj5" podUID="fd98fd1e-2a93-4be2-ba8c-21300b318c71"
Jul 30 20:29:31.191550 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:29:31.191370    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-f77f48c6d-jljn6" podUID="d00fb7ce-08f2-4e8e-bcb8-78e0d393e74f"
Jul 30 20:29:31.517666 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:31.517581    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-f77f48c6d-jljn6"
Jul 30 20:29:31.517666 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:31.517630    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rr72x" event={"ID":"72fcf9b4-8b2b-4143-be8b-52047fc8086c","Type":"ContainerStarted","Data":"fe3dd466f787b8216b1391344e0d4338d1cec0530ecd39c6c49636f4f76c2247"}
Jul 30 20:29:31.518164 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:31.517688    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tlhdq"
Jul 30 20:29:31.518164 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:31.517722    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5b5c7c9c69-f9wj5"
Jul 30 20:29:32.522928 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:32.522894    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rr72x" event={"ID":"72fcf9b4-8b2b-4143-be8b-52047fc8086c","Type":"ContainerStarted","Data":"538862419c05459ee3668095325731acc152ce920d83c8c60797854398c3a9ad"}
Jul 30 20:29:32.540180 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:32.540116    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-rr72x" podStartSLOduration=17.18770553 podStartE2EDuration="19.540102343s" totalImagesPullingTime="2.352396813s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 20:29:13 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:29:32.539098936 +0000 UTC m=+284.380574558" watchObservedRunningTime="2026-07-30 20:29:32.540102343 +0000 UTC m=+284.381577988"
Jul 30 20:29:35.015404 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:35.015356    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:29:35.065023 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:35.064998    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d00fb7ce-08f2-4e8e-bcb8-78e0d393e74f-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-jljn6\" (UID: \"d00fb7ce-08f2-4e8e-bcb8-78e0d393e74f\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-jljn6"
Jul 30 20:29:35.065194 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:35.065039    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/de47806e-aced-40b0-a9da-07fd79b4672a-metrics-tls\") pod \"dns-default-tlhdq\" (UID: \"de47806e-aced-40b0-a9da-07fd79b4672a\") " pod="openshift-dns/dns-default-tlhdq"
Jul 30 20:29:35.065194 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:35.065057    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fd98fd1e-2a93-4be2-ba8c-21300b318c71-registry-tls\") pod \"image-registry-5b5c7c9c69-f9wj5\" (UID: \"fd98fd1e-2a93-4be2-ba8c-21300b318c71\") " pod="openshift-image-registry/image-registry-5b5c7c9c69-f9wj5"
Jul 30 20:29:35.067519 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:35.067493    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/de47806e-aced-40b0-a9da-07fd79b4672a-metrics-tls\") pod \"dns-default-tlhdq\" (UID: \"de47806e-aced-40b0-a9da-07fd79b4672a\") " pod="openshift-dns/dns-default-tlhdq"
Jul 30 20:29:35.067632 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:35.067546    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d00fb7ce-08f2-4e8e-bcb8-78e0d393e74f-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-jljn6\" (UID: \"d00fb7ce-08f2-4e8e-bcb8-78e0d393e74f\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-jljn6"
Jul 30 20:29:35.067632 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:35.067574    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fd98fd1e-2a93-4be2-ba8c-21300b318c71-registry-tls\") pod \"image-registry-5b5c7c9c69-f9wj5\" (UID: \"fd98fd1e-2a93-4be2-ba8c-21300b318c71\") " pod="openshift-image-registry/image-registry-5b5c7c9c69-f9wj5"
Jul 30 20:29:35.120688 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:35.120662    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-qdbpc\""
Jul 30 20:29:35.120802 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:35.120731    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-mzftn\""
Jul 30 20:29:35.120802 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:35.120753    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-tn7n7\""
Jul 30 20:29:35.128551 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:35.128536    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tlhdq"
Jul 30 20:29:35.128659 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:35.128642    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5b5c7c9c69-f9wj5"
Jul 30 20:29:35.128712 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:35.128655    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-f77f48c6d-jljn6"
Jul 30 20:29:35.258120 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:35.258085    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:29:35.277043 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:35.276986    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-f77f48c6d-jljn6"]
Jul 30 20:29:35.280011 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:29:35.279989    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd00fb7ce_08f2_4e8e_bcb8_78e0d393e74f.slice/crio-b0b6c7df1a5ee092bd2edd9e7a506d4e1117b479654d15e22b99c545dc10f728 WatchSource:0}: Error finding container b0b6c7df1a5ee092bd2edd9e7a506d4e1117b479654d15e22b99c545dc10f728: Status 404 returned error can't find the container with id b0b6c7df1a5ee092bd2edd9e7a506d4e1117b479654d15e22b99c545dc10f728
Jul 30 20:29:35.530622 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:35.530536    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5b5c7c9c69-f9wj5"]
Jul 30 20:29:35.531700 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:35.531677    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-tlhdq"]
Jul 30 20:29:35.533752 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:29:35.533725    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd98fd1e_2a93_4be2_ba8c_21300b318c71.slice/crio-25fc83e6e2f6c5300709b22a7b11d59a4429a17424792fc766af7b242508c934 WatchSource:0}: Error finding container 25fc83e6e2f6c5300709b22a7b11d59a4429a17424792fc766af7b242508c934: Status 404 returned error can't find the container with id 25fc83e6e2f6c5300709b22a7b11d59a4429a17424792fc766af7b242508c934
Jul 30 20:29:35.534401 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:35.534375    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-f77f48c6d-jljn6" event={"ID":"d00fb7ce-08f2-4e8e-bcb8-78e0d393e74f","Type":"ContainerStarted","Data":"b0b6c7df1a5ee092bd2edd9e7a506d4e1117b479654d15e22b99c545dc10f728"}
Jul 30 20:29:35.534589 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:29:35.534562    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde47806e_aced_40b0_a9da_07fd79b4672a.slice/crio-51c63fb2ca5673523595d353619ca53d1a7bf111bee40ff7be9f0523edc01e9d WatchSource:0}: Error finding container 51c63fb2ca5673523595d353619ca53d1a7bf111bee40ff7be9f0523edc01e9d: Status 404 returned error can't find the container with id 51c63fb2ca5673523595d353619ca53d1a7bf111bee40ff7be9f0523edc01e9d
Jul 30 20:29:36.540343 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:36.540306    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tlhdq" event={"ID":"de47806e-aced-40b0-a9da-07fd79b4672a","Type":"ContainerStarted","Data":"51c63fb2ca5673523595d353619ca53d1a7bf111bee40ff7be9f0523edc01e9d"}
Jul 30 20:29:36.542215 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:36.542107    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5b5c7c9c69-f9wj5" event={"ID":"fd98fd1e-2a93-4be2-ba8c-21300b318c71","Type":"ContainerStarted","Data":"114dd3e25a185c3b7052079a133d96348126ebbe4bdec65f4fd1c783ca7ebc88"}
Jul 30 20:29:36.542215 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:36.542181    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5b5c7c9c69-f9wj5" event={"ID":"fd98fd1e-2a93-4be2-ba8c-21300b318c71","Type":"ContainerStarted","Data":"25fc83e6e2f6c5300709b22a7b11d59a4429a17424792fc766af7b242508c934"}
Jul 30 20:29:36.542546 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:36.542485    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5b5c7c9c69-f9wj5"
Jul 30 20:29:36.563579 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:36.563536    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5b5c7c9c69-f9wj5" podStartSLOduration=286.56351913 podStartE2EDuration="4m46.56351913s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:24:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:29:36.56158839 +0000 UTC m=+288.403064012" watchObservedRunningTime="2026-07-30 20:29:36.56351913 +0000 UTC m=+288.404994751"
Jul 30 20:29:38.399339 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:38.399298    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:29:38.495216 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:38.495178    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:29:38.550675 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:38.550645    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-f77f48c6d-jljn6" event={"ID":"d00fb7ce-08f2-4e8e-bcb8-78e0d393e74f","Type":"ContainerStarted","Data":"9d2da996ea88af192e170866323c278a77c56e3338154a07690f9f615f97b5bc"}
Jul 30 20:29:38.552356 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:38.552334    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tlhdq" event={"ID":"de47806e-aced-40b0-a9da-07fd79b4672a","Type":"ContainerStarted","Data":"6d1ee58fd8232eed517181687ba35aecdcda6a6ee11e7c76472c021eaaddb2fa"}
Jul 30 20:29:38.552508 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:38.552384    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-tlhdq"
Jul 30 20:29:38.552508 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:38.552407    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tlhdq" event={"ID":"de47806e-aced-40b0-a9da-07fd79b4672a","Type":"ContainerStarted","Data":"df2ff3813b26fa154241024121320fe13a8216f1a785954e7b01ec0f008d9a8d"}
Jul 30 20:29:38.579862 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:38.579827    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-f77f48c6d-jljn6" podStartSLOduration=264.052645591 podStartE2EDuration="4m26.57981394s" totalImagesPullingTime="2.527168349s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:25:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:29:38.579055512 +0000 UTC m=+290.420531136" watchObservedRunningTime="2026-07-30 20:29:38.57981394 +0000 UTC m=+290.421289590"
Jul 30 20:29:38.596607 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:38.596537    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-tlhdq" podStartSLOduration=251.259685977 podStartE2EDuration="4m13.596521517s" totalImagesPullingTime="2.33683554s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:25:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:29:38.596005507 +0000 UTC m=+290.437481129" watchObservedRunningTime="2026-07-30 20:29:38.596521517 +0000 UTC m=+290.437997137"
Jul 30 20:29:38.693990 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:38.693966    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:29:38.792809 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:38.792775    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:29:40.806680 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:40.806642    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/93b4f477-32ac-45e9-8a6a-e80bd8b8e403-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-n7kff\" (UID: \"93b4f477-32ac-45e9-8a6a-e80bd8b8e403\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-n7kff"
Jul 30 20:29:40.809024 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:40.808993    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/93b4f477-32ac-45e9-8a6a-e80bd8b8e403-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-n7kff\" (UID: \"93b4f477-32ac-45e9-8a6a-e80bd8b8e403\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-n7kff"
Jul 30 20:29:41.088415 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:41.088349    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-n7kff"
Jul 30 20:29:41.213622 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:41.213591    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-n7kff"]
Jul 30 20:29:41.217178 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:29:41.217153    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93b4f477_32ac_45e9_8a6a_e80bd8b8e403.slice/crio-b015d98bb962210f7d6e02419150ab6c08257988d533f92e458704f699508d31 WatchSource:0}: Error finding container b015d98bb962210f7d6e02419150ab6c08257988d533f92e458704f699508d31: Status 404 returned error can't find the container with id b015d98bb962210f7d6e02419150ab6c08257988d533f92e458704f699508d31
Jul 30 20:29:41.564054 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:41.564025    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-n7kff" event={"ID":"93b4f477-32ac-45e9-8a6a-e80bd8b8e403","Type":"ContainerStarted","Data":"b015d98bb962210f7d6e02419150ab6c08257988d533f92e458704f699508d31"}
Jul 30 20:29:43.069123 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:43.069008    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:29:43.248269 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:43.248238    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-sm726"]
Jul 30 20:29:43.251279 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:43.251258    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-sm726"
Jul 30 20:29:43.254409 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:43.254388    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-4mwb2\""
Jul 30 20:29:43.254515 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:43.254391    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 30 20:29:43.264438 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:43.264417    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-sm726"]
Jul 30 20:29:43.313388 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:43.313348    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:29:43.389047 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:43.388989    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:29:43.426984 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:43.426959    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/54a094da-81d1-4759-b29d-59e6a94cc246-tls-certificates\") pod \"prometheus-operator-admission-webhook-66685ff6d4-sm726\" (UID: \"54a094da-81d1-4759-b29d-59e6a94cc246\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-sm726"
Jul 30 20:29:43.528188 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:43.528157    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/54a094da-81d1-4759-b29d-59e6a94cc246-tls-certificates\") pod \"prometheus-operator-admission-webhook-66685ff6d4-sm726\" (UID: \"54a094da-81d1-4759-b29d-59e6a94cc246\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-sm726"
Jul 30 20:29:43.528297 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:29:43.528283    2583 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Jul 30 20:29:43.528347 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:29:43.528337    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54a094da-81d1-4759-b29d-59e6a94cc246-tls-certificates podName:54a094da-81d1-4759-b29d-59e6a94cc246 nodeName:}" failed. No retries permitted until 2026-07-30 20:29:44.028323914 +0000 UTC m=+295.869799513 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/54a094da-81d1-4759-b29d-59e6a94cc246-tls-certificates") pod "prometheus-operator-admission-webhook-66685ff6d4-sm726" (UID: "54a094da-81d1-4759-b29d-59e6a94cc246") : secret "prometheus-operator-admission-webhook-tls" not found
Jul 30 20:29:43.571732 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:43.571707    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-n7kff" event={"ID":"93b4f477-32ac-45e9-8a6a-e80bd8b8e403","Type":"ContainerStarted","Data":"df81720b6e05e9a5d7916a756a78c9055231b94394361dfad55e222746bcde85"}
Jul 30 20:29:43.590740 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:43.590700    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-n7kff" podStartSLOduration=34.063875467 podStartE2EDuration="35.590686711s" totalImagesPullingTime="1.526811244s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:29:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:29:43.589818875 +0000 UTC m=+295.431294528" watchObservedRunningTime="2026-07-30 20:29:43.590686711 +0000 UTC m=+295.432162332"
Jul 30 20:29:43.843497 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:43.843472    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:29:44.032667 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:44.032636    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/54a094da-81d1-4759-b29d-59e6a94cc246-tls-certificates\") pod \"prometheus-operator-admission-webhook-66685ff6d4-sm726\" (UID: \"54a094da-81d1-4759-b29d-59e6a94cc246\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-sm726"
Jul 30 20:29:44.035155 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:44.035109    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/54a094da-81d1-4759-b29d-59e6a94cc246-tls-certificates\") pod \"prometheus-operator-admission-webhook-66685ff6d4-sm726\" (UID: \"54a094da-81d1-4759-b29d-59e6a94cc246\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-sm726"
Jul 30 20:29:44.159444 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:44.159424    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-sm726"
Jul 30 20:29:44.281197 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:44.281170    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-sm726"]
Jul 30 20:29:44.284032 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:29:44.284006    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54a094da_81d1_4759_b29d_59e6a94cc246.slice/crio-6ef6ccc4cc443a7b85022c6d6eba50431e328a5767de9c05c3cc30232b6f7a06 WatchSource:0}: Error finding container 6ef6ccc4cc443a7b85022c6d6eba50431e328a5767de9c05c3cc30232b6f7a06: Status 404 returned error can't find the container with id 6ef6ccc4cc443a7b85022c6d6eba50431e328a5767de9c05c3cc30232b6f7a06
Jul 30 20:29:44.575739 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:44.575658    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-sm726" event={"ID":"54a094da-81d1-4759-b29d-59e6a94cc246","Type":"ContainerStarted","Data":"6ef6ccc4cc443a7b85022c6d6eba50431e328a5767de9c05c3cc30232b6f7a06"}
Jul 30 20:29:45.580388 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:45.580352    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-sm726" event={"ID":"54a094da-81d1-4759-b29d-59e6a94cc246","Type":"ContainerStarted","Data":"debf65bc0d45519aaf621bcd98a1ad340c466021a2f81d23dd17aaff398a1c32"}
Jul 30 20:29:45.580785 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:45.580581    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-sm726"
Jul 30 20:29:45.585051 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:45.585025    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-sm726"
Jul 30 20:29:45.594645 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:45.594577    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-sm726" podStartSLOduration=1.467436144 podStartE2EDuration="2.594562794s" totalImagesPullingTime="1.12712665s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:29:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:29:45.594266756 +0000 UTC m=+297.435742379" watchObservedRunningTime="2026-07-30 20:29:45.594562794 +0000 UTC m=+297.436038419"
Jul 30 20:29:45.670972 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:29:45.670903    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-jfpt4" podUID="9c27cd9e-72be-4a13-8deb-f4c3ffe3ecea"
Jul 30 20:29:46.256959 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:46.256930    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:29:46.292457 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:46.292427    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-758d7cb874-gprrk"]
Jul 30 20:29:46.295540 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:46.295526    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-758d7cb874-gprrk"
Jul 30 20:29:46.297466 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:46.297448    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 30 20:29:46.297571 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:46.297467    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-k9s99\""
Jul 30 20:29:46.298222 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:46.298206    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 30 20:29:46.298222 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:46.298219    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 30 20:29:46.303687 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:46.303649    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-758d7cb874-gprrk"]
Jul 30 20:29:46.317020 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:46.317000    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:29:46.349110 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:46.349083    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/55b86f40-b396-4670-894b-8573499634d6-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-758d7cb874-gprrk\" (UID: \"55b86f40-b396-4670-894b-8573499634d6\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-gprrk"
Jul 30 20:29:46.349207 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:46.349124    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5k9gp\" (UniqueName: \"kubernetes.io/projected/55b86f40-b396-4670-894b-8573499634d6-kube-api-access-5k9gp\") pod \"prometheus-operator-758d7cb874-gprrk\" (UID: \"55b86f40-b396-4670-894b-8573499634d6\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-gprrk"
Jul 30 20:29:46.349207 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:46.349170    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/55b86f40-b396-4670-894b-8573499634d6-metrics-client-ca\") pod \"prometheus-operator-758d7cb874-gprrk\" (UID: \"55b86f40-b396-4670-894b-8573499634d6\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-gprrk"
Jul 30 20:29:46.349277 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:46.349230    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/55b86f40-b396-4670-894b-8573499634d6-prometheus-operator-tls\") pod \"prometheus-operator-758d7cb874-gprrk\" (UID: \"55b86f40-b396-4670-894b-8573499634d6\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-gprrk"
Jul 30 20:29:46.449427 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:46.449408    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/55b86f40-b396-4670-894b-8573499634d6-metrics-client-ca\") pod \"prometheus-operator-758d7cb874-gprrk\" (UID: \"55b86f40-b396-4670-894b-8573499634d6\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-gprrk"
Jul 30 20:29:46.449497 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:46.449450    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/55b86f40-b396-4670-894b-8573499634d6-prometheus-operator-tls\") pod \"prometheus-operator-758d7cb874-gprrk\" (UID: \"55b86f40-b396-4670-894b-8573499634d6\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-gprrk"
Jul 30 20:29:46.449549 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:29:46.449537    2583 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Jul 30 20:29:46.449587 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:46.449566    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/55b86f40-b396-4670-894b-8573499634d6-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-758d7cb874-gprrk\" (UID: \"55b86f40-b396-4670-894b-8573499634d6\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-gprrk"
Jul 30 20:29:46.449587 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:29:46.449582    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/55b86f40-b396-4670-894b-8573499634d6-prometheus-operator-tls podName:55b86f40-b396-4670-894b-8573499634d6 nodeName:}" failed. No retries permitted until 2026-07-30 20:29:46.949568881 +0000 UTC m=+298.791044480 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/55b86f40-b396-4670-894b-8573499634d6-prometheus-operator-tls") pod "prometheus-operator-758d7cb874-gprrk" (UID: "55b86f40-b396-4670-894b-8573499634d6") : secret "prometheus-operator-tls" not found
Jul 30 20:29:46.449681 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:46.449607    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5k9gp\" (UniqueName: \"kubernetes.io/projected/55b86f40-b396-4670-894b-8573499634d6-kube-api-access-5k9gp\") pod \"prometheus-operator-758d7cb874-gprrk\" (UID: \"55b86f40-b396-4670-894b-8573499634d6\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-gprrk"
Jul 30 20:29:46.450011 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:46.449994    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/55b86f40-b396-4670-894b-8573499634d6-metrics-client-ca\") pod \"prometheus-operator-758d7cb874-gprrk\" (UID: \"55b86f40-b396-4670-894b-8573499634d6\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-gprrk"
Jul 30 20:29:46.451912 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:46.451890    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/55b86f40-b396-4670-894b-8573499634d6-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-758d7cb874-gprrk\" (UID: \"55b86f40-b396-4670-894b-8573499634d6\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-gprrk"
Jul 30 20:29:46.457207 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:46.457191    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5k9gp\" (UniqueName: \"kubernetes.io/projected/55b86f40-b396-4670-894b-8573499634d6-kube-api-access-5k9gp\") pod \"prometheus-operator-758d7cb874-gprrk\" (UID: \"55b86f40-b396-4670-894b-8573499634d6\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-gprrk"
Jul 30 20:29:46.510457 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:46.510394    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:29:46.953871 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:46.953840    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/55b86f40-b396-4670-894b-8573499634d6-prometheus-operator-tls\") pod \"prometheus-operator-758d7cb874-gprrk\" (UID: \"55b86f40-b396-4670-894b-8573499634d6\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-gprrk"
Jul 30 20:29:46.956307 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:46.956286    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/55b86f40-b396-4670-894b-8573499634d6-prometheus-operator-tls\") pod \"prometheus-operator-758d7cb874-gprrk\" (UID: \"55b86f40-b396-4670-894b-8573499634d6\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-gprrk"
Jul 30 20:29:47.205085 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:47.205017    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-758d7cb874-gprrk"
Jul 30 20:29:47.332537 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:47.329872    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-758d7cb874-gprrk"]
Jul 30 20:29:47.333621 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:29:47.333594    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55b86f40_b396_4670_894b_8573499634d6.slice/crio-e9a8048af33fa06871b3da8b43ef202c1bcba8b8379e00c64d3da17fd195a84a WatchSource:0}: Error finding container e9a8048af33fa06871b3da8b43ef202c1bcba8b8379e00c64d3da17fd195a84a: Status 404 returned error can't find the container with id e9a8048af33fa06871b3da8b43ef202c1bcba8b8379e00c64d3da17fd195a84a
Jul 30 20:29:47.589039 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:47.588967    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-758d7cb874-gprrk" event={"ID":"55b86f40-b396-4670-894b-8573499634d6","Type":"ContainerStarted","Data":"e9a8048af33fa06871b3da8b43ef202c1bcba8b8379e00c64d3da17fd195a84a"}
Jul 30 20:29:48.559077 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:48.559048    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-tlhdq"
Jul 30 20:29:48.608264 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:48.608243    2583 kubelet.go:1648] "Image garbage collection succeeded"
Jul 30 20:29:48.848229 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:48.848122    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:29:49.598384 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:49.598350    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-758d7cb874-gprrk" event={"ID":"55b86f40-b396-4670-894b-8573499634d6","Type":"ContainerStarted","Data":"a4cc1bfc8769780451eb105df789f80f7c8062d9397da1f621a803d38e8eeedf"}
Jul 30 20:29:49.598824 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:49.598406    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-758d7cb874-gprrk" event={"ID":"55b86f40-b396-4670-894b-8573499634d6","Type":"ContainerStarted","Data":"636097d09084123b9c4a45f20eea8b4657a15d18bc1dee2642ab250035267c68"}
Jul 30 20:29:49.615540 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:49.615492    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-758d7cb874-gprrk" podStartSLOduration=2.372667738 podStartE2EDuration="3.61547875s" totalImagesPullingTime="1.242811012s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:29:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:29:49.615113017 +0000 UTC m=+301.456588640" watchObservedRunningTime="2026-07-30 20:29:49.61547875 +0000 UTC m=+301.456954371"
Jul 30 20:29:51.394850 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:51.394800    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:29:51.633452 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:51.633421    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-gzzvz"]
Jul 30 20:29:51.636656 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:51.636641    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-gzzvz"
Jul 30 20:29:51.639466 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:51.639439    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 30 20:29:51.639943 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:51.639927    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 30 20:29:51.640276 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:51.640263    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-8hzzg\""
Jul 30 20:29:51.648612 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:51.648561    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-gzzvz"]
Jul 30 20:29:51.664067 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:51.664047    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-94r7j"]
Jul 30 20:29:51.667020 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:51.667006    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-94r7j"
Jul 30 20:29:51.668833 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:51.668806    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 30 20:29:51.668930 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:51.668907    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 30 20:29:51.668976 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:51.668951    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-nwh68\""
Jul 30 20:29:51.668976 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:51.668957    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 30 20:29:51.687528 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:51.687511    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ccd4c6cf-512d-4b96-91d3-b36dfe5d9b8c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-94r7j\" (UID: \"ccd4c6cf-512d-4b96-91d3-b36dfe5d9b8c\") " pod="openshift-monitoring/node-exporter-94r7j"
Jul 30 20:29:51.687627 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:51.687541    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ccd4c6cf-512d-4b96-91d3-b36dfe5d9b8c-root\") pod \"node-exporter-94r7j\" (UID: \"ccd4c6cf-512d-4b96-91d3-b36dfe5d9b8c\") " pod="openshift-monitoring/node-exporter-94r7j"
Jul 30 20:29:51.687627 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:51.687557    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/59382b27-3d72-4e9c-94de-9fcc4505bfe8-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6bb4d7b4dd-gzzvz\" (UID: \"59382b27-3d72-4e9c-94de-9fcc4505bfe8\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-gzzvz"
Jul 30 20:29:51.687627 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:51.687577    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ccd4c6cf-512d-4b96-91d3-b36dfe5d9b8c-node-exporter-tls\") pod \"node-exporter-94r7j\" (UID: \"ccd4c6cf-512d-4b96-91d3-b36dfe5d9b8c\") " pod="openshift-monitoring/node-exporter-94r7j"
Jul 30 20:29:51.687627 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:51.687594    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/59382b27-3d72-4e9c-94de-9fcc4505bfe8-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6bb4d7b4dd-gzzvz\" (UID: \"59382b27-3d72-4e9c-94de-9fcc4505bfe8\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-gzzvz"
Jul 30 20:29:51.687796 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:51.687642    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ccd4c6cf-512d-4b96-91d3-b36dfe5d9b8c-sys\") pod \"node-exporter-94r7j\" (UID: \"ccd4c6cf-512d-4b96-91d3-b36dfe5d9b8c\") " pod="openshift-monitoring/node-exporter-94r7j"
Jul 30 20:29:51.687796 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:51.687676    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ccd4c6cf-512d-4b96-91d3-b36dfe5d9b8c-metrics-client-ca\") pod \"node-exporter-94r7j\" (UID: \"ccd4c6cf-512d-4b96-91d3-b36dfe5d9b8c\") " pod="openshift-monitoring/node-exporter-94r7j"
Jul 30 20:29:51.687796 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:51.687718    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ccd4c6cf-512d-4b96-91d3-b36dfe5d9b8c-node-exporter-textfile\") pod \"node-exporter-94r7j\" (UID: \"ccd4c6cf-512d-4b96-91d3-b36dfe5d9b8c\") " pod="openshift-monitoring/node-exporter-94r7j"
Jul 30 20:29:51.687796 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:51.687745    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jv6pd\" (UniqueName: \"kubernetes.io/projected/59382b27-3d72-4e9c-94de-9fcc4505bfe8-kube-api-access-jv6pd\") pod \"openshift-state-metrics-6bb4d7b4dd-gzzvz\" (UID: \"59382b27-3d72-4e9c-94de-9fcc4505bfe8\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-gzzvz"
Jul 30 20:29:51.687978 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:51.687815    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tcqtw\" (UniqueName: \"kubernetes.io/projected/ccd4c6cf-512d-4b96-91d3-b36dfe5d9b8c-kube-api-access-tcqtw\") pod \"node-exporter-94r7j\" (UID: \"ccd4c6cf-512d-4b96-91d3-b36dfe5d9b8c\") " pod="openshift-monitoring/node-exporter-94r7j"
Jul 30 20:29:51.687978 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:51.687870    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ccd4c6cf-512d-4b96-91d3-b36dfe5d9b8c-node-exporter-accelerators-collector-config\") pod \"node-exporter-94r7j\" (UID: \"ccd4c6cf-512d-4b96-91d3-b36dfe5d9b8c\") " pod="openshift-monitoring/node-exporter-94r7j"
Jul 30 20:29:51.687978 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:51.687918    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/59382b27-3d72-4e9c-94de-9fcc4505bfe8-metrics-client-ca\") pod \"openshift-state-metrics-6bb4d7b4dd-gzzvz\" (UID: \"59382b27-3d72-4e9c-94de-9fcc4505bfe8\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-gzzvz"
Jul 30 20:29:51.687978 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:51.687970    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ccd4c6cf-512d-4b96-91d3-b36dfe5d9b8c-node-exporter-wtmp\") pod \"node-exporter-94r7j\" (UID: \"ccd4c6cf-512d-4b96-91d3-b36dfe5d9b8c\") " pod="openshift-monitoring/node-exporter-94r7j"
Jul 30 20:29:51.789256 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:51.789234    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ccd4c6cf-512d-4b96-91d3-b36dfe5d9b8c-node-exporter-wtmp\") pod \"node-exporter-94r7j\" (UID: \"ccd4c6cf-512d-4b96-91d3-b36dfe5d9b8c\") " pod="openshift-monitoring/node-exporter-94r7j"
Jul 30 20:29:51.789388 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:51.789263    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ccd4c6cf-512d-4b96-91d3-b36dfe5d9b8c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-94r7j\" (UID: \"ccd4c6cf-512d-4b96-91d3-b36dfe5d9b8c\") " pod="openshift-monitoring/node-exporter-94r7j"
Jul 30 20:29:51.789388 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:51.789294    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ccd4c6cf-512d-4b96-91d3-b36dfe5d9b8c-root\") pod \"node-exporter-94r7j\" (UID: \"ccd4c6cf-512d-4b96-91d3-b36dfe5d9b8c\") " pod="openshift-monitoring/node-exporter-94r7j"
Jul 30 20:29:51.789388 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:51.789323    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/59382b27-3d72-4e9c-94de-9fcc4505bfe8-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6bb4d7b4dd-gzzvz\" (UID: \"59382b27-3d72-4e9c-94de-9fcc4505bfe8\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-gzzvz"
Jul 30 20:29:51.789388 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:51.789345    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ccd4c6cf-512d-4b96-91d3-b36dfe5d9b8c-node-exporter-tls\") pod \"node-exporter-94r7j\" (UID: \"ccd4c6cf-512d-4b96-91d3-b36dfe5d9b8c\") " pod="openshift-monitoring/node-exporter-94r7j"
Jul 30 20:29:51.789388 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:51.789364    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/59382b27-3d72-4e9c-94de-9fcc4505bfe8-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6bb4d7b4dd-gzzvz\" (UID: \"59382b27-3d72-4e9c-94de-9fcc4505bfe8\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-gzzvz"
Jul 30 20:29:51.789388 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:51.789386    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ccd4c6cf-512d-4b96-91d3-b36dfe5d9b8c-sys\") pod \"node-exporter-94r7j\" (UID: \"ccd4c6cf-512d-4b96-91d3-b36dfe5d9b8c\") " pod="openshift-monitoring/node-exporter-94r7j"
Jul 30 20:29:51.789663 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:51.789409    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ccd4c6cf-512d-4b96-91d3-b36dfe5d9b8c-metrics-client-ca\") pod \"node-exporter-94r7j\" (UID: \"ccd4c6cf-512d-4b96-91d3-b36dfe5d9b8c\") " pod="openshift-monitoring/node-exporter-94r7j"
Jul 30 20:29:51.789663 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:51.789435    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ccd4c6cf-512d-4b96-91d3-b36dfe5d9b8c-node-exporter-textfile\") pod \"node-exporter-94r7j\" (UID: \"ccd4c6cf-512d-4b96-91d3-b36dfe5d9b8c\") " pod="openshift-monitoring/node-exporter-94r7j"
Jul 30 20:29:51.789663 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:51.789434    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ccd4c6cf-512d-4b96-91d3-b36dfe5d9b8c-node-exporter-wtmp\") pod \"node-exporter-94r7j\" (UID: \"ccd4c6cf-512d-4b96-91d3-b36dfe5d9b8c\") " pod="openshift-monitoring/node-exporter-94r7j"
Jul 30 20:29:51.789663 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:51.789452    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ccd4c6cf-512d-4b96-91d3-b36dfe5d9b8c-root\") pod \"node-exporter-94r7j\" (UID: \"ccd4c6cf-512d-4b96-91d3-b36dfe5d9b8c\") " pod="openshift-monitoring/node-exporter-94r7j"
Jul 30 20:29:51.789663 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:51.789480    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ccd4c6cf-512d-4b96-91d3-b36dfe5d9b8c-sys\") pod \"node-exporter-94r7j\" (UID: \"ccd4c6cf-512d-4b96-91d3-b36dfe5d9b8c\") " pod="openshift-monitoring/node-exporter-94r7j"
Jul 30 20:29:51.789663 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:51.789574    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jv6pd\" (UniqueName: \"kubernetes.io/projected/59382b27-3d72-4e9c-94de-9fcc4505bfe8-kube-api-access-jv6pd\") pod \"openshift-state-metrics-6bb4d7b4dd-gzzvz\" (UID: \"59382b27-3d72-4e9c-94de-9fcc4505bfe8\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-gzzvz"
Jul 30 20:29:51.789663 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:51.789623    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tcqtw\" (UniqueName: \"kubernetes.io/projected/ccd4c6cf-512d-4b96-91d3-b36dfe5d9b8c-kube-api-access-tcqtw\") pod \"node-exporter-94r7j\" (UID: \"ccd4c6cf-512d-4b96-91d3-b36dfe5d9b8c\") " pod="openshift-monitoring/node-exporter-94r7j"
Jul 30 20:29:51.789983 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:51.789770    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ccd4c6cf-512d-4b96-91d3-b36dfe5d9b8c-node-exporter-accelerators-collector-config\") pod \"node-exporter-94r7j\" (UID: \"ccd4c6cf-512d-4b96-91d3-b36dfe5d9b8c\") " pod="openshift-monitoring/node-exporter-94r7j"
Jul 30 20:29:51.789983 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:51.789790    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ccd4c6cf-512d-4b96-91d3-b36dfe5d9b8c-node-exporter-textfile\") pod \"node-exporter-94r7j\" (UID: \"ccd4c6cf-512d-4b96-91d3-b36dfe5d9b8c\") " pod="openshift-monitoring/node-exporter-94r7j"
Jul 30 20:29:51.789983 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:51.789838    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/59382b27-3d72-4e9c-94de-9fcc4505bfe8-metrics-client-ca\") pod \"openshift-state-metrics-6bb4d7b4dd-gzzvz\" (UID: \"59382b27-3d72-4e9c-94de-9fcc4505bfe8\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-gzzvz"
Jul 30 20:29:51.790130 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:51.790074    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ccd4c6cf-512d-4b96-91d3-b36dfe5d9b8c-metrics-client-ca\") pod \"node-exporter-94r7j\" (UID: \"ccd4c6cf-512d-4b96-91d3-b36dfe5d9b8c\") " pod="openshift-monitoring/node-exporter-94r7j"
Jul 30 20:29:51.790376 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:51.790356    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ccd4c6cf-512d-4b96-91d3-b36dfe5d9b8c-node-exporter-accelerators-collector-config\") pod \"node-exporter-94r7j\" (UID: \"ccd4c6cf-512d-4b96-91d3-b36dfe5d9b8c\") " pod="openshift-monitoring/node-exporter-94r7j"
Jul 30 20:29:51.790560 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:51.790536    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/59382b27-3d72-4e9c-94de-9fcc4505bfe8-metrics-client-ca\") pod \"openshift-state-metrics-6bb4d7b4dd-gzzvz\" (UID: \"59382b27-3d72-4e9c-94de-9fcc4505bfe8\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-gzzvz"
Jul 30 20:29:51.792057 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:51.792038    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/59382b27-3d72-4e9c-94de-9fcc4505bfe8-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6bb4d7b4dd-gzzvz\" (UID: \"59382b27-3d72-4e9c-94de-9fcc4505bfe8\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-gzzvz"
Jul 30 20:29:51.792365 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:51.792341    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ccd4c6cf-512d-4b96-91d3-b36dfe5d9b8c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-94r7j\" (UID: \"ccd4c6cf-512d-4b96-91d3-b36dfe5d9b8c\") " pod="openshift-monitoring/node-exporter-94r7j"
Jul 30 20:29:51.792365 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:51.792359    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/59382b27-3d72-4e9c-94de-9fcc4505bfe8-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6bb4d7b4dd-gzzvz\" (UID: \"59382b27-3d72-4e9c-94de-9fcc4505bfe8\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-gzzvz"
Jul 30 20:29:51.792510 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:51.792493    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ccd4c6cf-512d-4b96-91d3-b36dfe5d9b8c-node-exporter-tls\") pod \"node-exporter-94r7j\" (UID: \"ccd4c6cf-512d-4b96-91d3-b36dfe5d9b8c\") " pod="openshift-monitoring/node-exporter-94r7j"
Jul 30 20:29:51.796777 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:51.796750    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tcqtw\" (UniqueName: \"kubernetes.io/projected/ccd4c6cf-512d-4b96-91d3-b36dfe5d9b8c-kube-api-access-tcqtw\") pod \"node-exporter-94r7j\" (UID: \"ccd4c6cf-512d-4b96-91d3-b36dfe5d9b8c\") " pod="openshift-monitoring/node-exporter-94r7j"
Jul 30 20:29:51.797108 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:51.797089    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jv6pd\" (UniqueName: \"kubernetes.io/projected/59382b27-3d72-4e9c-94de-9fcc4505bfe8-kube-api-access-jv6pd\") pod \"openshift-state-metrics-6bb4d7b4dd-gzzvz\" (UID: \"59382b27-3d72-4e9c-94de-9fcc4505bfe8\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-gzzvz"
Jul 30 20:29:51.945424 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:51.945391    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-gzzvz"
Jul 30 20:29:51.975438 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:51.975417    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-94r7j"
Jul 30 20:29:51.986447 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:29:51.986411    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccd4c6cf_512d_4b96_91d3_b36dfe5d9b8c.slice/crio-a1a416ba3d28b846ba44d79a80dd818f0397d5e76460382ab78a6d00e93b8945 WatchSource:0}: Error finding container a1a416ba3d28b846ba44d79a80dd818f0397d5e76460382ab78a6d00e93b8945: Status 404 returned error can't find the container with id a1a416ba3d28b846ba44d79a80dd818f0397d5e76460382ab78a6d00e93b8945
Jul 30 20:29:51.988825 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:51.988807    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 30 20:29:52.074723 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:52.074646    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-gzzvz"]
Jul 30 20:29:52.077091 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:29:52.077069    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59382b27_3d72_4e9c_94de_9fcc4505bfe8.slice/crio-b92f0e61fb5bdf0afc6c14a8084435ae6b14bbf8fcc12f3076abfafeab5603be WatchSource:0}: Error finding container b92f0e61fb5bdf0afc6c14a8084435ae6b14bbf8fcc12f3076abfafeab5603be: Status 404 returned error can't find the container with id b92f0e61fb5bdf0afc6c14a8084435ae6b14bbf8fcc12f3076abfafeab5603be
Jul 30 20:29:52.479792 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:52.479704    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:29:52.612566 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:52.612340    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-gzzvz" event={"ID":"59382b27-3d72-4e9c-94de-9fcc4505bfe8","Type":"ContainerStarted","Data":"543b2dd56fca7ccff03d7b2d5c3c5b07303d44e5d933862bb47b8024199fe9b5"}
Jul 30 20:29:52.612566 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:52.612411    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-gzzvz" event={"ID":"59382b27-3d72-4e9c-94de-9fcc4505bfe8","Type":"ContainerStarted","Data":"c81b6212d7bca895e5c203a5b6033f90aea8da4c733b64946ca151d8b79bdc82"}
Jul 30 20:29:52.612566 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:52.612442    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-gzzvz" event={"ID":"59382b27-3d72-4e9c-94de-9fcc4505bfe8","Type":"ContainerStarted","Data":"b92f0e61fb5bdf0afc6c14a8084435ae6b14bbf8fcc12f3076abfafeab5603be"}
Jul 30 20:29:52.613680 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:52.613648    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-94r7j" event={"ID":"ccd4c6cf-512d-4b96-91d3-b36dfe5d9b8c","Type":"ContainerStarted","Data":"a1a416ba3d28b846ba44d79a80dd818f0397d5e76460382ab78a6d00e93b8945"}
Jul 30 20:29:52.664132 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:52.664100    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:29:52.770318 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:52.770212    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:29:53.116722 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:53.116667    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:29:53.624388 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:53.624301    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-gzzvz" event={"ID":"59382b27-3d72-4e9c-94de-9fcc4505bfe8","Type":"ContainerStarted","Data":"c18a92de1f767ab040357ed3e7b98b72f5e4afdab0afcbb4afaa684311df4f46"}
Jul 30 20:29:53.625959 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:53.625937    2583 generic.go:356] "Generic (PLEG): container finished" podID="ccd4c6cf-512d-4b96-91d3-b36dfe5d9b8c" containerID="7069d1e5321409befe3f39b28075ad12057304c846c966bed022eea66e959e30" exitCode=0
Jul 30 20:29:53.626089 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:53.625979    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-94r7j" event={"ID":"ccd4c6cf-512d-4b96-91d3-b36dfe5d9b8c","Type":"ContainerDied","Data":"7069d1e5321409befe3f39b28075ad12057304c846c966bed022eea66e959e30"}
Jul 30 20:29:53.648364 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:53.648330    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-gzzvz" podStartSLOduration=1.553739084 podStartE2EDuration="2.648317871s" totalImagesPullingTime="1.094578787s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:29:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:29:53.646869278 +0000 UTC m=+305.488344902" watchObservedRunningTime="2026-07-30 20:29:53.648317871 +0000 UTC m=+305.489793514"
Jul 30 20:29:54.574445 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:54.574410    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:29:54.623152 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:54.623109    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-576d9f695b-67q7v"]
Jul 30 20:29:54.626800 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:54.626779    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-576d9f695b-67q7v"
Jul 30 20:29:54.628877 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:54.628849    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 30 20:29:54.628996 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:54.628870    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 30 20:29:54.628996 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:54.628878    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 30 20:29:54.628996 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:54.628962    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-tzts9\""
Jul 30 20:29:54.629193 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:54.628931    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 30 20:29:54.629193 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:54.628849    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-65t5dncpubft6\""
Jul 30 20:29:54.629400 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:54.629383    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 30 20:29:54.632971 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:54.632950    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-94r7j" event={"ID":"ccd4c6cf-512d-4b96-91d3-b36dfe5d9b8c","Type":"ContainerStarted","Data":"f53e059f10692f07e1fb94415245cba4607208c60eb45a1739c8e9d706b0672c"}
Jul 30 20:29:54.633070 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:54.632993    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-94r7j" event={"ID":"ccd4c6cf-512d-4b96-91d3-b36dfe5d9b8c","Type":"ContainerStarted","Data":"ecbc0ff859872be1a0626659bc48453a79ee0c78d85b6e884bef5117eafd65f4"}
Jul 30 20:29:54.640175 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:54.640158    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-576d9f695b-67q7v"]
Jul 30 20:29:54.648195 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:54.648172    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:29:54.675300 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:54.675259    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-94r7j" podStartSLOduration=2.604063021 podStartE2EDuration="3.675244151s" totalImagesPullingTime="994.890231ms" totalInitContainerRuntime="76.290899ms" isStatefulPod=true podCreationTimestamp="2026-07-30 20:29:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:29:54.674515191 +0000 UTC m=+306.515990835" watchObservedRunningTime="2026-07-30 20:29:54.675244151 +0000 UTC m=+306.516719831"
Jul 30 20:29:54.716827 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:54.716802    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a03e1308-6f47-4afc-b370-a17ad76bdb89-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-576d9f695b-67q7v\" (UID: \"a03e1308-6f47-4afc-b370-a17ad76bdb89\") " pod="openshift-monitoring/thanos-querier-576d9f695b-67q7v"
Jul 30 20:29:54.717020 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:54.716999    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/a03e1308-6f47-4afc-b370-a17ad76bdb89-secret-thanos-querier-tls\") pod \"thanos-querier-576d9f695b-67q7v\" (UID: \"a03e1308-6f47-4afc-b370-a17ad76bdb89\") " pod="openshift-monitoring/thanos-querier-576d9f695b-67q7v"
Jul 30 20:29:54.717206 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:54.717185    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a03e1308-6f47-4afc-b370-a17ad76bdb89-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-576d9f695b-67q7v\" (UID: \"a03e1308-6f47-4afc-b370-a17ad76bdb89\") " pod="openshift-monitoring/thanos-querier-576d9f695b-67q7v"
Jul 30 20:29:54.717246 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:54.717231    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a03e1308-6f47-4afc-b370-a17ad76bdb89-secret-grpc-tls\") pod \"thanos-querier-576d9f695b-67q7v\" (UID: \"a03e1308-6f47-4afc-b370-a17ad76bdb89\") " pod="openshift-monitoring/thanos-querier-576d9f695b-67q7v"
Jul 30 20:29:54.717288 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:54.717263    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a03e1308-6f47-4afc-b370-a17ad76bdb89-metrics-client-ca\") pod \"thanos-querier-576d9f695b-67q7v\" (UID: \"a03e1308-6f47-4afc-b370-a17ad76bdb89\") " pod="openshift-monitoring/thanos-querier-576d9f695b-67q7v"
Jul 30 20:29:54.717321 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:54.717285    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/a03e1308-6f47-4afc-b370-a17ad76bdb89-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-576d9f695b-67q7v\" (UID: \"a03e1308-6f47-4afc-b370-a17ad76bdb89\") " pod="openshift-monitoring/thanos-querier-576d9f695b-67q7v"
Jul 30 20:29:54.717359 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:54.717315    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/a03e1308-6f47-4afc-b370-a17ad76bdb89-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-576d9f695b-67q7v\" (UID: \"a03e1308-6f47-4afc-b370-a17ad76bdb89\") " pod="openshift-monitoring/thanos-querier-576d9f695b-67q7v"
Jul 30 20:29:54.717395 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:54.717370    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6kfbf\" (UniqueName: \"kubernetes.io/projected/a03e1308-6f47-4afc-b370-a17ad76bdb89-kube-api-access-6kfbf\") pod \"thanos-querier-576d9f695b-67q7v\" (UID: \"a03e1308-6f47-4afc-b370-a17ad76bdb89\") " pod="openshift-monitoring/thanos-querier-576d9f695b-67q7v"
Jul 30 20:29:54.764151 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:54.764105    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:29:54.818540 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:54.818512    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/a03e1308-6f47-4afc-b370-a17ad76bdb89-secret-thanos-querier-tls\") pod \"thanos-querier-576d9f695b-67q7v\" (UID: \"a03e1308-6f47-4afc-b370-a17ad76bdb89\") " pod="openshift-monitoring/thanos-querier-576d9f695b-67q7v"
Jul 30 20:29:54.818631 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:54.818549    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a03e1308-6f47-4afc-b370-a17ad76bdb89-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-576d9f695b-67q7v\" (UID: \"a03e1308-6f47-4afc-b370-a17ad76bdb89\") " pod="openshift-monitoring/thanos-querier-576d9f695b-67q7v"
Jul 30 20:29:54.818631 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:54.818579    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a03e1308-6f47-4afc-b370-a17ad76bdb89-secret-grpc-tls\") pod \"thanos-querier-576d9f695b-67q7v\" (UID: \"a03e1308-6f47-4afc-b370-a17ad76bdb89\") " pod="openshift-monitoring/thanos-querier-576d9f695b-67q7v"
Jul 30 20:29:54.818631 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:54.818607    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a03e1308-6f47-4afc-b370-a17ad76bdb89-metrics-client-ca\") pod \"thanos-querier-576d9f695b-67q7v\" (UID: \"a03e1308-6f47-4afc-b370-a17ad76bdb89\") " pod="openshift-monitoring/thanos-querier-576d9f695b-67q7v"
Jul 30 20:29:54.818795 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:54.818639    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/a03e1308-6f47-4afc-b370-a17ad76bdb89-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-576d9f695b-67q7v\" (UID: \"a03e1308-6f47-4afc-b370-a17ad76bdb89\") " pod="openshift-monitoring/thanos-querier-576d9f695b-67q7v"
Jul 30 20:29:54.818795 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:54.818669    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/a03e1308-6f47-4afc-b370-a17ad76bdb89-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-576d9f695b-67q7v\" (UID: \"a03e1308-6f47-4afc-b370-a17ad76bdb89\") " pod="openshift-monitoring/thanos-querier-576d9f695b-67q7v"
Jul 30 20:29:54.818904 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:54.818830    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6kfbf\" (UniqueName: \"kubernetes.io/projected/a03e1308-6f47-4afc-b370-a17ad76bdb89-kube-api-access-6kfbf\") pod \"thanos-querier-576d9f695b-67q7v\" (UID: \"a03e1308-6f47-4afc-b370-a17ad76bdb89\") " pod="openshift-monitoring/thanos-querier-576d9f695b-67q7v"
Jul 30 20:29:54.818947 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:54.818908    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a03e1308-6f47-4afc-b370-a17ad76bdb89-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-576d9f695b-67q7v\" (UID: \"a03e1308-6f47-4afc-b370-a17ad76bdb89\") " pod="openshift-monitoring/thanos-querier-576d9f695b-67q7v"
Jul 30 20:29:54.819604 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:54.819571    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a03e1308-6f47-4afc-b370-a17ad76bdb89-metrics-client-ca\") pod \"thanos-querier-576d9f695b-67q7v\" (UID: \"a03e1308-6f47-4afc-b370-a17ad76bdb89\") " pod="openshift-monitoring/thanos-querier-576d9f695b-67q7v"
Jul 30 20:29:54.821155 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:54.821122    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/a03e1308-6f47-4afc-b370-a17ad76bdb89-secret-thanos-querier-tls\") pod \"thanos-querier-576d9f695b-67q7v\" (UID: \"a03e1308-6f47-4afc-b370-a17ad76bdb89\") " pod="openshift-monitoring/thanos-querier-576d9f695b-67q7v"
Jul 30 20:29:54.821322 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:54.821303    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/a03e1308-6f47-4afc-b370-a17ad76bdb89-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-576d9f695b-67q7v\" (UID: \"a03e1308-6f47-4afc-b370-a17ad76bdb89\") " pod="openshift-monitoring/thanos-querier-576d9f695b-67q7v"
Jul 30 20:29:54.821492 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:54.821469    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/a03e1308-6f47-4afc-b370-a17ad76bdb89-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-576d9f695b-67q7v\" (UID: \"a03e1308-6f47-4afc-b370-a17ad76bdb89\") " pod="openshift-monitoring/thanos-querier-576d9f695b-67q7v"
Jul 30 20:29:54.821598 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:54.821579    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a03e1308-6f47-4afc-b370-a17ad76bdb89-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-576d9f695b-67q7v\" (UID: \"a03e1308-6f47-4afc-b370-a17ad76bdb89\") " pod="openshift-monitoring/thanos-querier-576d9f695b-67q7v"
Jul 30 20:29:54.821776 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:54.821756    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a03e1308-6f47-4afc-b370-a17ad76bdb89-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-576d9f695b-67q7v\" (UID: \"a03e1308-6f47-4afc-b370-a17ad76bdb89\") " pod="openshift-monitoring/thanos-querier-576d9f695b-67q7v"
Jul 30 20:29:54.821813 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:54.821805    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a03e1308-6f47-4afc-b370-a17ad76bdb89-secret-grpc-tls\") pod \"thanos-querier-576d9f695b-67q7v\" (UID: \"a03e1308-6f47-4afc-b370-a17ad76bdb89\") " pod="openshift-monitoring/thanos-querier-576d9f695b-67q7v"
Jul 30 20:29:54.826493 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:54.826442    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6kfbf\" (UniqueName: \"kubernetes.io/projected/a03e1308-6f47-4afc-b370-a17ad76bdb89-kube-api-access-6kfbf\") pod \"thanos-querier-576d9f695b-67q7v\" (UID: \"a03e1308-6f47-4afc-b370-a17ad76bdb89\") " pod="openshift-monitoring/thanos-querier-576d9f695b-67q7v"
Jul 30 20:29:54.914117 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:54.913880    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:29:54.938012 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:54.937988    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-576d9f695b-67q7v"
Jul 30 20:29:55.073818 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:55.073788    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-576d9f695b-67q7v"]
Jul 30 20:29:55.076366 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:29:55.076343    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda03e1308_6f47_4afc_b370_a17ad76bdb89.slice/crio-f1c47fb3c2092c39da8209324fe96b2b1cf6abe037b01a3163921bfadbebb8bc WatchSource:0}: Error finding container f1c47fb3c2092c39da8209324fe96b2b1cf6abe037b01a3163921bfadbebb8bc: Status 404 returned error can't find the container with id f1c47fb3c2092c39da8209324fe96b2b1cf6abe037b01a3163921bfadbebb8bc
Jul 30 20:29:55.133199 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:55.133175    2583 patch_prober.go:28] interesting pod/image-registry-5b5c7c9c69-f9wj5 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 30 20:29:55.133303 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:55.133218    2583 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5b5c7c9c69-f9wj5" podUID="fd98fd1e-2a93-4be2-ba8c-21300b318c71" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 30 20:29:55.638601 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:55.638564    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-576d9f695b-67q7v" event={"ID":"a03e1308-6f47-4afc-b370-a17ad76bdb89","Type":"ContainerStarted","Data":"f1c47fb3c2092c39da8209324fe96b2b1cf6abe037b01a3163921bfadbebb8bc"}
Jul 30 20:29:56.406280 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:56.406237    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:29:56.412060 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:56.412035    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-6dffbbd67-nl4s4"]
Jul 30 20:29:56.415614 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:56.415593    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-nl4s4"
Jul 30 20:29:56.418854 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:56.418833    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-vcwfl\""
Jul 30 20:29:56.418976 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:56.418900    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 30 20:29:56.422236 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:56.422184    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-6dffbbd67-nl4s4"]
Jul 30 20:29:56.533626 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:56.533595    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fg74t\" (UniqueName: \"kubernetes.io/projected/29e70bb0-fd24-4335-a99d-d4e1e6481dcc-kube-api-access-fg74t\") pod \"monitoring-plugin-6dffbbd67-nl4s4\" (UID: \"29e70bb0-fd24-4335-a99d-d4e1e6481dcc\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-nl4s4"
Jul 30 20:29:56.533796 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:56.533681    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/29e70bb0-fd24-4335-a99d-d4e1e6481dcc-monitoring-plugin-cert\") pod \"monitoring-plugin-6dffbbd67-nl4s4\" (UID: \"29e70bb0-fd24-4335-a99d-d4e1e6481dcc\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-nl4s4"
Jul 30 20:29:56.604296 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:56.604264    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:29:56.634458 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:56.634425    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/29e70bb0-fd24-4335-a99d-d4e1e6481dcc-monitoring-plugin-cert\") pod \"monitoring-plugin-6dffbbd67-nl4s4\" (UID: \"29e70bb0-fd24-4335-a99d-d4e1e6481dcc\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-nl4s4"
Jul 30 20:29:56.634627 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:56.634526    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fg74t\" (UniqueName: \"kubernetes.io/projected/29e70bb0-fd24-4335-a99d-d4e1e6481dcc-kube-api-access-fg74t\") pod \"monitoring-plugin-6dffbbd67-nl4s4\" (UID: \"29e70bb0-fd24-4335-a99d-d4e1e6481dcc\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-nl4s4"
Jul 30 20:29:56.637313 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:56.637288    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/29e70bb0-fd24-4335-a99d-d4e1e6481dcc-monitoring-plugin-cert\") pod \"monitoring-plugin-6dffbbd67-nl4s4\" (UID: \"29e70bb0-fd24-4335-a99d-d4e1e6481dcc\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-nl4s4"
Jul 30 20:29:56.642745 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:56.642717    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fg74t\" (UniqueName: \"kubernetes.io/projected/29e70bb0-fd24-4335-a99d-d4e1e6481dcc-kube-api-access-fg74t\") pod \"monitoring-plugin-6dffbbd67-nl4s4\" (UID: \"29e70bb0-fd24-4335-a99d-d4e1e6481dcc\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-nl4s4"
Jul 30 20:29:56.729702 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:56.729618    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-nl4s4"
Jul 30 20:29:56.846035 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:56.845971    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-89bc6d7f5-ldnwg"]
Jul 30 20:29:56.849771 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:56.849748    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-89bc6d7f5-ldnwg"
Jul 30 20:29:56.851976 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:56.851952    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 30 20:29:56.852112 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:56.852060    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 30 20:29:56.852112 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:56.852068    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 30 20:29:56.852238 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:56.852163    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 30 20:29:56.852282 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:56.852242    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-fzsqb\""
Jul 30 20:29:56.852282 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:56.852263    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 30 20:29:56.858124 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:56.858099    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 30 20:29:56.862843 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:56.862820    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-89bc6d7f5-ldnwg"]
Jul 30 20:29:56.937266 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:56.937243    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bf2dcf72-0a9e-4eb3-b788-142d3c0d7cf1-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-89bc6d7f5-ldnwg\" (UID: \"bf2dcf72-0a9e-4eb3-b788-142d3c0d7cf1\") " pod="openshift-monitoring/telemeter-client-89bc6d7f5-ldnwg"
Jul 30 20:29:56.937349 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:56.937281    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bf2dcf72-0a9e-4eb3-b788-142d3c0d7cf1-metrics-client-ca\") pod \"telemeter-client-89bc6d7f5-ldnwg\" (UID: \"bf2dcf72-0a9e-4eb3-b788-142d3c0d7cf1\") " pod="openshift-monitoring/telemeter-client-89bc6d7f5-ldnwg"
Jul 30 20:29:56.937349 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:56.937321    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf2dcf72-0a9e-4eb3-b788-142d3c0d7cf1-telemeter-trusted-ca-bundle\") pod \"telemeter-client-89bc6d7f5-ldnwg\" (UID: \"bf2dcf72-0a9e-4eb3-b788-142d3c0d7cf1\") " pod="openshift-monitoring/telemeter-client-89bc6d7f5-ldnwg"
Jul 30 20:29:56.937426 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:56.937365    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49cwd\" (UniqueName: \"kubernetes.io/projected/bf2dcf72-0a9e-4eb3-b788-142d3c0d7cf1-kube-api-access-49cwd\") pod \"telemeter-client-89bc6d7f5-ldnwg\" (UID: \"bf2dcf72-0a9e-4eb3-b788-142d3c0d7cf1\") " pod="openshift-monitoring/telemeter-client-89bc6d7f5-ldnwg"
Jul 30 20:29:56.937426 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:56.937395    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/bf2dcf72-0a9e-4eb3-b788-142d3c0d7cf1-secret-telemeter-client\") pod \"telemeter-client-89bc6d7f5-ldnwg\" (UID: \"bf2dcf72-0a9e-4eb3-b788-142d3c0d7cf1\") " pod="openshift-monitoring/telemeter-client-89bc6d7f5-ldnwg"
Jul 30 20:29:56.937509 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:56.937435    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf2dcf72-0a9e-4eb3-b788-142d3c0d7cf1-serving-certs-ca-bundle\") pod \"telemeter-client-89bc6d7f5-ldnwg\" (UID: \"bf2dcf72-0a9e-4eb3-b788-142d3c0d7cf1\") " pod="openshift-monitoring/telemeter-client-89bc6d7f5-ldnwg"
Jul 30 20:29:56.937547 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:56.937530    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/bf2dcf72-0a9e-4eb3-b788-142d3c0d7cf1-federate-client-tls\") pod \"telemeter-client-89bc6d7f5-ldnwg\" (UID: \"bf2dcf72-0a9e-4eb3-b788-142d3c0d7cf1\") " pod="openshift-monitoring/telemeter-client-89bc6d7f5-ldnwg"
Jul 30 20:29:56.937584 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:56.937567    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/bf2dcf72-0a9e-4eb3-b788-142d3c0d7cf1-telemeter-client-tls\") pod \"telemeter-client-89bc6d7f5-ldnwg\" (UID: \"bf2dcf72-0a9e-4eb3-b788-142d3c0d7cf1\") " pod="openshift-monitoring/telemeter-client-89bc6d7f5-ldnwg"
Jul 30 20:29:57.003455 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:57.003432    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-6dffbbd67-nl4s4"]
Jul 30 20:29:57.005885 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:29:57.005863    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29e70bb0_fd24_4335_a99d_d4e1e6481dcc.slice/crio-11bb39f7d9dbba64503de0cd20c414466aee36b84990f4bde87ee6913352ca0d WatchSource:0}: Error finding container 11bb39f7d9dbba64503de0cd20c414466aee36b84990f4bde87ee6913352ca0d: Status 404 returned error can't find the container with id 11bb39f7d9dbba64503de0cd20c414466aee36b84990f4bde87ee6913352ca0d
Jul 30 20:29:57.038373 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:57.038340    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf2dcf72-0a9e-4eb3-b788-142d3c0d7cf1-telemeter-trusted-ca-bundle\") pod \"telemeter-client-89bc6d7f5-ldnwg\" (UID: \"bf2dcf72-0a9e-4eb3-b788-142d3c0d7cf1\") " pod="openshift-monitoring/telemeter-client-89bc6d7f5-ldnwg"
Jul 30 20:29:57.038486 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:57.038384    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49cwd\" (UniqueName: \"kubernetes.io/projected/bf2dcf72-0a9e-4eb3-b788-142d3c0d7cf1-kube-api-access-49cwd\") pod \"telemeter-client-89bc6d7f5-ldnwg\" (UID: \"bf2dcf72-0a9e-4eb3-b788-142d3c0d7cf1\") " pod="openshift-monitoring/telemeter-client-89bc6d7f5-ldnwg"
Jul 30 20:29:57.038486 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:57.038415    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/bf2dcf72-0a9e-4eb3-b788-142d3c0d7cf1-secret-telemeter-client\") pod \"telemeter-client-89bc6d7f5-ldnwg\" (UID: \"bf2dcf72-0a9e-4eb3-b788-142d3c0d7cf1\") " pod="openshift-monitoring/telemeter-client-89bc6d7f5-ldnwg"
Jul 30 20:29:57.038486 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:57.038458    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf2dcf72-0a9e-4eb3-b788-142d3c0d7cf1-serving-certs-ca-bundle\") pod \"telemeter-client-89bc6d7f5-ldnwg\" (UID: \"bf2dcf72-0a9e-4eb3-b788-142d3c0d7cf1\") " pod="openshift-monitoring/telemeter-client-89bc6d7f5-ldnwg"
Jul 30 20:29:57.038642 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:57.038518    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/bf2dcf72-0a9e-4eb3-b788-142d3c0d7cf1-federate-client-tls\") pod \"telemeter-client-89bc6d7f5-ldnwg\" (UID: \"bf2dcf72-0a9e-4eb3-b788-142d3c0d7cf1\") " pod="openshift-monitoring/telemeter-client-89bc6d7f5-ldnwg"
Jul 30 20:29:57.038642 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:57.038578    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/bf2dcf72-0a9e-4eb3-b788-142d3c0d7cf1-telemeter-client-tls\") pod \"telemeter-client-89bc6d7f5-ldnwg\" (UID: \"bf2dcf72-0a9e-4eb3-b788-142d3c0d7cf1\") " pod="openshift-monitoring/telemeter-client-89bc6d7f5-ldnwg"
Jul 30 20:29:57.038740 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:57.038635    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bf2dcf72-0a9e-4eb3-b788-142d3c0d7cf1-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-89bc6d7f5-ldnwg\" (UID: \"bf2dcf72-0a9e-4eb3-b788-142d3c0d7cf1\") " pod="openshift-monitoring/telemeter-client-89bc6d7f5-ldnwg"
Jul 30 20:29:57.038740 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:57.038664    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bf2dcf72-0a9e-4eb3-b788-142d3c0d7cf1-metrics-client-ca\") pod \"telemeter-client-89bc6d7f5-ldnwg\" (UID: \"bf2dcf72-0a9e-4eb3-b788-142d3c0d7cf1\") " pod="openshift-monitoring/telemeter-client-89bc6d7f5-ldnwg"
Jul 30 20:29:57.039301 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:57.039239    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf2dcf72-0a9e-4eb3-b788-142d3c0d7cf1-serving-certs-ca-bundle\") pod \"telemeter-client-89bc6d7f5-ldnwg\" (UID: \"bf2dcf72-0a9e-4eb3-b788-142d3c0d7cf1\") " pod="openshift-monitoring/telemeter-client-89bc6d7f5-ldnwg"
Jul 30 20:29:57.039301 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:57.039264    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf2dcf72-0a9e-4eb3-b788-142d3c0d7cf1-telemeter-trusted-ca-bundle\") pod \"telemeter-client-89bc6d7f5-ldnwg\" (UID: \"bf2dcf72-0a9e-4eb3-b788-142d3c0d7cf1\") " pod="openshift-monitoring/telemeter-client-89bc6d7f5-ldnwg"
Jul 30 20:29:57.039636 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:57.039545    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bf2dcf72-0a9e-4eb3-b788-142d3c0d7cf1-metrics-client-ca\") pod \"telemeter-client-89bc6d7f5-ldnwg\" (UID: \"bf2dcf72-0a9e-4eb3-b788-142d3c0d7cf1\") " pod="openshift-monitoring/telemeter-client-89bc6d7f5-ldnwg"
Jul 30 20:29:57.041080 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:57.041053    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/bf2dcf72-0a9e-4eb3-b788-142d3c0d7cf1-secret-telemeter-client\") pod \"telemeter-client-89bc6d7f5-ldnwg\" (UID: \"bf2dcf72-0a9e-4eb3-b788-142d3c0d7cf1\") " pod="openshift-monitoring/telemeter-client-89bc6d7f5-ldnwg"
Jul 30 20:29:57.041210 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:57.041166    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/bf2dcf72-0a9e-4eb3-b788-142d3c0d7cf1-telemeter-client-tls\") pod \"telemeter-client-89bc6d7f5-ldnwg\" (UID: \"bf2dcf72-0a9e-4eb3-b788-142d3c0d7cf1\") " pod="openshift-monitoring/telemeter-client-89bc6d7f5-ldnwg"
Jul 30 20:29:57.041552 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:57.041524    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bf2dcf72-0a9e-4eb3-b788-142d3c0d7cf1-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-89bc6d7f5-ldnwg\" (UID: \"bf2dcf72-0a9e-4eb3-b788-142d3c0d7cf1\") " pod="openshift-monitoring/telemeter-client-89bc6d7f5-ldnwg"
Jul 30 20:29:57.041552 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:57.041526    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/bf2dcf72-0a9e-4eb3-b788-142d3c0d7cf1-federate-client-tls\") pod \"telemeter-client-89bc6d7f5-ldnwg\" (UID: \"bf2dcf72-0a9e-4eb3-b788-142d3c0d7cf1\") " pod="openshift-monitoring/telemeter-client-89bc6d7f5-ldnwg"
Jul 30 20:29:57.045886 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:57.045866    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-49cwd\" (UniqueName: \"kubernetes.io/projected/bf2dcf72-0a9e-4eb3-b788-142d3c0d7cf1-kube-api-access-49cwd\") pod \"telemeter-client-89bc6d7f5-ldnwg\" (UID: \"bf2dcf72-0a9e-4eb3-b788-142d3c0d7cf1\") " pod="openshift-monitoring/telemeter-client-89bc6d7f5-ldnwg"
Jul 30 20:29:57.163856 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:57.163830    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-89bc6d7f5-ldnwg"
Jul 30 20:29:57.230459 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:57.230427    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:29:57.301555 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:57.301523    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-89bc6d7f5-ldnwg"]
Jul 30 20:29:57.305239 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:29:57.305214    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf2dcf72_0a9e_4eb3_b788_142d3c0d7cf1.slice/crio-652a436febc5255d3dbb253ba1936aa4b49e5009dd2c89463848f74eab16fdaa WatchSource:0}: Error finding container 652a436febc5255d3dbb253ba1936aa4b49e5009dd2c89463848f74eab16fdaa: Status 404 returned error can't find the container with id 652a436febc5255d3dbb253ba1936aa4b49e5009dd2c89463848f74eab16fdaa
Jul 30 20:29:57.306000 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:57.305883    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:29:57.364954 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:57.364929    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:29:57.466773 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:57.466747    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:29:57.553164 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:57.553087    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5b5c7c9c69-f9wj5"
Jul 30 20:29:57.651519 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:57.651481    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-576d9f695b-67q7v" event={"ID":"a03e1308-6f47-4afc-b370-a17ad76bdb89","Type":"ContainerStarted","Data":"e8541c05dac801887ed66caad9cefc75cc92f0e17a33f6125a3c8d8048da3a07"}
Jul 30 20:29:57.652033 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:57.651566    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-576d9f695b-67q7v" event={"ID":"a03e1308-6f47-4afc-b370-a17ad76bdb89","Type":"ContainerStarted","Data":"a39619fe48a20c7d23b8cd5b6b131293e6910f9cc903684647f0f31a6f5fd4ad"}
Jul 30 20:29:57.652033 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:57.651609    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-576d9f695b-67q7v" event={"ID":"a03e1308-6f47-4afc-b370-a17ad76bdb89","Type":"ContainerStarted","Data":"6e4a7e45ea17d839b5aaa4dda6cd1523fff639b69966621981bc0eacca71a553"}
Jul 30 20:29:57.652819 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:57.652790    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-nl4s4" event={"ID":"29e70bb0-fd24-4335-a99d-d4e1e6481dcc","Type":"ContainerStarted","Data":"11bb39f7d9dbba64503de0cd20c414466aee36b84990f4bde87ee6913352ca0d"}
Jul 30 20:29:57.655837 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:57.655809    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-89bc6d7f5-ldnwg" event={"ID":"bf2dcf72-0a9e-4eb3-b788-142d3c0d7cf1","Type":"ContainerStarted","Data":"652a436febc5255d3dbb253ba1936aa4b49e5009dd2c89463848f74eab16fdaa"}
Jul 30 20:29:57.850397 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:57.850316    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:29:57.910931 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:57.910857    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:29:58.663857 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:58.663816    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-576d9f695b-67q7v" event={"ID":"a03e1308-6f47-4afc-b370-a17ad76bdb89","Type":"ContainerStarted","Data":"1e91b37203016ef26527e81587e1b4beb365e2893f2593479a7b3573737edf2c"}
Jul 30 20:29:58.664265 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:58.663873    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-576d9f695b-67q7v" event={"ID":"a03e1308-6f47-4afc-b370-a17ad76bdb89","Type":"ContainerStarted","Data":"fcc07567103393ebfbb8790b04a00c7e87ae63dcd86a5577f37179ae48545c2c"}
Jul 30 20:29:58.664265 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:58.663899    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-576d9f695b-67q7v" event={"ID":"a03e1308-6f47-4afc-b370-a17ad76bdb89","Type":"ContainerStarted","Data":"bbcdc1c4d5e586615cc89b30099646afa3ba391cb3ca4a8493c1fc8ea3474f95"}
Jul 30 20:29:58.664912 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:58.664831    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-576d9f695b-67q7v"
Jul 30 20:29:58.666624 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:58.666601    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-nl4s4" event={"ID":"29e70bb0-fd24-4335-a99d-d4e1e6481dcc","Type":"ContainerStarted","Data":"93a596123a241049dd5eb9291105c5b1c484ccac05eb62ca174207123cd4c374"}
Jul 30 20:29:58.666715 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:58.666648    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-nl4s4"
Jul 30 20:29:58.675635 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:58.675615    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-nl4s4"
Jul 30 20:29:58.685396 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:58.685320    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-576d9f695b-67q7v" podStartSLOduration=1.877309344 podStartE2EDuration="4.685301287s" totalImagesPullingTime="2.807991943s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:29:54 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:29:58.684900433 +0000 UTC m=+310.526376066" watchObservedRunningTime="2026-07-30 20:29:58.685301287 +0000 UTC m=+310.526776968"
Jul 30 20:29:58.701370 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:58.701325    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-nl4s4" podStartSLOduration=1.152763611 podStartE2EDuration="2.701308417s" totalImagesPullingTime="1.548544806s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:29:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:29:58.698232333 +0000 UTC m=+310.539707954" watchObservedRunningTime="2026-07-30 20:29:58.701308417 +0000 UTC m=+310.542784038"
Jul 30 20:29:59.671130 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:29:59.671091    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jfpt4"
Jul 30 20:30:00.153538 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:00.153507    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5b5c7c9c69-f9wj5"]
Jul 30 20:30:00.254076 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:00.254035    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:30:00.334366 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:00.334332    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:30:00.676716 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:00.676689    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-89bc6d7f5-ldnwg" event={"ID":"bf2dcf72-0a9e-4eb3-b788-142d3c0d7cf1","Type":"ContainerStarted","Data":"f4aae92427c5a46b294d36b024cdc1a728cae25785e6f3e744342d6c6ef494c2"}
Jul 30 20:30:00.676992 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:00.676738    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-89bc6d7f5-ldnwg" event={"ID":"bf2dcf72-0a9e-4eb3-b788-142d3c0d7cf1","Type":"ContainerStarted","Data":"d52d14bd876a16f5c264f118228a4dc1de73e6f20b1dc3edffd032f9ec1d4ef5"}
Jul 30 20:30:01.682906 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:01.682868    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-89bc6d7f5-ldnwg" event={"ID":"bf2dcf72-0a9e-4eb3-b788-142d3c0d7cf1","Type":"ContainerStarted","Data":"5b2d1578cfa336fc6785422aa4d3bbacee0903c81b12a5c616802fbea837cdd2"}
Jul 30 20:30:01.704775 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:01.704725    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-89bc6d7f5-ldnwg" podStartSLOduration=2.490998913 podStartE2EDuration="5.704710106s" totalImagesPullingTime="3.213711193s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:29:56 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:30:01.703336309 +0000 UTC m=+313.544811931" watchObservedRunningTime="2026-07-30 20:30:01.704710106 +0000 UTC m=+313.546185727"
Jul 30 20:30:02.819017 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:02.818984    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:30:02.964207 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:02.964167    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:30:03.066265 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:03.066222    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:30:03.233007 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:03.232968    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:30:03.450072 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:03.450033    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:30:03.510373 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:03.510268    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:30:03.854025 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:03.853940    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:30:03.956713 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:03.956687    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:30:04.250695 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:04.250659    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:30:04.307133 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:04.307098    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:30:04.474523 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:04.474495    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:30:04.679577 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:04.679549    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:30:05.020663 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:05.020556    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:30:05.120485 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:05.120453    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:30:05.682505 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:05.682480    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-576d9f695b-67q7v"
Jul 30 20:30:05.891527 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:05.891476    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:30:10.304356 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:10.304319    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:30:10.663674 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:10.663641    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:30:12.113557 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:12.113525    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:30:12.165837 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:12.165806    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:30:12.916822 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:12.916792    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-bc4774bdd-hwwmz"]
Jul 30 20:30:12.921179 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:12.921159    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bc4774bdd-hwwmz"
Jul 30 20:30:12.923457 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:12.923438    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 30 20:30:12.923561 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:12.923460    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 30 20:30:12.923561 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:12.923510    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 30 20:30:12.923727 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:12.923712    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 30 20:30:12.923766 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:12.923734    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 30 20:30:12.924389 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:12.924373    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 30 20:30:12.924463 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:12.924381    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 30 20:30:12.924525 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:12.924381    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-mf675\""
Jul 30 20:30:12.931264 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:12.931244    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-bc4774bdd-hwwmz"]
Jul 30 20:30:13.067034 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:13.067013    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/147dc20e-f885-4a43-bece-b4997996d418-console-oauth-config\") pod \"console-bc4774bdd-hwwmz\" (UID: \"147dc20e-f885-4a43-bece-b4997996d418\") " pod="openshift-console/console-bc4774bdd-hwwmz"
Jul 30 20:30:13.067194 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:13.067053    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/147dc20e-f885-4a43-bece-b4997996d418-service-ca\") pod \"console-bc4774bdd-hwwmz\" (UID: \"147dc20e-f885-4a43-bece-b4997996d418\") " pod="openshift-console/console-bc4774bdd-hwwmz"
Jul 30 20:30:13.067194 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:13.067071    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/147dc20e-f885-4a43-bece-b4997996d418-console-config\") pod \"console-bc4774bdd-hwwmz\" (UID: \"147dc20e-f885-4a43-bece-b4997996d418\") " pod="openshift-console/console-bc4774bdd-hwwmz"
Jul 30 20:30:13.067194 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:13.067092    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/147dc20e-f885-4a43-bece-b4997996d418-console-serving-cert\") pod \"console-bc4774bdd-hwwmz\" (UID: \"147dc20e-f885-4a43-bece-b4997996d418\") " pod="openshift-console/console-bc4774bdd-hwwmz"
Jul 30 20:30:13.067194 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:13.067173    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6m7d5\" (UniqueName: \"kubernetes.io/projected/147dc20e-f885-4a43-bece-b4997996d418-kube-api-access-6m7d5\") pod \"console-bc4774bdd-hwwmz\" (UID: \"147dc20e-f885-4a43-bece-b4997996d418\") " pod="openshift-console/console-bc4774bdd-hwwmz"
Jul 30 20:30:13.067336 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:13.067204    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/147dc20e-f885-4a43-bece-b4997996d418-oauth-serving-cert\") pod \"console-bc4774bdd-hwwmz\" (UID: \"147dc20e-f885-4a43-bece-b4997996d418\") " pod="openshift-console/console-bc4774bdd-hwwmz"
Jul 30 20:30:13.167843 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:13.167775    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/147dc20e-f885-4a43-bece-b4997996d418-service-ca\") pod \"console-bc4774bdd-hwwmz\" (UID: \"147dc20e-f885-4a43-bece-b4997996d418\") " pod="openshift-console/console-bc4774bdd-hwwmz"
Jul 30 20:30:13.167843 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:13.167803    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/147dc20e-f885-4a43-bece-b4997996d418-console-config\") pod \"console-bc4774bdd-hwwmz\" (UID: \"147dc20e-f885-4a43-bece-b4997996d418\") " pod="openshift-console/console-bc4774bdd-hwwmz"
Jul 30 20:30:13.167843 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:13.167825    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/147dc20e-f885-4a43-bece-b4997996d418-console-serving-cert\") pod \"console-bc4774bdd-hwwmz\" (UID: \"147dc20e-f885-4a43-bece-b4997996d418\") " pod="openshift-console/console-bc4774bdd-hwwmz"
Jul 30 20:30:13.167843 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:13.167844    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6m7d5\" (UniqueName: \"kubernetes.io/projected/147dc20e-f885-4a43-bece-b4997996d418-kube-api-access-6m7d5\") pod \"console-bc4774bdd-hwwmz\" (UID: \"147dc20e-f885-4a43-bece-b4997996d418\") " pod="openshift-console/console-bc4774bdd-hwwmz"
Jul 30 20:30:13.168417 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:13.167869    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/147dc20e-f885-4a43-bece-b4997996d418-oauth-serving-cert\") pod \"console-bc4774bdd-hwwmz\" (UID: \"147dc20e-f885-4a43-bece-b4997996d418\") " pod="openshift-console/console-bc4774bdd-hwwmz"
Jul 30 20:30:13.168417 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:13.167939    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/147dc20e-f885-4a43-bece-b4997996d418-console-oauth-config\") pod \"console-bc4774bdd-hwwmz\" (UID: \"147dc20e-f885-4a43-bece-b4997996d418\") " pod="openshift-console/console-bc4774bdd-hwwmz"
Jul 30 20:30:13.168550 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:13.168525    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/147dc20e-f885-4a43-bece-b4997996d418-service-ca\") pod \"console-bc4774bdd-hwwmz\" (UID: \"147dc20e-f885-4a43-bece-b4997996d418\") " pod="openshift-console/console-bc4774bdd-hwwmz"
Jul 30 20:30:13.168607 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:13.168575    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/147dc20e-f885-4a43-bece-b4997996d418-console-config\") pod \"console-bc4774bdd-hwwmz\" (UID: \"147dc20e-f885-4a43-bece-b4997996d418\") " pod="openshift-console/console-bc4774bdd-hwwmz"
Jul 30 20:30:13.168607 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:13.168585    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/147dc20e-f885-4a43-bece-b4997996d418-oauth-serving-cert\") pod \"console-bc4774bdd-hwwmz\" (UID: \"147dc20e-f885-4a43-bece-b4997996d418\") " pod="openshift-console/console-bc4774bdd-hwwmz"
Jul 30 20:30:13.170357 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:13.170341    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/147dc20e-f885-4a43-bece-b4997996d418-console-serving-cert\") pod \"console-bc4774bdd-hwwmz\" (UID: \"147dc20e-f885-4a43-bece-b4997996d418\") " pod="openshift-console/console-bc4774bdd-hwwmz"
Jul 30 20:30:13.170436 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:13.170421    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/147dc20e-f885-4a43-bece-b4997996d418-console-oauth-config\") pod \"console-bc4774bdd-hwwmz\" (UID: \"147dc20e-f885-4a43-bece-b4997996d418\") " pod="openshift-console/console-bc4774bdd-hwwmz"
Jul 30 20:30:13.174844 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:13.174827    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6m7d5\" (UniqueName: \"kubernetes.io/projected/147dc20e-f885-4a43-bece-b4997996d418-kube-api-access-6m7d5\") pod \"console-bc4774bdd-hwwmz\" (UID: \"147dc20e-f885-4a43-bece-b4997996d418\") " pod="openshift-console/console-bc4774bdd-hwwmz"
Jul 30 20:30:13.230931 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:13.230912    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bc4774bdd-hwwmz"
Jul 30 20:30:13.380347 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:13.380268    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-bc4774bdd-hwwmz"]
Jul 30 20:30:13.382819 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:30:13.382788    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod147dc20e_f885_4a43_bece_b4997996d418.slice/crio-06261ae61d8ef7518b248a23cec333c55c525b0a15b52a44f22d45c086e20875 WatchSource:0}: Error finding container 06261ae61d8ef7518b248a23cec333c55c525b0a15b52a44f22d45c086e20875: Status 404 returned error can't find the container with id 06261ae61d8ef7518b248a23cec333c55c525b0a15b52a44f22d45c086e20875
Jul 30 20:30:13.725748 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:13.725710    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bc4774bdd-hwwmz" event={"ID":"147dc20e-f885-4a43-bece-b4997996d418","Type":"ContainerStarted","Data":"06261ae61d8ef7518b248a23cec333c55c525b0a15b52a44f22d45c086e20875"}
Jul 30 20:30:17.374644 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:17.374607    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:30:17.472248 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:17.472170    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:30:18.303812 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:18.303779    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:30:18.405897 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:18.405868    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:30:18.509644 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:18.509609    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:30:18.573095 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:18.573030    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:30:18.747592 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:18.747562    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bc4774bdd-hwwmz" event={"ID":"147dc20e-f885-4a43-bece-b4997996d418","Type":"ContainerStarted","Data":"c7d65cfc18e975ddd0367ef33cb044846a8272c68122fe707743575b674a4128"}
Jul 30 20:30:18.766868 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:18.766828    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-bc4774bdd-hwwmz" podStartSLOduration=2.33234787 podStartE2EDuration="6.766814932s" totalImagesPullingTime="4.434467062s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:30:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:30:18.765094597 +0000 UTC m=+330.606570217" watchObservedRunningTime="2026-07-30 20:30:18.766814932 +0000 UTC m=+330.608290554"
Jul 30 20:30:19.345556 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:19.345502    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:30:19.658602 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:19.658565    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:30:20.015660 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:20.015566    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:30:20.072423 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:20.072392    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:30:22.710760 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:22.710714    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:30:22.771890 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:22.771863    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:30:23.231070 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:23.231040    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-bc4774bdd-hwwmz"
Jul 30 20:30:23.231255 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:23.231130    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-bc4774bdd-hwwmz"
Jul 30 20:30:23.235724 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:23.235705    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-bc4774bdd-hwwmz"
Jul 30 20:30:23.769208 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:23.769184    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-bc4774bdd-hwwmz"
Jul 30 20:30:25.175807 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:25.175776    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5b5c7c9c69-f9wj5" podUID="fd98fd1e-2a93-4be2-ba8c-21300b318c71" containerName="registry" containerID="cri-o://114dd3e25a185c3b7052079a133d96348126ebbe4bdec65f4fd1c783ca7ebc88" gracePeriod=30
Jul 30 20:30:25.416909 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:25.416887    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5b5c7c9c69-f9wj5"
Jul 30 20:30:25.568316 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:25.568242    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fd98fd1e-2a93-4be2-ba8c-21300b318c71-trusted-ca\") pod \"fd98fd1e-2a93-4be2-ba8c-21300b318c71\" (UID: \"fd98fd1e-2a93-4be2-ba8c-21300b318c71\") "
Jul 30 20:30:25.568316 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:25.568292    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fd98fd1e-2a93-4be2-ba8c-21300b318c71-image-registry-private-configuration\") pod \"fd98fd1e-2a93-4be2-ba8c-21300b318c71\" (UID: \"fd98fd1e-2a93-4be2-ba8c-21300b318c71\") "
Jul 30 20:30:25.568316 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:25.568318    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fd98fd1e-2a93-4be2-ba8c-21300b318c71-ca-trust-extracted\") pod \"fd98fd1e-2a93-4be2-ba8c-21300b318c71\" (UID: \"fd98fd1e-2a93-4be2-ba8c-21300b318c71\") "
Jul 30 20:30:25.568540 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:25.568341    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fd98fd1e-2a93-4be2-ba8c-21300b318c71-registry-tls\") pod \"fd98fd1e-2a93-4be2-ba8c-21300b318c71\" (UID: \"fd98fd1e-2a93-4be2-ba8c-21300b318c71\") "
Jul 30 20:30:25.568540 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:25.568363    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fd98fd1e-2a93-4be2-ba8c-21300b318c71-installation-pull-secrets\") pod \"fd98fd1e-2a93-4be2-ba8c-21300b318c71\" (UID: \"fd98fd1e-2a93-4be2-ba8c-21300b318c71\") "
Jul 30 20:30:25.568540 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:25.568383    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fd98fd1e-2a93-4be2-ba8c-21300b318c71-registry-certificates\") pod \"fd98fd1e-2a93-4be2-ba8c-21300b318c71\" (UID: \"fd98fd1e-2a93-4be2-ba8c-21300b318c71\") "
Jul 30 20:30:25.568540 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:25.568403    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fd98fd1e-2a93-4be2-ba8c-21300b318c71-bound-sa-token\") pod \"fd98fd1e-2a93-4be2-ba8c-21300b318c71\" (UID: \"fd98fd1e-2a93-4be2-ba8c-21300b318c71\") "
Jul 30 20:30:25.568540 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:25.568418    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-grrfz\" (UniqueName: \"kubernetes.io/projected/fd98fd1e-2a93-4be2-ba8c-21300b318c71-kube-api-access-grrfz\") pod \"fd98fd1e-2a93-4be2-ba8c-21300b318c71\" (UID: \"fd98fd1e-2a93-4be2-ba8c-21300b318c71\") "
Jul 30 20:30:25.568780 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:25.568708    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fd98fd1e-2a93-4be2-ba8c-21300b318c71-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "fd98fd1e-2a93-4be2-ba8c-21300b318c71" (UID: "fd98fd1e-2a93-4be2-ba8c-21300b318c71"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 20:30:25.568830 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:25.568778    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fd98fd1e-2a93-4be2-ba8c-21300b318c71-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "fd98fd1e-2a93-4be2-ba8c-21300b318c71" (UID: "fd98fd1e-2a93-4be2-ba8c-21300b318c71"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 20:30:25.571216 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:25.571167    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fd98fd1e-2a93-4be2-ba8c-21300b318c71-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "fd98fd1e-2a93-4be2-ba8c-21300b318c71" (UID: "fd98fd1e-2a93-4be2-ba8c-21300b318c71"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 20:30:25.571340 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:25.571210    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd98fd1e-2a93-4be2-ba8c-21300b318c71-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "fd98fd1e-2a93-4be2-ba8c-21300b318c71" (UID: "fd98fd1e-2a93-4be2-ba8c-21300b318c71"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:30:25.571340 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:25.571262    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fd98fd1e-2a93-4be2-ba8c-21300b318c71-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "fd98fd1e-2a93-4be2-ba8c-21300b318c71" (UID: "fd98fd1e-2a93-4be2-ba8c-21300b318c71"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 20:30:25.571490 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:25.571397    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd98fd1e-2a93-4be2-ba8c-21300b318c71-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "fd98fd1e-2a93-4be2-ba8c-21300b318c71" (UID: "fd98fd1e-2a93-4be2-ba8c-21300b318c71"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:30:25.571603 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:25.571513    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd98fd1e-2a93-4be2-ba8c-21300b318c71-kube-api-access-grrfz" (OuterVolumeSpecName: "kube-api-access-grrfz") pod "fd98fd1e-2a93-4be2-ba8c-21300b318c71" (UID: "fd98fd1e-2a93-4be2-ba8c-21300b318c71"). InnerVolumeSpecName "kube-api-access-grrfz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:30:25.578004 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:25.577982    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd98fd1e-2a93-4be2-ba8c-21300b318c71-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "fd98fd1e-2a93-4be2-ba8c-21300b318c71" (UID: "fd98fd1e-2a93-4be2-ba8c-21300b318c71"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:30:25.669781 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:25.669744    2583 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fd98fd1e-2a93-4be2-ba8c-21300b318c71-trusted-ca\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 20:30:25.669943 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:25.669866    2583 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fd98fd1e-2a93-4be2-ba8c-21300b318c71-image-registry-private-configuration\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 20:30:25.669943 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:25.669933    2583 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fd98fd1e-2a93-4be2-ba8c-21300b318c71-ca-trust-extracted\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 20:30:25.670010 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:25.669948    2583 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fd98fd1e-2a93-4be2-ba8c-21300b318c71-registry-tls\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 20:30:25.670010 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:25.669957    2583 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fd98fd1e-2a93-4be2-ba8c-21300b318c71-installation-pull-secrets\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 20:30:25.670010 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:25.669966    2583 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fd98fd1e-2a93-4be2-ba8c-21300b318c71-registry-certificates\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 20:30:25.670010 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:25.669974    2583 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fd98fd1e-2a93-4be2-ba8c-21300b318c71-bound-sa-token\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 20:30:25.670010 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:25.669982    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-grrfz\" (UniqueName: \"kubernetes.io/projected/fd98fd1e-2a93-4be2-ba8c-21300b318c71-kube-api-access-grrfz\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 20:30:25.774647 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:25.774617    2583 generic.go:356] "Generic (PLEG): container finished" podID="fd98fd1e-2a93-4be2-ba8c-21300b318c71" containerID="114dd3e25a185c3b7052079a133d96348126ebbe4bdec65f4fd1c783ca7ebc88" exitCode=0
Jul 30 20:30:25.774804 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:25.774653    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5b5c7c9c69-f9wj5" event={"ID":"fd98fd1e-2a93-4be2-ba8c-21300b318c71","Type":"ContainerDied","Data":"114dd3e25a185c3b7052079a133d96348126ebbe4bdec65f4fd1c783ca7ebc88"}
Jul 30 20:30:25.774804 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:25.774681    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5b5c7c9c69-f9wj5"
Jul 30 20:30:25.774804 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:25.774719    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5b5c7c9c69-f9wj5" event={"ID":"fd98fd1e-2a93-4be2-ba8c-21300b318c71","Type":"ContainerDied","Data":"25fc83e6e2f6c5300709b22a7b11d59a4429a17424792fc766af7b242508c934"}
Jul 30 20:30:25.774804 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:25.774763    2583 scope.go:117] "RemoveContainer" containerID="114dd3e25a185c3b7052079a133d96348126ebbe4bdec65f4fd1c783ca7ebc88"
Jul 30 20:30:25.784338 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:25.784322    2583 scope.go:117] "RemoveContainer" containerID="114dd3e25a185c3b7052079a133d96348126ebbe4bdec65f4fd1c783ca7ebc88"
Jul 30 20:30:25.784580 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:30:25.784553    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"114dd3e25a185c3b7052079a133d96348126ebbe4bdec65f4fd1c783ca7ebc88\": container with ID starting with 114dd3e25a185c3b7052079a133d96348126ebbe4bdec65f4fd1c783ca7ebc88 not found: ID does not exist" containerID="114dd3e25a185c3b7052079a133d96348126ebbe4bdec65f4fd1c783ca7ebc88"
Jul 30 20:30:25.784679 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:25.784586    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"114dd3e25a185c3b7052079a133d96348126ebbe4bdec65f4fd1c783ca7ebc88"} err="failed to get container status \"114dd3e25a185c3b7052079a133d96348126ebbe4bdec65f4fd1c783ca7ebc88\": rpc error: code = NotFound desc = could not find container \"114dd3e25a185c3b7052079a133d96348126ebbe4bdec65f4fd1c783ca7ebc88\": container with ID starting with 114dd3e25a185c3b7052079a133d96348126ebbe4bdec65f4fd1c783ca7ebc88 not found: ID does not exist"
Jul 30 20:30:25.796597 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:25.796577    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5b5c7c9c69-f9wj5"]
Jul 30 20:30:25.801941 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:25.801923    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5b5c7c9c69-f9wj5"]
Jul 30 20:30:26.674729 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:26.674693    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fd98fd1e-2a93-4be2-ba8c-21300b318c71" path="/var/lib/kubelet/pods/fd98fd1e-2a93-4be2-ba8c-21300b318c71/volumes"
Jul 30 20:30:28.268851 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:28.268818    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-bc4774bdd-hwwmz"]
Jul 30 20:30:29.275532 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:29.275496    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:30:29.325408 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:29.325376    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:30:31.760421 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:31.760386    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:30:31.859990 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:31.859960    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:30:32.505046 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:32.505010    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:30:32.560278 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:32.560250    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:30:33.806249 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:33.806221    2583 generic.go:356] "Generic (PLEG): container finished" podID="812ee652-511e-4dab-9074-2628140ca8a3" containerID="c7ca75771c3201d3c95800fdb50b1d4bfd8be0bd61eec9ac8f1f6c4b0682c0ce" exitCode=0
Jul 30 20:30:33.806655 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:33.806283    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-77696685b-dqzbs" event={"ID":"812ee652-511e-4dab-9074-2628140ca8a3","Type":"ContainerDied","Data":"c7ca75771c3201d3c95800fdb50b1d4bfd8be0bd61eec9ac8f1f6c4b0682c0ce"}
Jul 30 20:30:33.806655 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:33.806577    2583 scope.go:117] "RemoveContainer" containerID="c7ca75771c3201d3c95800fdb50b1d4bfd8be0bd61eec9ac8f1f6c4b0682c0ce"
Jul 30 20:30:34.811689 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:34.811656    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-77696685b-dqzbs" event={"ID":"812ee652-511e-4dab-9074-2628140ca8a3","Type":"ContainerStarted","Data":"9dd23c78356e3dfbc1f82b3e91b6ad8e78116ed76c7dfbfd2cbf0c8251e08701"}
Jul 30 20:30:35.307023 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:35.306986    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:30:35.361323 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:35.361293    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:30:37.219390 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:37.219352    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:30:48.867757 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:48.867681    2583 generic.go:356] "Generic (PLEG): container finished" podID="3a311c25-3179-42a6-a5cc-99c05ae6c65a" containerID="4c9681854e436bcbf59b73b88f1218f3f69e79ac403c2ed778389c3382697739" exitCode=0
Jul 30 20:30:48.868208 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:48.867757    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-84jg4" event={"ID":"3a311c25-3179-42a6-a5cc-99c05ae6c65a","Type":"ContainerDied","Data":"4c9681854e436bcbf59b73b88f1218f3f69e79ac403c2ed778389c3382697739"}
Jul 30 20:30:48.868208 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:48.868113    2583 scope.go:117] "RemoveContainer" containerID="4c9681854e436bcbf59b73b88f1218f3f69e79ac403c2ed778389c3382697739"
Jul 30 20:30:48.869124 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:48.869103    2583 generic.go:356] "Generic (PLEG): container finished" podID="68eefba9-2bbd-4248-8317-842a022ccaea" containerID="fc591cb47a14f6ca55f9826343283c34cce8bbb4587afaf736d392b3fdc32b37" exitCode=0
Jul 30 20:30:48.869244 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:48.869166    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-ss584" event={"ID":"68eefba9-2bbd-4248-8317-842a022ccaea","Type":"ContainerDied","Data":"fc591cb47a14f6ca55f9826343283c34cce8bbb4587afaf736d392b3fdc32b37"}
Jul 30 20:30:48.869414 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:48.869400    2583 scope.go:117] "RemoveContainer" containerID="fc591cb47a14f6ca55f9826343283c34cce8bbb4587afaf736d392b3fdc32b37"
Jul 30 20:30:49.875332 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:49.875295    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-84jg4" event={"ID":"3a311c25-3179-42a6-a5cc-99c05ae6c65a","Type":"ContainerStarted","Data":"56616d9b5e46cb51edd64e0ee9952934195118fcea1b3286b302d51776a45633"}
Jul 30 20:30:49.877187 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:49.877160    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-ss584" event={"ID":"68eefba9-2bbd-4248-8317-842a022ccaea","Type":"ContainerStarted","Data":"3d4d656b064983ae9937e847374bc753f83420d23784f8fb5de96c81ab4cc022"}
Jul 30 20:30:50.021958 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:50.021925    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:30:50.123027 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:50.122998    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:30:53.288622 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:53.288584    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-bc4774bdd-hwwmz" podUID="147dc20e-f885-4a43-bece-b4997996d418" containerName="console" containerID="cri-o://c7d65cfc18e975ddd0367ef33cb044846a8272c68122fe707743575b674a4128" gracePeriod=15
Jul 30 20:30:53.529938 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:53.529915    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bc4774bdd-hwwmz"
Jul 30 20:30:53.692838 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:53.692816    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/147dc20e-f885-4a43-bece-b4997996d418-console-oauth-config\") pod \"147dc20e-f885-4a43-bece-b4997996d418\" (UID: \"147dc20e-f885-4a43-bece-b4997996d418\") "
Jul 30 20:30:53.692978 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:53.692856    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/147dc20e-f885-4a43-bece-b4997996d418-service-ca\") pod \"147dc20e-f885-4a43-bece-b4997996d418\" (UID: \"147dc20e-f885-4a43-bece-b4997996d418\") "
Jul 30 20:30:53.692978 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:53.692876    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/147dc20e-f885-4a43-bece-b4997996d418-console-config\") pod \"147dc20e-f885-4a43-bece-b4997996d418\" (UID: \"147dc20e-f885-4a43-bece-b4997996d418\") "
Jul 30 20:30:53.692978 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:53.692901    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/147dc20e-f885-4a43-bece-b4997996d418-console-serving-cert\") pod \"147dc20e-f885-4a43-bece-b4997996d418\" (UID: \"147dc20e-f885-4a43-bece-b4997996d418\") "
Jul 30 20:30:53.692978 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:53.692938    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/147dc20e-f885-4a43-bece-b4997996d418-oauth-serving-cert\") pod \"147dc20e-f885-4a43-bece-b4997996d418\" (UID: \"147dc20e-f885-4a43-bece-b4997996d418\") "
Jul 30 20:30:53.692978 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:53.692979    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6m7d5\" (UniqueName: \"kubernetes.io/projected/147dc20e-f885-4a43-bece-b4997996d418-kube-api-access-6m7d5\") pod \"147dc20e-f885-4a43-bece-b4997996d418\" (UID: \"147dc20e-f885-4a43-bece-b4997996d418\") "
Jul 30 20:30:53.693320 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:53.693296    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/147dc20e-f885-4a43-bece-b4997996d418-console-config" (OuterVolumeSpecName: "console-config") pod "147dc20e-f885-4a43-bece-b4997996d418" (UID: "147dc20e-f885-4a43-bece-b4997996d418"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 20:30:53.693320 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:53.693305    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/147dc20e-f885-4a43-bece-b4997996d418-service-ca" (OuterVolumeSpecName: "service-ca") pod "147dc20e-f885-4a43-bece-b4997996d418" (UID: "147dc20e-f885-4a43-bece-b4997996d418"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 20:30:53.693430 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:53.693320    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/147dc20e-f885-4a43-bece-b4997996d418-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "147dc20e-f885-4a43-bece-b4997996d418" (UID: "147dc20e-f885-4a43-bece-b4997996d418"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 20:30:53.695220 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:53.695201    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/147dc20e-f885-4a43-bece-b4997996d418-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "147dc20e-f885-4a43-bece-b4997996d418" (UID: "147dc20e-f885-4a43-bece-b4997996d418"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 20:30:53.695288 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:53.695262    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/147dc20e-f885-4a43-bece-b4997996d418-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "147dc20e-f885-4a43-bece-b4997996d418" (UID: "147dc20e-f885-4a43-bece-b4997996d418"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 20:30:53.695324 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:53.695285    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/147dc20e-f885-4a43-bece-b4997996d418-kube-api-access-6m7d5" (OuterVolumeSpecName: "kube-api-access-6m7d5") pod "147dc20e-f885-4a43-bece-b4997996d418" (UID: "147dc20e-f885-4a43-bece-b4997996d418"). InnerVolumeSpecName "kube-api-access-6m7d5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:30:53.793869 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:53.793837    2583 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/147dc20e-f885-4a43-bece-b4997996d418-oauth-serving-cert\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 20:30:53.793869 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:53.793867    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6m7d5\" (UniqueName: \"kubernetes.io/projected/147dc20e-f885-4a43-bece-b4997996d418-kube-api-access-6m7d5\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 20:30:53.793869 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:53.793876    2583 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/147dc20e-f885-4a43-bece-b4997996d418-console-oauth-config\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 20:30:53.794025 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:53.793885    2583 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/147dc20e-f885-4a43-bece-b4997996d418-service-ca\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 20:30:53.794025 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:53.793895    2583 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/147dc20e-f885-4a43-bece-b4997996d418-console-config\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 20:30:53.794025 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:53.793902    2583 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/147dc20e-f885-4a43-bece-b4997996d418-console-serving-cert\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 20:30:53.892632 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:53.892610    2583 generic.go:356] "Generic (PLEG): container finished" podID="147dc20e-f885-4a43-bece-b4997996d418" containerID="c7d65cfc18e975ddd0367ef33cb044846a8272c68122fe707743575b674a4128" exitCode=0
Jul 30 20:30:53.892716 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:53.892654    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bc4774bdd-hwwmz"
Jul 30 20:30:53.892716 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:53.892671    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bc4774bdd-hwwmz" event={"ID":"147dc20e-f885-4a43-bece-b4997996d418","Type":"ContainerDied","Data":"c7d65cfc18e975ddd0367ef33cb044846a8272c68122fe707743575b674a4128"}
Jul 30 20:30:53.892716 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:53.892710    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bc4774bdd-hwwmz" event={"ID":"147dc20e-f885-4a43-bece-b4997996d418","Type":"ContainerDied","Data":"06261ae61d8ef7518b248a23cec333c55c525b0a15b52a44f22d45c086e20875"}
Jul 30 20:30:53.892809 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:53.892729    2583 scope.go:117] "RemoveContainer" containerID="c7d65cfc18e975ddd0367ef33cb044846a8272c68122fe707743575b674a4128"
Jul 30 20:30:53.900856 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:53.900840    2583 scope.go:117] "RemoveContainer" containerID="c7d65cfc18e975ddd0367ef33cb044846a8272c68122fe707743575b674a4128"
Jul 30 20:30:53.901101 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:30:53.901084    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c7d65cfc18e975ddd0367ef33cb044846a8272c68122fe707743575b674a4128\": container with ID starting with c7d65cfc18e975ddd0367ef33cb044846a8272c68122fe707743575b674a4128 not found: ID does not exist" containerID="c7d65cfc18e975ddd0367ef33cb044846a8272c68122fe707743575b674a4128"
Jul 30 20:30:53.901174 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:53.901109    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7d65cfc18e975ddd0367ef33cb044846a8272c68122fe707743575b674a4128"} err="failed to get container status \"c7d65cfc18e975ddd0367ef33cb044846a8272c68122fe707743575b674a4128\": rpc error: code = NotFound desc = could not find container \"c7d65cfc18e975ddd0367ef33cb044846a8272c68122fe707743575b674a4128\": container with ID starting with c7d65cfc18e975ddd0367ef33cb044846a8272c68122fe707743575b674a4128 not found: ID does not exist"
Jul 30 20:30:53.910827 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:53.910807    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-bc4774bdd-hwwmz"]
Jul 30 20:30:53.914738 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:53.914717    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-bc4774bdd-hwwmz"]
Jul 30 20:30:54.675483 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:54.675453    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="147dc20e-f885-4a43-bece-b4997996d418" path="/var/lib/kubelet/pods/147dc20e-f885-4a43-bece-b4997996d418/volumes"
Jul 30 20:30:59.615232 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:30:59.615198    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:31:02.550869 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:31:02.550821    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c27cd9e-72be-4a13-8deb-f4c3ffe3ecea-metrics-certs\") pod \"network-metrics-daemon-jfpt4\" (UID: \"9c27cd9e-72be-4a13-8deb-f4c3ffe3ecea\") " pod="openshift-multus/network-metrics-daemon-jfpt4"
Jul 30 20:31:02.553302 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:31:02.553282    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c27cd9e-72be-4a13-8deb-f4c3ffe3ecea-metrics-certs\") pod \"network-metrics-daemon-jfpt4\" (UID: \"9c27cd9e-72be-4a13-8deb-f4c3ffe3ecea\") " pod="openshift-multus/network-metrics-daemon-jfpt4"
Jul 30 20:31:02.673857 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:31:02.673827    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4nz9n\""
Jul 30 20:31:02.682433 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:31:02.682414    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jfpt4"
Jul 30 20:31:02.806830 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:31:02.806806    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-jfpt4"]
Jul 30 20:31:02.809101 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:31:02.809067    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c27cd9e_72be_4a13_8deb_f4c3ffe3ecea.slice/crio-545a93de6f63239260e80efecd0cd7e07df3bffc961c22138651b910544a09c2 WatchSource:0}: Error finding container 545a93de6f63239260e80efecd0cd7e07df3bffc961c22138651b910544a09c2: Status 404 returned error can't find the container with id 545a93de6f63239260e80efecd0cd7e07df3bffc961c22138651b910544a09c2
Jul 30 20:31:02.929188 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:31:02.929156    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jfpt4" event={"ID":"9c27cd9e-72be-4a13-8deb-f4c3ffe3ecea","Type":"ContainerStarted","Data":"545a93de6f63239260e80efecd0cd7e07df3bffc961c22138651b910544a09c2"}
Jul 30 20:31:04.938548 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:31:04.938502    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jfpt4" event={"ID":"9c27cd9e-72be-4a13-8deb-f4c3ffe3ecea","Type":"ContainerStarted","Data":"8cf40dd1b2bd4903a849e26c3d338c95395696e684f8176190bff89bdcd01fc5"}
Jul 30 20:31:04.938922 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:31:04.938567    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jfpt4" event={"ID":"9c27cd9e-72be-4a13-8deb-f4c3ffe3ecea","Type":"ContainerStarted","Data":"0c8fe20cb37cb429bfd1b64434b58e9702ff4e4372fa0c20c1c3e952d7d13142"}
Jul 30 20:31:04.954858 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:31:04.954815    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-jfpt4" podStartSLOduration=374.889026316 podStartE2EDuration="6m15.954799895s" totalImagesPullingTime="1.065773579s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:24:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:31:04.953216709 +0000 UTC m=+376.794692335" watchObservedRunningTime="2026-07-30 20:31:04.954799895 +0000 UTC m=+376.796275518"
Jul 30 20:31:05.042971 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:31:05.042930    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:31:05.114465 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:31:05.114442    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:31:07.757747 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:31:07.757711    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:31:07.852664 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:31:07.852633    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:31:19.558521 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:31:19.558488    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-68875d4b88-s2rwb"]
Jul 30 20:31:19.558972 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:31:19.558935    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="147dc20e-f885-4a43-bece-b4997996d418" containerName="console"
Jul 30 20:31:19.558972 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:31:19.558952    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="147dc20e-f885-4a43-bece-b4997996d418" containerName="console"
Jul 30 20:31:19.558972 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:31:19.558968    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd98fd1e-2a93-4be2-ba8c-21300b318c71" containerName="registry"
Jul 30 20:31:19.559071 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:31:19.558976    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd98fd1e-2a93-4be2-ba8c-21300b318c71" containerName="registry"
Jul 30 20:31:19.559071 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:31:19.559043    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="147dc20e-f885-4a43-bece-b4997996d418" containerName="console"
Jul 30 20:31:19.559071 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:31:19.559052    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd98fd1e-2a93-4be2-ba8c-21300b318c71" containerName="registry"
Jul 30 20:31:19.561968 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:31:19.561953    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68875d4b88-s2rwb"
Jul 30 20:31:19.564032 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:31:19.564007    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 30 20:31:19.564184 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:31:19.564105    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 30 20:31:19.564184 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:31:19.564122    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 30 20:31:19.564745 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:31:19.564715    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 30 20:31:19.564745 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:31:19.564739    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-mf675\""
Jul 30 20:31:19.564899 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:31:19.564801    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 30 20:31:19.564899 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:31:19.564850    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 30 20:31:19.565070 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:31:19.565058    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 30 20:31:19.570397 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:31:19.569683    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 30 20:31:19.570971 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:31:19.570952    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-68875d4b88-s2rwb"]
Jul 30 20:31:19.601639 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:31:19.601617    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:31:19.656194 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:31:19.656164    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:31:19.659593 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:31:19.659574    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9706a4e1-98cd-4850-bcb6-609e5b6a2421-console-oauth-config\") pod \"console-68875d4b88-s2rwb\" (UID: \"9706a4e1-98cd-4850-bcb6-609e5b6a2421\") " pod="openshift-console/console-68875d4b88-s2rwb"
Jul 30 20:31:19.659657 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:31:19.659610    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9706a4e1-98cd-4850-bcb6-609e5b6a2421-service-ca\") pod \"console-68875d4b88-s2rwb\" (UID: \"9706a4e1-98cd-4850-bcb6-609e5b6a2421\") " pod="openshift-console/console-68875d4b88-s2rwb"
Jul 30 20:31:19.659657 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:31:19.659643    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4kz2q\" (UniqueName: \"kubernetes.io/projected/9706a4e1-98cd-4850-bcb6-609e5b6a2421-kube-api-access-4kz2q\") pod \"console-68875d4b88-s2rwb\" (UID: \"9706a4e1-98cd-4850-bcb6-609e5b6a2421\") " pod="openshift-console/console-68875d4b88-s2rwb"
Jul 30 20:31:19.659725 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:31:19.659687    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9706a4e1-98cd-4850-bcb6-609e5b6a2421-console-serving-cert\") pod \"console-68875d4b88-s2rwb\" (UID: \"9706a4e1-98cd-4850-bcb6-609e5b6a2421\") " pod="openshift-console/console-68875d4b88-s2rwb"
Jul 30 20:31:19.659725 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:31:19.659709    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9706a4e1-98cd-4850-bcb6-609e5b6a2421-oauth-serving-cert\") pod \"console-68875d4b88-s2rwb\" (UID: \"9706a4e1-98cd-4850-bcb6-609e5b6a2421\") " pod="openshift-console/console-68875d4b88-s2rwb"
Jul 30 20:31:19.659784 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:31:19.659733    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9706a4e1-98cd-4850-bcb6-609e5b6a2421-trusted-ca-bundle\") pod \"console-68875d4b88-s2rwb\" (UID: \"9706a4e1-98cd-4850-bcb6-609e5b6a2421\") " pod="openshift-console/console-68875d4b88-s2rwb"
Jul 30 20:31:19.659784 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:31:19.659750    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9706a4e1-98cd-4850-bcb6-609e5b6a2421-console-config\") pod \"console-68875d4b88-s2rwb\" (UID: \"9706a4e1-98cd-4850-bcb6-609e5b6a2421\") " pod="openshift-console/console-68875d4b88-s2rwb"
Jul 30 20:31:19.712968 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:31:19.712945    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:31:19.760709 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:31:19.760689    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9706a4e1-98cd-4850-bcb6-609e5b6a2421-service-ca\") pod \"console-68875d4b88-s2rwb\" (UID: \"9706a4e1-98cd-4850-bcb6-609e5b6a2421\") " pod="openshift-console/console-68875d4b88-s2rwb"
Jul 30 20:31:19.760787 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:31:19.760720    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4kz2q\" (UniqueName: \"kubernetes.io/projected/9706a4e1-98cd-4850-bcb6-609e5b6a2421-kube-api-access-4kz2q\") pod \"console-68875d4b88-s2rwb\" (UID: \"9706a4e1-98cd-4850-bcb6-609e5b6a2421\") " pod="openshift-console/console-68875d4b88-s2rwb"
Jul 30 20:31:19.760787 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:31:19.760753    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9706a4e1-98cd-4850-bcb6-609e5b6a2421-console-serving-cert\") pod \"console-68875d4b88-s2rwb\" (UID: \"9706a4e1-98cd-4850-bcb6-609e5b6a2421\") " pod="openshift-console/console-68875d4b88-s2rwb"
Jul 30 20:31:19.760787 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:31:19.760775    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9706a4e1-98cd-4850-bcb6-609e5b6a2421-oauth-serving-cert\") pod \"console-68875d4b88-s2rwb\" (UID: \"9706a4e1-98cd-4850-bcb6-609e5b6a2421\") " pod="openshift-console/console-68875d4b88-s2rwb"
Jul 30 20:31:19.760918 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:31:19.760814    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9706a4e1-98cd-4850-bcb6-609e5b6a2421-trusted-ca-bundle\") pod \"console-68875d4b88-s2rwb\" (UID: \"9706a4e1-98cd-4850-bcb6-609e5b6a2421\") " pod="openshift-console/console-68875d4b88-s2rwb"
Jul 30 20:31:19.760918 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:31:19.760837    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9706a4e1-98cd-4850-bcb6-609e5b6a2421-console-config\") pod \"console-68875d4b88-s2rwb\" (UID: \"9706a4e1-98cd-4850-bcb6-609e5b6a2421\") " pod="openshift-console/console-68875d4b88-s2rwb"
Jul 30 20:31:19.760918 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:31:19.760861    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9706a4e1-98cd-4850-bcb6-609e5b6a2421-console-oauth-config\") pod \"console-68875d4b88-s2rwb\" (UID: \"9706a4e1-98cd-4850-bcb6-609e5b6a2421\") " pod="openshift-console/console-68875d4b88-s2rwb"
Jul 30 20:31:19.761483 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:31:19.761462    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9706a4e1-98cd-4850-bcb6-609e5b6a2421-console-config\") pod \"console-68875d4b88-s2rwb\" (UID: \"9706a4e1-98cd-4850-bcb6-609e5b6a2421\") " pod="openshift-console/console-68875d4b88-s2rwb"
Jul 30 20:31:19.761563 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:31:19.761510    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9706a4e1-98cd-4850-bcb6-609e5b6a2421-service-ca\") pod \"console-68875d4b88-s2rwb\" (UID: \"9706a4e1-98cd-4850-bcb6-609e5b6a2421\") " pod="openshift-console/console-68875d4b88-s2rwb"
Jul 30 20:31:19.761602 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:31:19.761573    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9706a4e1-98cd-4850-bcb6-609e5b6a2421-oauth-serving-cert\") pod \"console-68875d4b88-s2rwb\" (UID: \"9706a4e1-98cd-4850-bcb6-609e5b6a2421\") " pod="openshift-console/console-68875d4b88-s2rwb"
Jul 30 20:31:19.761990 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:31:19.761966    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9706a4e1-98cd-4850-bcb6-609e5b6a2421-trusted-ca-bundle\") pod \"console-68875d4b88-s2rwb\" (UID: \"9706a4e1-98cd-4850-bcb6-609e5b6a2421\") " pod="openshift-console/console-68875d4b88-s2rwb"
Jul 30 20:31:19.763394 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:31:19.763368    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9706a4e1-98cd-4850-bcb6-609e5b6a2421-console-oauth-config\") pod \"console-68875d4b88-s2rwb\" (UID: \"9706a4e1-98cd-4850-bcb6-609e5b6a2421\") " pod="openshift-console/console-68875d4b88-s2rwb"
Jul 30 20:31:19.763394 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:31:19.763387    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9706a4e1-98cd-4850-bcb6-609e5b6a2421-console-serving-cert\") pod \"console-68875d4b88-s2rwb\" (UID: \"9706a4e1-98cd-4850-bcb6-609e5b6a2421\") " pod="openshift-console/console-68875d4b88-s2rwb"
Jul 30 20:31:19.769089 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:31:19.769067    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4kz2q\" (UniqueName: \"kubernetes.io/projected/9706a4e1-98cd-4850-bcb6-609e5b6a2421-kube-api-access-4kz2q\") pod \"console-68875d4b88-s2rwb\" (UID: \"9706a4e1-98cd-4850-bcb6-609e5b6a2421\") " pod="openshift-console/console-68875d4b88-s2rwb"
Jul 30 20:31:19.872753 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:31:19.872695    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68875d4b88-s2rwb"
Jul 30 20:31:20.024252 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:31:20.024221    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-68875d4b88-s2rwb"]
Jul 30 20:31:20.027494 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:31:20.027470    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9706a4e1_98cd_4850_bcb6_609e5b6a2421.slice/crio-f79908a78b4ee8c5daa28f4c03a60bfe363f6c18d9e51c07ceb69e35d9203e6c WatchSource:0}: Error finding container f79908a78b4ee8c5daa28f4c03a60bfe363f6c18d9e51c07ceb69e35d9203e6c: Status 404 returned error can't find the container with id f79908a78b4ee8c5daa28f4c03a60bfe363f6c18d9e51c07ceb69e35d9203e6c
Jul 30 20:31:21.004583 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:31:21.004550    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68875d4b88-s2rwb" event={"ID":"9706a4e1-98cd-4850-bcb6-609e5b6a2421","Type":"ContainerStarted","Data":"9593bf37b5e7cb80a2153c3897dd12a2b7e34097ed82dbcaf59983a360f2aa98"}
Jul 30 20:31:21.005010 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:31:21.004604    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68875d4b88-s2rwb" event={"ID":"9706a4e1-98cd-4850-bcb6-609e5b6a2421","Type":"ContainerStarted","Data":"f79908a78b4ee8c5daa28f4c03a60bfe363f6c18d9e51c07ceb69e35d9203e6c"}
Jul 30 20:31:21.021112 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:31:21.021062    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-68875d4b88-s2rwb" podStartSLOduration=2.021049457 podStartE2EDuration="2.021049457s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:31:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:31:21.01983611 +0000 UTC m=+392.861311731" watchObservedRunningTime="2026-07-30 20:31:21.021049457 +0000 UTC m=+392.862525077"
Jul 30 20:31:29.578859 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:31:29.578821    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:31:29.631468 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:31:29.631438    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:31:29.873012 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:31:29.872934    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-68875d4b88-s2rwb"
Jul 30 20:31:29.873012 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:31:29.872985    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-68875d4b88-s2rwb"
Jul 30 20:31:29.877619 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:31:29.877599    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-68875d4b88-s2rwb"
Jul 30 20:31:30.042302 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:31:30.042262    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-68875d4b88-s2rwb"
Jul 30 20:31:30.177468 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:31:30.177440    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:31:30.277990 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:31:30.277964    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:31:30.334206 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:31:30.334185    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:31:35.028598 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:31:35.028565    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:31:35.132750 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:31:35.132719    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:31:37.788536 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:31:37.788495    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:31:37.890120 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:31:37.890079    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:32:04.600675 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:32:04.600637    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:32:04.659866 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:32:04.659830    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:32:28.263112 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:32:28.263075    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:32:28.361159 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:32:28.361110    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:32:28.872285 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:32:28.872250    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540w2cj9"]
Jul 30 20:32:28.875723 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:32:28.875708    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540w2cj9"
Jul 30 20:32:28.877668 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:32:28.877643    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 30 20:32:28.878232 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:32:28.878215    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-qlc5n\""
Jul 30 20:32:28.878298 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:32:28.878247    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 30 20:32:28.884601 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:32:28.884578    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540w2cj9"]
Jul 30 20:32:28.892495 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:32:28.892466    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7bd7bcf5-1747-4673-af69-c355973c7cd3-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540w2cj9\" (UID: \"7bd7bcf5-1747-4673-af69-c355973c7cd3\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540w2cj9"
Jul 30 20:32:28.892613 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:32:28.892502    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7bd7bcf5-1747-4673-af69-c355973c7cd3-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540w2cj9\" (UID: \"7bd7bcf5-1747-4673-af69-c355973c7cd3\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540w2cj9"
Jul 30 20:32:28.892613 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:32:28.892520    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qsvhm\" (UniqueName: \"kubernetes.io/projected/7bd7bcf5-1747-4673-af69-c355973c7cd3-kube-api-access-qsvhm\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540w2cj9\" (UID: \"7bd7bcf5-1747-4673-af69-c355973c7cd3\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540w2cj9"
Jul 30 20:32:28.993505 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:32:28.993473    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7bd7bcf5-1747-4673-af69-c355973c7cd3-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540w2cj9\" (UID: \"7bd7bcf5-1747-4673-af69-c355973c7cd3\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540w2cj9"
Jul 30 20:32:28.993505 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:32:28.993506    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7bd7bcf5-1747-4673-af69-c355973c7cd3-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540w2cj9\" (UID: \"7bd7bcf5-1747-4673-af69-c355973c7cd3\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540w2cj9"
Jul 30 20:32:28.993713 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:32:28.993529    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qsvhm\" (UniqueName: \"kubernetes.io/projected/7bd7bcf5-1747-4673-af69-c355973c7cd3-kube-api-access-qsvhm\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540w2cj9\" (UID: \"7bd7bcf5-1747-4673-af69-c355973c7cd3\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540w2cj9"
Jul 30 20:32:28.993931 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:32:28.993905    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7bd7bcf5-1747-4673-af69-c355973c7cd3-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540w2cj9\" (UID: \"7bd7bcf5-1747-4673-af69-c355973c7cd3\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540w2cj9"
Jul 30 20:32:28.993979 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:32:28.993965    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7bd7bcf5-1747-4673-af69-c355973c7cd3-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540w2cj9\" (UID: \"7bd7bcf5-1747-4673-af69-c355973c7cd3\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540w2cj9"
Jul 30 20:32:29.001098 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:32:29.001072    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qsvhm\" (UniqueName: \"kubernetes.io/projected/7bd7bcf5-1747-4673-af69-c355973c7cd3-kube-api-access-qsvhm\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540w2cj9\" (UID: \"7bd7bcf5-1747-4673-af69-c355973c7cd3\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540w2cj9"
Jul 30 20:32:29.186065 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:32:29.186027    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540w2cj9"
Jul 30 20:32:29.321679 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:32:29.321633    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540w2cj9"]
Jul 30 20:32:29.324717 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:32:29.324663    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7bd7bcf5_1747_4673_af69_c355973c7cd3.slice/crio-6b57a86f685e04379e8fb1dfc7e29c01d901c06057ce606a6c56be86393a3f4c WatchSource:0}: Error finding container 6b57a86f685e04379e8fb1dfc7e29c01d901c06057ce606a6c56be86393a3f4c: Status 404 returned error can't find the container with id 6b57a86f685e04379e8fb1dfc7e29c01d901c06057ce606a6c56be86393a3f4c
Jul 30 20:32:30.282589 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:32:30.282551    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540w2cj9" event={"ID":"7bd7bcf5-1747-4673-af69-c355973c7cd3","Type":"ContainerStarted","Data":"6b57a86f685e04379e8fb1dfc7e29c01d901c06057ce606a6c56be86393a3f4c"}
Jul 30 20:32:36.309845 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:32:36.309805    2583 generic.go:356] "Generic (PLEG): container finished" podID="7bd7bcf5-1747-4673-af69-c355973c7cd3" containerID="253483ac54a6c34647fd8ba5c9f863b6bcc06d9da36af064f1eecd74c15e2103" exitCode=0
Jul 30 20:32:36.310268 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:32:36.309883    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540w2cj9" event={"ID":"7bd7bcf5-1747-4673-af69-c355973c7cd3","Type":"ContainerDied","Data":"253483ac54a6c34647fd8ba5c9f863b6bcc06d9da36af064f1eecd74c15e2103"}
Jul 30 20:32:38.322859 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:32:38.322797    2583 generic.go:356] "Generic (PLEG): container finished" podID="7bd7bcf5-1747-4673-af69-c355973c7cd3" containerID="3eaea14a1800f449e1d41ddeabf62f1e40d59c87b95dbfe23f6e0feb5e4d61a1" exitCode=0
Jul 30 20:32:38.323183 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:32:38.322878    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540w2cj9" event={"ID":"7bd7bcf5-1747-4673-af69-c355973c7cd3","Type":"ContainerDied","Data":"3eaea14a1800f449e1d41ddeabf62f1e40d59c87b95dbfe23f6e0feb5e4d61a1"}
Jul 30 20:32:46.359970 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:32:46.359929    2583 generic.go:356] "Generic (PLEG): container finished" podID="7bd7bcf5-1747-4673-af69-c355973c7cd3" containerID="eb5b9b45bd73c4b8ab81f759b825f12841792c3348c1e92bb1fab7fa4cc180f2" exitCode=0
Jul 30 20:32:46.360385 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:32:46.360046    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540w2cj9" event={"ID":"7bd7bcf5-1747-4673-af69-c355973c7cd3","Type":"ContainerDied","Data":"eb5b9b45bd73c4b8ab81f759b825f12841792c3348c1e92bb1fab7fa4cc180f2"}
Jul 30 20:32:47.498543 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:32:47.498518    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540w2cj9"
Jul 30 20:32:47.550880 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:32:47.550829    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7bd7bcf5-1747-4673-af69-c355973c7cd3-bundle\") pod \"7bd7bcf5-1747-4673-af69-c355973c7cd3\" (UID: \"7bd7bcf5-1747-4673-af69-c355973c7cd3\") "
Jul 30 20:32:47.551071 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:32:47.550945    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7bd7bcf5-1747-4673-af69-c355973c7cd3-util\") pod \"7bd7bcf5-1747-4673-af69-c355973c7cd3\" (UID: \"7bd7bcf5-1747-4673-af69-c355973c7cd3\") "
Jul 30 20:32:47.551071 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:32:47.550969    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qsvhm\" (UniqueName: \"kubernetes.io/projected/7bd7bcf5-1747-4673-af69-c355973c7cd3-kube-api-access-qsvhm\") pod \"7bd7bcf5-1747-4673-af69-c355973c7cd3\" (UID: \"7bd7bcf5-1747-4673-af69-c355973c7cd3\") "
Jul 30 20:32:47.551620 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:32:47.551594    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7bd7bcf5-1747-4673-af69-c355973c7cd3-bundle" (OuterVolumeSpecName: "bundle") pod "7bd7bcf5-1747-4673-af69-c355973c7cd3" (UID: "7bd7bcf5-1747-4673-af69-c355973c7cd3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:32:47.553443 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:32:47.553417    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7bd7bcf5-1747-4673-af69-c355973c7cd3-kube-api-access-qsvhm" (OuterVolumeSpecName: "kube-api-access-qsvhm") pod "7bd7bcf5-1747-4673-af69-c355973c7cd3" (UID: "7bd7bcf5-1747-4673-af69-c355973c7cd3"). InnerVolumeSpecName "kube-api-access-qsvhm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:32:47.554858 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:32:47.554832    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7bd7bcf5-1747-4673-af69-c355973c7cd3-util" (OuterVolumeSpecName: "util") pod "7bd7bcf5-1747-4673-af69-c355973c7cd3" (UID: "7bd7bcf5-1747-4673-af69-c355973c7cd3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:32:47.651961 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:32:47.651933    2583 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7bd7bcf5-1747-4673-af69-c355973c7cd3-bundle\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 20:32:47.651961 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:32:47.651960    2583 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7bd7bcf5-1747-4673-af69-c355973c7cd3-util\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 20:32:47.652168 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:32:47.651969    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qsvhm\" (UniqueName: \"kubernetes.io/projected/7bd7bcf5-1747-4673-af69-c355973c7cd3-kube-api-access-qsvhm\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 20:32:48.372004 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:32:48.371967    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540w2cj9" event={"ID":"7bd7bcf5-1747-4673-af69-c355973c7cd3","Type":"ContainerDied","Data":"6b57a86f685e04379e8fb1dfc7e29c01d901c06057ce606a6c56be86393a3f4c"}
Jul 30 20:32:48.372004 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:32:48.372014    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6b57a86f685e04379e8fb1dfc7e29c01d901c06057ce606a6c56be86393a3f4c"
Jul 30 20:32:48.372228 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:32:48.371980    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540w2cj9"
Jul 30 20:32:49.854399 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:32:49.854366    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:32:50.703577 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:32:50.703543    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:32:51.807906 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:32:51.807874    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-t9jtv"]
Jul 30 20:32:51.808315 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:32:51.808210    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7bd7bcf5-1747-4673-af69-c355973c7cd3" containerName="extract"
Jul 30 20:32:51.808315 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:32:51.808223    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="7bd7bcf5-1747-4673-af69-c355973c7cd3" containerName="extract"
Jul 30 20:32:51.808315 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:32:51.808247    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7bd7bcf5-1747-4673-af69-c355973c7cd3" containerName="util"
Jul 30 20:32:51.808315 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:32:51.808252    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="7bd7bcf5-1747-4673-af69-c355973c7cd3" containerName="util"
Jul 30 20:32:51.808315 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:32:51.808258    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7bd7bcf5-1747-4673-af69-c355973c7cd3" containerName="pull"
Jul 30 20:32:51.808315 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:32:51.808264    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="7bd7bcf5-1747-4673-af69-c355973c7cd3" containerName="pull"
Jul 30 20:32:51.808315 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:32:51.808313    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="7bd7bcf5-1747-4673-af69-c355973c7cd3" containerName="extract"
Jul 30 20:32:51.840713 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:32:51.840683    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-t9jtv"]
Jul 30 20:32:51.840869 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:32:51.840799    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-t9jtv"
Jul 30 20:32:51.843187 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:32:51.843161    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 30 20:32:51.843187 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:32:51.843165    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 30 20:32:51.843350 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:32:51.843196    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-pf9l9\""
Jul 30 20:32:51.993246 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:32:51.993210    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9ceee0dd-1fbc-48d2-a185-710c7bbcf005-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-t9jtv\" (UID: \"9ceee0dd-1fbc-48d2-a185-710c7bbcf005\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-t9jtv"
Jul 30 20:32:51.993437 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:32:51.993266    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wgqk8\" (UniqueName: \"kubernetes.io/projected/9ceee0dd-1fbc-48d2-a185-710c7bbcf005-kube-api-access-wgqk8\") pod \"cert-manager-operator-controller-manager-55c444bf86-t9jtv\" (UID: \"9ceee0dd-1fbc-48d2-a185-710c7bbcf005\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-t9jtv"
Jul 30 20:32:52.094498 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:32:52.094411    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9ceee0dd-1fbc-48d2-a185-710c7bbcf005-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-t9jtv\" (UID: \"9ceee0dd-1fbc-48d2-a185-710c7bbcf005\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-t9jtv"
Jul 30 20:32:52.094498 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:32:52.094467    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgqk8\" (UniqueName: \"kubernetes.io/projected/9ceee0dd-1fbc-48d2-a185-710c7bbcf005-kube-api-access-wgqk8\") pod \"cert-manager-operator-controller-manager-55c444bf86-t9jtv\" (UID: \"9ceee0dd-1fbc-48d2-a185-710c7bbcf005\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-t9jtv"
Jul 30 20:32:52.094808 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:32:52.094790    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9ceee0dd-1fbc-48d2-a185-710c7bbcf005-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-t9jtv\" (UID: \"9ceee0dd-1fbc-48d2-a185-710c7bbcf005\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-t9jtv"
Jul 30 20:32:52.102418 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:32:52.102398    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgqk8\" (UniqueName: \"kubernetes.io/projected/9ceee0dd-1fbc-48d2-a185-710c7bbcf005-kube-api-access-wgqk8\") pod \"cert-manager-operator-controller-manager-55c444bf86-t9jtv\" (UID: \"9ceee0dd-1fbc-48d2-a185-710c7bbcf005\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-t9jtv"
Jul 30 20:32:52.149969 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:32:52.149937    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-t9jtv"
Jul 30 20:32:52.299356 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:32:52.299332    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-t9jtv"]
Jul 30 20:32:52.302158 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:32:52.302119    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ceee0dd_1fbc_48d2_a185_710c7bbcf005.slice/crio-4556231384e46271a15d4bcbf2bfddd06631e3e0c34b7cdb396f48aaedaa1336 WatchSource:0}: Error finding container 4556231384e46271a15d4bcbf2bfddd06631e3e0c34b7cdb396f48aaedaa1336: Status 404 returned error can't find the container with id 4556231384e46271a15d4bcbf2bfddd06631e3e0c34b7cdb396f48aaedaa1336
Jul 30 20:32:52.389767 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:32:52.389690    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-t9jtv" event={"ID":"9ceee0dd-1fbc-48d2-a185-710c7bbcf005","Type":"ContainerStarted","Data":"4556231384e46271a15d4bcbf2bfddd06631e3e0c34b7cdb396f48aaedaa1336"}
Jul 30 20:32:53.471851 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:32:53.471813    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:32:53.575360 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:32:53.575326    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:32:55.262191 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:32:55.262153    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:32:55.359337 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:32:55.359304    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:32:55.406992 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:32:55.406957    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-t9jtv" event={"ID":"9ceee0dd-1fbc-48d2-a185-710c7bbcf005","Type":"ContainerStarted","Data":"748cb6132961021de023a49ce60797342d042bba446444d431636a795403cd01"}
Jul 30 20:32:55.427129 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:32:55.427083    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-t9jtv" podStartSLOduration=2.230177314 podStartE2EDuration="4.427069097s" totalImagesPullingTime="2.196891783s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:32:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:32:55.425299002 +0000 UTC m=+487.266774623" watchObservedRunningTime="2026-07-30 20:32:55.427069097 +0000 UTC m=+487.268544719"
Jul 30 20:32:55.948509 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:32:55.948474    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:32:56.061164 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:32:56.061103    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:32:56.230366 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:32:56.230268    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzqrdx"]
Jul 30 20:32:56.254669 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:32:56.254638    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzqrdx"
Jul 30 20:32:56.257558 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:32:56.257537    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 30 20:32:56.258000 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:32:56.257983    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 30 20:32:56.258267 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:32:56.258252    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-qlc5n\""
Jul 30 20:32:56.263037 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:32:56.263012    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzqrdx"]
Jul 30 20:32:56.329100 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:32:56.329068    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8c3fd2a9-27dc-42c5-a1ea-5077a9e47685-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzqrdx\" (UID: \"8c3fd2a9-27dc-42c5-a1ea-5077a9e47685\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzqrdx"
Jul 30 20:32:56.329351 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:32:56.329109    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8c3fd2a9-27dc-42c5-a1ea-5077a9e47685-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzqrdx\" (UID: \"8c3fd2a9-27dc-42c5-a1ea-5077a9e47685\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzqrdx"
Jul 30 20:32:56.329351 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:32:56.329178    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kt6k8\" (UniqueName: \"kubernetes.io/projected/8c3fd2a9-27dc-42c5-a1ea-5077a9e47685-kube-api-access-kt6k8\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzqrdx\" (UID: \"8c3fd2a9-27dc-42c5-a1ea-5077a9e47685\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzqrdx"
Jul 30 20:32:56.429710 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:32:56.429682    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kt6k8\" (UniqueName: \"kubernetes.io/projected/8c3fd2a9-27dc-42c5-a1ea-5077a9e47685-kube-api-access-kt6k8\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzqrdx\" (UID: \"8c3fd2a9-27dc-42c5-a1ea-5077a9e47685\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzqrdx"
Jul 30 20:32:56.429891 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:32:56.429750    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8c3fd2a9-27dc-42c5-a1ea-5077a9e47685-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzqrdx\" (UID: \"8c3fd2a9-27dc-42c5-a1ea-5077a9e47685\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzqrdx"
Jul 30 20:32:56.429891 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:32:56.429789    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8c3fd2a9-27dc-42c5-a1ea-5077a9e47685-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzqrdx\" (UID: \"8c3fd2a9-27dc-42c5-a1ea-5077a9e47685\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzqrdx"
Jul 30 20:32:56.430273 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:32:56.430256    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8c3fd2a9-27dc-42c5-a1ea-5077a9e47685-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzqrdx\" (UID: \"8c3fd2a9-27dc-42c5-a1ea-5077a9e47685\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzqrdx"
Jul 30 20:32:56.430322 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:32:56.430294    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8c3fd2a9-27dc-42c5-a1ea-5077a9e47685-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzqrdx\" (UID: \"8c3fd2a9-27dc-42c5-a1ea-5077a9e47685\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzqrdx"
Jul 30 20:32:56.440623 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:32:56.440604    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kt6k8\" (UniqueName: \"kubernetes.io/projected/8c3fd2a9-27dc-42c5-a1ea-5077a9e47685-kube-api-access-kt6k8\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzqrdx\" (UID: \"8c3fd2a9-27dc-42c5-a1ea-5077a9e47685\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzqrdx"
Jul 30 20:32:56.565409 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:32:56.565314    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzqrdx"
Jul 30 20:32:56.699953 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:32:56.699931    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzqrdx"]
Jul 30 20:32:56.702205 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:32:56.702174    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c3fd2a9_27dc_42c5_a1ea_5077a9e47685.slice/crio-904bf5bf495fd711c6b43b596bbf9c3609587f1c543a06c95227430bf903afb1 WatchSource:0}: Error finding container 904bf5bf495fd711c6b43b596bbf9c3609587f1c543a06c95227430bf903afb1: Status 404 returned error can't find the container with id 904bf5bf495fd711c6b43b596bbf9c3609587f1c543a06c95227430bf903afb1
Jul 30 20:32:57.255763 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:32:57.255722    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:32:57.417493 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:32:57.417457    2583 generic.go:356] "Generic (PLEG): container finished" podID="8c3fd2a9-27dc-42c5-a1ea-5077a9e47685" containerID="e359d467c6527548da1cbb96c258dc35227f410f5d0488d343e96bcb7fc1e509" exitCode=0
Jul 30 20:32:57.417892 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:32:57.417524    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzqrdx" event={"ID":"8c3fd2a9-27dc-42c5-a1ea-5077a9e47685","Type":"ContainerDied","Data":"e359d467c6527548da1cbb96c258dc35227f410f5d0488d343e96bcb7fc1e509"}
Jul 30 20:32:57.417892 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:32:57.417577    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzqrdx" event={"ID":"8c3fd2a9-27dc-42c5-a1ea-5077a9e47685","Type":"ContainerStarted","Data":"904bf5bf495fd711c6b43b596bbf9c3609587f1c543a06c95227430bf903afb1"}
Jul 30 20:32:57.631181 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:32:57.631084    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:33:00.433802 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:00.433766    2583 generic.go:356] "Generic (PLEG): container finished" podID="8c3fd2a9-27dc-42c5-a1ea-5077a9e47685" containerID="dfd6a55309e9a9590cec5e7b72bed321792675449bb63c17bccb08c96495f7da" exitCode=0
Jul 30 20:33:00.434220 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:00.433820    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzqrdx" event={"ID":"8c3fd2a9-27dc-42c5-a1ea-5077a9e47685","Type":"ContainerDied","Data":"dfd6a55309e9a9590cec5e7b72bed321792675449bb63c17bccb08c96495f7da"}
Jul 30 20:33:00.465478 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:00.465440    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:33:00.520870 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:00.520839    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:33:01.440479 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:01.440441    2583 generic.go:356] "Generic (PLEG): container finished" podID="8c3fd2a9-27dc-42c5-a1ea-5077a9e47685" containerID="3f8650e05385c199a2a9826b1a5a51eea86ed787036922b5c8ab93bdab423069" exitCode=0
Jul 30 20:33:01.440879 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:01.440496    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzqrdx" event={"ID":"8c3fd2a9-27dc-42c5-a1ea-5077a9e47685","Type":"ContainerDied","Data":"3f8650e05385c199a2a9826b1a5a51eea86ed787036922b5c8ab93bdab423069"}
Jul 30 20:33:02.587188 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:02.587165    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzqrdx"
Jul 30 20:33:02.686727 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:02.686700    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kt6k8\" (UniqueName: \"kubernetes.io/projected/8c3fd2a9-27dc-42c5-a1ea-5077a9e47685-kube-api-access-kt6k8\") pod \"8c3fd2a9-27dc-42c5-a1ea-5077a9e47685\" (UID: \"8c3fd2a9-27dc-42c5-a1ea-5077a9e47685\") "
Jul 30 20:33:02.686891 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:02.686755    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8c3fd2a9-27dc-42c5-a1ea-5077a9e47685-util\") pod \"8c3fd2a9-27dc-42c5-a1ea-5077a9e47685\" (UID: \"8c3fd2a9-27dc-42c5-a1ea-5077a9e47685\") "
Jul 30 20:33:02.686891 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:02.686788    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8c3fd2a9-27dc-42c5-a1ea-5077a9e47685-bundle\") pod \"8c3fd2a9-27dc-42c5-a1ea-5077a9e47685\" (UID: \"8c3fd2a9-27dc-42c5-a1ea-5077a9e47685\") "
Jul 30 20:33:02.687258 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:02.687235    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c3fd2a9-27dc-42c5-a1ea-5077a9e47685-bundle" (OuterVolumeSpecName: "bundle") pod "8c3fd2a9-27dc-42c5-a1ea-5077a9e47685" (UID: "8c3fd2a9-27dc-42c5-a1ea-5077a9e47685"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:33:02.688909 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:02.688883    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c3fd2a9-27dc-42c5-a1ea-5077a9e47685-kube-api-access-kt6k8" (OuterVolumeSpecName: "kube-api-access-kt6k8") pod "8c3fd2a9-27dc-42c5-a1ea-5077a9e47685" (UID: "8c3fd2a9-27dc-42c5-a1ea-5077a9e47685"). InnerVolumeSpecName "kube-api-access-kt6k8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:33:02.691501 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:02.691479    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c3fd2a9-27dc-42c5-a1ea-5077a9e47685-util" (OuterVolumeSpecName: "util") pod "8c3fd2a9-27dc-42c5-a1ea-5077a9e47685" (UID: "8c3fd2a9-27dc-42c5-a1ea-5077a9e47685"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:33:02.788350 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:02.788251    2583 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8c3fd2a9-27dc-42c5-a1ea-5077a9e47685-util\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 20:33:02.788350 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:02.788287    2583 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8c3fd2a9-27dc-42c5-a1ea-5077a9e47685-bundle\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 20:33:02.788350 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:02.788302    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kt6k8\" (UniqueName: \"kubernetes.io/projected/8c3fd2a9-27dc-42c5-a1ea-5077a9e47685-kube-api-access-kt6k8\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 20:33:03.012904 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:03.012863    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-fr98g"]
Jul 30 20:33:03.013295 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:03.013279    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c3fd2a9-27dc-42c5-a1ea-5077a9e47685" containerName="extract"
Jul 30 20:33:03.013397 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:03.013298    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c3fd2a9-27dc-42c5-a1ea-5077a9e47685" containerName="extract"
Jul 30 20:33:03.013397 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:03.013309    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c3fd2a9-27dc-42c5-a1ea-5077a9e47685" containerName="util"
Jul 30 20:33:03.013397 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:03.013316    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c3fd2a9-27dc-42c5-a1ea-5077a9e47685" containerName="util"
Jul 30 20:33:03.013397 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:03.013338    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c3fd2a9-27dc-42c5-a1ea-5077a9e47685" containerName="pull"
Jul 30 20:33:03.013397 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:03.013347    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c3fd2a9-27dc-42c5-a1ea-5077a9e47685" containerName="pull"
Jul 30 20:33:03.013620 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:03.013455    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c3fd2a9-27dc-42c5-a1ea-5077a9e47685" containerName="extract"
Jul 30 20:33:03.017360 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:03.017339    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-fr98g"
Jul 30 20:33:03.019540 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:03.019518    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 30 20:33:03.019678 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:03.019624    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 30 20:33:03.019740 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:03.019708    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-4rtdz\""
Jul 30 20:33:03.022965 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:03.022940    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-fr98g"]
Jul 30 20:33:03.192405 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:03.192375    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7527281c-a82f-4528-889c-cd7d9d585533-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-fr98g\" (UID: \"7527281c-a82f-4528-889c-cd7d9d585533\") " pod="cert-manager/cert-manager-webhook-6486ffd997-fr98g"
Jul 30 20:33:03.192582 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:03.192450    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxv6w\" (UniqueName: \"kubernetes.io/projected/7527281c-a82f-4528-889c-cd7d9d585533-kube-api-access-kxv6w\") pod \"cert-manager-webhook-6486ffd997-fr98g\" (UID: \"7527281c-a82f-4528-889c-cd7d9d585533\") " pod="cert-manager/cert-manager-webhook-6486ffd997-fr98g"
Jul 30 20:33:03.293283 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:03.293237    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxv6w\" (UniqueName: \"kubernetes.io/projected/7527281c-a82f-4528-889c-cd7d9d585533-kube-api-access-kxv6w\") pod \"cert-manager-webhook-6486ffd997-fr98g\" (UID: \"7527281c-a82f-4528-889c-cd7d9d585533\") " pod="cert-manager/cert-manager-webhook-6486ffd997-fr98g"
Jul 30 20:33:03.293439 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:03.293301    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7527281c-a82f-4528-889c-cd7d9d585533-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-fr98g\" (UID: \"7527281c-a82f-4528-889c-cd7d9d585533\") " pod="cert-manager/cert-manager-webhook-6486ffd997-fr98g"
Jul 30 20:33:03.301288 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:03.301254    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxv6w\" (UniqueName: \"kubernetes.io/projected/7527281c-a82f-4528-889c-cd7d9d585533-kube-api-access-kxv6w\") pod \"cert-manager-webhook-6486ffd997-fr98g\" (UID: \"7527281c-a82f-4528-889c-cd7d9d585533\") " pod="cert-manager/cert-manager-webhook-6486ffd997-fr98g"
Jul 30 20:33:03.301288 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:03.301271    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7527281c-a82f-4528-889c-cd7d9d585533-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-fr98g\" (UID: \"7527281c-a82f-4528-889c-cd7d9d585533\") " pod="cert-manager/cert-manager-webhook-6486ffd997-fr98g"
Jul 30 20:33:03.341297 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:03.341267    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-fr98g"
Jul 30 20:33:03.453437 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:03.453368    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzqrdx"
Jul 30 20:33:03.453569 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:03.453368    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzqrdx" event={"ID":"8c3fd2a9-27dc-42c5-a1ea-5077a9e47685","Type":"ContainerDied","Data":"904bf5bf495fd711c6b43b596bbf9c3609587f1c543a06c95227430bf903afb1"}
Jul 30 20:33:03.453569 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:03.453489    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="904bf5bf495fd711c6b43b596bbf9c3609587f1c543a06c95227430bf903afb1"
Jul 30 20:33:03.474356 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:03.474034    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-fr98g"]
Jul 30 20:33:03.476689 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:33:03.476664    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7527281c_a82f_4528_889c_cd7d9d585533.slice/crio-931c5d8bd58a92092ffba52a7b0f3e2e31649615b0fea2cc213fe1faeec5b28f WatchSource:0}: Error finding container 931c5d8bd58a92092ffba52a7b0f3e2e31649615b0fea2cc213fe1faeec5b28f: Status 404 returned error can't find the container with id 931c5d8bd58a92092ffba52a7b0f3e2e31649615b0fea2cc213fe1faeec5b28f
Jul 30 20:33:04.460451 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:04.460415    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-fr98g" event={"ID":"7527281c-a82f-4528-889c-cd7d9d585533","Type":"ContainerStarted","Data":"931c5d8bd58a92092ffba52a7b0f3e2e31649615b0fea2cc213fe1faeec5b28f"}
Jul 30 20:33:06.264188 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:06.264150    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:33:06.471478 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:06.471447    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-fr98g" event={"ID":"7527281c-a82f-4528-889c-cd7d9d585533","Type":"ContainerStarted","Data":"8641065117e730deed725bf47eb73bdf8d1d238ea065fbfbe8e1599ee3f93bae"}
Jul 30 20:33:06.471640 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:06.471506    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-fr98g"
Jul 30 20:33:06.486726 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:06.486683    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-fr98g" podStartSLOduration=1.650841603 podStartE2EDuration="4.486669424s" totalImagesPullingTime="2.835827821s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:33:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:33:06.48594528 +0000 UTC m=+498.327420902" watchObservedRunningTime="2026-07-30 20:33:06.486669424 +0000 UTC m=+498.328145046"
Jul 30 20:33:06.577087 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:06.576988    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:33:12.071891 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:12.071853    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:33:12.171117 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:12.171080    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:33:12.478469 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:12.478437    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-fr98g"
Jul 30 20:33:14.158673 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:14.158639    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-h5qk9"]
Jul 30 20:33:14.163893 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:14.163872    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-h5qk9"
Jul 30 20:33:14.166336 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:14.166315    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 30 20:33:14.166990 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:14.166973    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-vxm9m\""
Jul 30 20:33:14.167080 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:14.166973    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 30 20:33:14.171042 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:14.171019    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-h5qk9"]
Jul 30 20:33:14.192434 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:14.192403    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d6df703b-3ff8-4492-a840-d4fe64bc63c5-tmp\") pod \"openshift-lws-operator-fd8ccff4c-h5qk9\" (UID: \"d6df703b-3ff8-4492-a840-d4fe64bc63c5\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-h5qk9"
Jul 30 20:33:14.192555 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:14.192454    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w66xj\" (UniqueName: \"kubernetes.io/projected/d6df703b-3ff8-4492-a840-d4fe64bc63c5-kube-api-access-w66xj\") pod \"openshift-lws-operator-fd8ccff4c-h5qk9\" (UID: \"d6df703b-3ff8-4492-a840-d4fe64bc63c5\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-h5qk9"
Jul 30 20:33:14.293504 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:14.293474    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w66xj\" (UniqueName: \"kubernetes.io/projected/d6df703b-3ff8-4492-a840-d4fe64bc63c5-kube-api-access-w66xj\") pod \"openshift-lws-operator-fd8ccff4c-h5qk9\" (UID: \"d6df703b-3ff8-4492-a840-d4fe64bc63c5\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-h5qk9"
Jul 30 20:33:14.293640 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:14.293533    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d6df703b-3ff8-4492-a840-d4fe64bc63c5-tmp\") pod \"openshift-lws-operator-fd8ccff4c-h5qk9\" (UID: \"d6df703b-3ff8-4492-a840-d4fe64bc63c5\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-h5qk9"
Jul 30 20:33:14.293866 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:14.293845    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d6df703b-3ff8-4492-a840-d4fe64bc63c5-tmp\") pod \"openshift-lws-operator-fd8ccff4c-h5qk9\" (UID: \"d6df703b-3ff8-4492-a840-d4fe64bc63c5\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-h5qk9"
Jul 30 20:33:14.301154 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:14.301116    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w66xj\" (UniqueName: \"kubernetes.io/projected/d6df703b-3ff8-4492-a840-d4fe64bc63c5-kube-api-access-w66xj\") pod \"openshift-lws-operator-fd8ccff4c-h5qk9\" (UID: \"d6df703b-3ff8-4492-a840-d4fe64bc63c5\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-h5qk9"
Jul 30 20:33:14.474600 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:14.474520    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-h5qk9"
Jul 30 20:33:14.609013 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:14.608985    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-h5qk9"]
Jul 30 20:33:14.611751 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:33:14.611719    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd6df703b_3ff8_4492_a840_d4fe64bc63c5.slice/crio-a942c075664451f6ea2eac1340779d9f7e1b1872b0be43f99712bd9edc5ffe14 WatchSource:0}: Error finding container a942c075664451f6ea2eac1340779d9f7e1b1872b0be43f99712bd9edc5ffe14: Status 404 returned error can't find the container with id a942c075664451f6ea2eac1340779d9f7e1b1872b0be43f99712bd9edc5ffe14
Jul 30 20:33:15.512951 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:15.512919    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-h5qk9" event={"ID":"d6df703b-3ff8-4492-a840-d4fe64bc63c5","Type":"ContainerStarted","Data":"a942c075664451f6ea2eac1340779d9f7e1b1872b0be43f99712bd9edc5ffe14"}
Jul 30 20:33:17.524589 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:17.524549    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-h5qk9" event={"ID":"d6df703b-3ff8-4492-a840-d4fe64bc63c5","Type":"ContainerStarted","Data":"682c29584231c0515f84b51f530a5b15e33e6be4d15c7b48b89f0db6e074d583"}
Jul 30 20:33:17.540180 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:17.540120    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-h5qk9" podStartSLOduration=1.3481573390000001 podStartE2EDuration="3.540104158s" totalImagesPullingTime="2.191946819s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:33:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:33:17.539036104 +0000 UTC m=+509.380511727" watchObservedRunningTime="2026-07-30 20:33:17.540104158 +0000 UTC m=+509.381579780"
Jul 30 20:33:18.266544 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:18.266510    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:33:18.366635 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:18.366602    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:33:20.474075 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:20.474037    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:33:21.939521 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:21.939481    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afc9l52"]
Jul 30 20:33:21.943104 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:21.943087    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afc9l52"
Jul 30 20:33:21.945099 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:21.945073    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 30 20:33:21.945230 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:21.945109    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-qlc5n\""
Jul 30 20:33:21.945230 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:21.945078    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 30 20:33:21.945677 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:21.945659    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ccttt\" (UniqueName: \"kubernetes.io/projected/27aba7e2-7720-4545-b400-4d25192c93aa-kube-api-access-ccttt\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afc9l52\" (UID: \"27aba7e2-7720-4545-b400-4d25192c93aa\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afc9l52"
Jul 30 20:33:21.945731 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:21.945696    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/27aba7e2-7720-4545-b400-4d25192c93aa-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afc9l52\" (UID: \"27aba7e2-7720-4545-b400-4d25192c93aa\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afc9l52"
Jul 30 20:33:21.945766 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:21.945741    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/27aba7e2-7720-4545-b400-4d25192c93aa-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afc9l52\" (UID: \"27aba7e2-7720-4545-b400-4d25192c93aa\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afc9l52"
Jul 30 20:33:21.950755 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:21.950731    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afc9l52"]
Jul 30 20:33:22.046520 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:22.046482    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/27aba7e2-7720-4545-b400-4d25192c93aa-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afc9l52\" (UID: \"27aba7e2-7720-4545-b400-4d25192c93aa\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afc9l52"
Jul 30 20:33:22.046715 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:22.046546    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ccttt\" (UniqueName: \"kubernetes.io/projected/27aba7e2-7720-4545-b400-4d25192c93aa-kube-api-access-ccttt\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afc9l52\" (UID: \"27aba7e2-7720-4545-b400-4d25192c93aa\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afc9l52"
Jul 30 20:33:22.046715 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:22.046575    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/27aba7e2-7720-4545-b400-4d25192c93aa-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afc9l52\" (UID: \"27aba7e2-7720-4545-b400-4d25192c93aa\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afc9l52"
Jul 30 20:33:22.046902 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:22.046882    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/27aba7e2-7720-4545-b400-4d25192c93aa-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afc9l52\" (UID: \"27aba7e2-7720-4545-b400-4d25192c93aa\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afc9l52"
Jul 30 20:33:22.046902 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:22.046894    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/27aba7e2-7720-4545-b400-4d25192c93aa-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afc9l52\" (UID: \"27aba7e2-7720-4545-b400-4d25192c93aa\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afc9l52"
Jul 30 20:33:22.053922 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:22.053889    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ccttt\" (UniqueName: \"kubernetes.io/projected/27aba7e2-7720-4545-b400-4d25192c93aa-kube-api-access-ccttt\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afc9l52\" (UID: \"27aba7e2-7720-4545-b400-4d25192c93aa\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afc9l52"
Jul 30 20:33:22.253080 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:22.252995    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afc9l52"
Jul 30 20:33:22.387059 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:22.387033    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afc9l52"]
Jul 30 20:33:22.389379 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:33:22.389351    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27aba7e2_7720_4545_b400_4d25192c93aa.slice/crio-6f1266328e22b67b629f10a461bf2796ba7fbfc1de14f4fdbcf339278ae87d7c WatchSource:0}: Error finding container 6f1266328e22b67b629f10a461bf2796ba7fbfc1de14f4fdbcf339278ae87d7c: Status 404 returned error can't find the container with id 6f1266328e22b67b629f10a461bf2796ba7fbfc1de14f4fdbcf339278ae87d7c
Jul 30 20:33:22.550714 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:22.550626    2583 generic.go:356] "Generic (PLEG): container finished" podID="27aba7e2-7720-4545-b400-4d25192c93aa" containerID="d7c252d3c532978a2b04c137c94921190bfbe70ec0929212fa9a59adf8c675e6" exitCode=0
Jul 30 20:33:22.550714 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:22.550696    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afc9l52" event={"ID":"27aba7e2-7720-4545-b400-4d25192c93aa","Type":"ContainerDied","Data":"d7c252d3c532978a2b04c137c94921190bfbe70ec0929212fa9a59adf8c675e6"}
Jul 30 20:33:22.551177 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:22.550767    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afc9l52" event={"ID":"27aba7e2-7720-4545-b400-4d25192c93aa","Type":"ContainerStarted","Data":"6f1266328e22b67b629f10a461bf2796ba7fbfc1de14f4fdbcf339278ae87d7c"}
Jul 30 20:33:23.560202 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:23.560168    2583 generic.go:356] "Generic (PLEG): container finished" podID="27aba7e2-7720-4545-b400-4d25192c93aa" containerID="9f4f5f50986cd78c2d514d542ca364d572f8e54daaabb5cd5c515b91be004706" exitCode=0
Jul 30 20:33:23.560639 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:23.560261    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afc9l52" event={"ID":"27aba7e2-7720-4545-b400-4d25192c93aa","Type":"ContainerDied","Data":"9f4f5f50986cd78c2d514d542ca364d572f8e54daaabb5cd5c515b91be004706"}
Jul 30 20:33:24.567457 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:24.567424    2583 generic.go:356] "Generic (PLEG): container finished" podID="27aba7e2-7720-4545-b400-4d25192c93aa" containerID="efb883ad65ce850449e1717d8d38b91c8e76a75aec2bdc095815c344041db6ad" exitCode=0
Jul 30 20:33:24.567829 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:24.567497    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afc9l52" event={"ID":"27aba7e2-7720-4545-b400-4d25192c93aa","Type":"ContainerDied","Data":"efb883ad65ce850449e1717d8d38b91c8e76a75aec2bdc095815c344041db6ad"}
Jul 30 20:33:25.725221 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:25.725197    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afc9l52"
Jul 30 20:33:25.777903 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:25.777870    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ccttt\" (UniqueName: \"kubernetes.io/projected/27aba7e2-7720-4545-b400-4d25192c93aa-kube-api-access-ccttt\") pod \"27aba7e2-7720-4545-b400-4d25192c93aa\" (UID: \"27aba7e2-7720-4545-b400-4d25192c93aa\") "
Jul 30 20:33:25.778067 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:25.777940    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/27aba7e2-7720-4545-b400-4d25192c93aa-util\") pod \"27aba7e2-7720-4545-b400-4d25192c93aa\" (UID: \"27aba7e2-7720-4545-b400-4d25192c93aa\") "
Jul 30 20:33:25.778067 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:25.777984    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/27aba7e2-7720-4545-b400-4d25192c93aa-bundle\") pod \"27aba7e2-7720-4545-b400-4d25192c93aa\" (UID: \"27aba7e2-7720-4545-b400-4d25192c93aa\") "
Jul 30 20:33:25.778734 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:25.778712    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27aba7e2-7720-4545-b400-4d25192c93aa-bundle" (OuterVolumeSpecName: "bundle") pod "27aba7e2-7720-4545-b400-4d25192c93aa" (UID: "27aba7e2-7720-4545-b400-4d25192c93aa"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:33:25.780223 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:25.780198    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27aba7e2-7720-4545-b400-4d25192c93aa-kube-api-access-ccttt" (OuterVolumeSpecName: "kube-api-access-ccttt") pod "27aba7e2-7720-4545-b400-4d25192c93aa" (UID: "27aba7e2-7720-4545-b400-4d25192c93aa"). InnerVolumeSpecName "kube-api-access-ccttt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:33:25.783622 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:25.783593    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27aba7e2-7720-4545-b400-4d25192c93aa-util" (OuterVolumeSpecName: "util") pod "27aba7e2-7720-4545-b400-4d25192c93aa" (UID: "27aba7e2-7720-4545-b400-4d25192c93aa"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:33:25.879170 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:25.879086    2583 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/27aba7e2-7720-4545-b400-4d25192c93aa-util\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 20:33:25.879170 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:25.879110    2583 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/27aba7e2-7720-4545-b400-4d25192c93aa-bundle\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 20:33:25.879170 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:25.879119    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ccttt\" (UniqueName: \"kubernetes.io/projected/27aba7e2-7720-4545-b400-4d25192c93aa-kube-api-access-ccttt\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 20:33:26.579333 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:26.579296    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afc9l52" event={"ID":"27aba7e2-7720-4545-b400-4d25192c93aa","Type":"ContainerDied","Data":"6f1266328e22b67b629f10a461bf2796ba7fbfc1de14f4fdbcf339278ae87d7c"}
Jul 30 20:33:26.579503 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:26.579358    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6f1266328e22b67b629f10a461bf2796ba7fbfc1de14f4fdbcf339278ae87d7c"
Jul 30 20:33:26.579503 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:26.579306    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afc9l52"
Jul 30 20:33:32.090192 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:32.090157    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:33:32.181910 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:32.181871    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:33:32.563576 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:32.563541    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:33:32.995656 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:32.995616    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:33:33.078431 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:33.078400    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7fd799f58b-6p5j9"]
Jul 30 20:33:33.078804 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:33.078787    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27aba7e2-7720-4545-b400-4d25192c93aa" containerName="extract"
Jul 30 20:33:33.078893 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:33.078808    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="27aba7e2-7720-4545-b400-4d25192c93aa" containerName="extract"
Jul 30 20:33:33.078893 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:33.078827    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27aba7e2-7720-4545-b400-4d25192c93aa" containerName="util"
Jul 30 20:33:33.078893 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:33.078835    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="27aba7e2-7720-4545-b400-4d25192c93aa" containerName="util"
Jul 30 20:33:33.078893 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:33.078862    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27aba7e2-7720-4545-b400-4d25192c93aa" containerName="pull"
Jul 30 20:33:33.078893 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:33.078870    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="27aba7e2-7720-4545-b400-4d25192c93aa" containerName="pull"
Jul 30 20:33:33.079168 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:33.078963    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="27aba7e2-7720-4545-b400-4d25192c93aa" containerName="extract"
Jul 30 20:33:33.083428 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:33.083406    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7fd799f58b-6p5j9"
Jul 30 20:33:33.084937 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:33.084914    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:33:33.089127 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:33.089103    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 30 20:33:33.089250 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:33.089162    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-kxhrx\""
Jul 30 20:33:33.089554 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:33.089530    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 30 20:33:33.089641 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:33.089616    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 30 20:33:33.090484 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:33.090168    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 30 20:33:33.099029 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:33.099005    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7fd799f58b-6p5j9"]
Jul 30 20:33:33.142498 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:33.142470    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3e86153a-f7e1-440c-8b64-118a0a3ceba3-manifests\") pod \"opendatahub-operator-controller-manager-7fd799f58b-6p5j9\" (UID: \"3e86153a-f7e1-440c-8b64-118a0a3ceba3\") " pod="opendatahub/opendatahub-operator-controller-manager-7fd799f58b-6p5j9"
Jul 30 20:33:33.142670 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:33.142508    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3e86153a-f7e1-440c-8b64-118a0a3ceba3-tmp\") pod \"opendatahub-operator-controller-manager-7fd799f58b-6p5j9\" (UID: \"3e86153a-f7e1-440c-8b64-118a0a3ceba3\") " pod="opendatahub/opendatahub-operator-controller-manager-7fd799f58b-6p5j9"
Jul 30 20:33:33.142670 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:33.142543    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqbcp\" (UniqueName: \"kubernetes.io/projected/3e86153a-f7e1-440c-8b64-118a0a3ceba3-kube-api-access-wqbcp\") pod \"opendatahub-operator-controller-manager-7fd799f58b-6p5j9\" (UID: \"3e86153a-f7e1-440c-8b64-118a0a3ceba3\") " pod="opendatahub/opendatahub-operator-controller-manager-7fd799f58b-6p5j9"
Jul 30 20:33:33.142670 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:33.142608    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3e86153a-f7e1-440c-8b64-118a0a3ceba3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7fd799f58b-6p5j9\" (UID: \"3e86153a-f7e1-440c-8b64-118a0a3ceba3\") " pod="opendatahub/opendatahub-operator-controller-manager-7fd799f58b-6p5j9"
Jul 30 20:33:33.142799 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:33.142708    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3e86153a-f7e1-440c-8b64-118a0a3ceba3-webhook-cert\") pod \"opendatahub-operator-controller-manager-7fd799f58b-6p5j9\" (UID: \"3e86153a-f7e1-440c-8b64-118a0a3ceba3\") " pod="opendatahub/opendatahub-operator-controller-manager-7fd799f58b-6p5j9"
Jul 30 20:33:33.197503 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:33.197470    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:33:33.243495 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:33.243460    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3e86153a-f7e1-440c-8b64-118a0a3ceba3-manifests\") pod \"opendatahub-operator-controller-manager-7fd799f58b-6p5j9\" (UID: \"3e86153a-f7e1-440c-8b64-118a0a3ceba3\") " pod="opendatahub/opendatahub-operator-controller-manager-7fd799f58b-6p5j9"
Jul 30 20:33:33.243636 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:33.243502    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3e86153a-f7e1-440c-8b64-118a0a3ceba3-tmp\") pod \"opendatahub-operator-controller-manager-7fd799f58b-6p5j9\" (UID: \"3e86153a-f7e1-440c-8b64-118a0a3ceba3\") " pod="opendatahub/opendatahub-operator-controller-manager-7fd799f58b-6p5j9"
Jul 30 20:33:33.243636 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:33.243541    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqbcp\" (UniqueName: \"kubernetes.io/projected/3e86153a-f7e1-440c-8b64-118a0a3ceba3-kube-api-access-wqbcp\") pod \"opendatahub-operator-controller-manager-7fd799f58b-6p5j9\" (UID: \"3e86153a-f7e1-440c-8b64-118a0a3ceba3\") " pod="opendatahub/opendatahub-operator-controller-manager-7fd799f58b-6p5j9"
Jul 30 20:33:33.243636 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:33.243574    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3e86153a-f7e1-440c-8b64-118a0a3ceba3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7fd799f58b-6p5j9\" (UID: \"3e86153a-f7e1-440c-8b64-118a0a3ceba3\") " pod="opendatahub/opendatahub-operator-controller-manager-7fd799f58b-6p5j9"
Jul 30 20:33:33.243766 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:33.243657    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3e86153a-f7e1-440c-8b64-118a0a3ceba3-webhook-cert\") pod \"opendatahub-operator-controller-manager-7fd799f58b-6p5j9\" (UID: \"3e86153a-f7e1-440c-8b64-118a0a3ceba3\") " pod="opendatahub/opendatahub-operator-controller-manager-7fd799f58b-6p5j9"
Jul 30 20:33:33.243947 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:33.243923    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3e86153a-f7e1-440c-8b64-118a0a3ceba3-manifests\") pod \"opendatahub-operator-controller-manager-7fd799f58b-6p5j9\" (UID: \"3e86153a-f7e1-440c-8b64-118a0a3ceba3\") " pod="opendatahub/opendatahub-operator-controller-manager-7fd799f58b-6p5j9"
Jul 30 20:33:33.246092 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:33.246036    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3e86153a-f7e1-440c-8b64-118a0a3ceba3-tmp\") pod \"opendatahub-operator-controller-manager-7fd799f58b-6p5j9\" (UID: \"3e86153a-f7e1-440c-8b64-118a0a3ceba3\") " pod="opendatahub/opendatahub-operator-controller-manager-7fd799f58b-6p5j9"
Jul 30 20:33:33.246218 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:33.246189    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3e86153a-f7e1-440c-8b64-118a0a3ceba3-webhook-cert\") pod \"opendatahub-operator-controller-manager-7fd799f58b-6p5j9\" (UID: \"3e86153a-f7e1-440c-8b64-118a0a3ceba3\") " pod="opendatahub/opendatahub-operator-controller-manager-7fd799f58b-6p5j9"
Jul 30 20:33:33.246273 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:33.246219    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3e86153a-f7e1-440c-8b64-118a0a3ceba3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7fd799f58b-6p5j9\" (UID: \"3e86153a-f7e1-440c-8b64-118a0a3ceba3\") " pod="opendatahub/opendatahub-operator-controller-manager-7fd799f58b-6p5j9"
Jul 30 20:33:33.251677 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:33.251656    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqbcp\" (UniqueName: \"kubernetes.io/projected/3e86153a-f7e1-440c-8b64-118a0a3ceba3-kube-api-access-wqbcp\") pod \"opendatahub-operator-controller-manager-7fd799f58b-6p5j9\" (UID: \"3e86153a-f7e1-440c-8b64-118a0a3ceba3\") " pod="opendatahub/opendatahub-operator-controller-manager-7fd799f58b-6p5j9"
Jul 30 20:33:33.294608 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:33.294568    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:33:33.394104 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:33.394072    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7fd799f58b-6p5j9"
Jul 30 20:33:33.409368 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:33.409323    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:33:33.498038 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:33.497887    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:33:33.539949 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:33.539920    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7fd799f58b-6p5j9"]
Jul 30 20:33:33.543515 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:33:33.543491    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e86153a_f7e1_440c_8b64_118a0a3ceba3.slice/crio-eb5794f1afb46323b362d186940aeb34f40465fe8f5182224cec3055e0398d0a WatchSource:0}: Error finding container eb5794f1afb46323b362d186940aeb34f40465fe8f5182224cec3055e0398d0a: Status 404 returned error can't find the container with id eb5794f1afb46323b362d186940aeb34f40465fe8f5182224cec3055e0398d0a
Jul 30 20:33:33.595971 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:33.595938    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:33:33.612082 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:33.612054    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7fd799f58b-6p5j9" event={"ID":"3e86153a-f7e1-440c-8b64-118a0a3ceba3","Type":"ContainerStarted","Data":"eb5794f1afb46323b362d186940aeb34f40465fe8f5182224cec3055e0398d0a"}
Jul 30 20:33:36.631717 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:36.631676    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7fd799f58b-6p5j9" event={"ID":"3e86153a-f7e1-440c-8b64-118a0a3ceba3","Type":"ContainerStarted","Data":"d51962bb03edbe1793fce7a7aba8c8efff00f3dcc1c0c814a2af7524bc9c9cde"}
Jul 30 20:33:37.638536 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:37.638505    2583 generic.go:356] "Generic (PLEG): container finished" podID="3e86153a-f7e1-440c-8b64-118a0a3ceba3" containerID="d51962bb03edbe1793fce7a7aba8c8efff00f3dcc1c0c814a2af7524bc9c9cde" exitCode=0
Jul 30 20:33:37.638865 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:37.638552    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7fd799f58b-6p5j9" event={"ID":"3e86153a-f7e1-440c-8b64-118a0a3ceba3","Type":"ContainerDied","Data":"d51962bb03edbe1793fce7a7aba8c8efff00f3dcc1c0c814a2af7524bc9c9cde"}
Jul 30 20:33:38.646159 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:38.646107    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7fd799f58b-6p5j9" event={"ID":"3e86153a-f7e1-440c-8b64-118a0a3ceba3","Type":"ContainerStarted","Data":"427854ef5352935e5155b69f9af8684c9527b80a249d0f759e15ab734290e396"}
Jul 30 20:33:38.646624 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:38.646275    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7fd799f58b-6p5j9"
Jul 30 20:33:38.667898 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:38.667755    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7fd799f58b-6p5j9" podStartSLOduration=0.909817081 podStartE2EDuration="5.667735759s" totalImagesPullingTime="3.705364887s" totalInitContainerRuntime="1.052553791s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:33:33 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:33:38.665020726 +0000 UTC m=+530.506496348" watchObservedRunningTime="2026-07-30 20:33:38.667735759 +0000 UTC m=+530.509211380"
Jul 30 20:33:47.285918 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:47.285879    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:33:49.653169 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:49.653120    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7fd799f58b-6p5j9"
Jul 30 20:33:51.719098 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:51.719061    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:33:51.880667 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:51.880635    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:33:52.229764 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:52.229732    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:33:52.380381 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:52.380345    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-66684cbb98-9m4n8"]
Jul 30 20:33:52.390985 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:52.390955    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-66684cbb98-9m4n8"
Jul 30 20:33:52.394865 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:52.394811    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 30 20:33:52.395573 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:52.395552    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 30 20:33:52.396497 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:52.396475    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 30 20:33:52.396958 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:52.396942    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-5qqdk\""
Jul 30 20:33:52.400521 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:52.400501    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 30 20:33:52.404312 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:52.404290    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-66684cbb98-9m4n8"]
Jul 30 20:33:52.426311 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:52.426287    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5b6c8b8c96-d4pmz"]
Jul 30 20:33:52.429967 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:52.429950    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5b6c8b8c96-d4pmz"
Jul 30 20:33:52.436561 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:52.436483    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 30 20:33:52.436738 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:52.436723    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 30 20:33:52.436812 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:52.436765    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-xr27h\""
Jul 30 20:33:52.437243 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:52.437226    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 30 20:33:52.461261 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:52.461234    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:33:52.463410 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:52.463390    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5b6c8b8c96-d4pmz"]
Jul 30 20:33:52.509537 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:52.509455    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jgdqf\" (UniqueName: \"kubernetes.io/projected/ca860230-adcc-4965-90bc-992b6aa0b787-kube-api-access-jgdqf\") pod \"kube-auth-proxy-66684cbb98-9m4n8\" (UID: \"ca860230-adcc-4965-90bc-992b6aa0b787\") " pod="openshift-ingress/kube-auth-proxy-66684cbb98-9m4n8"
Jul 30 20:33:52.509664 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:52.509552    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ca860230-adcc-4965-90bc-992b6aa0b787-tls-certs\") pod \"kube-auth-proxy-66684cbb98-9m4n8\" (UID: \"ca860230-adcc-4965-90bc-992b6aa0b787\") " pod="openshift-ingress/kube-auth-proxy-66684cbb98-9m4n8"
Jul 30 20:33:52.509664 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:52.509606    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a79474e8-d1c1-45d9-a457-b487b0f55951-cert\") pod \"lws-controller-manager-5b6c8b8c96-d4pmz\" (UID: \"a79474e8-d1c1-45d9-a457-b487b0f55951\") " pod="openshift-lws-operator/lws-controller-manager-5b6c8b8c96-d4pmz"
Jul 30 20:33:52.509664 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:52.509635    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9wk7p\" (UniqueName: \"kubernetes.io/projected/a79474e8-d1c1-45d9-a457-b487b0f55951-kube-api-access-9wk7p\") pod \"lws-controller-manager-5b6c8b8c96-d4pmz\" (UID: \"a79474e8-d1c1-45d9-a457-b487b0f55951\") " pod="openshift-lws-operator/lws-controller-manager-5b6c8b8c96-d4pmz"
Jul 30 20:33:52.509779 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:52.509671    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ca860230-adcc-4965-90bc-992b6aa0b787-tmp\") pod \"kube-auth-proxy-66684cbb98-9m4n8\" (UID: \"ca860230-adcc-4965-90bc-992b6aa0b787\") " pod="openshift-ingress/kube-auth-proxy-66684cbb98-9m4n8"
Jul 30 20:33:52.509779 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:52.509694    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a79474e8-d1c1-45d9-a457-b487b0f55951-manager-config\") pod \"lws-controller-manager-5b6c8b8c96-d4pmz\" (UID: \"a79474e8-d1c1-45d9-a457-b487b0f55951\") " pod="openshift-lws-operator/lws-controller-manager-5b6c8b8c96-d4pmz"
Jul 30 20:33:52.509779 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:52.509745    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a79474e8-d1c1-45d9-a457-b487b0f55951-metrics-cert\") pod \"lws-controller-manager-5b6c8b8c96-d4pmz\" (UID: \"a79474e8-d1c1-45d9-a457-b487b0f55951\") " pod="openshift-lws-operator/lws-controller-manager-5b6c8b8c96-d4pmz"
Jul 30 20:33:52.610848 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:52.610812    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a79474e8-d1c1-45d9-a457-b487b0f55951-metrics-cert\") pod \"lws-controller-manager-5b6c8b8c96-d4pmz\" (UID: \"a79474e8-d1c1-45d9-a457-b487b0f55951\") " pod="openshift-lws-operator/lws-controller-manager-5b6c8b8c96-d4pmz"
Jul 30 20:33:52.611115 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:52.610858    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jgdqf\" (UniqueName: \"kubernetes.io/projected/ca860230-adcc-4965-90bc-992b6aa0b787-kube-api-access-jgdqf\") pod \"kube-auth-proxy-66684cbb98-9m4n8\" (UID: \"ca860230-adcc-4965-90bc-992b6aa0b787\") " pod="openshift-ingress/kube-auth-proxy-66684cbb98-9m4n8"
Jul 30 20:33:52.611115 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:52.610893    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ca860230-adcc-4965-90bc-992b6aa0b787-tls-certs\") pod \"kube-auth-proxy-66684cbb98-9m4n8\" (UID: \"ca860230-adcc-4965-90bc-992b6aa0b787\") " pod="openshift-ingress/kube-auth-proxy-66684cbb98-9m4n8"
Jul 30 20:33:52.611115 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:52.610951    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a79474e8-d1c1-45d9-a457-b487b0f55951-cert\") pod \"lws-controller-manager-5b6c8b8c96-d4pmz\" (UID: \"a79474e8-d1c1-45d9-a457-b487b0f55951\") " pod="openshift-lws-operator/lws-controller-manager-5b6c8b8c96-d4pmz"
Jul 30 20:33:52.611115 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:52.610982    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9wk7p\" (UniqueName: \"kubernetes.io/projected/a79474e8-d1c1-45d9-a457-b487b0f55951-kube-api-access-9wk7p\") pod \"lws-controller-manager-5b6c8b8c96-d4pmz\" (UID: \"a79474e8-d1c1-45d9-a457-b487b0f55951\") " pod="openshift-lws-operator/lws-controller-manager-5b6c8b8c96-d4pmz"
Jul 30 20:33:52.611115 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:52.611036    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ca860230-adcc-4965-90bc-992b6aa0b787-tmp\") pod \"kube-auth-proxy-66684cbb98-9m4n8\" (UID: \"ca860230-adcc-4965-90bc-992b6aa0b787\") " pod="openshift-ingress/kube-auth-proxy-66684cbb98-9m4n8"
Jul 30 20:33:52.611429 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:52.611369    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a79474e8-d1c1-45d9-a457-b487b0f55951-manager-config\") pod \"lws-controller-manager-5b6c8b8c96-d4pmz\" (UID: \"a79474e8-d1c1-45d9-a457-b487b0f55951\") " pod="openshift-lws-operator/lws-controller-manager-5b6c8b8c96-d4pmz"
Jul 30 20:33:52.612296 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:52.612268    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a79474e8-d1c1-45d9-a457-b487b0f55951-manager-config\") pod \"lws-controller-manager-5b6c8b8c96-d4pmz\" (UID: \"a79474e8-d1c1-45d9-a457-b487b0f55951\") " pod="openshift-lws-operator/lws-controller-manager-5b6c8b8c96-d4pmz"
Jul 30 20:33:52.613485 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:52.613464    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ca860230-adcc-4965-90bc-992b6aa0b787-tmp\") pod \"kube-auth-proxy-66684cbb98-9m4n8\" (UID: \"ca860230-adcc-4965-90bc-992b6aa0b787\") " pod="openshift-ingress/kube-auth-proxy-66684cbb98-9m4n8"
Jul 30 20:33:52.613702 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:52.613679    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ca860230-adcc-4965-90bc-992b6aa0b787-tls-certs\") pod \"kube-auth-proxy-66684cbb98-9m4n8\" (UID: \"ca860230-adcc-4965-90bc-992b6aa0b787\") " pod="openshift-ingress/kube-auth-proxy-66684cbb98-9m4n8"
Jul 30 20:33:52.613828 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:52.613805    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a79474e8-d1c1-45d9-a457-b487b0f55951-cert\") pod \"lws-controller-manager-5b6c8b8c96-d4pmz\" (UID: \"a79474e8-d1c1-45d9-a457-b487b0f55951\") " pod="openshift-lws-operator/lws-controller-manager-5b6c8b8c96-d4pmz"
Jul 30 20:33:52.614011 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:52.613995    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a79474e8-d1c1-45d9-a457-b487b0f55951-metrics-cert\") pod \"lws-controller-manager-5b6c8b8c96-d4pmz\" (UID: \"a79474e8-d1c1-45d9-a457-b487b0f55951\") " pod="openshift-lws-operator/lws-controller-manager-5b6c8b8c96-d4pmz"
Jul 30 20:33:52.616045 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:52.616022    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:33:52.640596 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:52.640567    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jgdqf\" (UniqueName: \"kubernetes.io/projected/ca860230-adcc-4965-90bc-992b6aa0b787-kube-api-access-jgdqf\") pod \"kube-auth-proxy-66684cbb98-9m4n8\" (UID: \"ca860230-adcc-4965-90bc-992b6aa0b787\") " pod="openshift-ingress/kube-auth-proxy-66684cbb98-9m4n8"
Jul 30 20:33:52.640698 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:52.640639    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9wk7p\" (UniqueName: \"kubernetes.io/projected/a79474e8-d1c1-45d9-a457-b487b0f55951-kube-api-access-9wk7p\") pod \"lws-controller-manager-5b6c8b8c96-d4pmz\" (UID: \"a79474e8-d1c1-45d9-a457-b487b0f55951\") " pod="openshift-lws-operator/lws-controller-manager-5b6c8b8c96-d4pmz"
Jul 30 20:33:52.701345 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:52.701322    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-66684cbb98-9m4n8"
Jul 30 20:33:52.738701 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:52.738673    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5b6c8b8c96-d4pmz"
Jul 30 20:33:52.918067 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:33:52.917970    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca860230_adcc_4965_90bc_992b6aa0b787.slice/crio-f5e06a5ce57099697ac04a86e3bdc4f57e67d6cea2f9fefbd0aa73944bb4bff7 WatchSource:0}: Error finding container f5e06a5ce57099697ac04a86e3bdc4f57e67d6cea2f9fefbd0aa73944bb4bff7: Status 404 returned error can't find the container with id f5e06a5ce57099697ac04a86e3bdc4f57e67d6cea2f9fefbd0aa73944bb4bff7
Jul 30 20:33:52.922084 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:52.922059    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-66684cbb98-9m4n8"]
Jul 30 20:33:52.974454 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:52.974426    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5b6c8b8c96-d4pmz"]
Jul 30 20:33:52.980111 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:33:52.980084    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda79474e8_d1c1_45d9_a457_b487b0f55951.slice/crio-7bc787c2995a2958dea26cdc92df47aadea855adc94570f8084014cf2e0d9c6a WatchSource:0}: Error finding container 7bc787c2995a2958dea26cdc92df47aadea855adc94570f8084014cf2e0d9c6a: Status 404 returned error can't find the container with id 7bc787c2995a2958dea26cdc92df47aadea855adc94570f8084014cf2e0d9c6a
Jul 30 20:33:53.018872 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:53.018841    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:33:53.134379 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:53.134268    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:33:53.251409 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:53.251371    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:33:53.717513 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:53.717473    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5b6c8b8c96-d4pmz" event={"ID":"a79474e8-d1c1-45d9-a457-b487b0f55951","Type":"ContainerStarted","Data":"7bc787c2995a2958dea26cdc92df47aadea855adc94570f8084014cf2e0d9c6a"}
Jul 30 20:33:53.719290 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:53.719253    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-66684cbb98-9m4n8" event={"ID":"ca860230-adcc-4965-90bc-992b6aa0b787","Type":"ContainerStarted","Data":"f5e06a5ce57099697ac04a86e3bdc4f57e67d6cea2f9fefbd0aa73944bb4bff7"}
Jul 30 20:33:54.037986 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:54.037896    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:33:54.286511 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:54.286422    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:33:54.433622 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:54.433580    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:33:54.733697 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:54.733612    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:33:55.340609 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:55.340511    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:33:55.731562 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:55.731522    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5b6c8b8c96-d4pmz" event={"ID":"a79474e8-d1c1-45d9-a457-b487b0f55951","Type":"ContainerStarted","Data":"d479eec1c696b3e711c57369630c0aad4ddc96d2f95c68212a7afaa5e6c48784"}
Jul 30 20:33:55.731791 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:55.731622    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5b6c8b8c96-d4pmz"
Jul 30 20:33:55.733170 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:55.733129    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-66684cbb98-9m4n8" event={"ID":"ca860230-adcc-4965-90bc-992b6aa0b787","Type":"ContainerStarted","Data":"633e37ce385901d1e59ae43a1cd44418bd8a3c31793f2f4d63dda13e0bc9e00e"}
Jul 30 20:33:55.746280 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:55.746228    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5b6c8b8c96-d4pmz" podStartSLOduration=1.353876874 podStartE2EDuration="3.746213863s" totalImagesPullingTime="2.392336989s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:33:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:33:55.744889558 +0000 UTC m=+547.586365181" watchObservedRunningTime="2026-07-30 20:33:55.746213863 +0000 UTC m=+547.587689485"
Jul 30 20:33:55.759703 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:33:55.759651    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-66684cbb98-9m4n8" podStartSLOduration=1.258558147 podStartE2EDuration="3.759634249s" totalImagesPullingTime="2.501076102s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:33:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:33:55.759472326 +0000 UTC m=+547.600948012" watchObservedRunningTime="2026-07-30 20:33:55.759634249 +0000 UTC m=+547.601109873"
Jul 30 20:34:00.728585 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:34:00.728549    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:34:00.828231 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:34:00.828202    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:34:01.486779 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:34:01.486737    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:34:01.611764 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:34:01.611728    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:34:01.814778 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:34:01.814681    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:34:01.972805 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:34:01.972766    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:34:02.663264 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:34:02.663224    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:34:02.781837 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:34:02.781799    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:34:02.865073 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:34:02.865041    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:34:03.220740 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:34:03.220693    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:34:03.343105 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:34:03.343067    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:34:03.465489 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:34:03.465457    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:34:04.030809 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:34:04.030777    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:34:04.144758 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:34:04.144716    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:34:06.739936 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:34:06.739906    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5b6c8b8c96-d4pmz"
Jul 30 20:34:22.584673 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:34:22.584634    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:34:22.685514 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:34:22.685471    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:34:53.324195 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:34:53.324126    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:34:54.837469 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:34:54.837432    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:34:56.235541 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:34:56.235501    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cwqc8k"]
Jul 30 20:34:56.239274 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:34:56.239252    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cwqc8k"
Jul 30 20:34:56.241496 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:34:56.241474    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 30 20:34:56.241952 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:34:56.241935    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 30 20:34:56.241952 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:34:56.241944    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-qlc5n\""
Jul 30 20:34:56.246204 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:34:56.246179    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cwqc8k"]
Jul 30 20:34:56.263524 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:34:56.263501    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/615a0878-4f4d-4503-a4e2-d112accd7b5e-bundle\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cwqc8k\" (UID: \"615a0878-4f4d-4503-a4e2-d112accd7b5e\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cwqc8k"
Jul 30 20:34:56.263630 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:34:56.263533    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2df7\" (UniqueName: \"kubernetes.io/projected/615a0878-4f4d-4503-a4e2-d112accd7b5e-kube-api-access-j2df7\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cwqc8k\" (UID: \"615a0878-4f4d-4503-a4e2-d112accd7b5e\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cwqc8k"
Jul 30 20:34:56.263630 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:34:56.263603    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/615a0878-4f4d-4503-a4e2-d112accd7b5e-util\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cwqc8k\" (UID: \"615a0878-4f4d-4503-a4e2-d112accd7b5e\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cwqc8k"
Jul 30 20:34:56.334912 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:34:56.334882    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0b2j9j"]
Jul 30 20:34:56.338502 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:34:56.338487    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0b2j9j"
Jul 30 20:34:56.345772 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:34:56.345617    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0b2j9j"]
Jul 30 20:34:56.364077 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:34:56.364057    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/320b5344-9386-42c5-afe9-25431502b6fe-bundle\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0b2j9j\" (UID: \"320b5344-9386-42c5-afe9-25431502b6fe\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0b2j9j"
Jul 30 20:34:56.364201 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:34:56.364097    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggqt9\" (UniqueName: \"kubernetes.io/projected/320b5344-9386-42c5-afe9-25431502b6fe-kube-api-access-ggqt9\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0b2j9j\" (UID: \"320b5344-9386-42c5-afe9-25431502b6fe\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0b2j9j"
Jul 30 20:34:56.364201 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:34:56.364171    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/615a0878-4f4d-4503-a4e2-d112accd7b5e-bundle\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cwqc8k\" (UID: \"615a0878-4f4d-4503-a4e2-d112accd7b5e\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cwqc8k"
Jul 30 20:34:56.364201 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:34:56.364196    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2df7\" (UniqueName: \"kubernetes.io/projected/615a0878-4f4d-4503-a4e2-d112accd7b5e-kube-api-access-j2df7\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cwqc8k\" (UID: \"615a0878-4f4d-4503-a4e2-d112accd7b5e\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cwqc8k"
Jul 30 20:34:56.364400 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:34:56.364239    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/320b5344-9386-42c5-afe9-25431502b6fe-util\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0b2j9j\" (UID: \"320b5344-9386-42c5-afe9-25431502b6fe\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0b2j9j"
Jul 30 20:34:56.364400 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:34:56.364260    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/615a0878-4f4d-4503-a4e2-d112accd7b5e-util\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cwqc8k\" (UID: \"615a0878-4f4d-4503-a4e2-d112accd7b5e\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cwqc8k"
Jul 30 20:34:56.364511 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:34:56.364494    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/615a0878-4f4d-4503-a4e2-d112accd7b5e-bundle\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cwqc8k\" (UID: \"615a0878-4f4d-4503-a4e2-d112accd7b5e\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cwqc8k"
Jul 30 20:34:56.364578 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:34:56.364554    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/615a0878-4f4d-4503-a4e2-d112accd7b5e-util\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cwqc8k\" (UID: \"615a0878-4f4d-4503-a4e2-d112accd7b5e\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cwqc8k"
Jul 30 20:34:56.371981 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:34:56.371955    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2df7\" (UniqueName: \"kubernetes.io/projected/615a0878-4f4d-4503-a4e2-d112accd7b5e-kube-api-access-j2df7\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cwqc8k\" (UID: \"615a0878-4f4d-4503-a4e2-d112accd7b5e\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cwqc8k"
Jul 30 20:34:56.430421 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:34:56.430387    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbkc645"]
Jul 30 20:34:56.434010 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:34:56.433995    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbkc645"
Jul 30 20:34:56.440678 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:34:56.440653    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbkc645"]
Jul 30 20:34:56.465250 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:34:56.465222    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b58ad287-6e32-427a-a440-e8412be9e4ac-bundle\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbkc645\" (UID: \"b58ad287-6e32-427a-a440-e8412be9e4ac\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbkc645"
Jul 30 20:34:56.465385 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:34:56.465258    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b58ad287-6e32-427a-a440-e8412be9e4ac-util\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbkc645\" (UID: \"b58ad287-6e32-427a-a440-e8412be9e4ac\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbkc645"
Jul 30 20:34:56.465385 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:34:56.465285    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/320b5344-9386-42c5-afe9-25431502b6fe-util\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0b2j9j\" (UID: \"320b5344-9386-42c5-afe9-25431502b6fe\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0b2j9j"
Jul 30 20:34:56.465385 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:34:56.465358    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5zqql\" (UniqueName: \"kubernetes.io/projected/b58ad287-6e32-427a-a440-e8412be9e4ac-kube-api-access-5zqql\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbkc645\" (UID: \"b58ad287-6e32-427a-a440-e8412be9e4ac\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbkc645"
Jul 30 20:34:56.465489 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:34:56.465418    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/320b5344-9386-42c5-afe9-25431502b6fe-bundle\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0b2j9j\" (UID: \"320b5344-9386-42c5-afe9-25431502b6fe\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0b2j9j"
Jul 30 20:34:56.465489 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:34:56.465459    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ggqt9\" (UniqueName: \"kubernetes.io/projected/320b5344-9386-42c5-afe9-25431502b6fe-kube-api-access-ggqt9\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0b2j9j\" (UID: \"320b5344-9386-42c5-afe9-25431502b6fe\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0b2j9j"
Jul 30 20:34:56.465736 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:34:56.465716    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/320b5344-9386-42c5-afe9-25431502b6fe-util\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0b2j9j\" (UID: \"320b5344-9386-42c5-afe9-25431502b6fe\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0b2j9j"
Jul 30 20:34:56.465771 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:34:56.465727    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/320b5344-9386-42c5-afe9-25431502b6fe-bundle\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0b2j9j\" (UID: \"320b5344-9386-42c5-afe9-25431502b6fe\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0b2j9j"
Jul 30 20:34:56.473716 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:34:56.473694    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggqt9\" (UniqueName: \"kubernetes.io/projected/320b5344-9386-42c5-afe9-25431502b6fe-kube-api-access-ggqt9\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0b2j9j\" (UID: \"320b5344-9386-42c5-afe9-25431502b6fe\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0b2j9j"
Jul 30 20:34:56.533334 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:34:56.533268    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053k6fsd"]
Jul 30 20:34:56.536933 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:34:56.536917    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053k6fsd"
Jul 30 20:34:56.544014 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:34:56.543983    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053k6fsd"]
Jul 30 20:34:56.550122 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:34:56.550105    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cwqc8k"
Jul 30 20:34:56.566505 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:34:56.566472    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b58ad287-6e32-427a-a440-e8412be9e4ac-util\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbkc645\" (UID: \"b58ad287-6e32-427a-a440-e8412be9e4ac\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbkc645"
Jul 30 20:34:56.566621 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:34:56.566522    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-js8kp\" (UniqueName: \"kubernetes.io/projected/fe4ffd58-ad9b-404c-b592-f286d425023e-kube-api-access-js8kp\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053k6fsd\" (UID: \"fe4ffd58-ad9b-404c-b592-f286d425023e\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053k6fsd"
Jul 30 20:34:56.566621 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:34:56.566588    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5zqql\" (UniqueName: \"kubernetes.io/projected/b58ad287-6e32-427a-a440-e8412be9e4ac-kube-api-access-5zqql\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbkc645\" (UID: \"b58ad287-6e32-427a-a440-e8412be9e4ac\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbkc645"
Jul 30 20:34:56.566741 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:34:56.566630    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fe4ffd58-ad9b-404c-b592-f286d425023e-util\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053k6fsd\" (UID: \"fe4ffd58-ad9b-404c-b592-f286d425023e\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053k6fsd"
Jul 30 20:34:56.566741 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:34:56.566718    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b58ad287-6e32-427a-a440-e8412be9e4ac-bundle\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbkc645\" (UID: \"b58ad287-6e32-427a-a440-e8412be9e4ac\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbkc645"
Jul 30 20:34:56.566851 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:34:56.566744    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fe4ffd58-ad9b-404c-b592-f286d425023e-bundle\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053k6fsd\" (UID: \"fe4ffd58-ad9b-404c-b592-f286d425023e\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053k6fsd"
Jul 30 20:34:56.566904 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:34:56.566846    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b58ad287-6e32-427a-a440-e8412be9e4ac-util\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbkc645\" (UID: \"b58ad287-6e32-427a-a440-e8412be9e4ac\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbkc645"
Jul 30 20:34:56.567089 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:34:56.567068    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b58ad287-6e32-427a-a440-e8412be9e4ac-bundle\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbkc645\" (UID: \"b58ad287-6e32-427a-a440-e8412be9e4ac\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbkc645"
Jul 30 20:34:56.575255 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:34:56.575231    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5zqql\" (UniqueName: \"kubernetes.io/projected/b58ad287-6e32-427a-a440-e8412be9e4ac-kube-api-access-5zqql\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbkc645\" (UID: \"b58ad287-6e32-427a-a440-e8412be9e4ac\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbkc645"
Jul 30 20:34:56.648536 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:34:56.648510    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0b2j9j"
Jul 30 20:34:56.668021 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:34:56.667993    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fe4ffd58-ad9b-404c-b592-f286d425023e-bundle\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053k6fsd\" (UID: \"fe4ffd58-ad9b-404c-b592-f286d425023e\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053k6fsd"
Jul 30 20:34:56.668175 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:34:56.668049    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-js8kp\" (UniqueName: \"kubernetes.io/projected/fe4ffd58-ad9b-404c-b592-f286d425023e-kube-api-access-js8kp\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053k6fsd\" (UID: \"fe4ffd58-ad9b-404c-b592-f286d425023e\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053k6fsd"
Jul 30 20:34:56.668175 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:34:56.668128    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fe4ffd58-ad9b-404c-b592-f286d425023e-util\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053k6fsd\" (UID: \"fe4ffd58-ad9b-404c-b592-f286d425023e\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053k6fsd"
Jul 30 20:34:56.668443 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:34:56.668420    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fe4ffd58-ad9b-404c-b592-f286d425023e-bundle\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053k6fsd\" (UID: \"fe4ffd58-ad9b-404c-b592-f286d425023e\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053k6fsd"
Jul 30 20:34:56.668502 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:34:56.668482    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fe4ffd58-ad9b-404c-b592-f286d425023e-util\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053k6fsd\" (UID: \"fe4ffd58-ad9b-404c-b592-f286d425023e\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053k6fsd"
Jul 30 20:34:56.678018 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:34:56.677990    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-js8kp\" (UniqueName: \"kubernetes.io/projected/fe4ffd58-ad9b-404c-b592-f286d425023e-kube-api-access-js8kp\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053k6fsd\" (UID: \"fe4ffd58-ad9b-404c-b592-f286d425023e\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053k6fsd"
Jul 30 20:34:56.688702 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:34:56.688634    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cwqc8k"]
Jul 30 20:34:56.691755 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:34:56.691729    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod615a0878_4f4d_4503_a4e2_d112accd7b5e.slice/crio-f45271eb041908290d4bb069915bec7844b6c0e7933f44f64d12e357cda73760 WatchSource:0}: Error finding container f45271eb041908290d4bb069915bec7844b6c0e7933f44f64d12e357cda73760: Status 404 returned error can't find the container with id f45271eb041908290d4bb069915bec7844b6c0e7933f44f64d12e357cda73760
Jul 30 20:34:56.744228 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:34:56.744195    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbkc645"
Jul 30 20:34:56.798324 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:34:56.798297    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0b2j9j"]
Jul 30 20:34:56.801066 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:34:56.801018    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod320b5344_9386_42c5_afe9_25431502b6fe.slice/crio-5f5d5cf04d0dbd53f19279fcd45f40d47d0f25d6e2b5fe1f54d2a5f74ef809ad WatchSource:0}: Error finding container 5f5d5cf04d0dbd53f19279fcd45f40d47d0f25d6e2b5fe1f54d2a5f74ef809ad: Status 404 returned error can't find the container with id 5f5d5cf04d0dbd53f19279fcd45f40d47d0f25d6e2b5fe1f54d2a5f74ef809ad
Jul 30 20:34:56.847655 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:34:56.847630    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053k6fsd"
Jul 30 20:34:56.898535 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:34:56.898504    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbkc645"]
Jul 30 20:34:56.900267 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:34:56.900234    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb58ad287_6e32_427a_a440_e8412be9e4ac.slice/crio-efbb8c024f90972ef6f2af4f958a14ed37f233ab9cf3f4c2668eaaf3b9582ae5 WatchSource:0}: Error finding container efbb8c024f90972ef6f2af4f958a14ed37f233ab9cf3f4c2668eaaf3b9582ae5: Status 404 returned error can't find the container with id efbb8c024f90972ef6f2af4f958a14ed37f233ab9cf3f4c2668eaaf3b9582ae5
Jul 30 20:34:57.009483 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:34:57.009459    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053k6fsd"]
Jul 30 20:34:57.014794 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:34:57.012205    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe4ffd58_ad9b_404c_b592_f286d425023e.slice/crio-3144dcf59dca8b66f4950d54297220c1fe028a717c6407bf57fc52ef4ed09b7b WatchSource:0}: Error finding container 3144dcf59dca8b66f4950d54297220c1fe028a717c6407bf57fc52ef4ed09b7b: Status 404 returned error can't find the container with id 3144dcf59dca8b66f4950d54297220c1fe028a717c6407bf57fc52ef4ed09b7b
Jul 30 20:34:57.046456 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:34:57.046428    2583 generic.go:356] "Generic (PLEG): container finished" podID="320b5344-9386-42c5-afe9-25431502b6fe" containerID="9b732b00b9ba442becf3e68f8393f29fbadc7e5e466fb1a6c30fd9405fd7c76f" exitCode=0
Jul 30 20:34:57.046686 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:34:57.046512    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0b2j9j" event={"ID":"320b5344-9386-42c5-afe9-25431502b6fe","Type":"ContainerDied","Data":"9b732b00b9ba442becf3e68f8393f29fbadc7e5e466fb1a6c30fd9405fd7c76f"}
Jul 30 20:34:57.046686 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:34:57.046563    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0b2j9j" event={"ID":"320b5344-9386-42c5-afe9-25431502b6fe","Type":"ContainerStarted","Data":"5f5d5cf04d0dbd53f19279fcd45f40d47d0f25d6e2b5fe1f54d2a5f74ef809ad"}
Jul 30 20:34:57.047643 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:34:57.047591    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 30 20:34:57.048096 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:34:57.048001    2583 generic.go:356] "Generic (PLEG): container finished" podID="615a0878-4f4d-4503-a4e2-d112accd7b5e" containerID="e106e3554a182177d05db17e40ce0b7e12bce8fb07c48a1465b0a76ed856fd5f" exitCode=0
Jul 30 20:34:57.048096 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:34:57.048084    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cwqc8k" event={"ID":"615a0878-4f4d-4503-a4e2-d112accd7b5e","Type":"ContainerDied","Data":"e106e3554a182177d05db17e40ce0b7e12bce8fb07c48a1465b0a76ed856fd5f"}
Jul 30 20:34:57.048337 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:34:57.048126    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cwqc8k" event={"ID":"615a0878-4f4d-4503-a4e2-d112accd7b5e","Type":"ContainerStarted","Data":"f45271eb041908290d4bb069915bec7844b6c0e7933f44f64d12e357cda73760"}
Jul 30 20:34:57.049748 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:34:57.049683    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053k6fsd" event={"ID":"fe4ffd58-ad9b-404c-b592-f286d425023e","Type":"ContainerStarted","Data":"3144dcf59dca8b66f4950d54297220c1fe028a717c6407bf57fc52ef4ed09b7b"}
Jul 30 20:34:57.051585 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:34:57.051567    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbkc645" event={"ID":"b58ad287-6e32-427a-a440-e8412be9e4ac","Type":"ContainerStarted","Data":"0aec3b2359ef6110bd62228985f103919fed2befb2f948e8bbe84060157ed51f"}
Jul 30 20:34:57.051644 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:34:57.051600    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbkc645" event={"ID":"b58ad287-6e32-427a-a440-e8412be9e4ac","Type":"ContainerStarted","Data":"efbb8c024f90972ef6f2af4f958a14ed37f233ab9cf3f4c2668eaaf3b9582ae5"}
Jul 30 20:34:58.058637 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:34:58.058605    2583 generic.go:356] "Generic (PLEG): container finished" podID="fe4ffd58-ad9b-404c-b592-f286d425023e" containerID="c0391872ffb003f6544f15ba4d9f337f1a9eb999f4416d6317bcbb551f4fee18" exitCode=0
Jul 30 20:34:58.058980 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:34:58.058660    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053k6fsd" event={"ID":"fe4ffd58-ad9b-404c-b592-f286d425023e","Type":"ContainerDied","Data":"c0391872ffb003f6544f15ba4d9f337f1a9eb999f4416d6317bcbb551f4fee18"}
Jul 30 20:34:58.060398 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:34:58.060378    2583 generic.go:356] "Generic (PLEG): container finished" podID="b58ad287-6e32-427a-a440-e8412be9e4ac" containerID="0aec3b2359ef6110bd62228985f103919fed2befb2f948e8bbe84060157ed51f" exitCode=0
Jul 30 20:34:58.060465 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:34:58.060448    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbkc645" event={"ID":"b58ad287-6e32-427a-a440-e8412be9e4ac","Type":"ContainerDied","Data":"0aec3b2359ef6110bd62228985f103919fed2befb2f948e8bbe84060157ed51f"}
Jul 30 20:34:59.067658 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:34:59.067628    2583 generic.go:356] "Generic (PLEG): container finished" podID="fe4ffd58-ad9b-404c-b592-f286d425023e" containerID="9cebb136d54af54d737263915671fa45d05c75abefd69a436f330326f5dbd39e" exitCode=0
Jul 30 20:34:59.068020 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:34:59.067710    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053k6fsd" event={"ID":"fe4ffd58-ad9b-404c-b592-f286d425023e","Type":"ContainerDied","Data":"9cebb136d54af54d737263915671fa45d05c75abefd69a436f330326f5dbd39e"}
Jul 30 20:34:59.069670 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:34:59.069649    2583 generic.go:356] "Generic (PLEG): container finished" podID="b58ad287-6e32-427a-a440-e8412be9e4ac" containerID="d857161adbb1a4a922d4f04cdb8cb9acf0f39ce8fc3ace680c4aaf003661305c" exitCode=0
Jul 30 20:34:59.069751 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:34:59.069719    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbkc645" event={"ID":"b58ad287-6e32-427a-a440-e8412be9e4ac","Type":"ContainerDied","Data":"d857161adbb1a4a922d4f04cdb8cb9acf0f39ce8fc3ace680c4aaf003661305c"}
Jul 30 20:34:59.262364 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:34:59.262338    2583 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb58ad287_6e32_427a_a440_e8412be9e4ac.slice/crio-conmon-32b48927de17c7a1c968ac24e2c775a3bd080d36c8d370f1548df91a765b5efd.scope\": RecentStats: unable to find data in memory cache]"
Jul 30 20:35:00.076712 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:00.076680    2583 generic.go:356] "Generic (PLEG): container finished" podID="fe4ffd58-ad9b-404c-b592-f286d425023e" containerID="7b914f4c433054ff0cb73f99b9c66b3f52643fb6096777754656b30f7ec2afae" exitCode=0
Jul 30 20:35:00.077104 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:00.076773    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053k6fsd" event={"ID":"fe4ffd58-ad9b-404c-b592-f286d425023e","Type":"ContainerDied","Data":"7b914f4c433054ff0cb73f99b9c66b3f52643fb6096777754656b30f7ec2afae"}
Jul 30 20:35:00.078880 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:00.078856    2583 generic.go:356] "Generic (PLEG): container finished" podID="b58ad287-6e32-427a-a440-e8412be9e4ac" containerID="32b48927de17c7a1c968ac24e2c775a3bd080d36c8d370f1548df91a765b5efd" exitCode=0
Jul 30 20:35:00.079012 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:00.078942    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbkc645" event={"ID":"b58ad287-6e32-427a-a440-e8412be9e4ac","Type":"ContainerDied","Data":"32b48927de17c7a1c968ac24e2c775a3bd080d36c8d370f1548df91a765b5efd"}
Jul 30 20:35:01.217830 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:01.217806    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053k6fsd"
Jul 30 20:35:01.244965 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:01.244943    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbkc645"
Jul 30 20:35:01.311258 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:01.311222    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5zqql\" (UniqueName: \"kubernetes.io/projected/b58ad287-6e32-427a-a440-e8412be9e4ac-kube-api-access-5zqql\") pod \"b58ad287-6e32-427a-a440-e8412be9e4ac\" (UID: \"b58ad287-6e32-427a-a440-e8412be9e4ac\") "
Jul 30 20:35:01.311431 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:01.311269    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b58ad287-6e32-427a-a440-e8412be9e4ac-util\") pod \"b58ad287-6e32-427a-a440-e8412be9e4ac\" (UID: \"b58ad287-6e32-427a-a440-e8412be9e4ac\") "
Jul 30 20:35:01.311431 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:01.311285    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-js8kp\" (UniqueName: \"kubernetes.io/projected/fe4ffd58-ad9b-404c-b592-f286d425023e-kube-api-access-js8kp\") pod \"fe4ffd58-ad9b-404c-b592-f286d425023e\" (UID: \"fe4ffd58-ad9b-404c-b592-f286d425023e\") "
Jul 30 20:35:01.311431 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:01.311326    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fe4ffd58-ad9b-404c-b592-f286d425023e-util\") pod \"fe4ffd58-ad9b-404c-b592-f286d425023e\" (UID: \"fe4ffd58-ad9b-404c-b592-f286d425023e\") "
Jul 30 20:35:01.311431 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:01.311389    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b58ad287-6e32-427a-a440-e8412be9e4ac-bundle\") pod \"b58ad287-6e32-427a-a440-e8412be9e4ac\" (UID: \"b58ad287-6e32-427a-a440-e8412be9e4ac\") "
Jul 30 20:35:01.311431 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:01.311424    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fe4ffd58-ad9b-404c-b592-f286d425023e-bundle\") pod \"fe4ffd58-ad9b-404c-b592-f286d425023e\" (UID: \"fe4ffd58-ad9b-404c-b592-f286d425023e\") "
Jul 30 20:35:01.311938 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:01.311910    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b58ad287-6e32-427a-a440-e8412be9e4ac-bundle" (OuterVolumeSpecName: "bundle") pod "b58ad287-6e32-427a-a440-e8412be9e4ac" (UID: "b58ad287-6e32-427a-a440-e8412be9e4ac"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:35:01.312277 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:01.312250    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe4ffd58-ad9b-404c-b592-f286d425023e-bundle" (OuterVolumeSpecName: "bundle") pod "fe4ffd58-ad9b-404c-b592-f286d425023e" (UID: "fe4ffd58-ad9b-404c-b592-f286d425023e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:35:01.314061 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:01.314040    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b58ad287-6e32-427a-a440-e8412be9e4ac-kube-api-access-5zqql" (OuterVolumeSpecName: "kube-api-access-5zqql") pod "b58ad287-6e32-427a-a440-e8412be9e4ac" (UID: "b58ad287-6e32-427a-a440-e8412be9e4ac"). InnerVolumeSpecName "kube-api-access-5zqql". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:35:01.314151 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:01.314035    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe4ffd58-ad9b-404c-b592-f286d425023e-kube-api-access-js8kp" (OuterVolumeSpecName: "kube-api-access-js8kp") pod "fe4ffd58-ad9b-404c-b592-f286d425023e" (UID: "fe4ffd58-ad9b-404c-b592-f286d425023e"). InnerVolumeSpecName "kube-api-access-js8kp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:35:01.317173 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:01.317117    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b58ad287-6e32-427a-a440-e8412be9e4ac-util" (OuterVolumeSpecName: "util") pod "b58ad287-6e32-427a-a440-e8412be9e4ac" (UID: "b58ad287-6e32-427a-a440-e8412be9e4ac"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:35:01.319322 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:01.319299    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe4ffd58-ad9b-404c-b592-f286d425023e-util" (OuterVolumeSpecName: "util") pod "fe4ffd58-ad9b-404c-b592-f286d425023e" (UID: "fe4ffd58-ad9b-404c-b592-f286d425023e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:35:01.412892 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:01.412861    2583 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b58ad287-6e32-427a-a440-e8412be9e4ac-bundle\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 20:35:01.412892 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:01.412889    2583 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fe4ffd58-ad9b-404c-b592-f286d425023e-bundle\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 20:35:01.413053 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:01.412898    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5zqql\" (UniqueName: \"kubernetes.io/projected/b58ad287-6e32-427a-a440-e8412be9e4ac-kube-api-access-5zqql\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 20:35:01.413053 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:01.412908    2583 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b58ad287-6e32-427a-a440-e8412be9e4ac-util\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 20:35:01.413053 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:01.412918    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-js8kp\" (UniqueName: \"kubernetes.io/projected/fe4ffd58-ad9b-404c-b592-f286d425023e-kube-api-access-js8kp\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 20:35:01.413053 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:01.412927    2583 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fe4ffd58-ad9b-404c-b592-f286d425023e-util\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 20:35:02.090875 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:02.090841    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053k6fsd"
Jul 30 20:35:02.091046 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:02.090840    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053k6fsd" event={"ID":"fe4ffd58-ad9b-404c-b592-f286d425023e","Type":"ContainerDied","Data":"3144dcf59dca8b66f4950d54297220c1fe028a717c6407bf57fc52ef4ed09b7b"}
Jul 30 20:35:02.091046 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:02.090964    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3144dcf59dca8b66f4950d54297220c1fe028a717c6407bf57fc52ef4ed09b7b"
Jul 30 20:35:02.092879 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:02.092848    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbkc645"
Jul 30 20:35:02.092997 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:02.092876    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbkc645" event={"ID":"b58ad287-6e32-427a-a440-e8412be9e4ac","Type":"ContainerDied","Data":"efbb8c024f90972ef6f2af4f958a14ed37f233ab9cf3f4c2668eaaf3b9582ae5"}
Jul 30 20:35:02.092997 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:02.092919    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="efbb8c024f90972ef6f2af4f958a14ed37f233ab9cf3f4c2668eaaf3b9582ae5"
Jul 30 20:35:06.115114 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:06.115080    2583 generic.go:356] "Generic (PLEG): container finished" podID="615a0878-4f4d-4503-a4e2-d112accd7b5e" containerID="f39c769ad9e43e2fd815ce0fab397092d26d816d803170966b2770b3d699a4fe" exitCode=0
Jul 30 20:35:06.115527 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:06.115127    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cwqc8k" event={"ID":"615a0878-4f4d-4503-a4e2-d112accd7b5e","Type":"ContainerDied","Data":"f39c769ad9e43e2fd815ce0fab397092d26d816d803170966b2770b3d699a4fe"}
Jul 30 20:35:07.121961 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:07.121930    2583 generic.go:356] "Generic (PLEG): container finished" podID="320b5344-9386-42c5-afe9-25431502b6fe" containerID="a96689fce5f7ed12b397132de265c2d006788ee860dd4f861f58ad15c6f3deba" exitCode=0
Jul 30 20:35:07.122415 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:07.122004    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0b2j9j" event={"ID":"320b5344-9386-42c5-afe9-25431502b6fe","Type":"ContainerDied","Data":"a96689fce5f7ed12b397132de265c2d006788ee860dd4f861f58ad15c6f3deba"}
Jul 30 20:35:07.124223 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:07.124199    2583 generic.go:356] "Generic (PLEG): container finished" podID="615a0878-4f4d-4503-a4e2-d112accd7b5e" containerID="378123b62abc12a61f1d6b45cec76fe540cfa6e5b319ceb2d4e8f196658b0fe0" exitCode=0
Jul 30 20:35:07.124329 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:07.124284    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cwqc8k" event={"ID":"615a0878-4f4d-4503-a4e2-d112accd7b5e","Type":"ContainerDied","Data":"378123b62abc12a61f1d6b45cec76fe540cfa6e5b319ceb2d4e8f196658b0fe0"}
Jul 30 20:35:08.131589 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:08.131551    2583 generic.go:356] "Generic (PLEG): container finished" podID="320b5344-9386-42c5-afe9-25431502b6fe" containerID="cf32f4c367ad40b75c89cccdde4a4eeb315900e6aa85db7b71affe213729de28" exitCode=0
Jul 30 20:35:08.132050 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:08.131627    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0b2j9j" event={"ID":"320b5344-9386-42c5-afe9-25431502b6fe","Type":"ContainerDied","Data":"cf32f4c367ad40b75c89cccdde4a4eeb315900e6aa85db7b71affe213729de28"}
Jul 30 20:35:08.270366 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:08.270343    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cwqc8k"
Jul 30 20:35:08.376575 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:08.376546    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j2df7\" (UniqueName: \"kubernetes.io/projected/615a0878-4f4d-4503-a4e2-d112accd7b5e-kube-api-access-j2df7\") pod \"615a0878-4f4d-4503-a4e2-d112accd7b5e\" (UID: \"615a0878-4f4d-4503-a4e2-d112accd7b5e\") "
Jul 30 20:35:08.376727 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:08.376590    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/615a0878-4f4d-4503-a4e2-d112accd7b5e-bundle\") pod \"615a0878-4f4d-4503-a4e2-d112accd7b5e\" (UID: \"615a0878-4f4d-4503-a4e2-d112accd7b5e\") "
Jul 30 20:35:08.376798 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:08.376779    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/615a0878-4f4d-4503-a4e2-d112accd7b5e-util\") pod \"615a0878-4f4d-4503-a4e2-d112accd7b5e\" (UID: \"615a0878-4f4d-4503-a4e2-d112accd7b5e\") "
Jul 30 20:35:08.377262 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:08.377228    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/615a0878-4f4d-4503-a4e2-d112accd7b5e-bundle" (OuterVolumeSpecName: "bundle") pod "615a0878-4f4d-4503-a4e2-d112accd7b5e" (UID: "615a0878-4f4d-4503-a4e2-d112accd7b5e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:35:08.378791 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:08.378769    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/615a0878-4f4d-4503-a4e2-d112accd7b5e-kube-api-access-j2df7" (OuterVolumeSpecName: "kube-api-access-j2df7") pod "615a0878-4f4d-4503-a4e2-d112accd7b5e" (UID: "615a0878-4f4d-4503-a4e2-d112accd7b5e"). InnerVolumeSpecName "kube-api-access-j2df7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:35:08.381363 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:08.381343    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/615a0878-4f4d-4503-a4e2-d112accd7b5e-util" (OuterVolumeSpecName: "util") pod "615a0878-4f4d-4503-a4e2-d112accd7b5e" (UID: "615a0878-4f4d-4503-a4e2-d112accd7b5e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:35:08.477492 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:08.477459    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j2df7\" (UniqueName: \"kubernetes.io/projected/615a0878-4f4d-4503-a4e2-d112accd7b5e-kube-api-access-j2df7\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 20:35:08.477492 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:08.477487    2583 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/615a0878-4f4d-4503-a4e2-d112accd7b5e-bundle\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 20:35:08.477492 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:08.477498    2583 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/615a0878-4f4d-4503-a4e2-d112accd7b5e-util\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 20:35:09.139260 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:09.139178    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cwqc8k"
Jul 30 20:35:09.139617 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:09.139177    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cwqc8k" event={"ID":"615a0878-4f4d-4503-a4e2-d112accd7b5e","Type":"ContainerDied","Data":"f45271eb041908290d4bb069915bec7844b6c0e7933f44f64d12e357cda73760"}
Jul 30 20:35:09.139617 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:09.139294    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f45271eb041908290d4bb069915bec7844b6c0e7933f44f64d12e357cda73760"
Jul 30 20:35:09.294355 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:09.294333    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0b2j9j"
Jul 30 20:35:09.384260 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:09.384229    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/320b5344-9386-42c5-afe9-25431502b6fe-util\") pod \"320b5344-9386-42c5-afe9-25431502b6fe\" (UID: \"320b5344-9386-42c5-afe9-25431502b6fe\") "
Jul 30 20:35:09.384401 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:09.384297    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/320b5344-9386-42c5-afe9-25431502b6fe-bundle\") pod \"320b5344-9386-42c5-afe9-25431502b6fe\" (UID: \"320b5344-9386-42c5-afe9-25431502b6fe\") "
Jul 30 20:35:09.384401 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:09.384326    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ggqt9\" (UniqueName: \"kubernetes.io/projected/320b5344-9386-42c5-afe9-25431502b6fe-kube-api-access-ggqt9\") pod \"320b5344-9386-42c5-afe9-25431502b6fe\" (UID: \"320b5344-9386-42c5-afe9-25431502b6fe\") "
Jul 30 20:35:09.384724 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:09.384696    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/320b5344-9386-42c5-afe9-25431502b6fe-bundle" (OuterVolumeSpecName: "bundle") pod "320b5344-9386-42c5-afe9-25431502b6fe" (UID: "320b5344-9386-42c5-afe9-25431502b6fe"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:35:09.386462 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:09.386440    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/320b5344-9386-42c5-afe9-25431502b6fe-kube-api-access-ggqt9" (OuterVolumeSpecName: "kube-api-access-ggqt9") pod "320b5344-9386-42c5-afe9-25431502b6fe" (UID: "320b5344-9386-42c5-afe9-25431502b6fe"). InnerVolumeSpecName "kube-api-access-ggqt9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:35:09.391833 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:09.391769    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/320b5344-9386-42c5-afe9-25431502b6fe-util" (OuterVolumeSpecName: "util") pod "320b5344-9386-42c5-afe9-25431502b6fe" (UID: "320b5344-9386-42c5-afe9-25431502b6fe"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:35:09.485461 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:09.485431    2583 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/320b5344-9386-42c5-afe9-25431502b6fe-util\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 20:35:09.485461 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:09.485457    2583 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/320b5344-9386-42c5-afe9-25431502b6fe-bundle\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 20:35:09.485461 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:09.485466    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ggqt9\" (UniqueName: \"kubernetes.io/projected/320b5344-9386-42c5-afe9-25431502b6fe-kube-api-access-ggqt9\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 20:35:10.146498 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:10.146455    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0b2j9j" event={"ID":"320b5344-9386-42c5-afe9-25431502b6fe","Type":"ContainerDied","Data":"5f5d5cf04d0dbd53f19279fcd45f40d47d0f25d6e2b5fe1f54d2a5f74ef809ad"}
Jul 30 20:35:10.146498 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:10.146488    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0b2j9j"
Jul 30 20:35:10.146893 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:10.146515    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5f5d5cf04d0dbd53f19279fcd45f40d47d0f25d6e2b5fe1f54d2a5f74ef809ad"
Jul 30 20:35:12.481600 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:12.481564    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:35:13.949114 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:13.949078    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:35:14.090289 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:14.090257    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:35:14.706018 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:14.705988    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:35:14.803416 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:14.803379    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:35:14.901644 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:14.901610    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:35:15.255209 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:15.255173    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:35:16.310692 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:16.310658    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:35:16.418085 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:16.418053    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:35:17.608091 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:17.608057    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:35:18.060440 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:18.060402    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:35:18.467919 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:18.467885    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:35:18.846155 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:18.846072    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:35:19.116365 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:19.116292    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:35:19.224133 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:19.224104    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:35:22.289551 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:22.289515    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:35:23.719536 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:23.719492    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:35:24.589158 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:24.589103    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-68875d4b88-s2rwb"]
Jul 30 20:35:24.712804 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:24.712775    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:35:24.812935 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:24.812902    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:35:24.914717 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:24.914692    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:35:25.279129 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:25.279050    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:35:25.382779 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:25.382741    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:35:28.934569 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:28.934539    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-598f86468b-d78pg"]
Jul 30 20:35:28.934934 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:28.934870    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="320b5344-9386-42c5-afe9-25431502b6fe" containerName="util"
Jul 30 20:35:28.934934 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:28.934880    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="320b5344-9386-42c5-afe9-25431502b6fe" containerName="util"
Jul 30 20:35:28.934934 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:28.934891    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe4ffd58-ad9b-404c-b592-f286d425023e" containerName="util"
Jul 30 20:35:28.934934 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:28.934896    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe4ffd58-ad9b-404c-b592-f286d425023e" containerName="util"
Jul 30 20:35:28.934934 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:28.934904    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b58ad287-6e32-427a-a440-e8412be9e4ac" containerName="pull"
Jul 30 20:35:28.934934 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:28.934909    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="b58ad287-6e32-427a-a440-e8412be9e4ac" containerName="pull"
Jul 30 20:35:28.934934 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:28.934915    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="615a0878-4f4d-4503-a4e2-d112accd7b5e" containerName="util"
Jul 30 20:35:28.934934 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:28.934920    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="615a0878-4f4d-4503-a4e2-d112accd7b5e" containerName="util"
Jul 30 20:35:28.934934 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:28.934927    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="320b5344-9386-42c5-afe9-25431502b6fe" containerName="pull"
Jul 30 20:35:28.934934 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:28.934932    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="320b5344-9386-42c5-afe9-25431502b6fe" containerName="pull"
Jul 30 20:35:28.934934 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:28.934939    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="615a0878-4f4d-4503-a4e2-d112accd7b5e" containerName="pull"
Jul 30 20:35:28.935332 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:28.934944    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="615a0878-4f4d-4503-a4e2-d112accd7b5e" containerName="pull"
Jul 30 20:35:28.935332 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:28.934961    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b58ad287-6e32-427a-a440-e8412be9e4ac" containerName="util"
Jul 30 20:35:28.935332 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:28.934966    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="b58ad287-6e32-427a-a440-e8412be9e4ac" containerName="util"
Jul 30 20:35:28.935332 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:28.934971    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe4ffd58-ad9b-404c-b592-f286d425023e" containerName="pull"
Jul 30 20:35:28.935332 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:28.934976    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe4ffd58-ad9b-404c-b592-f286d425023e" containerName="pull"
Jul 30 20:35:28.935332 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:28.934982    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe4ffd58-ad9b-404c-b592-f286d425023e" containerName="extract"
Jul 30 20:35:28.935332 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:28.934986    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe4ffd58-ad9b-404c-b592-f286d425023e" containerName="extract"
Jul 30 20:35:28.935332 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:28.934991    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="320b5344-9386-42c5-afe9-25431502b6fe" containerName="extract"
Jul 30 20:35:28.935332 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:28.934995    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="320b5344-9386-42c5-afe9-25431502b6fe" containerName="extract"
Jul 30 20:35:28.935332 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:28.935002    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b58ad287-6e32-427a-a440-e8412be9e4ac" containerName="extract"
Jul 30 20:35:28.935332 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:28.935008    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="b58ad287-6e32-427a-a440-e8412be9e4ac" containerName="extract"
Jul 30 20:35:28.935332 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:28.935013    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="615a0878-4f4d-4503-a4e2-d112accd7b5e" containerName="extract"
Jul 30 20:35:28.935332 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:28.935017    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="615a0878-4f4d-4503-a4e2-d112accd7b5e" containerName="extract"
Jul 30 20:35:28.935332 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:28.935068    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe4ffd58-ad9b-404c-b592-f286d425023e" containerName="extract"
Jul 30 20:35:28.935332 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:28.935074    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="b58ad287-6e32-427a-a440-e8412be9e4ac" containerName="extract"
Jul 30 20:35:28.935332 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:28.935080    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="320b5344-9386-42c5-afe9-25431502b6fe" containerName="extract"
Jul 30 20:35:28.935332 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:28.935087    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="615a0878-4f4d-4503-a4e2-d112accd7b5e" containerName="extract"
Jul 30 20:35:28.938410 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:28.938377    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:35:28.939471 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:28.939455    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-d78pg"
Jul 30 20:35:28.941593 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:28.941567    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 30 20:35:28.941593 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:28.941584    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 30 20:35:28.941753 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:28.941591    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 30 20:35:28.942416 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:28.942288    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 30 20:35:28.942416 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:28.942292    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-fl9qc\""
Jul 30 20:35:28.944812 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:28.944788    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-598f86468b-d78pg"]
Jul 30 20:35:29.037593 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:29.037567    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:35:29.041527 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:29.041507    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/7adbbb32-e65e-4802-987e-5a950b3cde51-plugin-serving-cert\") pod \"kuadrant-console-plugin-598f86468b-d78pg\" (UID: \"7adbbb32-e65e-4802-987e-5a950b3cde51\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-d78pg"
Jul 30 20:35:29.041602 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:29.041544    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7adbbb32-e65e-4802-987e-5a950b3cde51-nginx-conf\") pod \"kuadrant-console-plugin-598f86468b-d78pg\" (UID: \"7adbbb32-e65e-4802-987e-5a950b3cde51\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-d78pg"
Jul 30 20:35:29.041650 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:29.041629    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzzpf\" (UniqueName: \"kubernetes.io/projected/7adbbb32-e65e-4802-987e-5a950b3cde51-kube-api-access-kzzpf\") pod \"kuadrant-console-plugin-598f86468b-d78pg\" (UID: \"7adbbb32-e65e-4802-987e-5a950b3cde51\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-d78pg"
Jul 30 20:35:29.142476 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:29.142446    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzzpf\" (UniqueName: \"kubernetes.io/projected/7adbbb32-e65e-4802-987e-5a950b3cde51-kube-api-access-kzzpf\") pod \"kuadrant-console-plugin-598f86468b-d78pg\" (UID: \"7adbbb32-e65e-4802-987e-5a950b3cde51\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-d78pg"
Jul 30 20:35:29.142629 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:29.142506    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/7adbbb32-e65e-4802-987e-5a950b3cde51-plugin-serving-cert\") pod \"kuadrant-console-plugin-598f86468b-d78pg\" (UID: \"7adbbb32-e65e-4802-987e-5a950b3cde51\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-d78pg"
Jul 30 20:35:29.142629 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:29.142545    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7adbbb32-e65e-4802-987e-5a950b3cde51-nginx-conf\") pod \"kuadrant-console-plugin-598f86468b-d78pg\" (UID: \"7adbbb32-e65e-4802-987e-5a950b3cde51\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-d78pg"
Jul 30 20:35:29.143210 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:29.143182    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7adbbb32-e65e-4802-987e-5a950b3cde51-nginx-conf\") pod \"kuadrant-console-plugin-598f86468b-d78pg\" (UID: \"7adbbb32-e65e-4802-987e-5a950b3cde51\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-d78pg"
Jul 30 20:35:29.145131 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:29.145115    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/7adbbb32-e65e-4802-987e-5a950b3cde51-plugin-serving-cert\") pod \"kuadrant-console-plugin-598f86468b-d78pg\" (UID: \"7adbbb32-e65e-4802-987e-5a950b3cde51\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-d78pg"
Jul 30 20:35:29.150371 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:29.150353    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzzpf\" (UniqueName: \"kubernetes.io/projected/7adbbb32-e65e-4802-987e-5a950b3cde51-kube-api-access-kzzpf\") pod \"kuadrant-console-plugin-598f86468b-d78pg\" (UID: \"7adbbb32-e65e-4802-987e-5a950b3cde51\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-d78pg"
Jul 30 20:35:29.249276 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:29.249203    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-d78pg"
Jul 30 20:35:29.391820 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:35:29.391789    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7adbbb32_e65e_4802_987e_5a950b3cde51.slice/crio-63483bc260655c48997cb4e8b7d0ec3485767c52e795c21916c5812e5167851d WatchSource:0}: Error finding container 63483bc260655c48997cb4e8b7d0ec3485767c52e795c21916c5812e5167851d: Status 404 returned error can't find the container with id 63483bc260655c48997cb4e8b7d0ec3485767c52e795c21916c5812e5167851d
Jul 30 20:35:29.391950 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:29.391907    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-598f86468b-d78pg"]
Jul 30 20:35:30.259073 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:30.259030    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-d78pg" event={"ID":"7adbbb32-e65e-4802-987e-5a950b3cde51","Type":"ContainerStarted","Data":"63483bc260655c48997cb4e8b7d0ec3485767c52e795c21916c5812e5167851d"}
Jul 30 20:35:30.858452 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:30.858414    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:35:30.956277 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:30.956243    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:35:31.450104 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:31.450042    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:35:31.510205 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:31.510175    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:35:34.284564 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:34.284472    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-d78pg" event={"ID":"7adbbb32-e65e-4802-987e-5a950b3cde51","Type":"ContainerStarted","Data":"e2434bbef322bdf48facd0fe39b5a1376ca38ad47d5455cede384ca7cdcc0130"}
Jul 30 20:35:34.303301 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:34.303254    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-d78pg" podStartSLOduration=1.73950922 podStartE2EDuration="6.303238572s" totalImagesPullingTime="4.563729352s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:35:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:35:34.301872076 +0000 UTC m=+646.143347703" watchObservedRunningTime="2026-07-30 20:35:34.303238572 +0000 UTC m=+646.144714193"
Jul 30 20:35:34.914235 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:34.914203    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:35:35.011362 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:35.011328    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:35:35.072618 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:35.072582    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:35:39.354669 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:39.354635    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-7bxlq"]
Jul 30 20:35:39.358748 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:39.358727    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-7bxlq"
Jul 30 20:35:39.361474 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:39.361456    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-4j9mr\""
Jul 30 20:35:39.394664 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:39.394635    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-7bxlq"]
Jul 30 20:35:39.529966 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:39.529938    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8ad7661d-735b-4679-ad1b-1273d2eefeaf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-7bxlq\" (UID: \"8ad7661d-735b-4679-ad1b-1273d2eefeaf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-7bxlq"
Jul 30 20:35:39.530175 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:39.529994    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5wlw\" (UniqueName: \"kubernetes.io/projected/8ad7661d-735b-4679-ad1b-1273d2eefeaf-kube-api-access-t5wlw\") pod \"kuadrant-operator-controller-manager-58fc56757c-7bxlq\" (UID: \"8ad7661d-735b-4679-ad1b-1273d2eefeaf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-7bxlq"
Jul 30 20:35:39.631083 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:39.631014    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8ad7661d-735b-4679-ad1b-1273d2eefeaf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-7bxlq\" (UID: \"8ad7661d-735b-4679-ad1b-1273d2eefeaf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-7bxlq"
Jul 30 20:35:39.631235 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:39.631093    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5wlw\" (UniqueName: \"kubernetes.io/projected/8ad7661d-735b-4679-ad1b-1273d2eefeaf-kube-api-access-t5wlw\") pod \"kuadrant-operator-controller-manager-58fc56757c-7bxlq\" (UID: \"8ad7661d-735b-4679-ad1b-1273d2eefeaf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-7bxlq"
Jul 30 20:35:39.631419 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:39.631398    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8ad7661d-735b-4679-ad1b-1273d2eefeaf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-7bxlq\" (UID: \"8ad7661d-735b-4679-ad1b-1273d2eefeaf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-7bxlq"
Jul 30 20:35:39.639913 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:39.639879    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5wlw\" (UniqueName: \"kubernetes.io/projected/8ad7661d-735b-4679-ad1b-1273d2eefeaf-kube-api-access-t5wlw\") pod \"kuadrant-operator-controller-manager-58fc56757c-7bxlq\" (UID: \"8ad7661d-735b-4679-ad1b-1273d2eefeaf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-7bxlq"
Jul 30 20:35:39.669581 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:39.669559    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-7bxlq"
Jul 30 20:35:39.811032 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:39.811011    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-7bxlq"]
Jul 30 20:35:39.813068 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:35:39.813045    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ad7661d_735b_4679_ad1b_1273d2eefeaf.slice/crio-7651cf135fd2d422dde043873afd902b34ca5855e6f5e6a44dd5d0b72cd4f9c9 WatchSource:0}: Error finding container 7651cf135fd2d422dde043873afd902b34ca5855e6f5e6a44dd5d0b72cd4f9c9: Status 404 returned error can't find the container with id 7651cf135fd2d422dde043873afd902b34ca5855e6f5e6a44dd5d0b72cd4f9c9
Jul 30 20:35:40.320605 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:40.320568    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-7bxlq" event={"ID":"8ad7661d-735b-4679-ad1b-1273d2eefeaf","Type":"ContainerStarted","Data":"7651cf135fd2d422dde043873afd902b34ca5855e6f5e6a44dd5d0b72cd4f9c9"}
Jul 30 20:35:42.018117 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:42.018076    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:35:42.224700 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:42.224664    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:35:43.800346 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:43.800257    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:35:44.347253 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:44.347217    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-7bxlq" event={"ID":"8ad7661d-735b-4679-ad1b-1273d2eefeaf","Type":"ContainerStarted","Data":"83492334e5c7708afa2c4ee03e0e7c1f4baac14a84f17b5996352194a4ab2b5a"}
Jul 30 20:35:44.347418 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:44.347293    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-7bxlq"
Jul 30 20:35:44.374180 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:44.374116    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-7bxlq" podStartSLOduration=1.669715343 podStartE2EDuration="5.374103098s" totalImagesPullingTime="3.704387755s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:35:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:35:44.37164628 +0000 UTC m=+656.213121903" watchObservedRunningTime="2026-07-30 20:35:44.374103098 +0000 UTC m=+656.215578720"
Jul 30 20:35:44.609482 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:44.609387    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:35:44.706687 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:44.706657    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:35:49.608853 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:49.608796    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-68875d4b88-s2rwb" podUID="9706a4e1-98cd-4850-bcb6-609e5b6a2421" containerName="console" containerID="cri-o://9593bf37b5e7cb80a2153c3897dd12a2b7e34097ed82dbcaf59983a360f2aa98" gracePeriod=15
Jul 30 20:35:49.856095 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:49.856069    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68875d4b88-s2rwb"
Jul 30 20:35:49.993179 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:49.993131    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:35:50.017436 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:50.017410    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4kz2q\" (UniqueName: \"kubernetes.io/projected/9706a4e1-98cd-4850-bcb6-609e5b6a2421-kube-api-access-4kz2q\") pod \"9706a4e1-98cd-4850-bcb6-609e5b6a2421\" (UID: \"9706a4e1-98cd-4850-bcb6-609e5b6a2421\") "
Jul 30 20:35:50.017541 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:50.017446    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9706a4e1-98cd-4850-bcb6-609e5b6a2421-trusted-ca-bundle\") pod \"9706a4e1-98cd-4850-bcb6-609e5b6a2421\" (UID: \"9706a4e1-98cd-4850-bcb6-609e5b6a2421\") "
Jul 30 20:35:50.017541 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:50.017477    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9706a4e1-98cd-4850-bcb6-609e5b6a2421-console-oauth-config\") pod \"9706a4e1-98cd-4850-bcb6-609e5b6a2421\" (UID: \"9706a4e1-98cd-4850-bcb6-609e5b6a2421\") "
Jul 30 20:35:50.017632 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:50.017560    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9706a4e1-98cd-4850-bcb6-609e5b6a2421-oauth-serving-cert\") pod \"9706a4e1-98cd-4850-bcb6-609e5b6a2421\" (UID: \"9706a4e1-98cd-4850-bcb6-609e5b6a2421\") "
Jul 30 20:35:50.017632 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:50.017602    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9706a4e1-98cd-4850-bcb6-609e5b6a2421-service-ca\") pod \"9706a4e1-98cd-4850-bcb6-609e5b6a2421\" (UID: \"9706a4e1-98cd-4850-bcb6-609e5b6a2421\") "
Jul 30 20:35:50.017714 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:50.017636    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9706a4e1-98cd-4850-bcb6-609e5b6a2421-console-serving-cert\") pod \"9706a4e1-98cd-4850-bcb6-609e5b6a2421\" (UID: \"9706a4e1-98cd-4850-bcb6-609e5b6a2421\") "
Jul 30 20:35:50.017714 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:50.017673    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9706a4e1-98cd-4850-bcb6-609e5b6a2421-console-config\") pod \"9706a4e1-98cd-4850-bcb6-609e5b6a2421\" (UID: \"9706a4e1-98cd-4850-bcb6-609e5b6a2421\") "
Jul 30 20:35:50.017937 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:50.017889    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9706a4e1-98cd-4850-bcb6-609e5b6a2421-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "9706a4e1-98cd-4850-bcb6-609e5b6a2421" (UID: "9706a4e1-98cd-4850-bcb6-609e5b6a2421"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 20:35:50.017937 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:50.017922    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9706a4e1-98cd-4850-bcb6-609e5b6a2421-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "9706a4e1-98cd-4850-bcb6-609e5b6a2421" (UID: "9706a4e1-98cd-4850-bcb6-609e5b6a2421"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 20:35:50.018122 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:50.018036    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9706a4e1-98cd-4850-bcb6-609e5b6a2421-service-ca" (OuterVolumeSpecName: "service-ca") pod "9706a4e1-98cd-4850-bcb6-609e5b6a2421" (UID: "9706a4e1-98cd-4850-bcb6-609e5b6a2421"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 20:35:50.018394 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:50.018267    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9706a4e1-98cd-4850-bcb6-609e5b6a2421-console-config" (OuterVolumeSpecName: "console-config") pod "9706a4e1-98cd-4850-bcb6-609e5b6a2421" (UID: "9706a4e1-98cd-4850-bcb6-609e5b6a2421"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 20:35:50.019840 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:50.019806    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9706a4e1-98cd-4850-bcb6-609e5b6a2421-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "9706a4e1-98cd-4850-bcb6-609e5b6a2421" (UID: "9706a4e1-98cd-4850-bcb6-609e5b6a2421"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 20:35:50.019840 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:50.019817    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9706a4e1-98cd-4850-bcb6-609e5b6a2421-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "9706a4e1-98cd-4850-bcb6-609e5b6a2421" (UID: "9706a4e1-98cd-4850-bcb6-609e5b6a2421"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 20:35:50.019963 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:50.019837    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9706a4e1-98cd-4850-bcb6-609e5b6a2421-kube-api-access-4kz2q" (OuterVolumeSpecName: "kube-api-access-4kz2q") pod "9706a4e1-98cd-4850-bcb6-609e5b6a2421" (UID: "9706a4e1-98cd-4850-bcb6-609e5b6a2421"). InnerVolumeSpecName "kube-api-access-4kz2q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:35:50.095365 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:50.095317    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:35:50.119353 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:50.119322    2583 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9706a4e1-98cd-4850-bcb6-609e5b6a2421-oauth-serving-cert\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 20:35:50.119353 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:50.119351    2583 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9706a4e1-98cd-4850-bcb6-609e5b6a2421-service-ca\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 20:35:50.119533 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:50.119365    2583 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9706a4e1-98cd-4850-bcb6-609e5b6a2421-console-serving-cert\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 20:35:50.119533 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:50.119378    2583 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9706a4e1-98cd-4850-bcb6-609e5b6a2421-console-config\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 20:35:50.119533 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:50.119391    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4kz2q\" (UniqueName: \"kubernetes.io/projected/9706a4e1-98cd-4850-bcb6-609e5b6a2421-kube-api-access-4kz2q\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 20:35:50.119533 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:50.119404    2583 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9706a4e1-98cd-4850-bcb6-609e5b6a2421-trusted-ca-bundle\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 20:35:50.119533 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:50.119416    2583 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9706a4e1-98cd-4850-bcb6-609e5b6a2421-console-oauth-config\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 20:35:50.380129 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:50.380028    2583 generic.go:356] "Generic (PLEG): container finished" podID="9706a4e1-98cd-4850-bcb6-609e5b6a2421" containerID="9593bf37b5e7cb80a2153c3897dd12a2b7e34097ed82dbcaf59983a360f2aa98" exitCode=0
Jul 30 20:35:50.380129 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:50.380074    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68875d4b88-s2rwb"
Jul 30 20:35:50.380327 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:50.380124    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68875d4b88-s2rwb" event={"ID":"9706a4e1-98cd-4850-bcb6-609e5b6a2421","Type":"ContainerDied","Data":"9593bf37b5e7cb80a2153c3897dd12a2b7e34097ed82dbcaf59983a360f2aa98"}
Jul 30 20:35:50.380327 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:50.380196    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68875d4b88-s2rwb" event={"ID":"9706a4e1-98cd-4850-bcb6-609e5b6a2421","Type":"ContainerDied","Data":"f79908a78b4ee8c5daa28f4c03a60bfe363f6c18d9e51c07ceb69e35d9203e6c"}
Jul 30 20:35:50.380327 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:50.380218    2583 scope.go:117] "RemoveContainer" containerID="9593bf37b5e7cb80a2153c3897dd12a2b7e34097ed82dbcaf59983a360f2aa98"
Jul 30 20:35:50.388382 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:50.388357    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:35:50.390426 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:50.390407    2583 scope.go:117] "RemoveContainer" containerID="9593bf37b5e7cb80a2153c3897dd12a2b7e34097ed82dbcaf59983a360f2aa98"
Jul 30 20:35:50.390749 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:35:50.390727    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9593bf37b5e7cb80a2153c3897dd12a2b7e34097ed82dbcaf59983a360f2aa98\": container with ID starting with 9593bf37b5e7cb80a2153c3897dd12a2b7e34097ed82dbcaf59983a360f2aa98 not found: ID does not exist" containerID="9593bf37b5e7cb80a2153c3897dd12a2b7e34097ed82dbcaf59983a360f2aa98"
Jul 30 20:35:50.390833 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:50.390760    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9593bf37b5e7cb80a2153c3897dd12a2b7e34097ed82dbcaf59983a360f2aa98"} err="failed to get container status \"9593bf37b5e7cb80a2153c3897dd12a2b7e34097ed82dbcaf59983a360f2aa98\": rpc error: code = NotFound desc = could not find container \"9593bf37b5e7cb80a2153c3897dd12a2b7e34097ed82dbcaf59983a360f2aa98\": container with ID starting with 9593bf37b5e7cb80a2153c3897dd12a2b7e34097ed82dbcaf59983a360f2aa98 not found: ID does not exist"
Jul 30 20:35:50.400857 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:50.400837    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-68875d4b88-s2rwb"]
Jul 30 20:35:50.411175 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:50.411132    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-68875d4b88-s2rwb"]
Jul 30 20:35:50.449774 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:50.449753    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:35:50.682849 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:50.682815    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9706a4e1-98cd-4850-bcb6-609e5b6a2421" path="/var/lib/kubelet/pods/9706a4e1-98cd-4850-bcb6-609e5b6a2421/volumes"
Jul 30 20:35:51.644722 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:51.644694    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-7bxlq"]
Jul 30 20:35:51.644908 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:51.644887    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-7bxlq" podUID="8ad7661d-735b-4679-ad1b-1273d2eefeaf" containerName="manager" containerID="cri-o://83492334e5c7708afa2c4ee03e0e7c1f4baac14a84f17b5996352194a4ab2b5a" gracePeriod=10
Jul 30 20:35:51.646801 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:51.646780    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-7bxlq"
Jul 30 20:35:51.891592 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:51.891568    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-7bxlq"
Jul 30 20:35:52.035349 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:52.035320    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t5wlw\" (UniqueName: \"kubernetes.io/projected/8ad7661d-735b-4679-ad1b-1273d2eefeaf-kube-api-access-t5wlw\") pod \"8ad7661d-735b-4679-ad1b-1273d2eefeaf\" (UID: \"8ad7661d-735b-4679-ad1b-1273d2eefeaf\") "
Jul 30 20:35:52.035513 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:52.035360    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8ad7661d-735b-4679-ad1b-1273d2eefeaf-extensions-socket-volume\") pod \"8ad7661d-735b-4679-ad1b-1273d2eefeaf\" (UID: \"8ad7661d-735b-4679-ad1b-1273d2eefeaf\") "
Jul 30 20:35:52.035745 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:52.035719    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ad7661d-735b-4679-ad1b-1273d2eefeaf-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "8ad7661d-735b-4679-ad1b-1273d2eefeaf" (UID: "8ad7661d-735b-4679-ad1b-1273d2eefeaf"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:35:52.037594 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:52.037562    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ad7661d-735b-4679-ad1b-1273d2eefeaf-kube-api-access-t5wlw" (OuterVolumeSpecName: "kube-api-access-t5wlw") pod "8ad7661d-735b-4679-ad1b-1273d2eefeaf" (UID: "8ad7661d-735b-4679-ad1b-1273d2eefeaf"). InnerVolumeSpecName "kube-api-access-t5wlw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:35:52.136500 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:52.136460    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t5wlw\" (UniqueName: \"kubernetes.io/projected/8ad7661d-735b-4679-ad1b-1273d2eefeaf-kube-api-access-t5wlw\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 20:35:52.136500 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:52.136499    2583 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8ad7661d-735b-4679-ad1b-1273d2eefeaf-extensions-socket-volume\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 20:35:52.393329 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:52.393234    2583 generic.go:356] "Generic (PLEG): container finished" podID="8ad7661d-735b-4679-ad1b-1273d2eefeaf" containerID="83492334e5c7708afa2c4ee03e0e7c1f4baac14a84f17b5996352194a4ab2b5a" exitCode=0
Jul 30 20:35:52.393329 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:52.393277    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-7bxlq"
Jul 30 20:35:52.393329 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:52.393318    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-7bxlq" event={"ID":"8ad7661d-735b-4679-ad1b-1273d2eefeaf","Type":"ContainerDied","Data":"83492334e5c7708afa2c4ee03e0e7c1f4baac14a84f17b5996352194a4ab2b5a"}
Jul 30 20:35:52.393581 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:52.393374    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-7bxlq" event={"ID":"8ad7661d-735b-4679-ad1b-1273d2eefeaf","Type":"ContainerDied","Data":"7651cf135fd2d422dde043873afd902b34ca5855e6f5e6a44dd5d0b72cd4f9c9"}
Jul 30 20:35:52.393581 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:52.393398    2583 scope.go:117] "RemoveContainer" containerID="83492334e5c7708afa2c4ee03e0e7c1f4baac14a84f17b5996352194a4ab2b5a"
Jul 30 20:35:52.402621 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:52.402605    2583 scope.go:117] "RemoveContainer" containerID="83492334e5c7708afa2c4ee03e0e7c1f4baac14a84f17b5996352194a4ab2b5a"
Jul 30 20:35:52.402846 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:35:52.402831    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"83492334e5c7708afa2c4ee03e0e7c1f4baac14a84f17b5996352194a4ab2b5a\": container with ID starting with 83492334e5c7708afa2c4ee03e0e7c1f4baac14a84f17b5996352194a4ab2b5a not found: ID does not exist" containerID="83492334e5c7708afa2c4ee03e0e7c1f4baac14a84f17b5996352194a4ab2b5a"
Jul 30 20:35:52.402894 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:52.402853    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83492334e5c7708afa2c4ee03e0e7c1f4baac14a84f17b5996352194a4ab2b5a"} err="failed to get container status \"83492334e5c7708afa2c4ee03e0e7c1f4baac14a84f17b5996352194a4ab2b5a\": rpc error: code = NotFound desc = could not find container \"83492334e5c7708afa2c4ee03e0e7c1f4baac14a84f17b5996352194a4ab2b5a\": container with ID starting with 83492334e5c7708afa2c4ee03e0e7c1f4baac14a84f17b5996352194a4ab2b5a not found: ID does not exist"
Jul 30 20:35:52.421303 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:52.421279    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-7bxlq"]
Jul 30 20:35:52.433848 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:52.433829    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-7bxlq"]
Jul 30 20:35:52.675244 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:52.675212    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8ad7661d-735b-4679-ad1b-1273d2eefeaf" path="/var/lib/kubelet/pods/8ad7661d-735b-4679-ad1b-1273d2eefeaf/volumes"
Jul 30 20:35:54.641238 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:54.641198    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:35:54.757105 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:54.757063    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:35:54.815842 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:35:54.815811    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:36:01.673188 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:01.673153    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:36:01.773026 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:01.772990    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:36:02.789312 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:02.789274    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:36:02.890585 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:02.890554    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:36:07.952509 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:07.952482    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:36:08.272201 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:08.272102    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:36:09.539569 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:09.539527    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:36:09.643392 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:09.643345    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:36:09.716855 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:09.716820    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:36:09.918183 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:09.918155    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 20:36:09.918505 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:09.918493    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9706a4e1-98cd-4850-bcb6-609e5b6a2421" containerName="console"
Jul 30 20:36:09.918547 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:09.918507    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="9706a4e1-98cd-4850-bcb6-609e5b6a2421" containerName="console"
Jul 30 20:36:09.918547 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:09.918520    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ad7661d-735b-4679-ad1b-1273d2eefeaf" containerName="manager"
Jul 30 20:36:09.918547 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:09.918526    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ad7661d-735b-4679-ad1b-1273d2eefeaf" containerName="manager"
Jul 30 20:36:09.918642 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:09.918583    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ad7661d-735b-4679-ad1b-1273d2eefeaf" containerName="manager"
Jul 30 20:36:09.918642 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:09.918595    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="9706a4e1-98cd-4850-bcb6-609e5b6a2421" containerName="console"
Jul 30 20:36:09.945502 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:09.945465    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 20:36:09.945641 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:09.945510    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 20:36:09.945641 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:09.945571    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"
Jul 30 20:36:09.947736 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:09.947719    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 30 20:36:09.977841 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:09.977817    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sfb4b\" (UniqueName: \"kubernetes.io/projected/03b2e9b7-cb54-4932-b5f3-0986ec8d143b-kube-api-access-sfb4b\") pod \"limitador-limitador-85d9db4d5d-85k8g\" (UID: \"03b2e9b7-cb54-4932-b5f3-0986ec8d143b\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"
Jul 30 20:36:09.977956 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:09.977859    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/03b2e9b7-cb54-4932-b5f3-0986ec8d143b-config-file\") pod \"limitador-limitador-85d9db4d5d-85k8g\" (UID: \"03b2e9b7-cb54-4932-b5f3-0986ec8d143b\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"
Jul 30 20:36:10.079045 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:10.079020    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sfb4b\" (UniqueName: \"kubernetes.io/projected/03b2e9b7-cb54-4932-b5f3-0986ec8d143b-kube-api-access-sfb4b\") pod \"limitador-limitador-85d9db4d5d-85k8g\" (UID: \"03b2e9b7-cb54-4932-b5f3-0986ec8d143b\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"
Jul 30 20:36:10.079233 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:10.079068    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/03b2e9b7-cb54-4932-b5f3-0986ec8d143b-config-file\") pod \"limitador-limitador-85d9db4d5d-85k8g\" (UID: \"03b2e9b7-cb54-4932-b5f3-0986ec8d143b\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"
Jul 30 20:36:10.079685 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:10.079668    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/03b2e9b7-cb54-4932-b5f3-0986ec8d143b-config-file\") pod \"limitador-limitador-85d9db4d5d-85k8g\" (UID: \"03b2e9b7-cb54-4932-b5f3-0986ec8d143b\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"
Jul 30 20:36:10.087236 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:10.087215    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sfb4b\" (UniqueName: \"kubernetes.io/projected/03b2e9b7-cb54-4932-b5f3-0986ec8d143b-kube-api-access-sfb4b\") pod \"limitador-limitador-85d9db4d5d-85k8g\" (UID: \"03b2e9b7-cb54-4932-b5f3-0986ec8d143b\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"
Jul 30 20:36:10.255786 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:10.255724    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"
Jul 30 20:36:10.343662 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:10.343632    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-b54df94b4-r64qj"]
Jul 30 20:36:10.348382 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:10.348362    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-r64qj"
Jul 30 20:36:10.352775 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:10.352750    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-t4n2x\""
Jul 30 20:36:10.356878 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:10.356754    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b54df94b4-r64qj"]
Jul 30 20:36:10.378997 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:10.378969    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:36:10.380987 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:10.380968    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lfm4r\" (UniqueName: \"kubernetes.io/projected/58227579-295e-4d70-a7a4-2c23451f4b21-kube-api-access-lfm4r\") pod \"authorino-b54df94b4-r64qj\" (UID: \"58227579-295e-4d70-a7a4-2c23451f4b21\") " pod="kuadrant-system/authorino-b54df94b4-r64qj"
Jul 30 20:36:10.393238 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:10.393219    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 20:36:10.395404 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:36:10.395373    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03b2e9b7_cb54_4932_b5f3_0986ec8d143b.slice/crio-c250c5a9ef324563c2f6305b60aa7ad00ae96db0e38abbf9b6ecb06e540399ae WatchSource:0}: Error finding container c250c5a9ef324563c2f6305b60aa7ad00ae96db0e38abbf9b6ecb06e540399ae: Status 404 returned error can't find the container with id c250c5a9ef324563c2f6305b60aa7ad00ae96db0e38abbf9b6ecb06e540399ae
Jul 30 20:36:10.481627 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:10.481603    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lfm4r\" (UniqueName: \"kubernetes.io/projected/58227579-295e-4d70-a7a4-2c23451f4b21-kube-api-access-lfm4r\") pod \"authorino-b54df94b4-r64qj\" (UID: \"58227579-295e-4d70-a7a4-2c23451f4b21\") " pod="kuadrant-system/authorino-b54df94b4-r64qj"
Jul 30 20:36:10.483585 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:10.483551    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:36:10.484482 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:10.484465    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-c548b5d7d-zzpnh"]
Jul 30 20:36:10.487928 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:10.487915    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c548b5d7d-zzpnh"
Jul 30 20:36:10.491808 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:10.491764    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lfm4r\" (UniqueName: \"kubernetes.io/projected/58227579-295e-4d70-a7a4-2c23451f4b21-kube-api-access-lfm4r\") pod \"authorino-b54df94b4-r64qj\" (UID: \"58227579-295e-4d70-a7a4-2c23451f4b21\") " pod="kuadrant-system/authorino-b54df94b4-r64qj"
Jul 30 20:36:10.494955 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:10.494935    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-zzpnh"]
Jul 30 20:36:10.497480 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:10.497456    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-85d9db4d5d-85k8g" event={"ID":"03b2e9b7-cb54-4932-b5f3-0986ec8d143b","Type":"ContainerStarted","Data":"c250c5a9ef324563c2f6305b60aa7ad00ae96db0e38abbf9b6ecb06e540399ae"}
Jul 30 20:36:10.582205 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:10.582126    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pp555\" (UniqueName: \"kubernetes.io/projected/45925c2e-f9b0-4e7c-b457-eb9dc76b8f6c-kube-api-access-pp555\") pod \"authorino-c548b5d7d-zzpnh\" (UID: \"45925c2e-f9b0-4e7c-b457-eb9dc76b8f6c\") " pod="kuadrant-system/authorino-c548b5d7d-zzpnh"
Jul 30 20:36:10.660159 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:10.660109    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-r64qj"
Jul 30 20:36:10.683446 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:10.683407    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pp555\" (UniqueName: \"kubernetes.io/projected/45925c2e-f9b0-4e7c-b457-eb9dc76b8f6c-kube-api-access-pp555\") pod \"authorino-c548b5d7d-zzpnh\" (UID: \"45925c2e-f9b0-4e7c-b457-eb9dc76b8f6c\") " pod="kuadrant-system/authorino-c548b5d7d-zzpnh"
Jul 30 20:36:10.691119 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:10.691098    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pp555\" (UniqueName: \"kubernetes.io/projected/45925c2e-f9b0-4e7c-b457-eb9dc76b8f6c-kube-api-access-pp555\") pod \"authorino-c548b5d7d-zzpnh\" (UID: \"45925c2e-f9b0-4e7c-b457-eb9dc76b8f6c\") " pod="kuadrant-system/authorino-c548b5d7d-zzpnh"
Jul 30 20:36:10.788213 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:10.788192    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b54df94b4-r64qj"]
Jul 30 20:36:10.790484 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:36:10.790459    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod58227579_295e_4d70_a7a4_2c23451f4b21.slice/crio-c881413db1f3c8d4b3643c1d1731a01fc646ad5d92a36cb5e79da434b46e5ed7 WatchSource:0}: Error finding container c881413db1f3c8d4b3643c1d1731a01fc646ad5d92a36cb5e79da434b46e5ed7: Status 404 returned error can't find the container with id c881413db1f3c8d4b3643c1d1731a01fc646ad5d92a36cb5e79da434b46e5ed7
Jul 30 20:36:10.807651 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:10.807631    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c548b5d7d-zzpnh"
Jul 30 20:36:10.935544 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:10.935521    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-zzpnh"]
Jul 30 20:36:10.937411 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:36:10.937386    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod45925c2e_f9b0_4e7c_b457_eb9dc76b8f6c.slice/crio-54c1b2b822a7335ec429bf287f4a1a7ba7471ab90c8774062550bbd2ae9e7209 WatchSource:0}: Error finding container 54c1b2b822a7335ec429bf287f4a1a7ba7471ab90c8774062550bbd2ae9e7209: Status 404 returned error can't find the container with id 54c1b2b822a7335ec429bf287f4a1a7ba7471ab90c8774062550bbd2ae9e7209
Jul 30 20:36:11.504401 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:11.504361    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-r64qj" event={"ID":"58227579-295e-4d70-a7a4-2c23451f4b21","Type":"ContainerStarted","Data":"c881413db1f3c8d4b3643c1d1731a01fc646ad5d92a36cb5e79da434b46e5ed7"}
Jul 30 20:36:11.505690 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:11.505663    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c548b5d7d-zzpnh" event={"ID":"45925c2e-f9b0-4e7c-b457-eb9dc76b8f6c","Type":"ContainerStarted","Data":"54c1b2b822a7335ec429bf287f4a1a7ba7471ab90c8774062550bbd2ae9e7209"}
Jul 30 20:36:11.651403 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:36:11.651360    2583 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = unable to pull image or OCI artifact: pull image err: copying system image from manifest list: parsing image configuration: Get \"https://cdn01.quay.io/quayio-production-s3/sha256/09/0940a0ae5bd9eac04a1297e7c1ac759f2fda1cf01ef0fb35cd5c4229db830f83?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIATAAF2YHTGR23ZTE6%2F20260730%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20260730T203611Z&X-Amz-Expires=600&X-Amz-SignedHeaders=host&X-Amz-Signature=2290376cc91428526e03b3af1941cdcfefce2509253549a007feadde9c094e06&region=us-east-1&namespace=redhat-prod&username=redhat-prod+registry_proxy&repo_name=rhcl-1----authorino-rhel9&akamai_signature=exp=1785444671~hmac=d903a7e6ad87e4788b909e5fba9a5c07fd5e7fb2aee1d928c90b1ae16efb5599\": EOF; artifact err: provided artifact is a container image" image="registry.redhat.io/rhcl-1/authorino-rhel9@sha256:fbe9e2e767530eae72a421f541325640feba03322441cd7a294f8a6bf1fb4d97"
Jul 30 20:36:11.651778 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:36:11.651485    2583 kuberuntime_manager.go:1459] "Unhandled Error" err="container authorino start failed in pod authorino-c548b5d7d-zzpnh_kuadrant-system(45925c2e-f9b0-4e7c-b457-eb9dc76b8f6c): ErrImagePull: unable to pull image or OCI artifact: pull image err: copying system image from manifest list: parsing image configuration: Get \"https://cdn01.quay.io/quayio-production-s3/sha256/09/0940a0ae5bd9eac04a1297e7c1ac759f2fda1cf01ef0fb35cd5c4229db830f83?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIATAAF2YHTGR23ZTE6%2F20260730%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20260730T203611Z&X-Amz-Expires=600&X-Amz-SignedHeaders=host&X-Amz-Signature=2290376cc91428526e03b3af1941cdcfefce2509253549a007feadde9c094e06&region=us-east-1&namespace=redhat-prod&username=redhat-prod+registry_proxy&repo_name=rhcl-1----authorino-rhel9&akamai_signature=exp=1785444671~hmac=d903a7e6ad87e4788b909e5fba9a5c07fd5e7fb2aee1d928c90b1ae16efb5599\": EOF; artifact err: provided artifact is a container image" logger="UnhandledError"
Jul 30 20:36:11.651778 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:36:11.651528    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"authorino\" with ErrImagePull: \"unable to pull image or OCI artifact: pull image err: copying system image from manifest list: parsing image configuration: Get \\\"https://cdn01.quay.io/quayio-production-s3/sha256/09/0940a0ae5bd9eac04a1297e7c1ac759f2fda1cf01ef0fb35cd5c4229db830f83?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIATAAF2YHTGR23ZTE6%2F20260730%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20260730T203611Z&X-Amz-Expires=600&X-Amz-SignedHeaders=host&X-Amz-Signature=2290376cc91428526e03b3af1941cdcfefce2509253549a007feadde9c094e06&region=us-east-1&namespace=redhat-prod&username=redhat-prod+registry_proxy&repo_name=rhcl-1----authorino-rhel9&akamai_signature=exp=1785444671~hmac=d903a7e6ad87e4788b909e5fba9a5c07fd5e7fb2aee1d928c90b1ae16efb5599\\\": EOF; artifact err: provided artifact is a container image\"" pod="kuadrant-system/authorino-c548b5d7d-zzpnh" podUID="45925c2e-f9b0-4e7c-b457-eb9dc76b8f6c"
Jul 30 20:36:12.514752 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:12.514705    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-85d9db4d5d-85k8g" event={"ID":"03b2e9b7-cb54-4932-b5f3-0986ec8d143b","Type":"ContainerStarted","Data":"b450cad80467e8123fa3d5bfe9100815f69adf37c5abb1d52bdc75c107a64d99"}
Jul 30 20:36:12.515364 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:36:12.515320    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"authorino\" with ImagePullBackOff: \"Back-off pulling image \\\"registry.redhat.io/rhcl-1/authorino-rhel9@sha256:fbe9e2e767530eae72a421f541325640feba03322441cd7a294f8a6bf1fb4d97\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: copying system image from manifest list: parsing image configuration: Get \\\"https://cdn01.quay.io/quayio-production-s3/sha256/09/0940a0ae5bd9eac04a1297e7c1ac759f2fda1cf01ef0fb35cd5c4229db830f83?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIATAAF2YHTGR23ZTE6%2F20260730%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20260730T203611Z&X-Amz-Expires=600&X-Amz-SignedHeaders=host&X-Amz-Signature=2290376cc91428526e03b3af1941cdcfefce2509253549a007feadde9c094e06&region=us-east-1&namespace=redhat-prod&username=redhat-prod+registry_proxy&repo_name=rhcl-1----authorino-rhel9&akamai_signature=exp=1785444671~hmac=d903a7e6ad87e4788b909e5fba9a5c07fd5e7fb2aee1d928c90b1ae16efb5599\\\": EOF; artifact err: provided artifact is a container image\"" pod="kuadrant-system/authorino-c548b5d7d-zzpnh" podUID="45925c2e-f9b0-4e7c-b457-eb9dc76b8f6c"
Jul 30 20:36:12.547355 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:12.547301    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-85d9db4d5d-85k8g" podStartSLOduration=2.272889479 podStartE2EDuration="3.54728706s" totalImagesPullingTime="1.274397581s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:36:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:36:12.545674114 +0000 UTC m=+684.387149761" watchObservedRunningTime="2026-07-30 20:36:12.54728706 +0000 UTC m=+684.388762681"
Jul 30 20:36:13.524975 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:13.524937    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-r64qj" event={"ID":"58227579-295e-4d70-a7a4-2c23451f4b21","Type":"ContainerStarted","Data":"fa8834d948a6e8e8425f5f4b4b27148891d8939d93215f19556f005e3e199648"}
Jul 30 20:36:13.525438 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:13.525012    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"
Jul 30 20:36:13.539013 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:13.538964    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-b54df94b4-r64qj" podStartSLOduration=0.989050956 podStartE2EDuration="3.538943176s" totalImagesPullingTime="2.54989222s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:36:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:36:13.537638555 +0000 UTC m=+685.379114177" watchObservedRunningTime="2026-07-30 20:36:13.538943176 +0000 UTC m=+685.380418797"
Jul 30 20:36:20.408212 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:20.408171    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:36:20.509781 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:20.509750    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:36:21.427512 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:21.427468    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:36:24.531666 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:24.531635    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"
Jul 30 20:36:25.581056 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:25.581021    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:36:25.681847 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:25.681815    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:36:26.050270 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:26.050226    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:36:28.605434 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:28.605354    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c548b5d7d-zzpnh" event={"ID":"45925c2e-f9b0-4e7c-b457-eb9dc76b8f6c","Type":"ContainerStarted","Data":"aad9b38c81d358a0fe286a7a801b9cd4adff4051843b0fd4078ea3c51b6f006f"}
Jul 30 20:36:28.618857 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:28.618808    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-c548b5d7d-zzpnh" podStartSLOduration=1.30278921 podStartE2EDuration="18.618792265s" totalImagesPullingTime="17.316003055s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:36:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=1 observedRunningTime="2026-07-30 20:36:28.618356931 +0000 UTC m=+700.459832557" watchObservedRunningTime="2026-07-30 20:36:28.618792265 +0000 UTC m=+700.460267889"
Jul 30 20:36:28.646655 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:28.646627    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-b54df94b4-r64qj"]
Jul 30 20:36:28.646835 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:28.646813    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-b54df94b4-r64qj" podUID="58227579-295e-4d70-a7a4-2c23451f4b21" containerName="authorino" containerID="cri-o://fa8834d948a6e8e8425f5f4b4b27148891d8939d93215f19556f005e3e199648" gracePeriod=30
Jul 30 20:36:28.900041 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:28.900003    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-r64qj"
Jul 30 20:36:29.030324 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:29.030286    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lfm4r\" (UniqueName: \"kubernetes.io/projected/58227579-295e-4d70-a7a4-2c23451f4b21-kube-api-access-lfm4r\") pod \"58227579-295e-4d70-a7a4-2c23451f4b21\" (UID: \"58227579-295e-4d70-a7a4-2c23451f4b21\") "
Jul 30 20:36:29.032507 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:29.032472    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58227579-295e-4d70-a7a4-2c23451f4b21-kube-api-access-lfm4r" (OuterVolumeSpecName: "kube-api-access-lfm4r") pod "58227579-295e-4d70-a7a4-2c23451f4b21" (UID: "58227579-295e-4d70-a7a4-2c23451f4b21"). InnerVolumeSpecName "kube-api-access-lfm4r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:36:29.131475 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:29.131388    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lfm4r\" (UniqueName: \"kubernetes.io/projected/58227579-295e-4d70-a7a4-2c23451f4b21-kube-api-access-lfm4r\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 20:36:29.611768 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:29.611729    2583 generic.go:356] "Generic (PLEG): container finished" podID="58227579-295e-4d70-a7a4-2c23451f4b21" containerID="fa8834d948a6e8e8425f5f4b4b27148891d8939d93215f19556f005e3e199648" exitCode=0
Jul 30 20:36:29.612261 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:29.611776    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-r64qj"
Jul 30 20:36:29.612261 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:29.611817    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-r64qj" event={"ID":"58227579-295e-4d70-a7a4-2c23451f4b21","Type":"ContainerDied","Data":"fa8834d948a6e8e8425f5f4b4b27148891d8939d93215f19556f005e3e199648"}
Jul 30 20:36:29.612261 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:29.611874    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-r64qj" event={"ID":"58227579-295e-4d70-a7a4-2c23451f4b21","Type":"ContainerDied","Data":"c881413db1f3c8d4b3643c1d1731a01fc646ad5d92a36cb5e79da434b46e5ed7"}
Jul 30 20:36:29.612261 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:29.611902    2583 scope.go:117] "RemoveContainer" containerID="fa8834d948a6e8e8425f5f4b4b27148891d8939d93215f19556f005e3e199648"
Jul 30 20:36:29.621293 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:29.621275    2583 scope.go:117] "RemoveContainer" containerID="fa8834d948a6e8e8425f5f4b4b27148891d8939d93215f19556f005e3e199648"
Jul 30 20:36:29.621557 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:36:29.621540    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fa8834d948a6e8e8425f5f4b4b27148891d8939d93215f19556f005e3e199648\": container with ID starting with fa8834d948a6e8e8425f5f4b4b27148891d8939d93215f19556f005e3e199648 not found: ID does not exist" containerID="fa8834d948a6e8e8425f5f4b4b27148891d8939d93215f19556f005e3e199648"
Jul 30 20:36:29.621628 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:29.621580    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa8834d948a6e8e8425f5f4b4b27148891d8939d93215f19556f005e3e199648"} err="failed to get container status \"fa8834d948a6e8e8425f5f4b4b27148891d8939d93215f19556f005e3e199648\": rpc error: code = NotFound desc = could not find container \"fa8834d948a6e8e8425f5f4b4b27148891d8939d93215f19556f005e3e199648\": container with ID starting with fa8834d948a6e8e8425f5f4b4b27148891d8939d93215f19556f005e3e199648 not found: ID does not exist"
Jul 30 20:36:29.634207 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:29.634178    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-b54df94b4-r64qj"]
Jul 30 20:36:29.640407 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:29.640380    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-b54df94b4-r64qj"]
Jul 30 20:36:30.676150 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:30.676113    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="58227579-295e-4d70-a7a4-2c23451f4b21" path="/var/lib/kubelet/pods/58227579-295e-4d70-a7a4-2c23451f4b21/volumes"
Jul 30 20:36:38.196375 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:38.196335    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:36:38.420848 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:38.420819    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-m58mm"]
Jul 30 20:36:38.421205 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:38.421191    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58227579-295e-4d70-a7a4-2c23451f4b21" containerName="authorino"
Jul 30 20:36:38.421255 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:38.421207    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="58227579-295e-4d70-a7a4-2c23451f4b21" containerName="authorino"
Jul 30 20:36:38.421290 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:38.421273    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="58227579-295e-4d70-a7a4-2c23451f4b21" containerName="authorino"
Jul 30 20:36:38.423838 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:38.423822    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-m58mm"
Jul 30 20:36:38.430538 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:38.430510    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-m58mm"]
Jul 30 20:36:38.511568 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:38.511512    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fls4z\" (UniqueName: \"kubernetes.io/projected/22d27b7c-42ce-457f-be01-6153393e7feb-kube-api-access-fls4z\") pod \"authorino-5dc7ccb5f-m58mm\" (UID: \"22d27b7c-42ce-457f-be01-6153393e7feb\") " pod="kuadrant-system/authorino-5dc7ccb5f-m58mm"
Jul 30 20:36:38.564487 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:38.564463    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:36:38.595756 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:38.595734    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-m58mm"]
Jul 30 20:36:38.595974 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:36:38.595958    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-fls4z], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5dc7ccb5f-m58mm" podUID="22d27b7c-42ce-457f-be01-6153393e7feb"
Jul 30 20:36:38.612938 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:38.612917    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fls4z\" (UniqueName: \"kubernetes.io/projected/22d27b7c-42ce-457f-be01-6153393e7feb-kube-api-access-fls4z\") pod \"authorino-5dc7ccb5f-m58mm\" (UID: \"22d27b7c-42ce-457f-be01-6153393e7feb\") " pod="kuadrant-system/authorino-5dc7ccb5f-m58mm"
Jul 30 20:36:38.622304 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:38.622277    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fls4z\" (UniqueName: \"kubernetes.io/projected/22d27b7c-42ce-457f-be01-6153393e7feb-kube-api-access-fls4z\") pod \"authorino-5dc7ccb5f-m58mm\" (UID: \"22d27b7c-42ce-457f-be01-6153393e7feb\") " pod="kuadrant-system/authorino-5dc7ccb5f-m58mm"
Jul 30 20:36:38.623608 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:38.623588    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-687bd45585-wfxct"]
Jul 30 20:36:38.625850 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:38.625833    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-687bd45585-wfxct"
Jul 30 20:36:38.627821 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:38.627805    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 30 20:36:38.635737 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:38.635714    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-687bd45585-wfxct"]
Jul 30 20:36:38.660675 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:38.660644    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-m58mm"
Jul 30 20:36:38.666082 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:38.666065    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-m58mm"
Jul 30 20:36:38.685696 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:38.685670    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-687bd45585-wfxct"]
Jul 30 20:36:38.685965 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:36:38.685948    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-2cbmm tls-cert], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-687bd45585-wfxct" podUID="90cfa55a-1b61-4595-a8ce-c8eac7fc9470"
Jul 30 20:36:38.714421 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:38.714395    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2cbmm\" (UniqueName: \"kubernetes.io/projected/90cfa55a-1b61-4595-a8ce-c8eac7fc9470-kube-api-access-2cbmm\") pod \"authorino-687bd45585-wfxct\" (UID: \"90cfa55a-1b61-4595-a8ce-c8eac7fc9470\") " pod="kuadrant-system/authorino-687bd45585-wfxct"
Jul 30 20:36:38.714537 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:38.714433    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/90cfa55a-1b61-4595-a8ce-c8eac7fc9470-tls-cert\") pod \"authorino-687bd45585-wfxct\" (UID: \"90cfa55a-1b61-4595-a8ce-c8eac7fc9470\") " pod="kuadrant-system/authorino-687bd45585-wfxct"
Jul 30 20:36:38.815607 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:38.815545    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fls4z\" (UniqueName: \"kubernetes.io/projected/22d27b7c-42ce-457f-be01-6153393e7feb-kube-api-access-fls4z\") pod \"22d27b7c-42ce-457f-be01-6153393e7feb\" (UID: \"22d27b7c-42ce-457f-be01-6153393e7feb\") "
Jul 30 20:36:38.815718 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:38.815704    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2cbmm\" (UniqueName: \"kubernetes.io/projected/90cfa55a-1b61-4595-a8ce-c8eac7fc9470-kube-api-access-2cbmm\") pod \"authorino-687bd45585-wfxct\" (UID: \"90cfa55a-1b61-4595-a8ce-c8eac7fc9470\") " pod="kuadrant-system/authorino-687bd45585-wfxct"
Jul 30 20:36:38.815770 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:38.815737    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/90cfa55a-1b61-4595-a8ce-c8eac7fc9470-tls-cert\") pod \"authorino-687bd45585-wfxct\" (UID: \"90cfa55a-1b61-4595-a8ce-c8eac7fc9470\") " pod="kuadrant-system/authorino-687bd45585-wfxct"
Jul 30 20:36:38.817760 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:38.817735    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/22d27b7c-42ce-457f-be01-6153393e7feb-kube-api-access-fls4z" (OuterVolumeSpecName: "kube-api-access-fls4z") pod "22d27b7c-42ce-457f-be01-6153393e7feb" (UID: "22d27b7c-42ce-457f-be01-6153393e7feb"). InnerVolumeSpecName "kube-api-access-fls4z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:36:38.818226 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:38.818206    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/90cfa55a-1b61-4595-a8ce-c8eac7fc9470-tls-cert\") pod \"authorino-687bd45585-wfxct\" (UID: \"90cfa55a-1b61-4595-a8ce-c8eac7fc9470\") " pod="kuadrant-system/authorino-687bd45585-wfxct"
Jul 30 20:36:38.827552 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:38.827533    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2cbmm\" (UniqueName: \"kubernetes.io/projected/90cfa55a-1b61-4595-a8ce-c8eac7fc9470-kube-api-access-2cbmm\") pod \"authorino-687bd45585-wfxct\" (UID: \"90cfa55a-1b61-4595-a8ce-c8eac7fc9470\") " pod="kuadrant-system/authorino-687bd45585-wfxct"
Jul 30 20:36:38.916968 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:38.916943    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fls4z\" (UniqueName: \"kubernetes.io/projected/22d27b7c-42ce-457f-be01-6153393e7feb-kube-api-access-fls4z\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 20:36:39.666085 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:39.666017    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-687bd45585-wfxct"
Jul 30 20:36:39.666085 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:39.666054    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-m58mm"
Jul 30 20:36:39.672475 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:39.672457    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-687bd45585-wfxct"
Jul 30 20:36:39.710685 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:39.710658    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-m58mm"]
Jul 30 20:36:39.716266 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:39.716237    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-m58mm"]
Jul 30 20:36:39.824361 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:39.824339    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/90cfa55a-1b61-4595-a8ce-c8eac7fc9470-tls-cert\") pod \"90cfa55a-1b61-4595-a8ce-c8eac7fc9470\" (UID: \"90cfa55a-1b61-4595-a8ce-c8eac7fc9470\") "
Jul 30 20:36:39.824490 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:39.824416    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2cbmm\" (UniqueName: \"kubernetes.io/projected/90cfa55a-1b61-4595-a8ce-c8eac7fc9470-kube-api-access-2cbmm\") pod \"90cfa55a-1b61-4595-a8ce-c8eac7fc9470\" (UID: \"90cfa55a-1b61-4595-a8ce-c8eac7fc9470\") "
Jul 30 20:36:39.826615 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:39.826566    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/90cfa55a-1b61-4595-a8ce-c8eac7fc9470-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "90cfa55a-1b61-4595-a8ce-c8eac7fc9470" (UID: "90cfa55a-1b61-4595-a8ce-c8eac7fc9470"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 20:36:39.826707 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:39.826642    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90cfa55a-1b61-4595-a8ce-c8eac7fc9470-kube-api-access-2cbmm" (OuterVolumeSpecName: "kube-api-access-2cbmm") pod "90cfa55a-1b61-4595-a8ce-c8eac7fc9470" (UID: "90cfa55a-1b61-4595-a8ce-c8eac7fc9470"). InnerVolumeSpecName "kube-api-access-2cbmm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:36:39.925268 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:39.925199    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2cbmm\" (UniqueName: \"kubernetes.io/projected/90cfa55a-1b61-4595-a8ce-c8eac7fc9470-kube-api-access-2cbmm\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 20:36:39.925268 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:39.925225    2583 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/90cfa55a-1b61-4595-a8ce-c8eac7fc9470-tls-cert\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 20:36:40.671475 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:40.671439    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-687bd45585-wfxct"
Jul 30 20:36:40.676556 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:40.676510    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="22d27b7c-42ce-457f-be01-6153393e7feb" path="/var/lib/kubelet/pods/22d27b7c-42ce-457f-be01-6153393e7feb/volumes"
Jul 30 20:36:40.700289 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:40.700259    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-687bd45585-wfxct"]
Jul 30 20:36:40.703688 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:40.703664    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-687bd45585-wfxct"]
Jul 30 20:36:40.939385 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:40.939300    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-zzpnh"]
Jul 30 20:36:40.939532 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:40.939497    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-c548b5d7d-zzpnh" podUID="45925c2e-f9b0-4e7c-b457-eb9dc76b8f6c" containerName="authorino" containerID="cri-o://aad9b38c81d358a0fe286a7a801b9cd4adff4051843b0fd4078ea3c51b6f006f" gracePeriod=30
Jul 30 20:36:41.191937 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:41.191885    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c548b5d7d-zzpnh"
Jul 30 20:36:41.338018 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:41.337989    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pp555\" (UniqueName: \"kubernetes.io/projected/45925c2e-f9b0-4e7c-b457-eb9dc76b8f6c-kube-api-access-pp555\") pod \"45925c2e-f9b0-4e7c-b457-eb9dc76b8f6c\" (UID: \"45925c2e-f9b0-4e7c-b457-eb9dc76b8f6c\") "
Jul 30 20:36:41.340187 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:41.340155    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45925c2e-f9b0-4e7c-b457-eb9dc76b8f6c-kube-api-access-pp555" (OuterVolumeSpecName: "kube-api-access-pp555") pod "45925c2e-f9b0-4e7c-b457-eb9dc76b8f6c" (UID: "45925c2e-f9b0-4e7c-b457-eb9dc76b8f6c"). InnerVolumeSpecName "kube-api-access-pp555". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:36:41.438701 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:41.438667    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pp555\" (UniqueName: \"kubernetes.io/projected/45925c2e-f9b0-4e7c-b457-eb9dc76b8f6c-kube-api-access-pp555\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 20:36:41.678082 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:41.678051    2583 generic.go:356] "Generic (PLEG): container finished" podID="45925c2e-f9b0-4e7c-b457-eb9dc76b8f6c" containerID="aad9b38c81d358a0fe286a7a801b9cd4adff4051843b0fd4078ea3c51b6f006f" exitCode=0
Jul 30 20:36:41.678506 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:41.678091    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c548b5d7d-zzpnh"
Jul 30 20:36:41.678506 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:41.678132    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c548b5d7d-zzpnh" event={"ID":"45925c2e-f9b0-4e7c-b457-eb9dc76b8f6c","Type":"ContainerDied","Data":"aad9b38c81d358a0fe286a7a801b9cd4adff4051843b0fd4078ea3c51b6f006f"}
Jul 30 20:36:41.678506 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:41.678190    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c548b5d7d-zzpnh" event={"ID":"45925c2e-f9b0-4e7c-b457-eb9dc76b8f6c","Type":"ContainerDied","Data":"54c1b2b822a7335ec429bf287f4a1a7ba7471ab90c8774062550bbd2ae9e7209"}
Jul 30 20:36:41.678506 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:41.678208    2583 scope.go:117] "RemoveContainer" containerID="aad9b38c81d358a0fe286a7a801b9cd4adff4051843b0fd4078ea3c51b6f006f"
Jul 30 20:36:41.687585 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:41.687570    2583 scope.go:117] "RemoveContainer" containerID="aad9b38c81d358a0fe286a7a801b9cd4adff4051843b0fd4078ea3c51b6f006f"
Jul 30 20:36:41.687860 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:36:41.687838    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aad9b38c81d358a0fe286a7a801b9cd4adff4051843b0fd4078ea3c51b6f006f\": container with ID starting with aad9b38c81d358a0fe286a7a801b9cd4adff4051843b0fd4078ea3c51b6f006f not found: ID does not exist" containerID="aad9b38c81d358a0fe286a7a801b9cd4adff4051843b0fd4078ea3c51b6f006f"
Jul 30 20:36:41.687935 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:41.687868    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aad9b38c81d358a0fe286a7a801b9cd4adff4051843b0fd4078ea3c51b6f006f"} err="failed to get container status \"aad9b38c81d358a0fe286a7a801b9cd4adff4051843b0fd4078ea3c51b6f006f\": rpc error: code = NotFound desc = could not find container \"aad9b38c81d358a0fe286a7a801b9cd4adff4051843b0fd4078ea3c51b6f006f\": container with ID starting with aad9b38c81d358a0fe286a7a801b9cd4adff4051843b0fd4078ea3c51b6f006f not found: ID does not exist"
Jul 30 20:36:41.703344 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:41.703320    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-zzpnh"]
Jul 30 20:36:41.705284 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:41.705268    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-zzpnh"]
Jul 30 20:36:42.264333 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:42.264296    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:36:42.675976 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:42.675945    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="45925c2e-f9b0-4e7c-b457-eb9dc76b8f6c" path="/var/lib/kubelet/pods/45925c2e-f9b0-4e7c-b457-eb9dc76b8f6c/volumes"
Jul 30 20:36:42.676321 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:42.676308    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="90cfa55a-1b61-4595-a8ce-c8eac7fc9470" path="/var/lib/kubelet/pods/90cfa55a-1b61-4595-a8ce-c8eac7fc9470/volumes"
Jul 30 20:36:45.382759 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:45.382705    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:36:45.480340 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:45.480311    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:36:45.559732 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:45.559703    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:36:48.342860 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:48.342825    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:36:48.472642 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:36:48.472616    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:37:07.466117 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:37:07.466077    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:37:11.975094 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:37:11.975055    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:37:24.108992 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:37:24.108951    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:37:24.179822 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:37:24.179788    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:37:25.603859 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:37:25.603822    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:37:25.724329 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:37:25.724297    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:37:26.102771 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:37:26.102732    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:37:26.199229 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:37:26.199184    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:37:26.204953 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:37:26.204927    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 20:37:26.231014 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:37:26.230992    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-frt6g"]
Jul 30 20:37:26.231360 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:37:26.231348    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45925c2e-f9b0-4e7c-b457-eb9dc76b8f6c" containerName="authorino"
Jul 30 20:37:26.231406 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:37:26.231361    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="45925c2e-f9b0-4e7c-b457-eb9dc76b8f6c" containerName="authorino"
Jul 30 20:37:26.231441 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:37:26.231421    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="45925c2e-f9b0-4e7c-b457-eb9dc76b8f6c" containerName="authorino"
Jul 30 20:37:26.234367 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:37:26.234350    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-frt6g"
Jul 30 20:37:26.236592 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:37:26.236578    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 30 20:37:26.236654 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:37:26.236620    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-4bzq9\""
Jul 30 20:37:26.242946 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:37:26.242920    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-frt6g"]
Jul 30 20:37:26.290524 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:37:26.290496    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/88f255a7-c387-47df-a88b-e13110fa654c-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-frt6g\" (UID: \"88f255a7-c387-47df-a88b-e13110fa654c\") " pod="openshift-ingress/payload-processing-5cc6cd444b-frt6g"
Jul 30 20:37:26.290632 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:37:26.290529    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-prxdv\" (UniqueName: \"kubernetes.io/projected/88f255a7-c387-47df-a88b-e13110fa654c-kube-api-access-prxdv\") pod \"payload-processing-5cc6cd444b-frt6g\" (UID: \"88f255a7-c387-47df-a88b-e13110fa654c\") " pod="openshift-ingress/payload-processing-5cc6cd444b-frt6g"
Jul 30 20:37:26.391867 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:37:26.391805    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/88f255a7-c387-47df-a88b-e13110fa654c-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-frt6g\" (UID: \"88f255a7-c387-47df-a88b-e13110fa654c\") " pod="openshift-ingress/payload-processing-5cc6cd444b-frt6g"
Jul 30 20:37:26.391867 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:37:26.391838    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prxdv\" (UniqueName: \"kubernetes.io/projected/88f255a7-c387-47df-a88b-e13110fa654c-kube-api-access-prxdv\") pod \"payload-processing-5cc6cd444b-frt6g\" (UID: \"88f255a7-c387-47df-a88b-e13110fa654c\") " pod="openshift-ingress/payload-processing-5cc6cd444b-frt6g"
Jul 30 20:37:26.392501 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:37:26.392483    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/88f255a7-c387-47df-a88b-e13110fa654c-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-frt6g\" (UID: \"88f255a7-c387-47df-a88b-e13110fa654c\") " pod="openshift-ingress/payload-processing-5cc6cd444b-frt6g"
Jul 30 20:37:26.407944 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:37:26.407916    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-prxdv\" (UniqueName: \"kubernetes.io/projected/88f255a7-c387-47df-a88b-e13110fa654c-kube-api-access-prxdv\") pod \"payload-processing-5cc6cd444b-frt6g\" (UID: \"88f255a7-c387-47df-a88b-e13110fa654c\") " pod="openshift-ingress/payload-processing-5cc6cd444b-frt6g"
Jul 30 20:37:26.545389 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:37:26.545365    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-frt6g"
Jul 30 20:37:26.678245 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:37:26.678204    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-frt6g"]
Jul 30 20:37:26.681370 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:37:26.681343    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88f255a7_c387_47df_a88b_e13110fa654c.slice/crio-284103c8dfc55aa1a73f6e2534146df54a120db37754d78839d84f8c9fdf47a9 WatchSource:0}: Error finding container 284103c8dfc55aa1a73f6e2534146df54a120db37754d78839d84f8c9fdf47a9: Status 404 returned error can't find the container with id 284103c8dfc55aa1a73f6e2534146df54a120db37754d78839d84f8c9fdf47a9
Jul 30 20:37:26.918318 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:37:26.918289    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-frt6g" event={"ID":"88f255a7-c387-47df-a88b-e13110fa654c","Type":"ContainerStarted","Data":"284103c8dfc55aa1a73f6e2534146df54a120db37754d78839d84f8c9fdf47a9"}
Jul 30 20:37:28.930482 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:37:28.930437    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-frt6g" event={"ID":"88f255a7-c387-47df-a88b-e13110fa654c","Type":"ContainerStarted","Data":"b46f4ea7d6c2c2636f6ce6048efead4a2a69fb1a83894360034f1e27ecb8215b"}
Jul 30 20:37:28.930865 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:37:28.930510    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5cc6cd444b-frt6g"
Jul 30 20:37:28.946578 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:37:28.946530    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5cc6cd444b-frt6g" podStartSLOduration=1.280249714 podStartE2EDuration="2.946515107s" totalImagesPullingTime="1.666265393s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:37:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:37:28.945301647 +0000 UTC m=+760.786777274" watchObservedRunningTime="2026-07-30 20:37:28.946515107 +0000 UTC m=+760.787990730"
Jul 30 20:37:36.175061 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:37:36.175023    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:37:36.286024 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:37:36.285989    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:37:39.937921 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:37:39.937889    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5cc6cd444b-frt6g"
Jul 30 20:37:50.646000 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:37:50.645957    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9ts7j"]
Jul 30 20:37:50.650990 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:37:50.650969    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9ts7j"
Jul 30 20:37:50.653464 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:37:50.653445    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 30 20:37:50.653464 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:37:50.653453    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-6wjc2\""
Jul 30 20:37:50.654045 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:37:50.654027    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 30 20:37:50.654159 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:37:50.654032    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 30 20:37:50.659784 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:37:50.659763    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9ts7j"]
Jul 30 20:37:50.750926 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:37:50.750892    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:37:50.774976 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:37:50.774947    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/85e0a1f2-3d9c-4d33-b32c-8894ff503ab0-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9ts7j\" (UID: \"85e0a1f2-3d9c-4d33-b32c-8894ff503ab0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9ts7j"
Jul 30 20:37:50.775087 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:37:50.774985    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/85e0a1f2-3d9c-4d33-b32c-8894ff503ab0-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9ts7j\" (UID: \"85e0a1f2-3d9c-4d33-b32c-8894ff503ab0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9ts7j"
Jul 30 20:37:50.775087 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:37:50.775012    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/85e0a1f2-3d9c-4d33-b32c-8894ff503ab0-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9ts7j\" (UID: \"85e0a1f2-3d9c-4d33-b32c-8894ff503ab0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9ts7j"
Jul 30 20:37:50.775087 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:37:50.775028    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zthmm\" (UniqueName: \"kubernetes.io/projected/85e0a1f2-3d9c-4d33-b32c-8894ff503ab0-kube-api-access-zthmm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9ts7j\" (UID: \"85e0a1f2-3d9c-4d33-b32c-8894ff503ab0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9ts7j"
Jul 30 20:37:50.775238 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:37:50.775124    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/85e0a1f2-3d9c-4d33-b32c-8894ff503ab0-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9ts7j\" (UID: \"85e0a1f2-3d9c-4d33-b32c-8894ff503ab0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9ts7j"
Jul 30 20:37:50.775238 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:37:50.775187    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/85e0a1f2-3d9c-4d33-b32c-8894ff503ab0-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9ts7j\" (UID: \"85e0a1f2-3d9c-4d33-b32c-8894ff503ab0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9ts7j"
Jul 30 20:37:50.876305 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:37:50.876277    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/85e0a1f2-3d9c-4d33-b32c-8894ff503ab0-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9ts7j\" (UID: \"85e0a1f2-3d9c-4d33-b32c-8894ff503ab0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9ts7j"
Jul 30 20:37:50.876429 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:37:50.876317    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/85e0a1f2-3d9c-4d33-b32c-8894ff503ab0-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9ts7j\" (UID: \"85e0a1f2-3d9c-4d33-b32c-8894ff503ab0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9ts7j"
Jul 30 20:37:50.876429 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:37:50.876339    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zthmm\" (UniqueName: \"kubernetes.io/projected/85e0a1f2-3d9c-4d33-b32c-8894ff503ab0-kube-api-access-zthmm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9ts7j\" (UID: \"85e0a1f2-3d9c-4d33-b32c-8894ff503ab0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9ts7j"
Jul 30 20:37:50.876429 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:37:50.876403    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/85e0a1f2-3d9c-4d33-b32c-8894ff503ab0-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9ts7j\" (UID: \"85e0a1f2-3d9c-4d33-b32c-8894ff503ab0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9ts7j"
Jul 30 20:37:50.876571 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:37:50.876439    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/85e0a1f2-3d9c-4d33-b32c-8894ff503ab0-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9ts7j\" (UID: \"85e0a1f2-3d9c-4d33-b32c-8894ff503ab0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9ts7j"
Jul 30 20:37:50.876571 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:37:50.876477    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/85e0a1f2-3d9c-4d33-b32c-8894ff503ab0-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9ts7j\" (UID: \"85e0a1f2-3d9c-4d33-b32c-8894ff503ab0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9ts7j"
Jul 30 20:37:50.876762 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:37:50.876741    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/85e0a1f2-3d9c-4d33-b32c-8894ff503ab0-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9ts7j\" (UID: \"85e0a1f2-3d9c-4d33-b32c-8894ff503ab0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9ts7j"
Jul 30 20:37:50.876829 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:37:50.876798    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/85e0a1f2-3d9c-4d33-b32c-8894ff503ab0-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9ts7j\" (UID: \"85e0a1f2-3d9c-4d33-b32c-8894ff503ab0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9ts7j"
Jul 30 20:37:50.876928 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:37:50.876827    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/85e0a1f2-3d9c-4d33-b32c-8894ff503ab0-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9ts7j\" (UID: \"85e0a1f2-3d9c-4d33-b32c-8894ff503ab0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9ts7j"
Jul 30 20:37:50.878792 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:37:50.878770    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/85e0a1f2-3d9c-4d33-b32c-8894ff503ab0-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9ts7j\" (UID: \"85e0a1f2-3d9c-4d33-b32c-8894ff503ab0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9ts7j"
Jul 30 20:37:50.878961 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:37:50.878945    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/85e0a1f2-3d9c-4d33-b32c-8894ff503ab0-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9ts7j\" (UID: \"85e0a1f2-3d9c-4d33-b32c-8894ff503ab0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9ts7j"
Jul 30 20:37:50.883858 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:37:50.883841    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zthmm\" (UniqueName: \"kubernetes.io/projected/85e0a1f2-3d9c-4d33-b32c-8894ff503ab0-kube-api-access-zthmm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9ts7j\" (UID: \"85e0a1f2-3d9c-4d33-b32c-8894ff503ab0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9ts7j"
Jul 30 20:37:50.961826 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:37:50.961805    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9ts7j"
Jul 30 20:37:51.048125 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:37:51.048091    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 20:37:51.096636 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:37:51.096612    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9ts7j"]
Jul 30 20:37:51.098368 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:37:51.098341    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85e0a1f2_3d9c_4d33_b32c_8894ff503ab0.slice/crio-cbed7eab8e9ffbeba6a856c4bc308202715854e23628d6b563b01338cc2e0e74 WatchSource:0}: Error finding container cbed7eab8e9ffbeba6a856c4bc308202715854e23628d6b563b01338cc2e0e74: Status 404 returned error can't find the container with id cbed7eab8e9ffbeba6a856c4bc308202715854e23628d6b563b01338cc2e0e74
Jul 30 20:37:52.060786 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:37:52.060748    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9ts7j" event={"ID":"85e0a1f2-3d9c-4d33-b32c-8894ff503ab0","Type":"ContainerStarted","Data":"cbed7eab8e9ffbeba6a856c4bc308202715854e23628d6b563b01338cc2e0e74"}
Jul 30 20:37:53.067943 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:37:53.067907    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9ts7j" event={"ID":"85e0a1f2-3d9c-4d33-b32c-8894ff503ab0","Type":"ContainerStarted","Data":"f4bc820e71eaf88952dc55b61e59a61b0fd88492c63588a5de1f48ea83d14510"}
Jul 30 20:37:53.085938 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:37:53.085891    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9ts7j" podStartSLOduration=1.918572918 podStartE2EDuration="3.085876482s" totalImagesPullingTime="1.167303564s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:37:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:37:53.084364897 +0000 UTC m=+784.925840519" watchObservedRunningTime="2026-07-30 20:37:53.085876482 +0000 UTC m=+784.927352103"
Jul 30 20:38:00.962509 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:38:00.962477    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9ts7j"
Jul 30 20:38:00.962926 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:38:00.962744    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9ts7j"
Jul 30 20:38:00.974793 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:38:00.974773    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9ts7j"
Jul 30 20:38:01.123395 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:38:01.123365    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9ts7j"
Jul 30 20:38:03.571830 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:38:03.571793    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:38:04.257111 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:38:04.257080    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 20:38:15.168020 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:38:15.167937    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:38:16.448726 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:38:16.448695    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 20:38:26.169561 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:38:26.169524    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:38:27.346387 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:38:27.346357    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 20:38:30.667120 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:38:30.667082    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:38:31.653472 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:38:31.653438    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 20:38:36.337920 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:38:36.337885    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-mvtkb"]
Jul 30 20:38:36.344187 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:38:36.344166    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mvtkb"
Jul 30 20:38:36.346286 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:38:36.346252    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 30 20:38:36.353183 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:38:36.353160    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-mvtkb"]
Jul 30 20:38:36.369365 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:38:36.369333    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:38:36.439964 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:38:36.439943    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f57c6bd8-b83d-4f61-b31a-49f2a8e1dd09-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mvtkb\" (UID: \"f57c6bd8-b83d-4f61-b31a-49f2a8e1dd09\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mvtkb"
Jul 30 20:38:36.440071 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:38:36.439973    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f57c6bd8-b83d-4f61-b31a-49f2a8e1dd09-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mvtkb\" (UID: \"f57c6bd8-b83d-4f61-b31a-49f2a8e1dd09\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mvtkb"
Jul 30 20:38:36.440071 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:38:36.440001    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f57c6bd8-b83d-4f61-b31a-49f2a8e1dd09-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mvtkb\" (UID: \"f57c6bd8-b83d-4f61-b31a-49f2a8e1dd09\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mvtkb"
Jul 30 20:38:36.440071 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:38:36.440021    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbn7w\" (UniqueName: \"kubernetes.io/projected/f57c6bd8-b83d-4f61-b31a-49f2a8e1dd09-kube-api-access-qbn7w\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mvtkb\" (UID: \"f57c6bd8-b83d-4f61-b31a-49f2a8e1dd09\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mvtkb"
Jul 30 20:38:36.440071 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:38:36.440060    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f57c6bd8-b83d-4f61-b31a-49f2a8e1dd09-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mvtkb\" (UID: \"f57c6bd8-b83d-4f61-b31a-49f2a8e1dd09\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mvtkb"
Jul 30 20:38:36.440255 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:38:36.440201    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f57c6bd8-b83d-4f61-b31a-49f2a8e1dd09-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mvtkb\" (UID: \"f57c6bd8-b83d-4f61-b31a-49f2a8e1dd09\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mvtkb"
Jul 30 20:38:36.540976 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:38:36.540950    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f57c6bd8-b83d-4f61-b31a-49f2a8e1dd09-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mvtkb\" (UID: \"f57c6bd8-b83d-4f61-b31a-49f2a8e1dd09\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mvtkb"
Jul 30 20:38:36.541079 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:38:36.540982    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f57c6bd8-b83d-4f61-b31a-49f2a8e1dd09-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mvtkb\" (UID: \"f57c6bd8-b83d-4f61-b31a-49f2a8e1dd09\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mvtkb"
Jul 30 20:38:36.541079 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:38:36.541006    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f57c6bd8-b83d-4f61-b31a-49f2a8e1dd09-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mvtkb\" (UID: \"f57c6bd8-b83d-4f61-b31a-49f2a8e1dd09\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mvtkb"
Jul 30 20:38:36.541079 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:38:36.541029    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f57c6bd8-b83d-4f61-b31a-49f2a8e1dd09-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mvtkb\" (UID: \"f57c6bd8-b83d-4f61-b31a-49f2a8e1dd09\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mvtkb"
Jul 30 20:38:36.541079 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:38:36.541055    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbn7w\" (UniqueName: \"kubernetes.io/projected/f57c6bd8-b83d-4f61-b31a-49f2a8e1dd09-kube-api-access-qbn7w\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mvtkb\" (UID: \"f57c6bd8-b83d-4f61-b31a-49f2a8e1dd09\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mvtkb"
Jul 30 20:38:36.541346 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:38:36.541086    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f57c6bd8-b83d-4f61-b31a-49f2a8e1dd09-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mvtkb\" (UID: \"f57c6bd8-b83d-4f61-b31a-49f2a8e1dd09\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mvtkb"
Jul 30 20:38:36.541415 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:38:36.541392    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f57c6bd8-b83d-4f61-b31a-49f2a8e1dd09-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mvtkb\" (UID: \"f57c6bd8-b83d-4f61-b31a-49f2a8e1dd09\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mvtkb"
Jul 30 20:38:36.541521 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:38:36.541471    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f57c6bd8-b83d-4f61-b31a-49f2a8e1dd09-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mvtkb\" (UID: \"f57c6bd8-b83d-4f61-b31a-49f2a8e1dd09\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mvtkb"
Jul 30 20:38:36.541569 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:38:36.541522    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f57c6bd8-b83d-4f61-b31a-49f2a8e1dd09-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mvtkb\" (UID: \"f57c6bd8-b83d-4f61-b31a-49f2a8e1dd09\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mvtkb"
Jul 30 20:38:36.543307 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:38:36.543288    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f57c6bd8-b83d-4f61-b31a-49f2a8e1dd09-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mvtkb\" (UID: \"f57c6bd8-b83d-4f61-b31a-49f2a8e1dd09\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mvtkb"
Jul 30 20:38:36.543646 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:38:36.543630    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f57c6bd8-b83d-4f61-b31a-49f2a8e1dd09-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mvtkb\" (UID: \"f57c6bd8-b83d-4f61-b31a-49f2a8e1dd09\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mvtkb"
Jul 30 20:38:36.548283 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:38:36.548266    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbn7w\" (UniqueName: \"kubernetes.io/projected/f57c6bd8-b83d-4f61-b31a-49f2a8e1dd09-kube-api-access-qbn7w\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mvtkb\" (UID: \"f57c6bd8-b83d-4f61-b31a-49f2a8e1dd09\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mvtkb"
Jul 30 20:38:36.653936 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:38:36.653912    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mvtkb"
Jul 30 20:38:36.790052 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:38:36.790029    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-mvtkb"]
Jul 30 20:38:36.791938 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:38:36.791911    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf57c6bd8_b83d_4f61_b31a_49f2a8e1dd09.slice/crio-f45589d796d5f4defcdbf4782d56e3c1325119b940c98d0b02e571ea2a34edb0 WatchSource:0}: Error finding container f45589d796d5f4defcdbf4782d56e3c1325119b940c98d0b02e571ea2a34edb0: Status 404 returned error can't find the container with id f45589d796d5f4defcdbf4782d56e3c1325119b940c98d0b02e571ea2a34edb0
Jul 30 20:38:37.303473 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:38:37.303382    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mvtkb" event={"ID":"f57c6bd8-b83d-4f61-b31a-49f2a8e1dd09","Type":"ContainerStarted","Data":"3545e24c7dbaacc92c631f536e7e15db7bb1a32e2fafa645ebd90e0a11dbaf3f"}
Jul 30 20:38:37.303473 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:38:37.303438    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mvtkb" event={"ID":"f57c6bd8-b83d-4f61-b31a-49f2a8e1dd09","Type":"ContainerStarted","Data":"f45589d796d5f4defcdbf4782d56e3c1325119b940c98d0b02e571ea2a34edb0"}
Jul 30 20:38:37.318784 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:38:37.318728    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mvtkb" podStartSLOduration=1.118866043 podStartE2EDuration="1.318715181s" totalImagesPullingTime="199.849138ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:38:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:38:37.318692018 +0000 UTC m=+829.160167640" watchObservedRunningTime="2026-07-30 20:38:37.318715181 +0000 UTC m=+829.160190781"
Jul 30 20:38:38.753554 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:38:38.753523    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 20:38:46.654629 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:38:46.654584    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mvtkb"
Jul 30 20:38:46.654629 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:38:46.654636    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mvtkb"
Jul 30 20:38:46.666897 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:38:46.666875    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mvtkb"
Jul 30 20:38:47.366398 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:38:47.366367    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mvtkb"
Jul 30 20:39:59.435200 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:39:59.435159    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:40:01.057050 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:40:01.057004    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:40:27.859792 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:40:27.859756    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 20:40:28.633670 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:40:28.633626    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:40:38.045351 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:40:38.045318    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 20:40:51.256966 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:40:51.256932    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 20:42:06.475745 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:42:06.475712    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:42:07.689556 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:42:07.689522    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:42:27.560689 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:42:27.560657    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:42:30.946693 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:42:30.946660    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 20:42:40.659661 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:42:40.659580    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 20:43:10.919982 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:43:10.919949    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:43:11.024987 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:43:11.024961    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:43:11.162635 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:43:11.162607    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:43:16.825859 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:43:16.825824    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:43:16.929926 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:43:16.929897    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:43:17.026073 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:43:17.026042    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:43:17.186951 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:43:17.186918    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:43:22.854295 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:43:22.854255    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:43:22.955297 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:43:22.955264    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:43:38.952467 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:43:38.952431    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 20:43:45.566950 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:43:45.566916    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 20:44:01.258352 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:44:01.258313    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 20:44:07.347466 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:44:07.347430    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 20:44:16.748356 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:44:16.748286    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 20:44:17.458179 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:44:17.458153    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:44:17.559814 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:44:17.559788    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:44:24.258071 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:44:24.258035    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 20:44:37.053155 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:44:37.053118    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 20:44:42.151694 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:44:42.151663    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 20:44:47.166882 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:44:47.166848    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 20:44:52.149386 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:44:52.149351    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 20:44:59.747097 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:44:59.747063    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 20:45:12.151470 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:45:12.151436    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 20:45:23.153729 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:45:23.153691    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 20:45:46.358150 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:45:46.358114    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 20:45:56.857854 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:45:56.857819    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 20:46:02.151851 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:46:02.151808    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 20:46:09.545350 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:46:09.545297    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 20:46:17.452920 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:46:17.452881    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 20:46:22.948530 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:46:22.948494    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 20:46:27.852640 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:46:27.852601    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 20:46:35.349972 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:46:35.349933    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 20:46:56.454438 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:46:56.454397    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 20:47:05.546935 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:47:05.546901    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 20:47:15.553476 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:47:15.553387    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 20:47:25.952347 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:47:25.952315    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 20:47:33.951272 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:47:33.951236    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 20:47:34.301097 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:47:34.301024    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:47:41.957123 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:47:41.957082    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 20:49:20.985008 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:49:20.984968    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:49:59.455684 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:49:59.455652    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 20:50:04.347673 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:50:04.347638    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 20:50:29.244681 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:50:29.244587    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 20:50:51.048642 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:50:51.048609    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 20:51:01.665259 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:51:01.665230    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 20:51:06.560453 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:51:06.560417    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 20:51:11.552022 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:51:11.551991    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 20:51:21.564734 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:51:21.564703    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 20:51:27.860342 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:51:27.860309    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 20:51:36.755426 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:51:36.755390    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 20:51:43.059271 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:51:43.059237    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 20:51:52.063349 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:51:52.063314    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 20:51:58.064669 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:51:58.064634    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 20:52:04.152238 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:52:04.152204    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:52:04.237611 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:52:04.237585    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:52:08.057705 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:52:08.057666    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 20:52:30.453922 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:52:30.453891    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 20:52:37.265526 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:52:37.265492    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 20:52:48.169847 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:52:48.169815    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-92bd23a0-kserve-7c4495b75f-x2cbq"]
Jul 30 20:52:48.173340 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:52:48.173324    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-92bd23a0-kserve-7c4495b75f-x2cbq"
Jul 30 20:52:48.175563 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:52:48.175539    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-92bd23a0-kserve-self-signed-certs\""
Jul 30 20:52:48.190708 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:52:48.190686    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-92bd23a0-kserve-7c4495b75f-x2cbq"]
Jul 30 20:52:48.263845 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:52:48.263813    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:52:48.305968 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:52:48.305931    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2d9k5\" (UniqueName: \"kubernetes.io/projected/7233ba7c-7615-4b98-8214-c49591b876bb-kube-api-access-2d9k5\") pod \"e2e-same-id-a-92bd23a0-kserve-7c4495b75f-x2cbq\" (UID: \"7233ba7c-7615-4b98-8214-c49591b876bb\") " pod="llm/e2e-same-id-a-92bd23a0-kserve-7c4495b75f-x2cbq"
Jul 30 20:52:48.306131 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:52:48.305991    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7233ba7c-7615-4b98-8214-c49591b876bb-tmp-dir\") pod \"e2e-same-id-a-92bd23a0-kserve-7c4495b75f-x2cbq\" (UID: \"7233ba7c-7615-4b98-8214-c49591b876bb\") " pod="llm/e2e-same-id-a-92bd23a0-kserve-7c4495b75f-x2cbq"
Jul 30 20:52:48.306131 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:52:48.306056    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7233ba7c-7615-4b98-8214-c49591b876bb-home\") pod \"e2e-same-id-a-92bd23a0-kserve-7c4495b75f-x2cbq\" (UID: \"7233ba7c-7615-4b98-8214-c49591b876bb\") " pod="llm/e2e-same-id-a-92bd23a0-kserve-7c4495b75f-x2cbq"
Jul 30 20:52:48.306131 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:52:48.306083    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7233ba7c-7615-4b98-8214-c49591b876bb-model-cache\") pod \"e2e-same-id-a-92bd23a0-kserve-7c4495b75f-x2cbq\" (UID: \"7233ba7c-7615-4b98-8214-c49591b876bb\") " pod="llm/e2e-same-id-a-92bd23a0-kserve-7c4495b75f-x2cbq"
Jul 30 20:52:48.306131 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:52:48.306119    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7233ba7c-7615-4b98-8214-c49591b876bb-tls-certs\") pod \"e2e-same-id-a-92bd23a0-kserve-7c4495b75f-x2cbq\" (UID: \"7233ba7c-7615-4b98-8214-c49591b876bb\") " pod="llm/e2e-same-id-a-92bd23a0-kserve-7c4495b75f-x2cbq"
Jul 30 20:52:48.306334 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:52:48.306177    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7233ba7c-7615-4b98-8214-c49591b876bb-dshm\") pod \"e2e-same-id-a-92bd23a0-kserve-7c4495b75f-x2cbq\" (UID: \"7233ba7c-7615-4b98-8214-c49591b876bb\") " pod="llm/e2e-same-id-a-92bd23a0-kserve-7c4495b75f-x2cbq"
Jul 30 20:52:48.406950 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:52:48.406917    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7233ba7c-7615-4b98-8214-c49591b876bb-tmp-dir\") pod \"e2e-same-id-a-92bd23a0-kserve-7c4495b75f-x2cbq\" (UID: \"7233ba7c-7615-4b98-8214-c49591b876bb\") " pod="llm/e2e-same-id-a-92bd23a0-kserve-7c4495b75f-x2cbq"
Jul 30 20:52:48.407123 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:52:48.406971    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7233ba7c-7615-4b98-8214-c49591b876bb-home\") pod \"e2e-same-id-a-92bd23a0-kserve-7c4495b75f-x2cbq\" (UID: \"7233ba7c-7615-4b98-8214-c49591b876bb\") " pod="llm/e2e-same-id-a-92bd23a0-kserve-7c4495b75f-x2cbq"
Jul 30 20:52:48.407123 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:52:48.406992    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7233ba7c-7615-4b98-8214-c49591b876bb-model-cache\") pod \"e2e-same-id-a-92bd23a0-kserve-7c4495b75f-x2cbq\" (UID: \"7233ba7c-7615-4b98-8214-c49591b876bb\") " pod="llm/e2e-same-id-a-92bd23a0-kserve-7c4495b75f-x2cbq"
Jul 30 20:52:48.407123 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:52:48.407013    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7233ba7c-7615-4b98-8214-c49591b876bb-tls-certs\") pod \"e2e-same-id-a-92bd23a0-kserve-7c4495b75f-x2cbq\" (UID: \"7233ba7c-7615-4b98-8214-c49591b876bb\") " pod="llm/e2e-same-id-a-92bd23a0-kserve-7c4495b75f-x2cbq"
Jul 30 20:52:48.407123 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:52:48.407040    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7233ba7c-7615-4b98-8214-c49591b876bb-dshm\") pod \"e2e-same-id-a-92bd23a0-kserve-7c4495b75f-x2cbq\" (UID: \"7233ba7c-7615-4b98-8214-c49591b876bb\") " pod="llm/e2e-same-id-a-92bd23a0-kserve-7c4495b75f-x2cbq"
Jul 30 20:52:48.407123 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:52:48.407092    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2d9k5\" (UniqueName: \"kubernetes.io/projected/7233ba7c-7615-4b98-8214-c49591b876bb-kube-api-access-2d9k5\") pod \"e2e-same-id-a-92bd23a0-kserve-7c4495b75f-x2cbq\" (UID: \"7233ba7c-7615-4b98-8214-c49591b876bb\") " pod="llm/e2e-same-id-a-92bd23a0-kserve-7c4495b75f-x2cbq"
Jul 30 20:52:48.407436 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:52:48.407387    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7233ba7c-7615-4b98-8214-c49591b876bb-tmp-dir\") pod \"e2e-same-id-a-92bd23a0-kserve-7c4495b75f-x2cbq\" (UID: \"7233ba7c-7615-4b98-8214-c49591b876bb\") " pod="llm/e2e-same-id-a-92bd23a0-kserve-7c4495b75f-x2cbq"
Jul 30 20:52:48.407490 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:52:48.407437    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7233ba7c-7615-4b98-8214-c49591b876bb-model-cache\") pod \"e2e-same-id-a-92bd23a0-kserve-7c4495b75f-x2cbq\" (UID: \"7233ba7c-7615-4b98-8214-c49591b876bb\") " pod="llm/e2e-same-id-a-92bd23a0-kserve-7c4495b75f-x2cbq"
Jul 30 20:52:48.407490 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:52:48.407476    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7233ba7c-7615-4b98-8214-c49591b876bb-home\") pod \"e2e-same-id-a-92bd23a0-kserve-7c4495b75f-x2cbq\" (UID: \"7233ba7c-7615-4b98-8214-c49591b876bb\") " pod="llm/e2e-same-id-a-92bd23a0-kserve-7c4495b75f-x2cbq"
Jul 30 20:52:48.409434 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:52:48.409415    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7233ba7c-7615-4b98-8214-c49591b876bb-dshm\") pod \"e2e-same-id-a-92bd23a0-kserve-7c4495b75f-x2cbq\" (UID: \"7233ba7c-7615-4b98-8214-c49591b876bb\") " pod="llm/e2e-same-id-a-92bd23a0-kserve-7c4495b75f-x2cbq"
Jul 30 20:52:48.409684 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:52:48.409666    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7233ba7c-7615-4b98-8214-c49591b876bb-tls-certs\") pod \"e2e-same-id-a-92bd23a0-kserve-7c4495b75f-x2cbq\" (UID: \"7233ba7c-7615-4b98-8214-c49591b876bb\") " pod="llm/e2e-same-id-a-92bd23a0-kserve-7c4495b75f-x2cbq"
Jul 30 20:52:48.415158 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:52:48.415120    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2d9k5\" (UniqueName: \"kubernetes.io/projected/7233ba7c-7615-4b98-8214-c49591b876bb-kube-api-access-2d9k5\") pod \"e2e-same-id-a-92bd23a0-kserve-7c4495b75f-x2cbq\" (UID: \"7233ba7c-7615-4b98-8214-c49591b876bb\") " pod="llm/e2e-same-id-a-92bd23a0-kserve-7c4495b75f-x2cbq"
Jul 30 20:52:48.483006 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:52:48.482935    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-92bd23a0-kserve-7c4495b75f-x2cbq"
Jul 30 20:52:48.617885 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:52:48.617768    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-92bd23a0-kserve-7c4495b75f-x2cbq"]
Jul 30 20:52:48.620513 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:52:48.620482    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7233ba7c_7615_4b98_8214_c49591b876bb.slice/crio-17734e30a9d565508d7cfb85d6e095cd81394fa6b9b194663bc46cb8fe7c86b9 WatchSource:0}: Error finding container 17734e30a9d565508d7cfb85d6e095cd81394fa6b9b194663bc46cb8fe7c86b9: Status 404 returned error can't find the container with id 17734e30a9d565508d7cfb85d6e095cd81394fa6b9b194663bc46cb8fe7c86b9
Jul 30 20:52:48.755372 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:52:48.755280    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-92bd23a0-kserve-7c4495b75f-x2cbq" event={"ID":"7233ba7c-7615-4b98-8214-c49591b876bb","Type":"ContainerStarted","Data":"ba27235ed2a9b8808f6813e2a82821dd85e728fb3d6511944bf0006fc98113db"}
Jul 30 20:52:48.755372 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:52:48.755324    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-92bd23a0-kserve-7c4495b75f-x2cbq" event={"ID":"7233ba7c-7615-4b98-8214-c49591b876bb","Type":"ContainerStarted","Data":"17734e30a9d565508d7cfb85d6e095cd81394fa6b9b194663bc46cb8fe7c86b9"}
Jul 30 20:52:48.774946 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:52:48.774896    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-a-92bd23a0-kserve-7c4495b75f-x2cbq" podStartSLOduration=0.774879937 podStartE2EDuration="774.879937ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:52:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:52:48.773334405 +0000 UTC m=+1680.614810028" watchObservedRunningTime="2026-07-30 20:52:48.774879937 +0000 UTC m=+1680.616355557"
Jul 30 20:52:51.062670 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:52:51.062639    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 20:52:58.483242 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:52:58.483156    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-92bd23a0-kserve-7c4495b75f-x2cbq"
Jul 30 20:52:58.483242 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:52:58.483205    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-92bd23a0-kserve-7c4495b75f-x2cbq"
Jul 30 20:52:58.495559 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:52:58.495538    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-92bd23a0-kserve-7c4495b75f-x2cbq"
Jul 30 20:52:58.817188 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:52:58.817090    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-92bd23a0-kserve-7c4495b75f-x2cbq"
Jul 30 20:53:05.045329 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:53:05.045295    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-92bd23a0-kserve-89dd67c9f-m4krh"]
Jul 30 20:53:05.049218 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:53:05.049202    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-92bd23a0-kserve-89dd67c9f-m4krh"
Jul 30 20:53:05.051108 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:53:05.051094    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-92bd23a0-kserve-self-signed-certs\""
Jul 30 20:53:05.058464 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:53:05.058445    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-92bd23a0-kserve-89dd67c9f-m4krh"]
Jul 30 20:53:05.084985 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:53:05.084936    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:53:05.143043 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:53:05.143014    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b580190-dee6-4910-8b18-7ef0c38ca02b-tmp-dir\") pod \"e2e-same-id-b-92bd23a0-kserve-89dd67c9f-m4krh\" (UID: \"2b580190-dee6-4910-8b18-7ef0c38ca02b\") " pod="llm/e2e-same-id-b-92bd23a0-kserve-89dd67c9f-m4krh"
Jul 30 20:53:05.143159 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:53:05.143051    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2b580190-dee6-4910-8b18-7ef0c38ca02b-dshm\") pod \"e2e-same-id-b-92bd23a0-kserve-89dd67c9f-m4krh\" (UID: \"2b580190-dee6-4910-8b18-7ef0c38ca02b\") " pod="llm/e2e-same-id-b-92bd23a0-kserve-89dd67c9f-m4krh"
Jul 30 20:53:05.143159 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:53:05.143068    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2b580190-dee6-4910-8b18-7ef0c38ca02b-model-cache\") pod \"e2e-same-id-b-92bd23a0-kserve-89dd67c9f-m4krh\" (UID: \"2b580190-dee6-4910-8b18-7ef0c38ca02b\") " pod="llm/e2e-same-id-b-92bd23a0-kserve-89dd67c9f-m4krh"
Jul 30 20:53:05.143159 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:53:05.143082    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9j8sq\" (UniqueName: \"kubernetes.io/projected/2b580190-dee6-4910-8b18-7ef0c38ca02b-kube-api-access-9j8sq\") pod \"e2e-same-id-b-92bd23a0-kserve-89dd67c9f-m4krh\" (UID: \"2b580190-dee6-4910-8b18-7ef0c38ca02b\") " pod="llm/e2e-same-id-b-92bd23a0-kserve-89dd67c9f-m4krh"
Jul 30 20:53:05.143276 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:53:05.143163    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2b580190-dee6-4910-8b18-7ef0c38ca02b-home\") pod \"e2e-same-id-b-92bd23a0-kserve-89dd67c9f-m4krh\" (UID: \"2b580190-dee6-4910-8b18-7ef0c38ca02b\") " pod="llm/e2e-same-id-b-92bd23a0-kserve-89dd67c9f-m4krh"
Jul 30 20:53:05.143276 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:53:05.143193    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b580190-dee6-4910-8b18-7ef0c38ca02b-tls-certs\") pod \"e2e-same-id-b-92bd23a0-kserve-89dd67c9f-m4krh\" (UID: \"2b580190-dee6-4910-8b18-7ef0c38ca02b\") " pod="llm/e2e-same-id-b-92bd23a0-kserve-89dd67c9f-m4krh"
Jul 30 20:53:05.243709 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:53:05.243681    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b580190-dee6-4910-8b18-7ef0c38ca02b-tmp-dir\") pod \"e2e-same-id-b-92bd23a0-kserve-89dd67c9f-m4krh\" (UID: \"2b580190-dee6-4910-8b18-7ef0c38ca02b\") " pod="llm/e2e-same-id-b-92bd23a0-kserve-89dd67c9f-m4krh"
Jul 30 20:53:05.243826 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:53:05.243719    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2b580190-dee6-4910-8b18-7ef0c38ca02b-dshm\") pod \"e2e-same-id-b-92bd23a0-kserve-89dd67c9f-m4krh\" (UID: \"2b580190-dee6-4910-8b18-7ef0c38ca02b\") " pod="llm/e2e-same-id-b-92bd23a0-kserve-89dd67c9f-m4krh"
Jul 30 20:53:05.243826 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:53:05.243740    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2b580190-dee6-4910-8b18-7ef0c38ca02b-model-cache\") pod \"e2e-same-id-b-92bd23a0-kserve-89dd67c9f-m4krh\" (UID: \"2b580190-dee6-4910-8b18-7ef0c38ca02b\") " pod="llm/e2e-same-id-b-92bd23a0-kserve-89dd67c9f-m4krh"
Jul 30 20:53:05.243826 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:53:05.243766    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9j8sq\" (UniqueName: \"kubernetes.io/projected/2b580190-dee6-4910-8b18-7ef0c38ca02b-kube-api-access-9j8sq\") pod \"e2e-same-id-b-92bd23a0-kserve-89dd67c9f-m4krh\" (UID: \"2b580190-dee6-4910-8b18-7ef0c38ca02b\") " pod="llm/e2e-same-id-b-92bd23a0-kserve-89dd67c9f-m4krh"
Jul 30 20:53:05.243826 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:53:05.243798    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2b580190-dee6-4910-8b18-7ef0c38ca02b-home\") pod \"e2e-same-id-b-92bd23a0-kserve-89dd67c9f-m4krh\" (UID: \"2b580190-dee6-4910-8b18-7ef0c38ca02b\") " pod="llm/e2e-same-id-b-92bd23a0-kserve-89dd67c9f-m4krh"
Jul 30 20:53:05.244042 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:53:05.243839    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b580190-dee6-4910-8b18-7ef0c38ca02b-tls-certs\") pod \"e2e-same-id-b-92bd23a0-kserve-89dd67c9f-m4krh\" (UID: \"2b580190-dee6-4910-8b18-7ef0c38ca02b\") " pod="llm/e2e-same-id-b-92bd23a0-kserve-89dd67c9f-m4krh"
Jul 30 20:53:05.244096 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:53:05.244060    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2b580190-dee6-4910-8b18-7ef0c38ca02b-model-cache\") pod \"e2e-same-id-b-92bd23a0-kserve-89dd67c9f-m4krh\" (UID: \"2b580190-dee6-4910-8b18-7ef0c38ca02b\") " pod="llm/e2e-same-id-b-92bd23a0-kserve-89dd67c9f-m4krh"
Jul 30 20:53:05.244191 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:53:05.244121    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b580190-dee6-4910-8b18-7ef0c38ca02b-tmp-dir\") pod \"e2e-same-id-b-92bd23a0-kserve-89dd67c9f-m4krh\" (UID: \"2b580190-dee6-4910-8b18-7ef0c38ca02b\") " pod="llm/e2e-same-id-b-92bd23a0-kserve-89dd67c9f-m4krh"
Jul 30 20:53:05.244265 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:53:05.244249    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2b580190-dee6-4910-8b18-7ef0c38ca02b-home\") pod \"e2e-same-id-b-92bd23a0-kserve-89dd67c9f-m4krh\" (UID: \"2b580190-dee6-4910-8b18-7ef0c38ca02b\") " pod="llm/e2e-same-id-b-92bd23a0-kserve-89dd67c9f-m4krh"
Jul 30 20:53:05.246037 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:53:05.246017    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2b580190-dee6-4910-8b18-7ef0c38ca02b-dshm\") pod \"e2e-same-id-b-92bd23a0-kserve-89dd67c9f-m4krh\" (UID: \"2b580190-dee6-4910-8b18-7ef0c38ca02b\") " pod="llm/e2e-same-id-b-92bd23a0-kserve-89dd67c9f-m4krh"
Jul 30 20:53:05.246317 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:53:05.246287    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b580190-dee6-4910-8b18-7ef0c38ca02b-tls-certs\") pod \"e2e-same-id-b-92bd23a0-kserve-89dd67c9f-m4krh\" (UID: \"2b580190-dee6-4910-8b18-7ef0c38ca02b\") " pod="llm/e2e-same-id-b-92bd23a0-kserve-89dd67c9f-m4krh"
Jul 30 20:53:05.253080 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:53:05.253062    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9j8sq\" (UniqueName: \"kubernetes.io/projected/2b580190-dee6-4910-8b18-7ef0c38ca02b-kube-api-access-9j8sq\") pod \"e2e-same-id-b-92bd23a0-kserve-89dd67c9f-m4krh\" (UID: \"2b580190-dee6-4910-8b18-7ef0c38ca02b\") " pod="llm/e2e-same-id-b-92bd23a0-kserve-89dd67c9f-m4krh"
Jul 30 20:53:05.358806 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:53:05.358754    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-92bd23a0-kserve-89dd67c9f-m4krh"
Jul 30 20:53:05.493979 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:53:05.493947    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-92bd23a0-kserve-89dd67c9f-m4krh"]
Jul 30 20:53:05.494751 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:53:05.494722    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2b580190_dee6_4910_8b18_7ef0c38ca02b.slice/crio-1def4ed1af535532855fd42ec6ca2744a2c2bc9728d57d550c3f808bee12b327 WatchSource:0}: Error finding container 1def4ed1af535532855fd42ec6ca2744a2c2bc9728d57d550c3f808bee12b327: Status 404 returned error can't find the container with id 1def4ed1af535532855fd42ec6ca2744a2c2bc9728d57d550c3f808bee12b327
Jul 30 20:53:05.843641 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:53:05.843608    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-92bd23a0-kserve-89dd67c9f-m4krh" event={"ID":"2b580190-dee6-4910-8b18-7ef0c38ca02b","Type":"ContainerStarted","Data":"cec3ee0ea134c0e8628435579abd27d48b0a71063b608b9e524507893f1d86d4"}
Jul 30 20:53:05.843641 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:53:05.843646    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-92bd23a0-kserve-89dd67c9f-m4krh" event={"ID":"2b580190-dee6-4910-8b18-7ef0c38ca02b","Type":"ContainerStarted","Data":"1def4ed1af535532855fd42ec6ca2744a2c2bc9728d57d550c3f808bee12b327"}
Jul 30 20:53:05.863825 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:53:05.863779    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-92bd23a0-kserve-89dd67c9f-m4krh" podStartSLOduration=0.863763419 podStartE2EDuration="863.763419ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:53:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:53:05.86186525 +0000 UTC m=+1697.703340871" watchObservedRunningTime="2026-07-30 20:53:05.863763419 +0000 UTC m=+1697.705239040"
Jul 30 20:53:07.364027 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:53:07.363993    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 20:53:15.359935 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:53:15.359853    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-92bd23a0-kserve-89dd67c9f-m4krh"
Jul 30 20:53:15.359935 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:53:15.359901    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-92bd23a0-kserve-89dd67c9f-m4krh"
Jul 30 20:53:15.371926 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:53:15.371901    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-92bd23a0-kserve-89dd67c9f-m4krh"
Jul 30 20:53:15.905792 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:53:15.905763    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-92bd23a0-kserve-89dd67c9f-m4krh"
Jul 30 20:53:35.856081 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:53:35.856047    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:53:43.370745 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:53:43.370708    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-92bd23a0-kserve-7c4495b75f-x2cbq"]
Jul 30 20:53:43.394935 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:53:43.394910    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:53:44.967000 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:53:44.966959    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-92bd23a0-kserve-89dd67c9f-m4krh"]
Jul 30 20:53:44.988258 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:53:44.988230    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:53:45.162935 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:53:45.162905    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 20:53:51.961854 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:53:51.961821    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 20:53:58.390344 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:53:58.390290    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-a-92bd23a0-kserve-7c4495b75f-x2cbq" podUID="7233ba7c-7615-4b98-8214-c49591b876bb" containerName="main" containerID="cri-o://ba27235ed2a9b8808f6813e2a82821dd85e728fb3d6511944bf0006fc98113db" gracePeriod=45
Jul 30 20:53:58.635042 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:53:58.635021    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-92bd23a0-kserve-7c4495b75f-x2cbq"
Jul 30 20:53:58.781546 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:53:58.781475    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2d9k5\" (UniqueName: \"kubernetes.io/projected/7233ba7c-7615-4b98-8214-c49591b876bb-kube-api-access-2d9k5\") pod \"7233ba7c-7615-4b98-8214-c49591b876bb\" (UID: \"7233ba7c-7615-4b98-8214-c49591b876bb\") "
Jul 30 20:53:58.781546 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:53:58.781536    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7233ba7c-7615-4b98-8214-c49591b876bb-model-cache\") pod \"7233ba7c-7615-4b98-8214-c49591b876bb\" (UID: \"7233ba7c-7615-4b98-8214-c49591b876bb\") "
Jul 30 20:53:58.781762 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:53:58.781565    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7233ba7c-7615-4b98-8214-c49591b876bb-home\") pod \"7233ba7c-7615-4b98-8214-c49591b876bb\" (UID: \"7233ba7c-7615-4b98-8214-c49591b876bb\") "
Jul 30 20:53:58.781762 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:53:58.781610    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7233ba7c-7615-4b98-8214-c49591b876bb-tls-certs\") pod \"7233ba7c-7615-4b98-8214-c49591b876bb\" (UID: \"7233ba7c-7615-4b98-8214-c49591b876bb\") "
Jul 30 20:53:58.781762 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:53:58.781632    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7233ba7c-7615-4b98-8214-c49591b876bb-dshm\") pod \"7233ba7c-7615-4b98-8214-c49591b876bb\" (UID: \"7233ba7c-7615-4b98-8214-c49591b876bb\") "
Jul 30 20:53:58.781762 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:53:58.781656    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7233ba7c-7615-4b98-8214-c49591b876bb-tmp-dir\") pod \"7233ba7c-7615-4b98-8214-c49591b876bb\" (UID: \"7233ba7c-7615-4b98-8214-c49591b876bb\") "
Jul 30 20:53:58.781959 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:53:58.781833    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7233ba7c-7615-4b98-8214-c49591b876bb-model-cache" (OuterVolumeSpecName: "model-cache") pod "7233ba7c-7615-4b98-8214-c49591b876bb" (UID: "7233ba7c-7615-4b98-8214-c49591b876bb"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:53:58.781959 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:53:58.781848    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7233ba7c-7615-4b98-8214-c49591b876bb-home" (OuterVolumeSpecName: "home") pod "7233ba7c-7615-4b98-8214-c49591b876bb" (UID: "7233ba7c-7615-4b98-8214-c49591b876bb"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:53:58.782065 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:53:58.781988    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7233ba7c-7615-4b98-8214-c49591b876bb-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "7233ba7c-7615-4b98-8214-c49591b876bb" (UID: "7233ba7c-7615-4b98-8214-c49591b876bb"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:53:58.782065 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:53:58.782025    2583 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7233ba7c-7615-4b98-8214-c49591b876bb-model-cache\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 20:53:58.782065 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:53:58.782040    2583 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7233ba7c-7615-4b98-8214-c49591b876bb-home\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 20:53:58.783886 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:53:58.783862    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7233ba7c-7615-4b98-8214-c49591b876bb-dshm" (OuterVolumeSpecName: "dshm") pod "7233ba7c-7615-4b98-8214-c49591b876bb" (UID: "7233ba7c-7615-4b98-8214-c49591b876bb"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:53:58.783983 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:53:58.783896    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7233ba7c-7615-4b98-8214-c49591b876bb-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "7233ba7c-7615-4b98-8214-c49591b876bb" (UID: "7233ba7c-7615-4b98-8214-c49591b876bb"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 20:53:58.783983 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:53:58.783921    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7233ba7c-7615-4b98-8214-c49591b876bb-kube-api-access-2d9k5" (OuterVolumeSpecName: "kube-api-access-2d9k5") pod "7233ba7c-7615-4b98-8214-c49591b876bb" (UID: "7233ba7c-7615-4b98-8214-c49591b876bb"). InnerVolumeSpecName "kube-api-access-2d9k5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:53:58.882817 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:53:58.882793    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2d9k5\" (UniqueName: \"kubernetes.io/projected/7233ba7c-7615-4b98-8214-c49591b876bb-kube-api-access-2d9k5\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 20:53:58.882817 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:53:58.882814    2583 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7233ba7c-7615-4b98-8214-c49591b876bb-tls-certs\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 20:53:58.882941 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:53:58.882825    2583 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7233ba7c-7615-4b98-8214-c49591b876bb-dshm\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 20:53:58.882941 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:53:58.882832    2583 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7233ba7c-7615-4b98-8214-c49591b876bb-tmp-dir\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 20:53:59.131890 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:53:59.131811    2583 generic.go:356] "Generic (PLEG): container finished" podID="7233ba7c-7615-4b98-8214-c49591b876bb" containerID="ba27235ed2a9b8808f6813e2a82821dd85e728fb3d6511944bf0006fc98113db" exitCode=0
Jul 30 20:53:59.131890 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:53:59.131857    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-92bd23a0-kserve-7c4495b75f-x2cbq"
Jul 30 20:53:59.132092 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:53:59.131897    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-92bd23a0-kserve-7c4495b75f-x2cbq" event={"ID":"7233ba7c-7615-4b98-8214-c49591b876bb","Type":"ContainerDied","Data":"ba27235ed2a9b8808f6813e2a82821dd85e728fb3d6511944bf0006fc98113db"}
Jul 30 20:53:59.132092 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:53:59.131935    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-92bd23a0-kserve-7c4495b75f-x2cbq" event={"ID":"7233ba7c-7615-4b98-8214-c49591b876bb","Type":"ContainerDied","Data":"17734e30a9d565508d7cfb85d6e095cd81394fa6b9b194663bc46cb8fe7c86b9"}
Jul 30 20:53:59.132092 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:53:59.131955    2583 scope.go:117] "RemoveContainer" containerID="ba27235ed2a9b8808f6813e2a82821dd85e728fb3d6511944bf0006fc98113db"
Jul 30 20:53:59.141590 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:53:59.141574    2583 scope.go:117] "RemoveContainer" containerID="ba27235ed2a9b8808f6813e2a82821dd85e728fb3d6511944bf0006fc98113db"
Jul 30 20:53:59.141829 ip-10-0-142-69 kubenswrapper[2583]: E0730 20:53:59.141812    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ba27235ed2a9b8808f6813e2a82821dd85e728fb3d6511944bf0006fc98113db\": container with ID starting with ba27235ed2a9b8808f6813e2a82821dd85e728fb3d6511944bf0006fc98113db not found: ID does not exist" containerID="ba27235ed2a9b8808f6813e2a82821dd85e728fb3d6511944bf0006fc98113db"
Jul 30 20:53:59.141885 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:53:59.141837    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba27235ed2a9b8808f6813e2a82821dd85e728fb3d6511944bf0006fc98113db"} err="failed to get container status \"ba27235ed2a9b8808f6813e2a82821dd85e728fb3d6511944bf0006fc98113db\": rpc error: code = NotFound desc = could not find container \"ba27235ed2a9b8808f6813e2a82821dd85e728fb3d6511944bf0006fc98113db\": container with ID starting with ba27235ed2a9b8808f6813e2a82821dd85e728fb3d6511944bf0006fc98113db not found: ID does not exist"
Jul 30 20:53:59.152891 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:53:59.152873    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-92bd23a0-kserve-7c4495b75f-x2cbq"]
Jul 30 20:53:59.157577 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:53:59.157558    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-92bd23a0-kserve-7c4495b75f-x2cbq"]
Jul 30 20:53:59.985642 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:53:59.985606    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-92bd23a0-kserve-89dd67c9f-m4krh" podUID="2b580190-dee6-4910-8b18-7ef0c38ca02b" containerName="main" containerID="cri-o://cec3ee0ea134c0e8628435579abd27d48b0a71063b608b9e524507893f1d86d4" gracePeriod=45
Jul 30 20:54:00.138514 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:54:00.138478    2583 generic.go:356] "Generic (PLEG): container finished" podID="2b580190-dee6-4910-8b18-7ef0c38ca02b" containerID="cec3ee0ea134c0e8628435579abd27d48b0a71063b608b9e524507893f1d86d4" exitCode=0
Jul 30 20:54:00.138664 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:54:00.138546    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-92bd23a0-kserve-89dd67c9f-m4krh" event={"ID":"2b580190-dee6-4910-8b18-7ef0c38ca02b","Type":"ContainerDied","Data":"cec3ee0ea134c0e8628435579abd27d48b0a71063b608b9e524507893f1d86d4"}
Jul 30 20:54:00.230422 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:54:00.230395    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-92bd23a0-kserve-89dd67c9f-m4krh"
Jul 30 20:54:00.262816 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:54:00.262755    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 20:54:00.293913 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:54:00.293886    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b580190-dee6-4910-8b18-7ef0c38ca02b-tmp-dir\") pod \"2b580190-dee6-4910-8b18-7ef0c38ca02b\" (UID: \"2b580190-dee6-4910-8b18-7ef0c38ca02b\") "
Jul 30 20:54:00.294039 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:54:00.293919    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b580190-dee6-4910-8b18-7ef0c38ca02b-tls-certs\") pod \"2b580190-dee6-4910-8b18-7ef0c38ca02b\" (UID: \"2b580190-dee6-4910-8b18-7ef0c38ca02b\") "
Jul 30 20:54:00.294039 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:54:00.293971    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9j8sq\" (UniqueName: \"kubernetes.io/projected/2b580190-dee6-4910-8b18-7ef0c38ca02b-kube-api-access-9j8sq\") pod \"2b580190-dee6-4910-8b18-7ef0c38ca02b\" (UID: \"2b580190-dee6-4910-8b18-7ef0c38ca02b\") "
Jul 30 20:54:00.294171 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:54:00.294109    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b580190-dee6-4910-8b18-7ef0c38ca02b-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "2b580190-dee6-4910-8b18-7ef0c38ca02b" (UID: "2b580190-dee6-4910-8b18-7ef0c38ca02b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:54:00.294259 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:54:00.294238    2583 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b580190-dee6-4910-8b18-7ef0c38ca02b-tmp-dir\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 20:54:00.296175 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:54:00.296129    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b580190-dee6-4910-8b18-7ef0c38ca02b-kube-api-access-9j8sq" (OuterVolumeSpecName: "kube-api-access-9j8sq") pod "2b580190-dee6-4910-8b18-7ef0c38ca02b" (UID: "2b580190-dee6-4910-8b18-7ef0c38ca02b"). InnerVolumeSpecName "kube-api-access-9j8sq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:54:00.296175 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:54:00.296129    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b580190-dee6-4910-8b18-7ef0c38ca02b-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "2b580190-dee6-4910-8b18-7ef0c38ca02b" (UID: "2b580190-dee6-4910-8b18-7ef0c38ca02b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 20:54:00.394953 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:54:00.394920    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2b580190-dee6-4910-8b18-7ef0c38ca02b-model-cache\") pod \"2b580190-dee6-4910-8b18-7ef0c38ca02b\" (UID: \"2b580190-dee6-4910-8b18-7ef0c38ca02b\") "
Jul 30 20:54:00.395043 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:54:00.395020    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2b580190-dee6-4910-8b18-7ef0c38ca02b-home\") pod \"2b580190-dee6-4910-8b18-7ef0c38ca02b\" (UID: \"2b580190-dee6-4910-8b18-7ef0c38ca02b\") "
Jul 30 20:54:00.395088 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:54:00.395049    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2b580190-dee6-4910-8b18-7ef0c38ca02b-dshm\") pod \"2b580190-dee6-4910-8b18-7ef0c38ca02b\" (UID: \"2b580190-dee6-4910-8b18-7ef0c38ca02b\") "
Jul 30 20:54:00.395088 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:54:00.395067    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b580190-dee6-4910-8b18-7ef0c38ca02b-model-cache" (OuterVolumeSpecName: "model-cache") pod "2b580190-dee6-4910-8b18-7ef0c38ca02b" (UID: "2b580190-dee6-4910-8b18-7ef0c38ca02b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:54:00.395258 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:54:00.395241    2583 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2b580190-dee6-4910-8b18-7ef0c38ca02b-model-cache\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 20:54:00.395298 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:54:00.395265    2583 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b580190-dee6-4910-8b18-7ef0c38ca02b-tls-certs\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 20:54:00.395298 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:54:00.395279    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9j8sq\" (UniqueName: \"kubernetes.io/projected/2b580190-dee6-4910-8b18-7ef0c38ca02b-kube-api-access-9j8sq\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 20:54:00.395362 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:54:00.395298    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b580190-dee6-4910-8b18-7ef0c38ca02b-home" (OuterVolumeSpecName: "home") pod "2b580190-dee6-4910-8b18-7ef0c38ca02b" (UID: "2b580190-dee6-4910-8b18-7ef0c38ca02b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:54:00.396868 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:54:00.396851    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b580190-dee6-4910-8b18-7ef0c38ca02b-dshm" (OuterVolumeSpecName: "dshm") pod "2b580190-dee6-4910-8b18-7ef0c38ca02b" (UID: "2b580190-dee6-4910-8b18-7ef0c38ca02b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:54:00.496277 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:54:00.496249    2583 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2b580190-dee6-4910-8b18-7ef0c38ca02b-home\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 20:54:00.496277 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:54:00.496277    2583 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2b580190-dee6-4910-8b18-7ef0c38ca02b-dshm\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 20:54:00.681094 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:54:00.681052    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7233ba7c-7615-4b98-8214-c49591b876bb" path="/var/lib/kubelet/pods/7233ba7c-7615-4b98-8214-c49591b876bb/volumes"
Jul 30 20:54:01.146543 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:54:01.146515    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-92bd23a0-kserve-89dd67c9f-m4krh"
Jul 30 20:54:01.146925 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:54:01.146505    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-92bd23a0-kserve-89dd67c9f-m4krh" event={"ID":"2b580190-dee6-4910-8b18-7ef0c38ca02b","Type":"ContainerDied","Data":"1def4ed1af535532855fd42ec6ca2744a2c2bc9728d57d550c3f808bee12b327"}
Jul 30 20:54:01.146925 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:54:01.146639    2583 scope.go:117] "RemoveContainer" containerID="cec3ee0ea134c0e8628435579abd27d48b0a71063b608b9e524507893f1d86d4"
Jul 30 20:54:01.163884 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:54:01.163859    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-92bd23a0-kserve-89dd67c9f-m4krh"]
Jul 30 20:54:01.168379 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:54:01.168356    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-92bd23a0-kserve-89dd67c9f-m4krh"]
Jul 30 20:54:02.675880 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:54:02.675846    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b580190-dee6-4910-8b18-7ef0c38ca02b" path="/var/lib/kubelet/pods/2b580190-dee6-4910-8b18-7ef0c38ca02b/volumes"
Jul 30 20:54:06.858552 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:54:06.858507    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 20:54:17.065189 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:54:17.065157    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 20:54:22.659234 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:54:22.659200    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 20:54:29.155179 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:54:29.155147    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 20:54:35.354952 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:54:35.354911    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 20:54:39.955981 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:54:39.955894    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 20:54:49.652230 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:54:49.652197    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 20:54:56.059060 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:54:56.059013    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 20:55:12.255479 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:55:12.255426    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 20:55:19.259936 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:55:19.259894    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 20:55:30.859115 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:55:30.859068    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 20:55:38.463407 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:55:38.463349    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 20:55:45.355492 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:55:45.355444    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 20:55:50.352076 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:55:50.352041    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 20:55:57.068950 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:55:57.068917    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 20:56:05.965998 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:56:05.965959    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 20:56:12.765022 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:56:12.764944    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 20:56:23.060107 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:56:23.060070    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 20:56:29.661097 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:56:29.661059    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 20:56:40.358221 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:56:40.358181    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 20:56:55.551374 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:56:55.551338    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 20:57:02.158371 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:57:02.158338    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 20:57:05.144458 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:57:05.144430    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:57:12.461208 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:57:12.461168    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 20:57:19.664697 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:57:19.664663    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 20:57:27.664707 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:57:27.664665    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 20:57:31.070389 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:57:31.070355    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:57:32.970309 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:57:32.970275    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 20:57:34.207067 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:57:34.207030    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:57:34.304105 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:57:34.304069    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:57:34.670881 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:57:34.670830    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:57:40.558055 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:57:40.557970    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:57:40.659134 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:57:40.659104    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:57:40.803628 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:57:40.803601    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:57:41.123463 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:57:41.123433    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:57:41.270812 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:57:41.270786    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:57:43.247604 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:57:43.247565    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:57:43.342204 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:57:43.342173    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:57:44.479253 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:57:44.479221    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:57:44.743701 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:57:44.743614    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:57:44.994086 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:57:44.994005    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:57:45.087613 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:57:45.087578    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:57:47.852033 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:57:47.852004    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 20:58:08.858785 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:58:08.858752    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-83e97498-5knls"]
Jul 30 20:58:08.859283 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:58:08.859115    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b580190-dee6-4910-8b18-7ef0c38ca02b" containerName="main"
Jul 30 20:58:08.859283 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:58:08.859126    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b580190-dee6-4910-8b18-7ef0c38ca02b" containerName="main"
Jul 30 20:58:08.859283 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:58:08.859158    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7233ba7c-7615-4b98-8214-c49591b876bb" containerName="main"
Jul 30 20:58:08.859283 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:58:08.859165    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="7233ba7c-7615-4b98-8214-c49591b876bb" containerName="main"
Jul 30 20:58:08.859283 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:58:08.859233    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="7233ba7c-7615-4b98-8214-c49591b876bb" containerName="main"
Jul 30 20:58:08.859283 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:58:08.859240    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b580190-dee6-4910-8b18-7ef0c38ca02b" containerName="main"
Jul 30 20:58:08.862289 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:58:08.862266    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-83e97498-5knls"
Jul 30 20:58:08.864913 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:58:08.864894    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 30 20:58:08.865059 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:58:08.865035    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zm2hs\""
Jul 30 20:58:08.871883 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:58:08.871860    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-83e97498-5knls"]
Jul 30 20:58:08.972643 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:58:08.972612    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c819c64-acbf-426e-81ba-aa2e8299f5c2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-83e97498-5knls\" (UID: \"3c819c64-acbf-426e-81ba-aa2e8299f5c2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-83e97498-5knls"
Jul 30 20:58:09.073298 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:58:09.073259    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c819c64-acbf-426e-81ba-aa2e8299f5c2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-83e97498-5knls\" (UID: \"3c819c64-acbf-426e-81ba-aa2e8299f5c2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-83e97498-5knls"
Jul 30 20:58:09.073879 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:58:09.073860    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c819c64-acbf-426e-81ba-aa2e8299f5c2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-83e97498-5knls\" (UID: \"3c819c64-acbf-426e-81ba-aa2e8299f5c2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-83e97498-5knls"
Jul 30 20:58:09.172927 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:58:09.172895    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-83e97498-5knls"
Jul 30 20:58:09.306417 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:58:09.306394    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-83e97498-5knls"]
Jul 30 20:58:09.308207 ip-10-0-142-69 kubenswrapper[2583]: W0730 20:58:09.308182    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c819c64_acbf_426e_81ba_aa2e8299f5c2.slice/crio-714ef5964b7c859f716d2309da5756451b75dce42f275bf347ed1ff7120b46f0 WatchSource:0}: Error finding container 714ef5964b7c859f716d2309da5756451b75dce42f275bf347ed1ff7120b46f0: Status 404 returned error can't find the container with id 714ef5964b7c859f716d2309da5756451b75dce42f275bf347ed1ff7120b46f0
Jul 30 20:58:09.310168 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:58:09.310129    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 30 20:58:09.444049 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:58:09.443961    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-83e97498-5knls" event={"ID":"3c819c64-acbf-426e-81ba-aa2e8299f5c2","Type":"ContainerStarted","Data":"714ef5964b7c859f716d2309da5756451b75dce42f275bf347ed1ff7120b46f0"}
Jul 30 20:58:12.462923 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:58:12.462817    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-83e97498-5knls" event={"ID":"3c819c64-acbf-426e-81ba-aa2e8299f5c2","Type":"ContainerStarted","Data":"a2bf38161e3368c906450e7b045d4bbfa94b83dec3e29a20fec2e5201760a28b"}
Jul 30 20:58:12.480872 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:58:12.480820    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-83e97498-5knls" podStartSLOduration=1.874719128 podStartE2EDuration="4.48080289s" totalImagesPullingTime="2.606083762s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:58:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:58:12.477874163 +0000 UTC m=+2004.319349783" watchObservedRunningTime="2026-07-30 20:58:12.48080289 +0000 UTC m=+2004.322278513"
Jul 30 20:58:13.469490 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:58:13.469448    2583 generic.go:356] "Generic (PLEG): container finished" podID="3c819c64-acbf-426e-81ba-aa2e8299f5c2" containerID="a2bf38161e3368c906450e7b045d4bbfa94b83dec3e29a20fec2e5201760a28b" exitCode=0
Jul 30 20:58:13.469892 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:58:13.469530    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-83e97498-5knls" event={"ID":"3c819c64-acbf-426e-81ba-aa2e8299f5c2","Type":"ContainerDied","Data":"a2bf38161e3368c906450e7b045d4bbfa94b83dec3e29a20fec2e5201760a28b"}
Jul 30 20:58:14.602933 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:58:14.602906    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-83e97498-5knls"
Jul 30 20:58:14.721416 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:58:14.721378    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c819c64-acbf-426e-81ba-aa2e8299f5c2-maas-api-service-ca\") pod \"3c819c64-acbf-426e-81ba-aa2e8299f5c2\" (UID: \"3c819c64-acbf-426e-81ba-aa2e8299f5c2\") "
Jul 30 20:58:14.721746 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:58:14.721721    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3c819c64-acbf-426e-81ba-aa2e8299f5c2-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "3c819c64-acbf-426e-81ba-aa2e8299f5c2" (UID: "3c819c64-acbf-426e-81ba-aa2e8299f5c2"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 20:58:14.721847 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:58:14.721804    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c819c64-acbf-426e-81ba-aa2e8299f5c2-maas-api-service-ca\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 20:58:15.487461 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:58:15.487421    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-83e97498-5knls"
Jul 30 20:58:15.487629 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:58:15.487468    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-83e97498-5knls" event={"ID":"3c819c64-acbf-426e-81ba-aa2e8299f5c2","Type":"ContainerDied","Data":"714ef5964b7c859f716d2309da5756451b75dce42f275bf347ed1ff7120b46f0"}
Jul 30 20:58:15.487629 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:58:15.487542    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="714ef5964b7c859f716d2309da5756451b75dce42f275bf347ed1ff7120b46f0"
Jul 30 20:58:24.902832 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:58:24.902796    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:58:25.088026 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:58:25.087989    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-83e97498-5knls"]
Jul 30 20:58:25.090084 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:58:25.090060    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-83e97498-5knls"]
Jul 30 20:58:26.338871 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:58:26.338836    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:58:26.503212 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:58:26.503176    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:58:26.675706 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:58:26.675677    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3c819c64-acbf-426e-81ba-aa2e8299f5c2" path="/var/lib/kubelet/pods/3c819c64-acbf-426e-81ba-aa2e8299f5c2/volumes"
Jul 30 20:58:27.067218 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:58:27.067118    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:58:28.054039 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:58:28.054001    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 20:58:28.727685 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:58:28.727656    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:58:28.821749 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:58:28.821715    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:58:28.981295 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:58:28.981215    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:58:29.274554 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:58:29.274477    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:58:29.369151 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:58:29.369117    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:58:34.272525 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:58:34.272491    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 20:58:38.173265 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:58:38.173220    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:58:51.337453 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:58:51.337364    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:59:00.242115 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:59:00.242075    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:59:00.335349 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:59:00.335311    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:59:00.402901 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:59:00.402864    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:59:00.503571 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:59:00.503476    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:59:00.627085 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:59:00.627047    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:59:00.842096 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:59:00.842016    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:59:01.077970 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:59:01.077937    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:59:01.411527 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:59:01.411502    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:59:01.556542 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:59:01.556513    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:59:03.165065 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:59:03.165032    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 20:59:03.638321 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:59:03.638233    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:59:03.723611 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:59:03.723586    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:59:04.751685 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:59:04.751657    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:59:04.852160 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:59:04.852104    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:59:05.420045 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:59:05.420012    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:59:05.519758 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:59:05.519724    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:59:08.860523 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:59:08.860493    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 20:59:35.442157 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:59:35.442056    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:59:35.524633 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:59:35.524605    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:59:35.608353 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:59:35.608304    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:59:35.678081 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:59:35.678042    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:59:36.403538 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:59:36.403511    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:59:36.847606 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:59:36.847522    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:59:37.062656 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:59:37.062624    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:59:37.300263 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:59:37.300232    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:59:37.670526 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:59:37.670496    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:59:37.880072 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:59:37.880036    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:59:38.362195 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:59:38.362159    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 20:59:39.832385 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:59:39.832350    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:59:39.930019 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:59:39.929982    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:59:40.964011 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:59:40.963970    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:59:41.177041 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:59:41.177001    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:59:41.481865 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:59:41.481824    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:59:41.585574 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:59:41.585535    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 20:59:44.455962 ip-10-0-142-69 kubenswrapper[2583]: I0730 20:59:44.455924    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 21:00:11.502921 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:00:11.502885    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:00:11.666556 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:00:11.666523    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:00:11.993754 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:00:11.993723    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:00:12.066792 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:00:12.066750    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:00:12.199914 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:00:12.199878    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:00:12.671542 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:00:12.671506    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:00:12.771082 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:00:12.771045    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:00:12.873183 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:00:12.873132    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:00:13.565792 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:00:13.565756    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 21:00:20.058103 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:00:20.058063    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 21:00:24.594126 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:00:24.594093    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:00:26.657348 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:00:26.657316    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 21:00:28.012669 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:00:28.012635    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:00:28.114125 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:00:28.114096    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:00:31.455076 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:00:31.455039    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:00:32.322631 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:00:32.322596    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:00:32.420376 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:00:32.420339    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:00:54.435735 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:00:54.435701    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:00:54.534074 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:00:54.534039    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:00:58.239306 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:00:58.239273    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:01:04.422761 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:01:04.422727    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:01:04.536066 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:01:04.536036    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:01:04.627524 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:01:04.627488    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:01:20.563618 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:01:20.563581    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:01:26.566895 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:01:26.566860    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:01:26.695632 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:01:26.695598    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:01:26.835580 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:01:26.835497    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:01:37.380624 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:01:37.380583    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:01:48.464629 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:01:48.464592    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:01:54.561498 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:01:54.561459    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:01:54.667522 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:01:54.667493    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:01:54.761255 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:01:54.761228    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:01:54.861423 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:01:54.861343    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:01:55.520712 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:01:55.520681    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:01:55.617960 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:01:55.617932    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:01:55.721788 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:01:55.721754    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:01:56.651696 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:01:56.651663    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 21:01:57.262427 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:01:57.262389    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:02:03.156535 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:02:03.156500    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:02:03.215042 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:02:03.215010    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:02:03.846864 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:02:03.846835    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:02:05.945361 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:02:05.945325    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 21:02:10.337721 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:02:10.337632    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:02:11.127455 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:02:11.127415    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:02:11.228636 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:02:11.228603    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:02:11.588707 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:02:11.588676    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:02:14.203891 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:02:14.203856    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:02:14.297157 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:02:14.297102    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:02:15.330213 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:02:15.330176    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:02:15.477783 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:02:15.477752    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:02:15.848425 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:02:15.848390    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:02:15.942337 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:02:15.942296    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:02:18.750291 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:02:18.750261    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 21:02:39.112983 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:02:39.112949    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:02:39.809320 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:02:39.809284    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:02:39.897133 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:02:39.897096    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:02:40.242161 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:02:40.242106    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:02:45.752999 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:02:45.752962    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:02:45.853800 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:02:45.853771    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:02:56.681906 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:02:56.681876    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:02:56.785393 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:02:56.785364    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:02:56.842566 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:02:56.842536    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:02:58.618390 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:02:58.618337    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:02:58.750019 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:02:58.749991    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 21:03:02.981281 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:03:02.981249    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:03:03.081733 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:03:03.081706    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:03:03.258335 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:03:03.258245    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:03:03.478750 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:03:03.478715    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:03:03.611160 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:03:03.611057    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:03:03.710540 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:03:03.710514    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:03:03.837921 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:03:03.837887    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:03:09.613706 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:03:09.613666    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:03:09.719287 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:03:09.719254    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:03:09.813703 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:03:09.813670    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:03:09.969629 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:03:09.969595    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:03:15.701884 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:03:15.701845    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:03:15.764174 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:03:15.764129    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:03:34.943344 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:03:34.943309    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 21:04:46.656371 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:04:46.656332    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:04:48.894448 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:04:48.894415    2583 scope.go:117] "RemoveContainer" containerID="a2bf38161e3368c906450e7b045d4bbfa94b83dec3e29a20fec2e5201760a28b"
Jul 30 21:05:18.814790 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:05:18.814752    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:05:19.113679 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:05:19.113588    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:05:19.360940 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:05:19.360887    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:05:21.646622 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:05:21.646582    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 21:05:21.956637 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:05:21.956598    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:05:22.186633 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:05:22.186576    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:05:23.081939 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:05:23.081902    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:05:23.404338 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:05:23.404304    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:05:23.717813 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:05:23.717723    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:05:23.848538 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:05:23.848506    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:05:29.448958 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:05:29.448919    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 21:05:46.993160 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:05:46.993111    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:05:52.443109 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:05:52.443072    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-9e2107d7/e2e-lifecycle-model-9e2107d7-kserve-cf58fb8ff-hwhtj"]
Jul 30 21:05:52.443607 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:05:52.443517    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c819c64-acbf-426e-81ba-aa2e8299f5c2" containerName="revoke-keys"
Jul 30 21:05:52.443607 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:05:52.443530    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c819c64-acbf-426e-81ba-aa2e8299f5c2" containerName="revoke-keys"
Jul 30 21:05:52.443607 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:05:52.443589    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c819c64-acbf-426e-81ba-aa2e8299f5c2" containerName="revoke-keys"
Jul 30 21:05:52.446687 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:05:52.446672    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-9e2107d7/e2e-lifecycle-model-9e2107d7-kserve-cf58fb8ff-hwhtj"
Jul 30 21:05:52.449245 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:05:52.449212    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-9e2107d7\"/\"e2e-lifecycle-model-9e2107d7-kserve-self-signed-certs\""
Jul 30 21:05:52.449245 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:05:52.449225    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-9e2107d7\"/\"kube-root-ca.crt\""
Jul 30 21:05:52.449438 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:05:52.449265    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-9e2107d7\"/\"default-dockercfg-fc6mb\""
Jul 30 21:05:52.449438 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:05:52.449273    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-9e2107d7\"/\"openshift-service-ca.crt\""
Jul 30 21:05:52.454240 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:05:52.454215    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-9e2107d7/e2e-lifecycle-model-9e2107d7-kserve-cf58fb8ff-hwhtj"]
Jul 30 21:05:52.543735 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:05:52.543695    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:05:52.569738 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:05:52.569698    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ec03a94f-1305-4c34-9aa6-8e4eda7a4b31-tmp-dir\") pod \"e2e-lifecycle-model-9e2107d7-kserve-cf58fb8ff-hwhtj\" (UID: \"ec03a94f-1305-4c34-9aa6-8e4eda7a4b31\") " pod="ai-tenant-e2e-mt-9e2107d7/e2e-lifecycle-model-9e2107d7-kserve-cf58fb8ff-hwhtj"
Jul 30 21:05:52.569738 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:05:52.569742    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ec03a94f-1305-4c34-9aa6-8e4eda7a4b31-model-cache\") pod \"e2e-lifecycle-model-9e2107d7-kserve-cf58fb8ff-hwhtj\" (UID: \"ec03a94f-1305-4c34-9aa6-8e4eda7a4b31\") " pod="ai-tenant-e2e-mt-9e2107d7/e2e-lifecycle-model-9e2107d7-kserve-cf58fb8ff-hwhtj"
Jul 30 21:05:52.569954 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:05:52.569761    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4ll7\" (UniqueName: \"kubernetes.io/projected/ec03a94f-1305-4c34-9aa6-8e4eda7a4b31-kube-api-access-c4ll7\") pod \"e2e-lifecycle-model-9e2107d7-kserve-cf58fb8ff-hwhtj\" (UID: \"ec03a94f-1305-4c34-9aa6-8e4eda7a4b31\") " pod="ai-tenant-e2e-mt-9e2107d7/e2e-lifecycle-model-9e2107d7-kserve-cf58fb8ff-hwhtj"
Jul 30 21:05:52.569954 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:05:52.569807    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ec03a94f-1305-4c34-9aa6-8e4eda7a4b31-home\") pod \"e2e-lifecycle-model-9e2107d7-kserve-cf58fb8ff-hwhtj\" (UID: \"ec03a94f-1305-4c34-9aa6-8e4eda7a4b31\") " pod="ai-tenant-e2e-mt-9e2107d7/e2e-lifecycle-model-9e2107d7-kserve-cf58fb8ff-hwhtj"
Jul 30 21:05:52.569954 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:05:52.569830    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ec03a94f-1305-4c34-9aa6-8e4eda7a4b31-tls-certs\") pod \"e2e-lifecycle-model-9e2107d7-kserve-cf58fb8ff-hwhtj\" (UID: \"ec03a94f-1305-4c34-9aa6-8e4eda7a4b31\") " pod="ai-tenant-e2e-mt-9e2107d7/e2e-lifecycle-model-9e2107d7-kserve-cf58fb8ff-hwhtj"
Jul 30 21:05:52.569954 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:05:52.569873    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ec03a94f-1305-4c34-9aa6-8e4eda7a4b31-dshm\") pod \"e2e-lifecycle-model-9e2107d7-kserve-cf58fb8ff-hwhtj\" (UID: \"ec03a94f-1305-4c34-9aa6-8e4eda7a4b31\") " pod="ai-tenant-e2e-mt-9e2107d7/e2e-lifecycle-model-9e2107d7-kserve-cf58fb8ff-hwhtj"
Jul 30 21:05:52.671250 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:05:52.671206    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ec03a94f-1305-4c34-9aa6-8e4eda7a4b31-model-cache\") pod \"e2e-lifecycle-model-9e2107d7-kserve-cf58fb8ff-hwhtj\" (UID: \"ec03a94f-1305-4c34-9aa6-8e4eda7a4b31\") " pod="ai-tenant-e2e-mt-9e2107d7/e2e-lifecycle-model-9e2107d7-kserve-cf58fb8ff-hwhtj"
Jul 30 21:05:52.671449 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:05:52.671257    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4ll7\" (UniqueName: \"kubernetes.io/projected/ec03a94f-1305-4c34-9aa6-8e4eda7a4b31-kube-api-access-c4ll7\") pod \"e2e-lifecycle-model-9e2107d7-kserve-cf58fb8ff-hwhtj\" (UID: \"ec03a94f-1305-4c34-9aa6-8e4eda7a4b31\") " pod="ai-tenant-e2e-mt-9e2107d7/e2e-lifecycle-model-9e2107d7-kserve-cf58fb8ff-hwhtj"
Jul 30 21:05:52.671449 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:05:52.671307    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ec03a94f-1305-4c34-9aa6-8e4eda7a4b31-home\") pod \"e2e-lifecycle-model-9e2107d7-kserve-cf58fb8ff-hwhtj\" (UID: \"ec03a94f-1305-4c34-9aa6-8e4eda7a4b31\") " pod="ai-tenant-e2e-mt-9e2107d7/e2e-lifecycle-model-9e2107d7-kserve-cf58fb8ff-hwhtj"
Jul 30 21:05:52.671449 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:05:52.671348    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ec03a94f-1305-4c34-9aa6-8e4eda7a4b31-tls-certs\") pod \"e2e-lifecycle-model-9e2107d7-kserve-cf58fb8ff-hwhtj\" (UID: \"ec03a94f-1305-4c34-9aa6-8e4eda7a4b31\") " pod="ai-tenant-e2e-mt-9e2107d7/e2e-lifecycle-model-9e2107d7-kserve-cf58fb8ff-hwhtj"
Jul 30 21:05:52.671449 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:05:52.671435    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ec03a94f-1305-4c34-9aa6-8e4eda7a4b31-dshm\") pod \"e2e-lifecycle-model-9e2107d7-kserve-cf58fb8ff-hwhtj\" (UID: \"ec03a94f-1305-4c34-9aa6-8e4eda7a4b31\") " pod="ai-tenant-e2e-mt-9e2107d7/e2e-lifecycle-model-9e2107d7-kserve-cf58fb8ff-hwhtj"
Jul 30 21:05:52.671698 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:05:52.671488    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ec03a94f-1305-4c34-9aa6-8e4eda7a4b31-tmp-dir\") pod \"e2e-lifecycle-model-9e2107d7-kserve-cf58fb8ff-hwhtj\" (UID: \"ec03a94f-1305-4c34-9aa6-8e4eda7a4b31\") " pod="ai-tenant-e2e-mt-9e2107d7/e2e-lifecycle-model-9e2107d7-kserve-cf58fb8ff-hwhtj"
Jul 30 21:05:52.671698 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:05:52.671658    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ec03a94f-1305-4c34-9aa6-8e4eda7a4b31-model-cache\") pod \"e2e-lifecycle-model-9e2107d7-kserve-cf58fb8ff-hwhtj\" (UID: \"ec03a94f-1305-4c34-9aa6-8e4eda7a4b31\") " pod="ai-tenant-e2e-mt-9e2107d7/e2e-lifecycle-model-9e2107d7-kserve-cf58fb8ff-hwhtj"
Jul 30 21:05:52.671783 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:05:52.671698    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ec03a94f-1305-4c34-9aa6-8e4eda7a4b31-home\") pod \"e2e-lifecycle-model-9e2107d7-kserve-cf58fb8ff-hwhtj\" (UID: \"ec03a94f-1305-4c34-9aa6-8e4eda7a4b31\") " pod="ai-tenant-e2e-mt-9e2107d7/e2e-lifecycle-model-9e2107d7-kserve-cf58fb8ff-hwhtj"
Jul 30 21:05:52.671852 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:05:52.671833    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ec03a94f-1305-4c34-9aa6-8e4eda7a4b31-tmp-dir\") pod \"e2e-lifecycle-model-9e2107d7-kserve-cf58fb8ff-hwhtj\" (UID: \"ec03a94f-1305-4c34-9aa6-8e4eda7a4b31\") " pod="ai-tenant-e2e-mt-9e2107d7/e2e-lifecycle-model-9e2107d7-kserve-cf58fb8ff-hwhtj"
Jul 30 21:05:52.673819 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:05:52.673795    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ec03a94f-1305-4c34-9aa6-8e4eda7a4b31-dshm\") pod \"e2e-lifecycle-model-9e2107d7-kserve-cf58fb8ff-hwhtj\" (UID: \"ec03a94f-1305-4c34-9aa6-8e4eda7a4b31\") " pod="ai-tenant-e2e-mt-9e2107d7/e2e-lifecycle-model-9e2107d7-kserve-cf58fb8ff-hwhtj"
Jul 30 21:05:52.674259 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:05:52.674243    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ec03a94f-1305-4c34-9aa6-8e4eda7a4b31-tls-certs\") pod \"e2e-lifecycle-model-9e2107d7-kserve-cf58fb8ff-hwhtj\" (UID: \"ec03a94f-1305-4c34-9aa6-8e4eda7a4b31\") " pod="ai-tenant-e2e-mt-9e2107d7/e2e-lifecycle-model-9e2107d7-kserve-cf58fb8ff-hwhtj"
Jul 30 21:05:52.679283 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:05:52.679261    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4ll7\" (UniqueName: \"kubernetes.io/projected/ec03a94f-1305-4c34-9aa6-8e4eda7a4b31-kube-api-access-c4ll7\") pod \"e2e-lifecycle-model-9e2107d7-kserve-cf58fb8ff-hwhtj\" (UID: \"ec03a94f-1305-4c34-9aa6-8e4eda7a4b31\") " pod="ai-tenant-e2e-mt-9e2107d7/e2e-lifecycle-model-9e2107d7-kserve-cf58fb8ff-hwhtj"
Jul 30 21:05:52.756187 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:05:52.756073    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-9e2107d7/e2e-lifecycle-model-9e2107d7-kserve-cf58fb8ff-hwhtj"
Jul 30 21:05:52.892756 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:05:52.892729    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-9e2107d7/e2e-lifecycle-model-9e2107d7-kserve-cf58fb8ff-hwhtj"]
Jul 30 21:05:52.894370 ip-10-0-142-69 kubenswrapper[2583]: W0730 21:05:52.894322    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podec03a94f_1305_4c34_9aa6_8e4eda7a4b31.slice/crio-d03ba2c665d606e66ad63caef476533b1b6e4072b30e0670e7ea152e3d28b28d WatchSource:0}: Error finding container d03ba2c665d606e66ad63caef476533b1b6e4072b30e0670e7ea152e3d28b28d: Status 404 returned error can't find the container with id d03ba2c665d606e66ad63caef476533b1b6e4072b30e0670e7ea152e3d28b28d
Jul 30 21:05:52.984305 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:05:52.984266    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-9e2107d7/e2e-lifecycle-model-9e2107d7-kserve-cf58fb8ff-hwhtj" event={"ID":"ec03a94f-1305-4c34-9aa6-8e4eda7a4b31","Type":"ContainerStarted","Data":"133d13e4b05519f2740454cca283fe8b1ca64f1a861f3e98f9706b9ee41c987e"}
Jul 30 21:05:52.984305 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:05:52.984306    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-9e2107d7/e2e-lifecycle-model-9e2107d7-kserve-cf58fb8ff-hwhtj" event={"ID":"ec03a94f-1305-4c34-9aa6-8e4eda7a4b31","Type":"ContainerStarted","Data":"d03ba2c665d606e66ad63caef476533b1b6e4072b30e0670e7ea152e3d28b28d"}
Jul 30 21:05:52.999967 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:05:52.999909    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-9e2107d7/e2e-lifecycle-model-9e2107d7-kserve-cf58fb8ff-hwhtj" podStartSLOduration=0.999891585 podStartE2EDuration="999.891585ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 21:05:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 21:05:52.998309695 +0000 UTC m=+2464.839785316" watchObservedRunningTime="2026-07-30 21:05:52.999891585 +0000 UTC m=+2464.841367206"
Jul 30 21:05:54.651192 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:05:54.651152    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 21:06:02.756381 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:06:02.756344    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-9e2107d7/e2e-lifecycle-model-9e2107d7-kserve-cf58fb8ff-hwhtj"
Jul 30 21:06:02.756769 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:06:02.756397    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-9e2107d7/e2e-lifecycle-model-9e2107d7-kserve-cf58fb8ff-hwhtj"
Jul 30 21:06:02.768979 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:06:02.768957    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-9e2107d7/e2e-lifecycle-model-9e2107d7-kserve-cf58fb8ff-hwhtj"
Jul 30 21:06:03.049366 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:06:03.049289    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-9e2107d7/e2e-lifecycle-model-9e2107d7-kserve-cf58fb8ff-hwhtj"
Jul 30 21:06:10.001273 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:06:10.001238    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:06:10.052284 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:06:10.052254    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:06:21.353102 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:06:21.353063    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 21:06:44.552830 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:06:44.552790    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 21:06:47.331924 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:06:47.331879    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:06:47.428977 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:06:47.428940    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:06:47.506770 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:06:47.506733    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:06:47.675622 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:06:47.675595    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:06:50.350760 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:06:50.350724    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 21:06:50.888779 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:06:50.888746    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:06:55.877054 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:06:55.877015    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-9e2107d7/e2e-lifecycle-model-9e2107d7-kserve-cf58fb8ff-hwhtj"]
Jul 30 21:06:55.971885 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:06:55.971842    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:07:10.897125 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:07:10.897063    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-9e2107d7/e2e-lifecycle-model-9e2107d7-kserve-cf58fb8ff-hwhtj" podUID="ec03a94f-1305-4c34-9aa6-8e4eda7a4b31" containerName="main" containerID="cri-o://133d13e4b05519f2740454cca283fe8b1ca64f1a861f3e98f9706b9ee41c987e" gracePeriod=45
Jul 30 21:07:11.145489 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:07:11.145466    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-9e2107d7/e2e-lifecycle-model-9e2107d7-kserve-cf58fb8ff-hwhtj"
Jul 30 21:07:11.261211 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:07:11.261099    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ec03a94f-1305-4c34-9aa6-8e4eda7a4b31-home\") pod \"ec03a94f-1305-4c34-9aa6-8e4eda7a4b31\" (UID: \"ec03a94f-1305-4c34-9aa6-8e4eda7a4b31\") "
Jul 30 21:07:11.261386 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:07:11.261250    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ec03a94f-1305-4c34-9aa6-8e4eda7a4b31-model-cache\") pod \"ec03a94f-1305-4c34-9aa6-8e4eda7a4b31\" (UID: \"ec03a94f-1305-4c34-9aa6-8e4eda7a4b31\") "
Jul 30 21:07:11.261386 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:07:11.261284    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ec03a94f-1305-4c34-9aa6-8e4eda7a4b31-tls-certs\") pod \"ec03a94f-1305-4c34-9aa6-8e4eda7a4b31\" (UID: \"ec03a94f-1305-4c34-9aa6-8e4eda7a4b31\") "
Jul 30 21:07:11.261386 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:07:11.261334    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec03a94f-1305-4c34-9aa6-8e4eda7a4b31-home" (OuterVolumeSpecName: "home") pod "ec03a94f-1305-4c34-9aa6-8e4eda7a4b31" (UID: "ec03a94f-1305-4c34-9aa6-8e4eda7a4b31"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:07:11.261386 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:07:11.261380    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c4ll7\" (UniqueName: \"kubernetes.io/projected/ec03a94f-1305-4c34-9aa6-8e4eda7a4b31-kube-api-access-c4ll7\") pod \"ec03a94f-1305-4c34-9aa6-8e4eda7a4b31\" (UID: \"ec03a94f-1305-4c34-9aa6-8e4eda7a4b31\") "
Jul 30 21:07:11.261589 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:07:11.261447    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ec03a94f-1305-4c34-9aa6-8e4eda7a4b31-dshm\") pod \"ec03a94f-1305-4c34-9aa6-8e4eda7a4b31\" (UID: \"ec03a94f-1305-4c34-9aa6-8e4eda7a4b31\") "
Jul 30 21:07:11.261589 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:07:11.261471    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ec03a94f-1305-4c34-9aa6-8e4eda7a4b31-tmp-dir\") pod \"ec03a94f-1305-4c34-9aa6-8e4eda7a4b31\" (UID: \"ec03a94f-1305-4c34-9aa6-8e4eda7a4b31\") "
Jul 30 21:07:11.261589 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:07:11.261517    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec03a94f-1305-4c34-9aa6-8e4eda7a4b31-model-cache" (OuterVolumeSpecName: "model-cache") pod "ec03a94f-1305-4c34-9aa6-8e4eda7a4b31" (UID: "ec03a94f-1305-4c34-9aa6-8e4eda7a4b31"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:07:11.261728 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:07:11.261681    2583 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ec03a94f-1305-4c34-9aa6-8e4eda7a4b31-home\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 21:07:11.261728 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:07:11.261698    2583 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ec03a94f-1305-4c34-9aa6-8e4eda7a4b31-model-cache\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 21:07:11.261832 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:07:11.261768    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec03a94f-1305-4c34-9aa6-8e4eda7a4b31-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "ec03a94f-1305-4c34-9aa6-8e4eda7a4b31" (UID: "ec03a94f-1305-4c34-9aa6-8e4eda7a4b31"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:07:11.263774 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:07:11.263747    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ec03a94f-1305-4c34-9aa6-8e4eda7a4b31-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ec03a94f-1305-4c34-9aa6-8e4eda7a4b31" (UID: "ec03a94f-1305-4c34-9aa6-8e4eda7a4b31"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 21:07:11.263774 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:07:11.263754    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec03a94f-1305-4c34-9aa6-8e4eda7a4b31-kube-api-access-c4ll7" (OuterVolumeSpecName: "kube-api-access-c4ll7") pod "ec03a94f-1305-4c34-9aa6-8e4eda7a4b31" (UID: "ec03a94f-1305-4c34-9aa6-8e4eda7a4b31"). InnerVolumeSpecName "kube-api-access-c4ll7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 21:07:11.263774 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:07:11.263761    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec03a94f-1305-4c34-9aa6-8e4eda7a4b31-dshm" (OuterVolumeSpecName: "dshm") pod "ec03a94f-1305-4c34-9aa6-8e4eda7a4b31" (UID: "ec03a94f-1305-4c34-9aa6-8e4eda7a4b31"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:07:11.362672 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:07:11.362640    2583 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ec03a94f-1305-4c34-9aa6-8e4eda7a4b31-dshm\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 21:07:11.362846 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:07:11.362686    2583 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ec03a94f-1305-4c34-9aa6-8e4eda7a4b31-tmp-dir\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 21:07:11.362846 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:07:11.362699    2583 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ec03a94f-1305-4c34-9aa6-8e4eda7a4b31-tls-certs\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 21:07:11.362846 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:07:11.362713    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c4ll7\" (UniqueName: \"kubernetes.io/projected/ec03a94f-1305-4c34-9aa6-8e4eda7a4b31-kube-api-access-c4ll7\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 21:07:11.414887 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:07:11.414858    2583 generic.go:356] "Generic (PLEG): container finished" podID="ec03a94f-1305-4c34-9aa6-8e4eda7a4b31" containerID="133d13e4b05519f2740454cca283fe8b1ca64f1a861f3e98f9706b9ee41c987e" exitCode=0
Jul 30 21:07:11.415046 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:07:11.414900    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-9e2107d7/e2e-lifecycle-model-9e2107d7-kserve-cf58fb8ff-hwhtj"
Jul 30 21:07:11.415046 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:07:11.414933    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-9e2107d7/e2e-lifecycle-model-9e2107d7-kserve-cf58fb8ff-hwhtj" event={"ID":"ec03a94f-1305-4c34-9aa6-8e4eda7a4b31","Type":"ContainerDied","Data":"133d13e4b05519f2740454cca283fe8b1ca64f1a861f3e98f9706b9ee41c987e"}
Jul 30 21:07:11.415046 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:07:11.414963    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-9e2107d7/e2e-lifecycle-model-9e2107d7-kserve-cf58fb8ff-hwhtj" event={"ID":"ec03a94f-1305-4c34-9aa6-8e4eda7a4b31","Type":"ContainerDied","Data":"d03ba2c665d606e66ad63caef476533b1b6e4072b30e0670e7ea152e3d28b28d"}
Jul 30 21:07:11.415046 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:07:11.414979    2583 scope.go:117] "RemoveContainer" containerID="133d13e4b05519f2740454cca283fe8b1ca64f1a861f3e98f9706b9ee41c987e"
Jul 30 21:07:11.424528 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:07:11.424512    2583 scope.go:117] "RemoveContainer" containerID="133d13e4b05519f2740454cca283fe8b1ca64f1a861f3e98f9706b9ee41c987e"
Jul 30 21:07:11.424786 ip-10-0-142-69 kubenswrapper[2583]: E0730 21:07:11.424768    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"133d13e4b05519f2740454cca283fe8b1ca64f1a861f3e98f9706b9ee41c987e\": container with ID starting with 133d13e4b05519f2740454cca283fe8b1ca64f1a861f3e98f9706b9ee41c987e not found: ID does not exist" containerID="133d13e4b05519f2740454cca283fe8b1ca64f1a861f3e98f9706b9ee41c987e"
Jul 30 21:07:11.424832 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:07:11.424794    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"133d13e4b05519f2740454cca283fe8b1ca64f1a861f3e98f9706b9ee41c987e"} err="failed to get container status \"133d13e4b05519f2740454cca283fe8b1ca64f1a861f3e98f9706b9ee41c987e\": rpc error: code = NotFound desc = could not find container \"133d13e4b05519f2740454cca283fe8b1ca64f1a861f3e98f9706b9ee41c987e\": container with ID starting with 133d13e4b05519f2740454cca283fe8b1ca64f1a861f3e98f9706b9ee41c987e not found: ID does not exist"
Jul 30 21:07:11.434310 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:07:11.434287    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-9e2107d7/e2e-lifecycle-model-9e2107d7-kserve-cf58fb8ff-hwhtj"]
Jul 30 21:07:11.437446 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:07:11.437423    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-9e2107d7/e2e-lifecycle-model-9e2107d7-kserve-cf58fb8ff-hwhtj"]
Jul 30 21:07:12.676874 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:07:12.676842    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ec03a94f-1305-4c34-9aa6-8e4eda7a4b31" path="/var/lib/kubelet/pods/ec03a94f-1305-4c34-9aa6-8e4eda7a4b31/volumes"
Jul 30 21:07:32.791851 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:07:32.791821    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:07:33.119811 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:07:33.119709    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:07:38.596798 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:07:38.596755    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:07:52.683284 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:07:52.683244    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:07:52.746534 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:07:52.746494    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:07:52.958429 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:07:52.958336    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:07:53.216960 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:07:53.216868    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:07:54.954073 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:07:54.954041    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 21:08:04.602371 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:08:04.602331    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:08:04.700518 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:08:04.700492    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:08:04.800252 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:08:04.800220    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:08:05.387961 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:08:05.387927    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:08:05.478034 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:08:05.478001    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:08:05.578709 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:08:05.578673    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:08:06.920841 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:08:06.920798    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:08:07.258153 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:08:07.258047    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 21:08:13.133866 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:08:13.133824    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:08:13.203112 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:08:13.203080    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:08:13.876686 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:08:13.876657    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:08:15.252999 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:08:15.252965    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 21:08:20.176033 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:08:20.176000    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:08:20.279948 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:08:20.279915    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:08:20.376697 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:08:20.376654    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:08:30.885091 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:08:30.885045    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:08:31.131790 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:08:31.131743    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:08:52.115459 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:08:52.115417    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:08:57.991275 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:08:57.991234    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:08:58.092705 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:08:58.092671    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:08:58.348156 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:08:58.348029    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:08:58.678641 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:08:58.678611    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:08:58.843340 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:08:58.843307    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:09:02.005322 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:09:02.005285    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:09:02.105052 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:09:02.105018    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:09:03.157845 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:09:03.157811    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:09:03.293248 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:09:03.293210    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:09:03.621189 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:09:03.621077    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:09:03.725202 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:09:03.725169    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:09:05.146155 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:09:05.146110    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 21:09:27.033156 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:09:27.033092    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:09:27.385243 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:09:27.385111    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:09:27.694770 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:09:27.694729    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:09:27.949569 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:09:27.949480    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:09:30.147593 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:09:30.147561    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:09:30.249176 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:09:30.249116    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:09:31.277496 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:09:31.277466    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:09:31.766675 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:09:31.766642    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:09:31.866153 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:09:31.866112    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:09:34.152221 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:09:34.152182    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 21:09:44.709841 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:09:44.709801    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:09:44.783318 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:09:44.783280    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:09:55.284802 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:09:55.284762    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:09:59.639645 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:09:59.639610    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-d59412/test-model-d59412-kserve-58bbf8f6f9-sh66x"]
Jul 30 21:09:59.640068 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:09:59.639988    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec03a94f-1305-4c34-9aa6-8e4eda7a4b31" containerName="main"
Jul 30 21:09:59.640068 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:09:59.640005    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec03a94f-1305-4c34-9aa6-8e4eda7a4b31" containerName="main"
Jul 30 21:09:59.640157 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:09:59.640092    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec03a94f-1305-4c34-9aa6-8e4eda7a4b31" containerName="main"
Jul 30 21:09:59.643196 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:09:59.643178    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-d59412/test-model-d59412-kserve-58bbf8f6f9-sh66x"
Jul 30 21:09:59.645339 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:09:59.645313    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-d59412\"/\"openshift-service-ca.crt\""
Jul 30 21:09:59.645339 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:09:59.645334    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-d59412\"/\"kube-root-ca.crt\""
Jul 30 21:09:59.645805 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:09:59.645785    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-d59412\"/\"default-dockercfg-sdwcs\""
Jul 30 21:09:59.645916 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:09:59.645823    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-d59412\"/\"test-model-d59412-kserve-self-signed-certs\""
Jul 30 21:09:59.653534 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:09:59.653510    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-d59412/test-model-d59412-kserve-58bbf8f6f9-sh66x"]
Jul 30 21:09:59.673002 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:09:59.672970    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:09:59.717036 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:09:59.717014    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/82c3df95-ba6c-4908-9702-eccb86c4bea0-tls-certs\") pod \"test-model-d59412-kserve-58bbf8f6f9-sh66x\" (UID: \"82c3df95-ba6c-4908-9702-eccb86c4bea0\") " pod="ai-tenant-e2e-inf-a-d59412/test-model-d59412-kserve-58bbf8f6f9-sh66x"
Jul 30 21:09:59.717173 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:09:59.717055    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/82c3df95-ba6c-4908-9702-eccb86c4bea0-home\") pod \"test-model-d59412-kserve-58bbf8f6f9-sh66x\" (UID: \"82c3df95-ba6c-4908-9702-eccb86c4bea0\") " pod="ai-tenant-e2e-inf-a-d59412/test-model-d59412-kserve-58bbf8f6f9-sh66x"
Jul 30 21:09:59.717173 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:09:59.717104    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/82c3df95-ba6c-4908-9702-eccb86c4bea0-dshm\") pod \"test-model-d59412-kserve-58bbf8f6f9-sh66x\" (UID: \"82c3df95-ba6c-4908-9702-eccb86c4bea0\") " pod="ai-tenant-e2e-inf-a-d59412/test-model-d59412-kserve-58bbf8f6f9-sh66x"
Jul 30 21:09:59.717173 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:09:59.717164    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/82c3df95-ba6c-4908-9702-eccb86c4bea0-model-cache\") pod \"test-model-d59412-kserve-58bbf8f6f9-sh66x\" (UID: \"82c3df95-ba6c-4908-9702-eccb86c4bea0\") " pod="ai-tenant-e2e-inf-a-d59412/test-model-d59412-kserve-58bbf8f6f9-sh66x"
Jul 30 21:09:59.717277 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:09:59.717203    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45z95\" (UniqueName: \"kubernetes.io/projected/82c3df95-ba6c-4908-9702-eccb86c4bea0-kube-api-access-45z95\") pod \"test-model-d59412-kserve-58bbf8f6f9-sh66x\" (UID: \"82c3df95-ba6c-4908-9702-eccb86c4bea0\") " pod="ai-tenant-e2e-inf-a-d59412/test-model-d59412-kserve-58bbf8f6f9-sh66x"
Jul 30 21:09:59.717277 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:09:59.717255    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/82c3df95-ba6c-4908-9702-eccb86c4bea0-tmp-dir\") pod \"test-model-d59412-kserve-58bbf8f6f9-sh66x\" (UID: \"82c3df95-ba6c-4908-9702-eccb86c4bea0\") " pod="ai-tenant-e2e-inf-a-d59412/test-model-d59412-kserve-58bbf8f6f9-sh66x"
Jul 30 21:09:59.817588 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:09:59.817564    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/82c3df95-ba6c-4908-9702-eccb86c4bea0-tmp-dir\") pod \"test-model-d59412-kserve-58bbf8f6f9-sh66x\" (UID: \"82c3df95-ba6c-4908-9702-eccb86c4bea0\") " pod="ai-tenant-e2e-inf-a-d59412/test-model-d59412-kserve-58bbf8f6f9-sh66x"
Jul 30 21:09:59.817679 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:09:59.817596    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/82c3df95-ba6c-4908-9702-eccb86c4bea0-tls-certs\") pod \"test-model-d59412-kserve-58bbf8f6f9-sh66x\" (UID: \"82c3df95-ba6c-4908-9702-eccb86c4bea0\") " pod="ai-tenant-e2e-inf-a-d59412/test-model-d59412-kserve-58bbf8f6f9-sh66x"
Jul 30 21:09:59.817679 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:09:59.817631    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/82c3df95-ba6c-4908-9702-eccb86c4bea0-home\") pod \"test-model-d59412-kserve-58bbf8f6f9-sh66x\" (UID: \"82c3df95-ba6c-4908-9702-eccb86c4bea0\") " pod="ai-tenant-e2e-inf-a-d59412/test-model-d59412-kserve-58bbf8f6f9-sh66x"
Jul 30 21:09:59.817756 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:09:59.817741    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/82c3df95-ba6c-4908-9702-eccb86c4bea0-dshm\") pod \"test-model-d59412-kserve-58bbf8f6f9-sh66x\" (UID: \"82c3df95-ba6c-4908-9702-eccb86c4bea0\") " pod="ai-tenant-e2e-inf-a-d59412/test-model-d59412-kserve-58bbf8f6f9-sh66x"
Jul 30 21:09:59.817803 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:09:59.817781    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/82c3df95-ba6c-4908-9702-eccb86c4bea0-model-cache\") pod \"test-model-d59412-kserve-58bbf8f6f9-sh66x\" (UID: \"82c3df95-ba6c-4908-9702-eccb86c4bea0\") " pod="ai-tenant-e2e-inf-a-d59412/test-model-d59412-kserve-58bbf8f6f9-sh66x"
Jul 30 21:09:59.817856 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:09:59.817810    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45z95\" (UniqueName: \"kubernetes.io/projected/82c3df95-ba6c-4908-9702-eccb86c4bea0-kube-api-access-45z95\") pod \"test-model-d59412-kserve-58bbf8f6f9-sh66x\" (UID: \"82c3df95-ba6c-4908-9702-eccb86c4bea0\") " pod="ai-tenant-e2e-inf-a-d59412/test-model-d59412-kserve-58bbf8f6f9-sh66x"
Jul 30 21:09:59.817996 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:09:59.817975    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/82c3df95-ba6c-4908-9702-eccb86c4bea0-home\") pod \"test-model-d59412-kserve-58bbf8f6f9-sh66x\" (UID: \"82c3df95-ba6c-4908-9702-eccb86c4bea0\") " pod="ai-tenant-e2e-inf-a-d59412/test-model-d59412-kserve-58bbf8f6f9-sh66x"
Jul 30 21:09:59.818061 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:09:59.817996    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/82c3df95-ba6c-4908-9702-eccb86c4bea0-tmp-dir\") pod \"test-model-d59412-kserve-58bbf8f6f9-sh66x\" (UID: \"82c3df95-ba6c-4908-9702-eccb86c4bea0\") " pod="ai-tenant-e2e-inf-a-d59412/test-model-d59412-kserve-58bbf8f6f9-sh66x"
Jul 30 21:09:59.818112 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:09:59.818056    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/82c3df95-ba6c-4908-9702-eccb86c4bea0-model-cache\") pod \"test-model-d59412-kserve-58bbf8f6f9-sh66x\" (UID: \"82c3df95-ba6c-4908-9702-eccb86c4bea0\") " pod="ai-tenant-e2e-inf-a-d59412/test-model-d59412-kserve-58bbf8f6f9-sh66x"
Jul 30 21:09:59.820028 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:09:59.820009    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/82c3df95-ba6c-4908-9702-eccb86c4bea0-dshm\") pod \"test-model-d59412-kserve-58bbf8f6f9-sh66x\" (UID: \"82c3df95-ba6c-4908-9702-eccb86c4bea0\") " pod="ai-tenant-e2e-inf-a-d59412/test-model-d59412-kserve-58bbf8f6f9-sh66x"
Jul 30 21:09:59.820318 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:09:59.820299    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/82c3df95-ba6c-4908-9702-eccb86c4bea0-tls-certs\") pod \"test-model-d59412-kserve-58bbf8f6f9-sh66x\" (UID: \"82c3df95-ba6c-4908-9702-eccb86c4bea0\") " pod="ai-tenant-e2e-inf-a-d59412/test-model-d59412-kserve-58bbf8f6f9-sh66x"
Jul 30 21:09:59.824626 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:09:59.824607    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-45z95\" (UniqueName: \"kubernetes.io/projected/82c3df95-ba6c-4908-9702-eccb86c4bea0-kube-api-access-45z95\") pod \"test-model-d59412-kserve-58bbf8f6f9-sh66x\" (UID: \"82c3df95-ba6c-4908-9702-eccb86c4bea0\") " pod="ai-tenant-e2e-inf-a-d59412/test-model-d59412-kserve-58bbf8f6f9-sh66x"
Jul 30 21:09:59.954180 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:09:59.954151    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-d59412/test-model-d59412-kserve-58bbf8f6f9-sh66x"
Jul 30 21:10:00.087955 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:10:00.087882    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-d59412/test-model-d59412-kserve-58bbf8f6f9-sh66x"]
Jul 30 21:10:00.090634 ip-10-0-142-69 kubenswrapper[2583]: W0730 21:10:00.090607    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod82c3df95_ba6c_4908_9702_eccb86c4bea0.slice/crio-0ade8f6d6b8b99fed4707872fea7960906620cd08c6d00f826eded2ed4e216b0 WatchSource:0}: Error finding container 0ade8f6d6b8b99fed4707872fea7960906620cd08c6d00f826eded2ed4e216b0: Status 404 returned error can't find the container with id 0ade8f6d6b8b99fed4707872fea7960906620cd08c6d00f826eded2ed4e216b0
Jul 30 21:10:00.333907 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:10:00.333818    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-d59412/test-model-d59412-kserve-58bbf8f6f9-sh66x" event={"ID":"82c3df95-ba6c-4908-9702-eccb86c4bea0","Type":"ContainerStarted","Data":"0010b4a8fe1897d922ee735775243f18a13c510cc4bcaadfa6db9a5355893a5e"}
Jul 30 21:10:00.333907 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:10:00.333859    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-d59412/test-model-d59412-kserve-58bbf8f6f9-sh66x" event={"ID":"82c3df95-ba6c-4908-9702-eccb86c4bea0","Type":"ContainerStarted","Data":"0ade8f6d6b8b99fed4707872fea7960906620cd08c6d00f826eded2ed4e216b0"}
Jul 30 21:10:00.350253 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:10:00.350211    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-d59412/test-model-d59412-kserve-58bbf8f6f9-sh66x" podStartSLOduration=1.350197278 podStartE2EDuration="1.350197278s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 21:09:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 21:10:00.347889938 +0000 UTC m=+2712.189365558" watchObservedRunningTime="2026-07-30 21:10:00.350197278 +0000 UTC m=+2712.191672898"
Jul 30 21:10:02.854523 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:10:02.854473    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 21:10:09.954843 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:10:09.954803    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-d59412/test-model-d59412-kserve-58bbf8f6f9-sh66x"
Jul 30 21:10:09.955280 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:10:09.954858    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-d59412/test-model-d59412-kserve-58bbf8f6f9-sh66x"
Jul 30 21:10:09.967566 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:10:09.967541    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-d59412/test-model-d59412-kserve-58bbf8f6f9-sh66x"
Jul 30 21:10:10.398157 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:10:10.398048    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-d59412/test-model-d59412-kserve-58bbf8f6f9-sh66x"
Jul 30 21:10:32.249726 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:10:32.249687    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-3230ac/test-model-3230ac-kserve-c66476c97-khcvj"]
Jul 30 21:10:32.253399 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:10:32.253377    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-3230ac/test-model-3230ac-kserve-c66476c97-khcvj"
Jul 30 21:10:32.255542 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:10:32.255511    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-3230ac\"/\"openshift-service-ca.crt\""
Jul 30 21:10:32.256117 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:10:32.256098    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-3230ac\"/\"default-dockercfg-zdn7n\""
Jul 30 21:10:32.256258 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:10:32.256113    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-3230ac\"/\"test-model-3230ac-kserve-self-signed-certs\""
Jul 30 21:10:32.256258 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:10:32.256184    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-3230ac\"/\"kube-root-ca.crt\""
Jul 30 21:10:32.260360 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:10:32.260336    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-3230ac/test-model-3230ac-kserve-c66476c97-khcvj"]
Jul 30 21:10:32.273264 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:10:32.273238    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:10:32.415527 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:10:32.415474    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/15fef28f-0e9c-4be0-8a74-8a94288527b4-model-cache\") pod \"test-model-3230ac-kserve-c66476c97-khcvj\" (UID: \"15fef28f-0e9c-4be0-8a74-8a94288527b4\") " pod="ai-tenant-e2e-inf-b-3230ac/test-model-3230ac-kserve-c66476c97-khcvj"
Jul 30 21:10:32.415720 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:10:32.415547    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/15fef28f-0e9c-4be0-8a74-8a94288527b4-tls-certs\") pod \"test-model-3230ac-kserve-c66476c97-khcvj\" (UID: \"15fef28f-0e9c-4be0-8a74-8a94288527b4\") " pod="ai-tenant-e2e-inf-b-3230ac/test-model-3230ac-kserve-c66476c97-khcvj"
Jul 30 21:10:32.415720 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:10:32.415597    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/15fef28f-0e9c-4be0-8a74-8a94288527b4-dshm\") pod \"test-model-3230ac-kserve-c66476c97-khcvj\" (UID: \"15fef28f-0e9c-4be0-8a74-8a94288527b4\") " pod="ai-tenant-e2e-inf-b-3230ac/test-model-3230ac-kserve-c66476c97-khcvj"
Jul 30 21:10:32.415720 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:10:32.415613    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/15fef28f-0e9c-4be0-8a74-8a94288527b4-tmp-dir\") pod \"test-model-3230ac-kserve-c66476c97-khcvj\" (UID: \"15fef28f-0e9c-4be0-8a74-8a94288527b4\") " pod="ai-tenant-e2e-inf-b-3230ac/test-model-3230ac-kserve-c66476c97-khcvj"
Jul 30 21:10:32.415720 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:10:32.415640    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hc9k8\" (UniqueName: \"kubernetes.io/projected/15fef28f-0e9c-4be0-8a74-8a94288527b4-kube-api-access-hc9k8\") pod \"test-model-3230ac-kserve-c66476c97-khcvj\" (UID: \"15fef28f-0e9c-4be0-8a74-8a94288527b4\") " pod="ai-tenant-e2e-inf-b-3230ac/test-model-3230ac-kserve-c66476c97-khcvj"
Jul 30 21:10:32.415720 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:10:32.415686    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/15fef28f-0e9c-4be0-8a74-8a94288527b4-home\") pod \"test-model-3230ac-kserve-c66476c97-khcvj\" (UID: \"15fef28f-0e9c-4be0-8a74-8a94288527b4\") " pod="ai-tenant-e2e-inf-b-3230ac/test-model-3230ac-kserve-c66476c97-khcvj"
Jul 30 21:10:32.516505 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:10:32.516416    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/15fef28f-0e9c-4be0-8a74-8a94288527b4-model-cache\") pod \"test-model-3230ac-kserve-c66476c97-khcvj\" (UID: \"15fef28f-0e9c-4be0-8a74-8a94288527b4\") " pod="ai-tenant-e2e-inf-b-3230ac/test-model-3230ac-kserve-c66476c97-khcvj"
Jul 30 21:10:32.516505 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:10:32.516492    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/15fef28f-0e9c-4be0-8a74-8a94288527b4-tls-certs\") pod \"test-model-3230ac-kserve-c66476c97-khcvj\" (UID: \"15fef28f-0e9c-4be0-8a74-8a94288527b4\") " pod="ai-tenant-e2e-inf-b-3230ac/test-model-3230ac-kserve-c66476c97-khcvj"
Jul 30 21:10:32.516744 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:10:32.516527    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/15fef28f-0e9c-4be0-8a74-8a94288527b4-dshm\") pod \"test-model-3230ac-kserve-c66476c97-khcvj\" (UID: \"15fef28f-0e9c-4be0-8a74-8a94288527b4\") " pod="ai-tenant-e2e-inf-b-3230ac/test-model-3230ac-kserve-c66476c97-khcvj"
Jul 30 21:10:32.516744 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:10:32.516542    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/15fef28f-0e9c-4be0-8a74-8a94288527b4-tmp-dir\") pod \"test-model-3230ac-kserve-c66476c97-khcvj\" (UID: \"15fef28f-0e9c-4be0-8a74-8a94288527b4\") " pod="ai-tenant-e2e-inf-b-3230ac/test-model-3230ac-kserve-c66476c97-khcvj"
Jul 30 21:10:32.516744 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:10:32.516567    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hc9k8\" (UniqueName: \"kubernetes.io/projected/15fef28f-0e9c-4be0-8a74-8a94288527b4-kube-api-access-hc9k8\") pod \"test-model-3230ac-kserve-c66476c97-khcvj\" (UID: \"15fef28f-0e9c-4be0-8a74-8a94288527b4\") " pod="ai-tenant-e2e-inf-b-3230ac/test-model-3230ac-kserve-c66476c97-khcvj"
Jul 30 21:10:32.516744 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:10:32.516593    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/15fef28f-0e9c-4be0-8a74-8a94288527b4-home\") pod \"test-model-3230ac-kserve-c66476c97-khcvj\" (UID: \"15fef28f-0e9c-4be0-8a74-8a94288527b4\") " pod="ai-tenant-e2e-inf-b-3230ac/test-model-3230ac-kserve-c66476c97-khcvj"
Jul 30 21:10:32.516954 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:10:32.516825    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/15fef28f-0e9c-4be0-8a74-8a94288527b4-model-cache\") pod \"test-model-3230ac-kserve-c66476c97-khcvj\" (UID: \"15fef28f-0e9c-4be0-8a74-8a94288527b4\") " pod="ai-tenant-e2e-inf-b-3230ac/test-model-3230ac-kserve-c66476c97-khcvj"
Jul 30 21:10:32.517015 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:10:32.516952    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/15fef28f-0e9c-4be0-8a74-8a94288527b4-tmp-dir\") pod \"test-model-3230ac-kserve-c66476c97-khcvj\" (UID: \"15fef28f-0e9c-4be0-8a74-8a94288527b4\") " pod="ai-tenant-e2e-inf-b-3230ac/test-model-3230ac-kserve-c66476c97-khcvj"
Jul 30 21:10:32.517015 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:10:32.517008    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/15fef28f-0e9c-4be0-8a74-8a94288527b4-home\") pod \"test-model-3230ac-kserve-c66476c97-khcvj\" (UID: \"15fef28f-0e9c-4be0-8a74-8a94288527b4\") " pod="ai-tenant-e2e-inf-b-3230ac/test-model-3230ac-kserve-c66476c97-khcvj"
Jul 30 21:10:32.518895 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:10:32.518874    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/15fef28f-0e9c-4be0-8a74-8a94288527b4-dshm\") pod \"test-model-3230ac-kserve-c66476c97-khcvj\" (UID: \"15fef28f-0e9c-4be0-8a74-8a94288527b4\") " pod="ai-tenant-e2e-inf-b-3230ac/test-model-3230ac-kserve-c66476c97-khcvj"
Jul 30 21:10:32.519173 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:10:32.519127    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/15fef28f-0e9c-4be0-8a74-8a94288527b4-tls-certs\") pod \"test-model-3230ac-kserve-c66476c97-khcvj\" (UID: \"15fef28f-0e9c-4be0-8a74-8a94288527b4\") " pod="ai-tenant-e2e-inf-b-3230ac/test-model-3230ac-kserve-c66476c97-khcvj"
Jul 30 21:10:32.524402 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:10:32.524380    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hc9k8\" (UniqueName: \"kubernetes.io/projected/15fef28f-0e9c-4be0-8a74-8a94288527b4-kube-api-access-hc9k8\") pod \"test-model-3230ac-kserve-c66476c97-khcvj\" (UID: \"15fef28f-0e9c-4be0-8a74-8a94288527b4\") " pod="ai-tenant-e2e-inf-b-3230ac/test-model-3230ac-kserve-c66476c97-khcvj"
Jul 30 21:10:32.564686 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:10:32.564655    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-3230ac/test-model-3230ac-kserve-c66476c97-khcvj"
Jul 30 21:10:32.702665 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:10:32.702636    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-3230ac/test-model-3230ac-kserve-c66476c97-khcvj"]
Jul 30 21:10:32.704465 ip-10-0-142-69 kubenswrapper[2583]: W0730 21:10:32.704439    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod15fef28f_0e9c_4be0_8a74_8a94288527b4.slice/crio-9f35252d313ca2b59ab8b1db1869ca04d3c3e60e9c6f9de2322b1b137a0384ec WatchSource:0}: Error finding container 9f35252d313ca2b59ab8b1db1869ca04d3c3e60e9c6f9de2322b1b137a0384ec: Status 404 returned error can't find the container with id 9f35252d313ca2b59ab8b1db1869ca04d3c3e60e9c6f9de2322b1b137a0384ec
Jul 30 21:10:33.517795 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:10:33.517753    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-3230ac/test-model-3230ac-kserve-c66476c97-khcvj" event={"ID":"15fef28f-0e9c-4be0-8a74-8a94288527b4","Type":"ContainerStarted","Data":"5be072ee379f47189dbee26a8776ca42c29c081d6d0af57699fd9464c7fa7ba9"}
Jul 30 21:10:33.517795 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:10:33.517800    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-3230ac/test-model-3230ac-kserve-c66476c97-khcvj" event={"ID":"15fef28f-0e9c-4be0-8a74-8a94288527b4","Type":"ContainerStarted","Data":"9f35252d313ca2b59ab8b1db1869ca04d3c3e60e9c6f9de2322b1b137a0384ec"}
Jul 30 21:10:33.532888 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:10:33.532846    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-3230ac/test-model-3230ac-kserve-c66476c97-khcvj" podStartSLOduration=1.532831871 podStartE2EDuration="1.532831871s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 21:10:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 21:10:33.531696922 +0000 UTC m=+2745.373172542" watchObservedRunningTime="2026-07-30 21:10:33.532831871 +0000 UTC m=+2745.374307492"
Jul 30 21:10:36.451105 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:10:36.451070    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 21:10:42.565203 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:10:42.565166    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-3230ac/test-model-3230ac-kserve-c66476c97-khcvj"
Jul 30 21:10:42.565665 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:10:42.565218    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-3230ac/test-model-3230ac-kserve-c66476c97-khcvj"
Jul 30 21:10:42.578064 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:10:42.578041    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-3230ac/test-model-3230ac-kserve-c66476c97-khcvj"
Jul 30 21:10:43.584885 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:10:43.584857    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-3230ac/test-model-3230ac-kserve-c66476c97-khcvj"
Jul 30 21:11:15.084043 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:15.084005    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-d59412/test-model-d59412-kserve-58bbf8f6f9-sh66x"]
Jul 30 21:11:15.110161 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:15.110113    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:11:16.063248 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:16.063214    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-3230ac/test-model-3230ac-kserve-c66476c97-khcvj"]
Jul 30 21:11:16.081807 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:16.081779    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:11:16.196255 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:16.196230    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d59412-8h2zw"]
Jul 30 21:11:16.199835 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:16.199819    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d59412-8h2zw"
Jul 30 21:11:16.207270 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:16.207232    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zm2hs\""
Jul 30 21:11:16.207409 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:16.207362    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 30 21:11:16.210779 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:16.210755    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d59412-8h2zw"]
Jul 30 21:11:16.286952 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:16.286924    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/31e7762c-f203-47fc-b707-ce5a1cbaeb50-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-d59412-8h2zw\" (UID: \"31e7762c-f203-47fc-b707-ce5a1cbaeb50\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d59412-8h2zw"
Jul 30 21:11:16.388434 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:16.388343    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/31e7762c-f203-47fc-b707-ce5a1cbaeb50-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-d59412-8h2zw\" (UID: \"31e7762c-f203-47fc-b707-ce5a1cbaeb50\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d59412-8h2zw"
Jul 30 21:11:16.389000 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:16.388975    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/31e7762c-f203-47fc-b707-ce5a1cbaeb50-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-d59412-8h2zw\" (UID: \"31e7762c-f203-47fc-b707-ce5a1cbaeb50\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d59412-8h2zw"
Jul 30 21:11:16.518178 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:16.518111    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d59412-8h2zw"
Jul 30 21:11:16.649398 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:16.649365    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d59412-8h2zw"]
Jul 30 21:11:16.650664 ip-10-0-142-69 kubenswrapper[2583]: W0730 21:11:16.650636    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31e7762c_f203_47fc_b707_ce5a1cbaeb50.slice/crio-d93341acf9c0b1ff9e286db79d63808cfc5c81bcf8f2e8a3aa52719245c29d80 WatchSource:0}: Error finding container d93341acf9c0b1ff9e286db79d63808cfc5c81bcf8f2e8a3aa52719245c29d80: Status 404 returned error can't find the container with id d93341acf9c0b1ff9e286db79d63808cfc5c81bcf8f2e8a3aa52719245c29d80
Jul 30 21:11:16.750058 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:16.750027    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d59412-8h2zw" event={"ID":"31e7762c-f203-47fc-b707-ce5a1cbaeb50","Type":"ContainerStarted","Data":"d93341acf9c0b1ff9e286db79d63808cfc5c81bcf8f2e8a3aa52719245c29d80"}
Jul 30 21:11:17.760735 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:17.760693    2583 generic.go:356] "Generic (PLEG): container finished" podID="31e7762c-f203-47fc-b707-ce5a1cbaeb50" containerID="f396414373c281514c97a3e210fe4fc94413102a2fb5fbcb3de13d7c6507f972" exitCode=0
Jul 30 21:11:17.761123 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:17.760782    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d59412-8h2zw" event={"ID":"31e7762c-f203-47fc-b707-ce5a1cbaeb50","Type":"ContainerDied","Data":"f396414373c281514c97a3e210fe4fc94413102a2fb5fbcb3de13d7c6507f972"}
Jul 30 21:11:18.894045 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:18.894024    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d59412-8h2zw"
Jul 30 21:11:19.009641 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:19.009619    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/31e7762c-f203-47fc-b707-ce5a1cbaeb50-maas-api-service-ca\") pod \"31e7762c-f203-47fc-b707-ce5a1cbaeb50\" (UID: \"31e7762c-f203-47fc-b707-ce5a1cbaeb50\") "
Jul 30 21:11:19.009933 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:19.009913    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/31e7762c-f203-47fc-b707-ce5a1cbaeb50-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "31e7762c-f203-47fc-b707-ce5a1cbaeb50" (UID: "31e7762c-f203-47fc-b707-ce5a1cbaeb50"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 21:11:19.110601 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:19.110537    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/31e7762c-f203-47fc-b707-ce5a1cbaeb50-maas-api-service-ca\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 21:11:19.149739 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:19.149716    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 21:11:19.772707 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:19.772674    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d59412-8h2zw"
Jul 30 21:11:19.772918 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:19.772707    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d59412-8h2zw" event={"ID":"31e7762c-f203-47fc-b707-ce5a1cbaeb50","Type":"ContainerDied","Data":"d93341acf9c0b1ff9e286db79d63808cfc5c81bcf8f2e8a3aa52719245c29d80"}
Jul 30 21:11:19.772918 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:19.772750    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d93341acf9c0b1ff9e286db79d63808cfc5c81bcf8f2e8a3aa52719245c29d80"
Jul 30 21:11:26.665880 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:26.665847    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:11:26.729892 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:26.729852    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:11:26.790663 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:26.790621    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:11:26.844359 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:26.844327    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d59412-8h2zw"]
Jul 30 21:11:26.848231 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:26.848207    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:11:26.848386 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:26.848370    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d59412-8h2zw"]
Jul 30 21:11:27.232876 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:27.232837    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:11:28.676177 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:28.676119    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="31e7762c-f203-47fc-b707-ce5a1cbaeb50" path="/var/lib/kubelet/pods/31e7762c-f203-47fc-b707-ce5a1cbaeb50/volumes"
Jul 30 21:11:29.152968 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:29.152932    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 21:11:30.103731 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:30.103698    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-d59412/test-model-d59412-kserve-58bbf8f6f9-sh66x" podUID="82c3df95-ba6c-4908-9702-eccb86c4bea0" containerName="main" containerID="cri-o://0010b4a8fe1897d922ee735775243f18a13c510cc4bcaadfa6db9a5355893a5e" gracePeriod=45
Jul 30 21:11:30.347079 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:30.347056    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-d59412/test-model-d59412-kserve-58bbf8f6f9-sh66x"
Jul 30 21:11:30.515823 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:30.515795    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/82c3df95-ba6c-4908-9702-eccb86c4bea0-model-cache\") pod \"82c3df95-ba6c-4908-9702-eccb86c4bea0\" (UID: \"82c3df95-ba6c-4908-9702-eccb86c4bea0\") "
Jul 30 21:11:30.515965 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:30.515857    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/82c3df95-ba6c-4908-9702-eccb86c4bea0-home\") pod \"82c3df95-ba6c-4908-9702-eccb86c4bea0\" (UID: \"82c3df95-ba6c-4908-9702-eccb86c4bea0\") "
Jul 30 21:11:30.515965 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:30.515879    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/82c3df95-ba6c-4908-9702-eccb86c4bea0-tmp-dir\") pod \"82c3df95-ba6c-4908-9702-eccb86c4bea0\" (UID: \"82c3df95-ba6c-4908-9702-eccb86c4bea0\") "
Jul 30 21:11:30.515965 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:30.515936    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/82c3df95-ba6c-4908-9702-eccb86c4bea0-tls-certs\") pod \"82c3df95-ba6c-4908-9702-eccb86c4bea0\" (UID: \"82c3df95-ba6c-4908-9702-eccb86c4bea0\") "
Jul 30 21:11:30.515965 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:30.515955    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/82c3df95-ba6c-4908-9702-eccb86c4bea0-dshm\") pod \"82c3df95-ba6c-4908-9702-eccb86c4bea0\" (UID: \"82c3df95-ba6c-4908-9702-eccb86c4bea0\") "
Jul 30 21:11:30.516217 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:30.516016    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-45z95\" (UniqueName: \"kubernetes.io/projected/82c3df95-ba6c-4908-9702-eccb86c4bea0-kube-api-access-45z95\") pod \"82c3df95-ba6c-4908-9702-eccb86c4bea0\" (UID: \"82c3df95-ba6c-4908-9702-eccb86c4bea0\") "
Jul 30 21:11:30.516217 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:30.516058    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82c3df95-ba6c-4908-9702-eccb86c4bea0-model-cache" (OuterVolumeSpecName: "model-cache") pod "82c3df95-ba6c-4908-9702-eccb86c4bea0" (UID: "82c3df95-ba6c-4908-9702-eccb86c4bea0"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:11:30.516217 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:30.516125    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82c3df95-ba6c-4908-9702-eccb86c4bea0-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "82c3df95-ba6c-4908-9702-eccb86c4bea0" (UID: "82c3df95-ba6c-4908-9702-eccb86c4bea0"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:11:30.516217 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:30.516177    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82c3df95-ba6c-4908-9702-eccb86c4bea0-home" (OuterVolumeSpecName: "home") pod "82c3df95-ba6c-4908-9702-eccb86c4bea0" (UID: "82c3df95-ba6c-4908-9702-eccb86c4bea0"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:11:30.516404 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:30.516331    2583 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/82c3df95-ba6c-4908-9702-eccb86c4bea0-model-cache\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 21:11:30.516404 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:30.516347    2583 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/82c3df95-ba6c-4908-9702-eccb86c4bea0-home\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 21:11:30.516404 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:30.516359    2583 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/82c3df95-ba6c-4908-9702-eccb86c4bea0-tmp-dir\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 21:11:30.518318 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:30.518291    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82c3df95-ba6c-4908-9702-eccb86c4bea0-dshm" (OuterVolumeSpecName: "dshm") pod "82c3df95-ba6c-4908-9702-eccb86c4bea0" (UID: "82c3df95-ba6c-4908-9702-eccb86c4bea0"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:11:30.518318 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:30.518300    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/82c3df95-ba6c-4908-9702-eccb86c4bea0-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "82c3df95-ba6c-4908-9702-eccb86c4bea0" (UID: "82c3df95-ba6c-4908-9702-eccb86c4bea0"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 21:11:30.518318 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:30.518306    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82c3df95-ba6c-4908-9702-eccb86c4bea0-kube-api-access-45z95" (OuterVolumeSpecName: "kube-api-access-45z95") pod "82c3df95-ba6c-4908-9702-eccb86c4bea0" (UID: "82c3df95-ba6c-4908-9702-eccb86c4bea0"). InnerVolumeSpecName "kube-api-access-45z95". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 21:11:30.617325 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:30.617297    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-45z95\" (UniqueName: \"kubernetes.io/projected/82c3df95-ba6c-4908-9702-eccb86c4bea0-kube-api-access-45z95\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 21:11:30.617325 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:30.617323    2583 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/82c3df95-ba6c-4908-9702-eccb86c4bea0-tls-certs\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 21:11:30.617454 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:30.617338    2583 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/82c3df95-ba6c-4908-9702-eccb86c4bea0-dshm\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 21:11:30.829785 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:30.829722    2583 generic.go:356] "Generic (PLEG): container finished" podID="82c3df95-ba6c-4908-9702-eccb86c4bea0" containerID="0010b4a8fe1897d922ee735775243f18a13c510cc4bcaadfa6db9a5355893a5e" exitCode=0
Jul 30 21:11:30.829785 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:30.829760    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-d59412/test-model-d59412-kserve-58bbf8f6f9-sh66x"
Jul 30 21:11:30.829785 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:30.829765    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-d59412/test-model-d59412-kserve-58bbf8f6f9-sh66x" event={"ID":"82c3df95-ba6c-4908-9702-eccb86c4bea0","Type":"ContainerDied","Data":"0010b4a8fe1897d922ee735775243f18a13c510cc4bcaadfa6db9a5355893a5e"}
Jul 30 21:11:30.829965 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:30.829788    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-d59412/test-model-d59412-kserve-58bbf8f6f9-sh66x" event={"ID":"82c3df95-ba6c-4908-9702-eccb86c4bea0","Type":"ContainerDied","Data":"0ade8f6d6b8b99fed4707872fea7960906620cd08c6d00f826eded2ed4e216b0"}
Jul 30 21:11:30.829965 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:30.829804    2583 scope.go:117] "RemoveContainer" containerID="0010b4a8fe1897d922ee735775243f18a13c510cc4bcaadfa6db9a5355893a5e"
Jul 30 21:11:30.838810 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:30.838794    2583 scope.go:117] "RemoveContainer" containerID="0010b4a8fe1897d922ee735775243f18a13c510cc4bcaadfa6db9a5355893a5e"
Jul 30 21:11:30.839075 ip-10-0-142-69 kubenswrapper[2583]: E0730 21:11:30.839056    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0010b4a8fe1897d922ee735775243f18a13c510cc4bcaadfa6db9a5355893a5e\": container with ID starting with 0010b4a8fe1897d922ee735775243f18a13c510cc4bcaadfa6db9a5355893a5e not found: ID does not exist" containerID="0010b4a8fe1897d922ee735775243f18a13c510cc4bcaadfa6db9a5355893a5e"
Jul 30 21:11:30.839116 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:30.839086    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0010b4a8fe1897d922ee735775243f18a13c510cc4bcaadfa6db9a5355893a5e"} err="failed to get container status \"0010b4a8fe1897d922ee735775243f18a13c510cc4bcaadfa6db9a5355893a5e\": rpc error: code = NotFound desc = could not find container \"0010b4a8fe1897d922ee735775243f18a13c510cc4bcaadfa6db9a5355893a5e\": container with ID starting with 0010b4a8fe1897d922ee735775243f18a13c510cc4bcaadfa6db9a5355893a5e not found: ID does not exist"
Jul 30 21:11:30.844560 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:30.844538    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-d59412/test-model-d59412-kserve-58bbf8f6f9-sh66x"]
Jul 30 21:11:30.847997 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:30.847978    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-d59412/test-model-d59412-kserve-58bbf8f6f9-sh66x"]
Jul 30 21:11:31.082788 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:31.082704    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-3230ac/test-model-3230ac-kserve-c66476c97-khcvj" podUID="15fef28f-0e9c-4be0-8a74-8a94288527b4" containerName="main" containerID="cri-o://5be072ee379f47189dbee26a8776ca42c29c081d6d0af57699fd9464c7fa7ba9" gracePeriod=45
Jul 30 21:11:31.322313 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:31.322284    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-3230ac/test-model-3230ac-kserve-c66476c97-khcvj"
Jul 30 21:11:31.423934 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:31.423900    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/15fef28f-0e9c-4be0-8a74-8a94288527b4-model-cache\") pod \"15fef28f-0e9c-4be0-8a74-8a94288527b4\" (UID: \"15fef28f-0e9c-4be0-8a74-8a94288527b4\") "
Jul 30 21:11:31.424079 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:31.423945    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/15fef28f-0e9c-4be0-8a74-8a94288527b4-tls-certs\") pod \"15fef28f-0e9c-4be0-8a74-8a94288527b4\" (UID: \"15fef28f-0e9c-4be0-8a74-8a94288527b4\") "
Jul 30 21:11:31.424079 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:31.423976    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/15fef28f-0e9c-4be0-8a74-8a94288527b4-home\") pod \"15fef28f-0e9c-4be0-8a74-8a94288527b4\" (UID: \"15fef28f-0e9c-4be0-8a74-8a94288527b4\") "
Jul 30 21:11:31.424079 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:31.424007    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/15fef28f-0e9c-4be0-8a74-8a94288527b4-tmp-dir\") pod \"15fef28f-0e9c-4be0-8a74-8a94288527b4\" (UID: \"15fef28f-0e9c-4be0-8a74-8a94288527b4\") "
Jul 30 21:11:31.424079 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:31.424073    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hc9k8\" (UniqueName: \"kubernetes.io/projected/15fef28f-0e9c-4be0-8a74-8a94288527b4-kube-api-access-hc9k8\") pod \"15fef28f-0e9c-4be0-8a74-8a94288527b4\" (UID: \"15fef28f-0e9c-4be0-8a74-8a94288527b4\") "
Jul 30 21:11:31.424313 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:31.424107    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/15fef28f-0e9c-4be0-8a74-8a94288527b4-dshm\") pod \"15fef28f-0e9c-4be0-8a74-8a94288527b4\" (UID: \"15fef28f-0e9c-4be0-8a74-8a94288527b4\") "
Jul 30 21:11:31.424313 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:31.424164    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15fef28f-0e9c-4be0-8a74-8a94288527b4-model-cache" (OuterVolumeSpecName: "model-cache") pod "15fef28f-0e9c-4be0-8a74-8a94288527b4" (UID: "15fef28f-0e9c-4be0-8a74-8a94288527b4"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:11:31.424313 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:31.424272    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15fef28f-0e9c-4be0-8a74-8a94288527b4-home" (OuterVolumeSpecName: "home") pod "15fef28f-0e9c-4be0-8a74-8a94288527b4" (UID: "15fef28f-0e9c-4be0-8a74-8a94288527b4"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:11:31.424777 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:31.424350    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15fef28f-0e9c-4be0-8a74-8a94288527b4-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "15fef28f-0e9c-4be0-8a74-8a94288527b4" (UID: "15fef28f-0e9c-4be0-8a74-8a94288527b4"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:11:31.424777 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:31.424390    2583 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/15fef28f-0e9c-4be0-8a74-8a94288527b4-home\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 21:11:31.424777 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:31.424407    2583 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/15fef28f-0e9c-4be0-8a74-8a94288527b4-model-cache\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 21:11:31.426452 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:31.426429    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15fef28f-0e9c-4be0-8a74-8a94288527b4-dshm" (OuterVolumeSpecName: "dshm") pod "15fef28f-0e9c-4be0-8a74-8a94288527b4" (UID: "15fef28f-0e9c-4be0-8a74-8a94288527b4"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:11:31.426452 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:31.426437    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/15fef28f-0e9c-4be0-8a74-8a94288527b4-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "15fef28f-0e9c-4be0-8a74-8a94288527b4" (UID: "15fef28f-0e9c-4be0-8a74-8a94288527b4"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 21:11:31.426569 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:31.426436    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15fef28f-0e9c-4be0-8a74-8a94288527b4-kube-api-access-hc9k8" (OuterVolumeSpecName: "kube-api-access-hc9k8") pod "15fef28f-0e9c-4be0-8a74-8a94288527b4" (UID: "15fef28f-0e9c-4be0-8a74-8a94288527b4"). InnerVolumeSpecName "kube-api-access-hc9k8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 21:11:31.525252 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:31.525228    2583 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/15fef28f-0e9c-4be0-8a74-8a94288527b4-tmp-dir\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 21:11:31.525348 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:31.525256    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hc9k8\" (UniqueName: \"kubernetes.io/projected/15fef28f-0e9c-4be0-8a74-8a94288527b4-kube-api-access-hc9k8\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 21:11:31.525348 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:31.525270    2583 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/15fef28f-0e9c-4be0-8a74-8a94288527b4-dshm\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 21:11:31.525348 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:31.525283    2583 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/15fef28f-0e9c-4be0-8a74-8a94288527b4-tls-certs\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 21:11:31.836806 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:31.836722    2583 generic.go:356] "Generic (PLEG): container finished" podID="15fef28f-0e9c-4be0-8a74-8a94288527b4" containerID="5be072ee379f47189dbee26a8776ca42c29c081d6d0af57699fd9464c7fa7ba9" exitCode=0
Jul 30 21:11:31.836806 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:31.836756    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-3230ac/test-model-3230ac-kserve-c66476c97-khcvj"
Jul 30 21:11:31.836979 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:31.836803    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-3230ac/test-model-3230ac-kserve-c66476c97-khcvj" event={"ID":"15fef28f-0e9c-4be0-8a74-8a94288527b4","Type":"ContainerDied","Data":"5be072ee379f47189dbee26a8776ca42c29c081d6d0af57699fd9464c7fa7ba9"}
Jul 30 21:11:31.836979 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:31.836839    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-3230ac/test-model-3230ac-kserve-c66476c97-khcvj" event={"ID":"15fef28f-0e9c-4be0-8a74-8a94288527b4","Type":"ContainerDied","Data":"9f35252d313ca2b59ab8b1db1869ca04d3c3e60e9c6f9de2322b1b137a0384ec"}
Jul 30 21:11:31.836979 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:31.836856    2583 scope.go:117] "RemoveContainer" containerID="5be072ee379f47189dbee26a8776ca42c29c081d6d0af57699fd9464c7fa7ba9"
Jul 30 21:11:31.846828 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:31.846811    2583 scope.go:117] "RemoveContainer" containerID="5be072ee379f47189dbee26a8776ca42c29c081d6d0af57699fd9464c7fa7ba9"
Jul 30 21:11:31.847094 ip-10-0-142-69 kubenswrapper[2583]: E0730 21:11:31.847077    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5be072ee379f47189dbee26a8776ca42c29c081d6d0af57699fd9464c7fa7ba9\": container with ID starting with 5be072ee379f47189dbee26a8776ca42c29c081d6d0af57699fd9464c7fa7ba9 not found: ID does not exist" containerID="5be072ee379f47189dbee26a8776ca42c29c081d6d0af57699fd9464c7fa7ba9"
Jul 30 21:11:31.847164 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:31.847101    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5be072ee379f47189dbee26a8776ca42c29c081d6d0af57699fd9464c7fa7ba9"} err="failed to get container status \"5be072ee379f47189dbee26a8776ca42c29c081d6d0af57699fd9464c7fa7ba9\": rpc error: code = NotFound desc = could not find container \"5be072ee379f47189dbee26a8776ca42c29c081d6d0af57699fd9464c7fa7ba9\": container with ID starting with 5be072ee379f47189dbee26a8776ca42c29c081d6d0af57699fd9464c7fa7ba9 not found: ID does not exist"
Jul 30 21:11:31.857206 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:31.857183    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-3230ac/test-model-3230ac-kserve-c66476c97-khcvj"]
Jul 30 21:11:31.860237 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:31.860219    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-3230ac/test-model-3230ac-kserve-c66476c97-khcvj"]
Jul 30 21:11:32.675844 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:32.675810    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="15fef28f-0e9c-4be0-8a74-8a94288527b4" path="/var/lib/kubelet/pods/15fef28f-0e9c-4be0-8a74-8a94288527b4/volumes"
Jul 30 21:11:32.676343 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:32.676255    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="82c3df95-ba6c-4908-9702-eccb86c4bea0" path="/var/lib/kubelet/pods/82c3df95-ba6c-4908-9702-eccb86c4bea0/volumes"
Jul 30 21:11:32.969760 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:32.969686    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:11:33.069946 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:33.069916    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:11:33.235981 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:33.235900    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:11:33.480684 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:33.480653    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:11:33.597728 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:33.597658    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-3230ac-sf4r7"]
Jul 30 21:11:33.598010 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:33.597999    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82c3df95-ba6c-4908-9702-eccb86c4bea0" containerName="main"
Jul 30 21:11:33.598055 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:33.598012    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="82c3df95-ba6c-4908-9702-eccb86c4bea0" containerName="main"
Jul 30 21:11:33.598055 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:33.598031    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15fef28f-0e9c-4be0-8a74-8a94288527b4" containerName="main"
Jul 30 21:11:33.598055 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:33.598036    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="15fef28f-0e9c-4be0-8a74-8a94288527b4" containerName="main"
Jul 30 21:11:33.598055 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:33.598043    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31e7762c-f203-47fc-b707-ce5a1cbaeb50" containerName="revoke-keys"
Jul 30 21:11:33.598055 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:33.598048    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="31e7762c-f203-47fc-b707-ce5a1cbaeb50" containerName="revoke-keys"
Jul 30 21:11:33.598229 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:33.598106    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="31e7762c-f203-47fc-b707-ce5a1cbaeb50" containerName="revoke-keys"
Jul 30 21:11:33.598229 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:33.598112    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="15fef28f-0e9c-4be0-8a74-8a94288527b4" containerName="main"
Jul 30 21:11:33.598229 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:33.598119    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="82c3df95-ba6c-4908-9702-eccb86c4bea0" containerName="main"
Jul 30 21:11:33.602550 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:33.602534    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-3230ac-sf4r7"
Jul 30 21:11:33.605554 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:33.605530    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 30 21:11:33.605813 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:33.605771    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zm2hs\""
Jul 30 21:11:33.608112 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:33.608085    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-3230ac-sf4r7"]
Jul 30 21:11:33.742783 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:33.742754    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb3e3bac-7d97-4316-8f38-3a0522da4298-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-3230ac-sf4r7\" (UID: \"bb3e3bac-7d97-4316-8f38-3a0522da4298\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-3230ac-sf4r7"
Jul 30 21:11:33.843374 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:33.843340    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb3e3bac-7d97-4316-8f38-3a0522da4298-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-3230ac-sf4r7\" (UID: \"bb3e3bac-7d97-4316-8f38-3a0522da4298\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-3230ac-sf4r7"
Jul 30 21:11:33.843965 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:33.843945    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb3e3bac-7d97-4316-8f38-3a0522da4298-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-3230ac-sf4r7\" (UID: \"bb3e3bac-7d97-4316-8f38-3a0522da4298\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-3230ac-sf4r7"
Jul 30 21:11:33.915699 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:33.915676    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-3230ac-sf4r7"
Jul 30 21:11:34.047786 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:34.047761    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-3230ac-sf4r7"]
Jul 30 21:11:34.049667 ip-10-0-142-69 kubenswrapper[2583]: W0730 21:11:34.049640    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb3e3bac_7d97_4316_8f38_3a0522da4298.slice/crio-c2a08d10b8702993f963e8e0d8cdf6ecb95e6f3a7c4384713bcbc5df286bbd9f WatchSource:0}: Error finding container c2a08d10b8702993f963e8e0d8cdf6ecb95e6f3a7c4384713bcbc5df286bbd9f: Status 404 returned error can't find the container with id c2a08d10b8702993f963e8e0d8cdf6ecb95e6f3a7c4384713bcbc5df286bbd9f
Jul 30 21:11:34.854461 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:34.854428    2583 generic.go:356] "Generic (PLEG): container finished" podID="bb3e3bac-7d97-4316-8f38-3a0522da4298" containerID="a427c50167d959464f7443f64962568fc488ebc71ad94e818ac8b1adc2e5ed1f" exitCode=0
Jul 30 21:11:34.854779 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:34.854468    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-3230ac-sf4r7" event={"ID":"bb3e3bac-7d97-4316-8f38-3a0522da4298","Type":"ContainerDied","Data":"a427c50167d959464f7443f64962568fc488ebc71ad94e818ac8b1adc2e5ed1f"}
Jul 30 21:11:34.854779 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:34.854512    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-3230ac-sf4r7" event={"ID":"bb3e3bac-7d97-4316-8f38-3a0522da4298","Type":"ContainerStarted","Data":"c2a08d10b8702993f963e8e0d8cdf6ecb95e6f3a7c4384713bcbc5df286bbd9f"}
Jul 30 21:11:35.989368 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:35.989338    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-3230ac-sf4r7"
Jul 30 21:11:36.162461 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:36.162437    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb3e3bac-7d97-4316-8f38-3a0522da4298-maas-api-service-ca\") pod \"bb3e3bac-7d97-4316-8f38-3a0522da4298\" (UID: \"bb3e3bac-7d97-4316-8f38-3a0522da4298\") "
Jul 30 21:11:36.162781 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:36.162758    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bb3e3bac-7d97-4316-8f38-3a0522da4298-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "bb3e3bac-7d97-4316-8f38-3a0522da4298" (UID: "bb3e3bac-7d97-4316-8f38-3a0522da4298"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 21:11:36.263418 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:36.263390    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb3e3bac-7d97-4316-8f38-3a0522da4298-maas-api-service-ca\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 21:11:36.867706 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:36.867671    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-3230ac-sf4r7" event={"ID":"bb3e3bac-7d97-4316-8f38-3a0522da4298","Type":"ContainerDied","Data":"c2a08d10b8702993f963e8e0d8cdf6ecb95e6f3a7c4384713bcbc5df286bbd9f"}
Jul 30 21:11:36.867943 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:36.867759    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c2a08d10b8702993f963e8e0d8cdf6ecb95e6f3a7c4384713bcbc5df286bbd9f"
Jul 30 21:11:36.867943 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:36.867825    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-3230ac-sf4r7"
Jul 30 21:11:44.040391 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:44.040354    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:11:44.100831 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:44.100802    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:11:44.155086 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:44.155054    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:11:44.201381 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:44.201351    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-3230ac-sf4r7"]
Jul 30 21:11:44.203813 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:44.203787    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-3230ac-sf4r7"]
Jul 30 21:11:44.213580 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:44.213559    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:11:44.594728 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:44.594679    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:11:44.675044 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:44.675015    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bb3e3bac-7d97-4316-8f38-3a0522da4298" path="/var/lib/kubelet/pods/bb3e3bac-7d97-4316-8f38-3a0522da4298/volumes"
Jul 30 21:11:46.343002 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:46.342975    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 21:11:50.312360 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:50.312324    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:11:50.372865 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:50.372816    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:11:50.604616 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:50.604530    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:11:50.849949 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:50.849921    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:11:51.196440 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:51.196411    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:11:51.508444 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:51.508350    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:11:51.667389 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:51.667358    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:11:54.865250 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:54.865217    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:11:54.964033 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:54.964000    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:11:56.202658 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:56.202610    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:11:56.319204 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:56.319171    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:11:56.632620 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:56.632550    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:11:56.732533 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:56.732496    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:11:59.052738 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:11:59.052707    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 21:12:19.899114 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:12:19.899077    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:12:20.387180 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:12:20.387128    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:12:20.700237 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:12:20.700209    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:12:20.926171 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:12:20.926119    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:12:24.131355 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:12:24.131322    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:12:24.231160 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:12:24.231118    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:12:25.272696 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:12:25.272659    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:12:25.676615 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:12:25.676574    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:12:25.783591 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:12:25.783563    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:12:25.852613 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:12:25.852578    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:12:28.155123 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:12:28.155091    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 21:12:49.087821 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:12:49.087774    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:12:52.176206 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:12:52.176167    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-c6145d-j6kwj"]
Jul 30 21:12:52.176790 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:12:52.176725    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb3e3bac-7d97-4316-8f38-3a0522da4298" containerName="revoke-keys"
Jul 30 21:12:52.176790 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:12:52.176745    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb3e3bac-7d97-4316-8f38-3a0522da4298" containerName="revoke-keys"
Jul 30 21:12:52.176906 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:12:52.176858    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb3e3bac-7d97-4316-8f38-3a0522da4298" containerName="revoke-keys"
Jul 30 21:12:52.179896 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:12:52.179875    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-c6145d-j6kwj"
Jul 30 21:12:52.181856 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:12:52.181837    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 30 21:12:52.183000 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:12:52.182560    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zm2hs\""
Jul 30 21:12:52.185766 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:12:52.185743    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-c6145d-j6kwj"]
Jul 30 21:12:52.281093 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:12:52.281048    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6c0f00ab-4258-4386-aa3d-f851906f921c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-c6145d-j6kwj\" (UID: \"6c0f00ab-4258-4386-aa3d-f851906f921c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-c6145d-j6kwj"
Jul 30 21:12:52.381790 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:12:52.381752    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6c0f00ab-4258-4386-aa3d-f851906f921c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-c6145d-j6kwj\" (UID: \"6c0f00ab-4258-4386-aa3d-f851906f921c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-c6145d-j6kwj"
Jul 30 21:12:52.382465 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:12:52.382444    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6c0f00ab-4258-4386-aa3d-f851906f921c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-c6145d-j6kwj\" (UID: \"6c0f00ab-4258-4386-aa3d-f851906f921c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-c6145d-j6kwj"
Jul 30 21:12:52.492751 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:12:52.492666    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-c6145d-j6kwj"
Jul 30 21:12:52.638613 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:12:52.638587    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-c6145d-j6kwj"]
Jul 30 21:12:52.640792 ip-10-0-142-69 kubenswrapper[2583]: W0730 21:12:52.640759    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c0f00ab_4258_4386_aa3d_f851906f921c.slice/crio-77adb68fcbdc09443c036089dcdf1ac5849edea0e78578b1aa593070f8d0969a WatchSource:0}: Error finding container 77adb68fcbdc09443c036089dcdf1ac5849edea0e78578b1aa593070f8d0969a: Status 404 returned error can't find the container with id 77adb68fcbdc09443c036089dcdf1ac5849edea0e78578b1aa593070f8d0969a
Jul 30 21:12:53.292861 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:12:53.292819    2583 generic.go:356] "Generic (PLEG): container finished" podID="6c0f00ab-4258-4386-aa3d-f851906f921c" containerID="9bfc0b8f23537a0a1948e55eda8098d619a4f23078b00b79f636ec8bc3462f24" exitCode=0
Jul 30 21:12:53.293239 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:12:53.292905    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-c6145d-j6kwj" event={"ID":"6c0f00ab-4258-4386-aa3d-f851906f921c","Type":"ContainerDied","Data":"9bfc0b8f23537a0a1948e55eda8098d619a4f23078b00b79f636ec8bc3462f24"}
Jul 30 21:12:53.293239 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:12:53.292957    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-c6145d-j6kwj" event={"ID":"6c0f00ab-4258-4386-aa3d-f851906f921c","Type":"ContainerStarted","Data":"77adb68fcbdc09443c036089dcdf1ac5849edea0e78578b1aa593070f8d0969a"}
Jul 30 21:12:54.440320 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:12:54.440292    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-c6145d-j6kwj"
Jul 30 21:12:54.500107 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:12:54.500070    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6c0f00ab-4258-4386-aa3d-f851906f921c-maas-api-service-ca\") pod \"6c0f00ab-4258-4386-aa3d-f851906f921c\" (UID: \"6c0f00ab-4258-4386-aa3d-f851906f921c\") "
Jul 30 21:12:54.500470 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:12:54.500446    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6c0f00ab-4258-4386-aa3d-f851906f921c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "6c0f00ab-4258-4386-aa3d-f851906f921c" (UID: "6c0f00ab-4258-4386-aa3d-f851906f921c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 21:12:54.601546 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:12:54.601449    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6c0f00ab-4258-4386-aa3d-f851906f921c-maas-api-service-ca\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 21:12:55.307340 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:12:55.307313    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-c6145d-j6kwj"
Jul 30 21:12:55.307578 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:12:55.307355    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-c6145d-j6kwj" event={"ID":"6c0f00ab-4258-4386-aa3d-f851906f921c","Type":"ContainerDied","Data":"77adb68fcbdc09443c036089dcdf1ac5849edea0e78578b1aa593070f8d0969a"}
Jul 30 21:12:55.307578 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:12:55.307407    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="77adb68fcbdc09443c036089dcdf1ac5849edea0e78578b1aa593070f8d0969a"
Jul 30 21:13:06.558774 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:13:06.558726    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:13:07.604422 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:13:07.604373    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:13:07.675351 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:13:07.675320    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:13:07.740278 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:13:07.740240    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:13:07.767603 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:13:07.767564    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-c6145d-j6kwj"]
Jul 30 21:13:07.769748 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:13:07.769723    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-c6145d-j6kwj"]
Jul 30 21:13:07.841247 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:13:07.841219    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:13:08.144732 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:13:08.144703    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:13:08.675614 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:13:08.675580    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6c0f00ab-4258-4386-aa3d-f851906f921c" path="/var/lib/kubelet/pods/6c0f00ab-4258-4386-aa3d-f851906f921c/volumes"
Jul 30 21:13:10.248077 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:13:10.248041    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 21:13:13.892009 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:13:13.891971    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:13:13.954806 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:13:13.954770    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:13:14.169537 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:13:14.169496    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:13:14.389637 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:13:14.389603    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:13:16.801870 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:13:16.801835    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:13:16.855297 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:13:16.855265    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:13:29.977506 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:13:29.977470    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:13:30.084332 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:13:30.084299    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:13:30.145026 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:13:30.144991    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:13:30.561322 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:13:30.561293    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:13:32.051697 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:13:32.051661    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 21:13:36.180943 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:13:36.180910    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:13:36.280270 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:13:36.280234    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:13:36.465862 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:13:36.465779    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:13:36.707276 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:13:36.707231    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:13:37.054078 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:13:37.054013    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:13:37.395877 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:13:37.395789    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:13:37.638787 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:13:37.638755    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:13:38.944579 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:13:38.944544    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:13:40.425585 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:13:40.425548    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:13:40.525790 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:13:40.525747    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:13:41.679522 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:13:41.679482    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:13:42.200853 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:13:42.200817    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:13:42.273674 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:13:42.273640    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:13:44.554161 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:13:44.554106    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 21:14:05.460203 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:14:05.460134    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:14:05.806883 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:14:05.806791    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:14:06.112515 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:14:06.112437    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:14:06.360696 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:14:06.360663    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:14:08.609215 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:14:08.609178    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:14:08.708195 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:14:08.708162    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:14:09.782165 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:14:09.782065    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:14:10.069777 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:14:10.069694    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:14:10.252463 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:14:10.252432    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:14:10.347329 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:14:10.347233    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:14:12.348681 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:14:12.348650    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 21:14:33.664829 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:14:33.664797    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:14:39.744886 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:14:39.744852    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-155c1d/auth-test-model-155c1d-kserve-5d4f776955-mczcr"]
Jul 30 21:14:39.745354 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:14:39.745266    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c0f00ab-4258-4386-aa3d-f851906f921c" containerName="revoke-keys"
Jul 30 21:14:39.745354 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:14:39.745280    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c0f00ab-4258-4386-aa3d-f851906f921c" containerName="revoke-keys"
Jul 30 21:14:39.745354 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:14:39.745345    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c0f00ab-4258-4386-aa3d-f851906f921c" containerName="revoke-keys"
Jul 30 21:14:39.748413 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:14:39.748397    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-155c1d/auth-test-model-155c1d-kserve-5d4f776955-mczcr"
Jul 30 21:14:39.750609 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:14:39.750588    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-155c1d\"/\"kube-root-ca.crt\""
Jul 30 21:14:39.751112 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:14:39.751092    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-155c1d\"/\"default-dockercfg-7b7vq\""
Jul 30 21:14:39.751213 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:14:39.751101    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-155c1d\"/\"openshift-service-ca.crt\""
Jul 30 21:14:39.751270 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:14:39.751242    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-155c1d\"/\"auth-test-model-155c1d-kserve-self-signed-certs\""
Jul 30 21:14:39.757464 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:14:39.757441    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-155c1d/auth-test-model-155c1d-kserve-5d4f776955-mczcr"]
Jul 30 21:14:39.769269 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:14:39.769241    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:14:39.809420 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:14:39.809377    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0d4a43c1-c9a1-4543-b489-14208bfcd87e-dshm\") pod \"auth-test-model-155c1d-kserve-5d4f776955-mczcr\" (UID: \"0d4a43c1-c9a1-4543-b489-14208bfcd87e\") " pod="ai-tenant-e2e-shared-a-155c1d/auth-test-model-155c1d-kserve-5d4f776955-mczcr"
Jul 30 21:14:39.809420 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:14:39.809419    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0d4a43c1-c9a1-4543-b489-14208bfcd87e-tls-certs\") pod \"auth-test-model-155c1d-kserve-5d4f776955-mczcr\" (UID: \"0d4a43c1-c9a1-4543-b489-14208bfcd87e\") " pod="ai-tenant-e2e-shared-a-155c1d/auth-test-model-155c1d-kserve-5d4f776955-mczcr"
Jul 30 21:14:39.809636 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:14:39.809441    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvj97\" (UniqueName: \"kubernetes.io/projected/0d4a43c1-c9a1-4543-b489-14208bfcd87e-kube-api-access-xvj97\") pod \"auth-test-model-155c1d-kserve-5d4f776955-mczcr\" (UID: \"0d4a43c1-c9a1-4543-b489-14208bfcd87e\") " pod="ai-tenant-e2e-shared-a-155c1d/auth-test-model-155c1d-kserve-5d4f776955-mczcr"
Jul 30 21:14:39.809636 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:14:39.809508    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0d4a43c1-c9a1-4543-b489-14208bfcd87e-tmp-dir\") pod \"auth-test-model-155c1d-kserve-5d4f776955-mczcr\" (UID: \"0d4a43c1-c9a1-4543-b489-14208bfcd87e\") " pod="ai-tenant-e2e-shared-a-155c1d/auth-test-model-155c1d-kserve-5d4f776955-mczcr"
Jul 30 21:14:39.809636 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:14:39.809570    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0d4a43c1-c9a1-4543-b489-14208bfcd87e-home\") pod \"auth-test-model-155c1d-kserve-5d4f776955-mczcr\" (UID: \"0d4a43c1-c9a1-4543-b489-14208bfcd87e\") " pod="ai-tenant-e2e-shared-a-155c1d/auth-test-model-155c1d-kserve-5d4f776955-mczcr"
Jul 30 21:14:39.809731 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:14:39.809650    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0d4a43c1-c9a1-4543-b489-14208bfcd87e-model-cache\") pod \"auth-test-model-155c1d-kserve-5d4f776955-mczcr\" (UID: \"0d4a43c1-c9a1-4543-b489-14208bfcd87e\") " pod="ai-tenant-e2e-shared-a-155c1d/auth-test-model-155c1d-kserve-5d4f776955-mczcr"
Jul 30 21:14:39.910066 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:14:39.910028    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0d4a43c1-c9a1-4543-b489-14208bfcd87e-home\") pod \"auth-test-model-155c1d-kserve-5d4f776955-mczcr\" (UID: \"0d4a43c1-c9a1-4543-b489-14208bfcd87e\") " pod="ai-tenant-e2e-shared-a-155c1d/auth-test-model-155c1d-kserve-5d4f776955-mczcr"
Jul 30 21:14:39.910306 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:14:39.910101    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0d4a43c1-c9a1-4543-b489-14208bfcd87e-model-cache\") pod \"auth-test-model-155c1d-kserve-5d4f776955-mczcr\" (UID: \"0d4a43c1-c9a1-4543-b489-14208bfcd87e\") " pod="ai-tenant-e2e-shared-a-155c1d/auth-test-model-155c1d-kserve-5d4f776955-mczcr"
Jul 30 21:14:39.910306 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:14:39.910129    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0d4a43c1-c9a1-4543-b489-14208bfcd87e-dshm\") pod \"auth-test-model-155c1d-kserve-5d4f776955-mczcr\" (UID: \"0d4a43c1-c9a1-4543-b489-14208bfcd87e\") " pod="ai-tenant-e2e-shared-a-155c1d/auth-test-model-155c1d-kserve-5d4f776955-mczcr"
Jul 30 21:14:39.910306 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:14:39.910162    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0d4a43c1-c9a1-4543-b489-14208bfcd87e-tls-certs\") pod \"auth-test-model-155c1d-kserve-5d4f776955-mczcr\" (UID: \"0d4a43c1-c9a1-4543-b489-14208bfcd87e\") " pod="ai-tenant-e2e-shared-a-155c1d/auth-test-model-155c1d-kserve-5d4f776955-mczcr"
Jul 30 21:14:39.910306 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:14:39.910178    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvj97\" (UniqueName: \"kubernetes.io/projected/0d4a43c1-c9a1-4543-b489-14208bfcd87e-kube-api-access-xvj97\") pod \"auth-test-model-155c1d-kserve-5d4f776955-mczcr\" (UID: \"0d4a43c1-c9a1-4543-b489-14208bfcd87e\") " pod="ai-tenant-e2e-shared-a-155c1d/auth-test-model-155c1d-kserve-5d4f776955-mczcr"
Jul 30 21:14:39.910306 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:14:39.910199    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0d4a43c1-c9a1-4543-b489-14208bfcd87e-tmp-dir\") pod \"auth-test-model-155c1d-kserve-5d4f776955-mczcr\" (UID: \"0d4a43c1-c9a1-4543-b489-14208bfcd87e\") " pod="ai-tenant-e2e-shared-a-155c1d/auth-test-model-155c1d-kserve-5d4f776955-mczcr"
Jul 30 21:14:39.910644 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:14:39.910546    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0d4a43c1-c9a1-4543-b489-14208bfcd87e-home\") pod \"auth-test-model-155c1d-kserve-5d4f776955-mczcr\" (UID: \"0d4a43c1-c9a1-4543-b489-14208bfcd87e\") " pod="ai-tenant-e2e-shared-a-155c1d/auth-test-model-155c1d-kserve-5d4f776955-mczcr"
Jul 30 21:14:39.910644 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:14:39.910570    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0d4a43c1-c9a1-4543-b489-14208bfcd87e-tmp-dir\") pod \"auth-test-model-155c1d-kserve-5d4f776955-mczcr\" (UID: \"0d4a43c1-c9a1-4543-b489-14208bfcd87e\") " pod="ai-tenant-e2e-shared-a-155c1d/auth-test-model-155c1d-kserve-5d4f776955-mczcr"
Jul 30 21:14:39.910644 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:14:39.910606    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0d4a43c1-c9a1-4543-b489-14208bfcd87e-model-cache\") pod \"auth-test-model-155c1d-kserve-5d4f776955-mczcr\" (UID: \"0d4a43c1-c9a1-4543-b489-14208bfcd87e\") " pod="ai-tenant-e2e-shared-a-155c1d/auth-test-model-155c1d-kserve-5d4f776955-mczcr"
Jul 30 21:14:39.912679 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:14:39.912645    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0d4a43c1-c9a1-4543-b489-14208bfcd87e-dshm\") pod \"auth-test-model-155c1d-kserve-5d4f776955-mczcr\" (UID: \"0d4a43c1-c9a1-4543-b489-14208bfcd87e\") " pod="ai-tenant-e2e-shared-a-155c1d/auth-test-model-155c1d-kserve-5d4f776955-mczcr"
Jul 30 21:14:39.912865 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:14:39.912851    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0d4a43c1-c9a1-4543-b489-14208bfcd87e-tls-certs\") pod \"auth-test-model-155c1d-kserve-5d4f776955-mczcr\" (UID: \"0d4a43c1-c9a1-4543-b489-14208bfcd87e\") " pod="ai-tenant-e2e-shared-a-155c1d/auth-test-model-155c1d-kserve-5d4f776955-mczcr"
Jul 30 21:14:39.917637 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:14:39.917603    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvj97\" (UniqueName: \"kubernetes.io/projected/0d4a43c1-c9a1-4543-b489-14208bfcd87e-kube-api-access-xvj97\") pod \"auth-test-model-155c1d-kserve-5d4f776955-mczcr\" (UID: \"0d4a43c1-c9a1-4543-b489-14208bfcd87e\") " pod="ai-tenant-e2e-shared-a-155c1d/auth-test-model-155c1d-kserve-5d4f776955-mczcr"
Jul 30 21:14:40.058608 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:14:40.058517    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-155c1d/auth-test-model-155c1d-kserve-5d4f776955-mczcr"
Jul 30 21:14:40.196609 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:14:40.196582    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-155c1d/auth-test-model-155c1d-kserve-5d4f776955-mczcr"]
Jul 30 21:14:40.199510 ip-10-0-142-69 kubenswrapper[2583]: W0730 21:14:40.199483    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0d4a43c1_c9a1_4543_b489_14208bfcd87e.slice/crio-b9824ec782e6289f8acf495cfe01f7600458e4887a026ea1c327d514a97e85dc WatchSource:0}: Error finding container b9824ec782e6289f8acf495cfe01f7600458e4887a026ea1c327d514a97e85dc: Status 404 returned error can't find the container with id b9824ec782e6289f8acf495cfe01f7600458e4887a026ea1c327d514a97e85dc
Jul 30 21:14:40.896696 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:14:40.896661    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-155c1d/auth-test-model-155c1d-kserve-5d4f776955-mczcr" event={"ID":"0d4a43c1-c9a1-4543-b489-14208bfcd87e","Type":"ContainerStarted","Data":"cf0247c220981f4bcdd0d61df6e49595403c00b7d14fb2bc5bbe96c1753e16e5"}
Jul 30 21:14:40.896696 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:14:40.896701    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-155c1d/auth-test-model-155c1d-kserve-5d4f776955-mczcr" event={"ID":"0d4a43c1-c9a1-4543-b489-14208bfcd87e","Type":"ContainerStarted","Data":"b9824ec782e6289f8acf495cfe01f7600458e4887a026ea1c327d514a97e85dc"}
Jul 30 21:14:40.915379 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:14:40.915322    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-155c1d/auth-test-model-155c1d-kserve-5d4f776955-mczcr" podStartSLOduration=1.915307506 podStartE2EDuration="1.915307506s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 21:14:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 21:14:40.912702589 +0000 UTC m=+2992.754178209" watchObservedRunningTime="2026-07-30 21:14:40.915307506 +0000 UTC m=+2992.756783129"
Jul 30 21:14:42.244446 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:14:42.244409    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 21:14:50.059689 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:14:50.059649    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-155c1d/auth-test-model-155c1d-kserve-5d4f776955-mczcr"
Jul 30 21:14:50.060083 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:14:50.059759    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-155c1d/auth-test-model-155c1d-kserve-5d4f776955-mczcr"
Jul 30 21:14:50.072264 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:14:50.072242    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-155c1d/auth-test-model-155c1d-kserve-5d4f776955-mczcr"
Jul 30 21:14:50.960548 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:14:50.960520    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-155c1d/auth-test-model-155c1d-kserve-5d4f776955-mczcr"
Jul 30 21:15:00.137921 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:15:00.137893    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29757435-76j8z"]
Jul 30 21:15:00.141234 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:15:00.141218    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-01bc1b-29757435-mllkr"]
Jul 30 21:15:00.141385 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:15:00.141363    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757435-76j8z"
Jul 30 21:15:00.143357 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:15:00.143337    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zm2hs\""
Jul 30 21:15:00.144260 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:15:00.144239    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-155c1d-29757435-klbvl"]
Jul 30 21:15:00.144799 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:15:00.144776    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-01bc1b-29757435-mllkr"
Jul 30 21:15:00.148321 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:15:00.148229    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29757435-76j8z"]
Jul 30 21:15:00.148321 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:15:00.148319    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-155c1d-29757435-klbvl"
Jul 30 21:15:00.150651 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:15:00.150631    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-155c1d-29757435-klbvl"]
Jul 30 21:15:00.155890 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:15:00.155872    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757435-76j8z"
Jul 30 21:15:00.162996 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:15:00.162972    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-01bc1b-29757435-mllkr"]
Jul 30 21:15:00.168096 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:15:00.168074    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-01bc1b-29757435-mllkr"
Jul 30 21:15:00.204604 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:15:00.204573    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-155c1d-29757435-klbvl"
Jul 30 21:15:00.323914 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:15:00.323677    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29757435-76j8z"]
Jul 30 21:15:00.382861 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:15:00.382834    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-155c1d-29757435-klbvl"]
Jul 30 21:15:00.383857 ip-10-0-142-69 kubenswrapper[2583]: W0730 21:15:00.383835    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa7818dc_2b8c_4cae_bc85_e5e625683d2c.slice/crio-c9c2a843b9015fbf6c7152b4fd3cdfcb04dfb88973b8b1471ab0912972169de2 WatchSource:0}: Error finding container c9c2a843b9015fbf6c7152b4fd3cdfcb04dfb88973b8b1471ab0912972169de2: Status 404 returned error can't find the container with id c9c2a843b9015fbf6c7152b4fd3cdfcb04dfb88973b8b1471ab0912972169de2
Jul 30 21:15:00.551914 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:15:00.551887    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-01bc1b-29757435-mllkr"]
Jul 30 21:15:00.553285 ip-10-0-142-69 kubenswrapper[2583]: W0730 21:15:00.553258    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded44b979_46b3_424d_8b53_f25c58b5a1b1.slice/crio-9d4ce617e34961cfe34d007013ebc9613acaef631aedd8728888e06d2bfe6b45 WatchSource:0}: Error finding container 9d4ce617e34961cfe34d007013ebc9613acaef631aedd8728888e06d2bfe6b45: Status 404 returned error can't find the container with id 9d4ce617e34961cfe34d007013ebc9613acaef631aedd8728888e06d2bfe6b45
Jul 30 21:15:01.003532 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:15:01.002910    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-155c1d-29757435-klbvl" event={"ID":"aa7818dc-2b8c-4cae-bc85-e5e625683d2c","Type":"ContainerStarted","Data":"c8c355871cc2b6c097272bc5fcf3d92934683cf64f52cba6b8694fa795c0f5fd"}
Jul 30 21:15:01.003532 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:15:01.002977    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-155c1d-29757435-klbvl" event={"ID":"aa7818dc-2b8c-4cae-bc85-e5e625683d2c","Type":"ContainerStarted","Data":"c9c2a843b9015fbf6c7152b4fd3cdfcb04dfb88973b8b1471ab0912972169de2"}
Jul 30 21:15:01.004783 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:15:01.004748    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757435-76j8z" event={"ID":"0f9ef2d5-e7a0-43e3-9a07-707eda0bbbbf","Type":"ContainerStarted","Data":"68b0a031dcf0d491f403014b729b846b3c75a0ca15ce7124d6b64ea420a4391a"}
Jul 30 21:15:01.005015 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:15:01.004806    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757435-76j8z" event={"ID":"0f9ef2d5-e7a0-43e3-9a07-707eda0bbbbf","Type":"ContainerStarted","Data":"f0f4435ea4110d68873ead431d11dca86f34cc8c6e7a20d8072dbdf7151044d6"}
Jul 30 21:15:01.006490 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:15:01.006461    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-01bc1b-29757435-mllkr" event={"ID":"ed44b979-46b3-424d-8b53-f25c58b5a1b1","Type":"ContainerStarted","Data":"9e352622cb281921613e3a60de94f37180e622034075ae557ea441738f5b8df3"}
Jul 30 21:15:01.006607 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:15:01.006525    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-01bc1b-29757435-mllkr" event={"ID":"ed44b979-46b3-424d-8b53-f25c58b5a1b1","Type":"ContainerStarted","Data":"9d4ce617e34961cfe34d007013ebc9613acaef631aedd8728888e06d2bfe6b45"}
Jul 30 21:15:01.018616 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:15:01.018576    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-155c1d-29757435-klbvl" podStartSLOduration=1.018563145 podStartE2EDuration="1.018563145s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 21:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 21:15:01.016487991 +0000 UTC m=+3012.857963612" watchObservedRunningTime="2026-07-30 21:15:01.018563145 +0000 UTC m=+3012.860038766"
Jul 30 21:15:01.028745 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:15:01.028677    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757435-76j8z" podStartSLOduration=1.028665142 podStartE2EDuration="1.028665142s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 21:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 21:15:01.028213754 +0000 UTC m=+3012.869689375" watchObservedRunningTime="2026-07-30 21:15:01.028665142 +0000 UTC m=+3012.870140763"
Jul 30 21:15:01.042134 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:15:01.042100    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-01bc1b-29757435-mllkr" podStartSLOduration=1.042090404 podStartE2EDuration="1.042090404s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 21:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 21:15:01.040028641 +0000 UTC m=+3012.881504263" watchObservedRunningTime="2026-07-30 21:15:01.042090404 +0000 UTC m=+3012.883566025"
Jul 30 21:15:02.013077 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:15:02.013042    2583 generic.go:356] "Generic (PLEG): container finished" podID="aa7818dc-2b8c-4cae-bc85-e5e625683d2c" containerID="c8c355871cc2b6c097272bc5fcf3d92934683cf64f52cba6b8694fa795c0f5fd" exitCode=0
Jul 30 21:15:02.013523 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:15:02.013114    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-155c1d-29757435-klbvl" event={"ID":"aa7818dc-2b8c-4cae-bc85-e5e625683d2c","Type":"ContainerDied","Data":"c8c355871cc2b6c097272bc5fcf3d92934683cf64f52cba6b8694fa795c0f5fd"}
Jul 30 21:15:02.014598 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:15:02.014572    2583 generic.go:356] "Generic (PLEG): container finished" podID="0f9ef2d5-e7a0-43e3-9a07-707eda0bbbbf" containerID="68b0a031dcf0d491f403014b729b846b3c75a0ca15ce7124d6b64ea420a4391a" exitCode=0
Jul 30 21:15:02.014711 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:15:02.014659    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757435-76j8z" event={"ID":"0f9ef2d5-e7a0-43e3-9a07-707eda0bbbbf","Type":"ContainerDied","Data":"68b0a031dcf0d491f403014b729b846b3c75a0ca15ce7124d6b64ea420a4391a"}
Jul 30 21:15:02.016028 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:15:02.016000    2583 generic.go:356] "Generic (PLEG): container finished" podID="ed44b979-46b3-424d-8b53-f25c58b5a1b1" containerID="9e352622cb281921613e3a60de94f37180e622034075ae557ea441738f5b8df3" exitCode=0
Jul 30 21:15:02.016124 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:15:02.016044    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-01bc1b-29757435-mllkr" event={"ID":"ed44b979-46b3-424d-8b53-f25c58b5a1b1","Type":"ContainerDied","Data":"9e352622cb281921613e3a60de94f37180e622034075ae557ea441738f5b8df3"}
Jul 30 21:15:02.447950 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:15:02.447914    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-01bc1b/auth-test-model-01bc1b-kserve-7ccf49fc67-28rc2"]
Jul 30 21:15:02.451662 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:15:02.451644    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-01bc1b/auth-test-model-01bc1b-kserve-7ccf49fc67-28rc2"
Jul 30 21:15:02.453785 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:15:02.453753    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-01bc1b\"/\"openshift-service-ca.crt\""
Jul 30 21:15:02.453785 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:15:02.453781    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-01bc1b\"/\"kube-root-ca.crt\""
Jul 30 21:15:02.454388 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:15:02.454374    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-01bc1b\"/\"default-dockercfg-b6qdq\""
Jul 30 21:15:02.454449 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:15:02.454430    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-01bc1b\"/\"auth-test-model-01bc1b-kserve-self-signed-certs\""
Jul 30 21:15:02.459106 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:15:02.459075    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-01bc1b/auth-test-model-01bc1b-kserve-7ccf49fc67-28rc2"]
Jul 30 21:15:02.477662 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:15:02.477636    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:15:02.490810 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:15:02.490792    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ec4b7e13-62fb-4990-be1e-0102d3a2a885-home\") pod \"auth-test-model-01bc1b-kserve-7ccf49fc67-28rc2\" (UID: \"ec4b7e13-62fb-4990-be1e-0102d3a2a885\") " pod="ai-tenant-e2e-shared-b-01bc1b/auth-test-model-01bc1b-kserve-7ccf49fc67-28rc2"
Jul 30 21:15:02.490879 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:15:02.490819    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2j2v4\" (UniqueName: \"kubernetes.io/projected/ec4b7e13-62fb-4990-be1e-0102d3a2a885-kube-api-access-2j2v4\") pod \"auth-test-model-01bc1b-kserve-7ccf49fc67-28rc2\" (UID: \"ec4b7e13-62fb-4990-be1e-0102d3a2a885\") " pod="ai-tenant-e2e-shared-b-01bc1b/auth-test-model-01bc1b-kserve-7ccf49fc67-28rc2"
Jul 30 21:15:02.490931 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:15:02.490915    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ec4b7e13-62fb-4990-be1e-0102d3a2a885-model-cache\") pod \"auth-test-model-01bc1b-kserve-7ccf49fc67-28rc2\" (UID: \"ec4b7e13-62fb-4990-be1e-0102d3a2a885\") " pod="ai-tenant-e2e-shared-b-01bc1b/auth-test-model-01bc1b-kserve-7ccf49fc67-28rc2"
Jul 30 21:15:02.490999 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:15:02.490982    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ec4b7e13-62fb-4990-be1e-0102d3a2a885-tmp-dir\") pod \"auth-test-model-01bc1b-kserve-7ccf49fc67-28rc2\" (UID: \"ec4b7e13-62fb-4990-be1e-0102d3a2a885\") " pod="ai-tenant-e2e-shared-b-01bc1b/auth-test-model-01bc1b-kserve-7ccf49fc67-28rc2"
Jul 30 21:15:02.491035 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:15:02.491008    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ec4b7e13-62fb-4990-be1e-0102d3a2a885-dshm\") pod \"auth-test-model-01bc1b-kserve-7ccf49fc67-28rc2\" (UID: \"ec4b7e13-62fb-4990-be1e-0102d3a2a885\") " pod="ai-tenant-e2e-shared-b-01bc1b/auth-test-model-01bc1b-kserve-7ccf49fc67-28rc2"
Jul 30 21:15:02.491035 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:15:02.491025    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ec4b7e13-62fb-4990-be1e-0102d3a2a885-tls-certs\") pod \"auth-test-model-01bc1b-kserve-7ccf49fc67-28rc2\" (UID: \"ec4b7e13-62fb-4990-be1e-0102d3a2a885\") " pod="ai-tenant-e2e-shared-b-01bc1b/auth-test-model-01bc1b-kserve-7ccf49fc67-28rc2"
Jul 30 21:15:02.591935 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:15:02.591901    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ec4b7e13-62fb-4990-be1e-0102d3a2a885-home\") pod \"auth-test-model-01bc1b-kserve-7ccf49fc67-28rc2\" (UID: \"ec4b7e13-62fb-4990-be1e-0102d3a2a885\") " pod="ai-tenant-e2e-shared-b-01bc1b/auth-test-model-01bc1b-kserve-7ccf49fc67-28rc2"
Jul 30 21:15:02.591935 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:15:02.591938    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2j2v4\" (UniqueName: \"kubernetes.io/projected/ec4b7e13-62fb-4990-be1e-0102d3a2a885-kube-api-access-2j2v4\") pod \"auth-test-model-01bc1b-kserve-7ccf49fc67-28rc2\" (UID: \"ec4b7e13-62fb-4990-be1e-0102d3a2a885\") " pod="ai-tenant-e2e-shared-b-01bc1b/auth-test-model-01bc1b-kserve-7ccf49fc67-28rc2"
Jul 30 21:15:02.592129 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:15:02.592018    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ec4b7e13-62fb-4990-be1e-0102d3a2a885-model-cache\") pod \"auth-test-model-01bc1b-kserve-7ccf49fc67-28rc2\" (UID: \"ec4b7e13-62fb-4990-be1e-0102d3a2a885\") " pod="ai-tenant-e2e-shared-b-01bc1b/auth-test-model-01bc1b-kserve-7ccf49fc67-28rc2"
Jul 30 21:15:02.592129 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:15:02.592057    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ec4b7e13-62fb-4990-be1e-0102d3a2a885-tmp-dir\") pod \"auth-test-model-01bc1b-kserve-7ccf49fc67-28rc2\" (UID: \"ec4b7e13-62fb-4990-be1e-0102d3a2a885\") " pod="ai-tenant-e2e-shared-b-01bc1b/auth-test-model-01bc1b-kserve-7ccf49fc67-28rc2"
Jul 30 21:15:02.592129 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:15:02.592079    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ec4b7e13-62fb-4990-be1e-0102d3a2a885-dshm\") pod \"auth-test-model-01bc1b-kserve-7ccf49fc67-28rc2\" (UID: \"ec4b7e13-62fb-4990-be1e-0102d3a2a885\") " pod="ai-tenant-e2e-shared-b-01bc1b/auth-test-model-01bc1b-kserve-7ccf49fc67-28rc2"
Jul 30 21:15:02.592129 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:15:02.592098    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ec4b7e13-62fb-4990-be1e-0102d3a2a885-tls-certs\") pod \"auth-test-model-01bc1b-kserve-7ccf49fc67-28rc2\" (UID: \"ec4b7e13-62fb-4990-be1e-0102d3a2a885\") " pod="ai-tenant-e2e-shared-b-01bc1b/auth-test-model-01bc1b-kserve-7ccf49fc67-28rc2"
Jul 30 21:15:02.592391 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:15:02.592369    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ec4b7e13-62fb-4990-be1e-0102d3a2a885-home\") pod \"auth-test-model-01bc1b-kserve-7ccf49fc67-28rc2\" (UID: \"ec4b7e13-62fb-4990-be1e-0102d3a2a885\") " pod="ai-tenant-e2e-shared-b-01bc1b/auth-test-model-01bc1b-kserve-7ccf49fc67-28rc2"
Jul 30 21:15:02.592493 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:15:02.592473    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ec4b7e13-62fb-4990-be1e-0102d3a2a885-tmp-dir\") pod \"auth-test-model-01bc1b-kserve-7ccf49fc67-28rc2\" (UID: \"ec4b7e13-62fb-4990-be1e-0102d3a2a885\") " pod="ai-tenant-e2e-shared-b-01bc1b/auth-test-model-01bc1b-kserve-7ccf49fc67-28rc2"
Jul 30 21:15:02.592541 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:15:02.592516    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ec4b7e13-62fb-4990-be1e-0102d3a2a885-model-cache\") pod \"auth-test-model-01bc1b-kserve-7ccf49fc67-28rc2\" (UID: \"ec4b7e13-62fb-4990-be1e-0102d3a2a885\") " pod="ai-tenant-e2e-shared-b-01bc1b/auth-test-model-01bc1b-kserve-7ccf49fc67-28rc2"
Jul 30 21:15:02.594316 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:15:02.594277    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ec4b7e13-62fb-4990-be1e-0102d3a2a885-dshm\") pod \"auth-test-model-01bc1b-kserve-7ccf49fc67-28rc2\" (UID: \"ec4b7e13-62fb-4990-be1e-0102d3a2a885\") " pod="ai-tenant-e2e-shared-b-01bc1b/auth-test-model-01bc1b-kserve-7ccf49fc67-28rc2"
Jul 30 21:15:02.594573 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:15:02.594557    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ec4b7e13-62fb-4990-be1e-0102d3a2a885-tls-certs\") pod \"auth-test-model-01bc1b-kserve-7ccf49fc67-28rc2\" (UID: \"ec4b7e13-62fb-4990-be1e-0102d3a2a885\") " pod="ai-tenant-e2e-shared-b-01bc1b/auth-test-model-01bc1b-kserve-7ccf49fc67-28rc2"
Jul 30 21:15:02.599234 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:15:02.599209    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2j2v4\" (UniqueName: \"kubernetes.io/projected/ec4b7e13-62fb-4990-be1e-0102d3a2a885-kube-api-access-2j2v4\") pod \"auth-test-model-01bc1b-kserve-7ccf49fc67-28rc2\" (UID: \"ec4b7e13-62fb-4990-be1e-0102d3a2a885\") " pod="ai-tenant-e2e-shared-b-01bc1b/auth-test-model-01bc1b-kserve-7ccf49fc67-28rc2"
Jul 30 21:15:02.762631 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:15:02.762528    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-01bc1b/auth-test-model-01bc1b-kserve-7ccf49fc67-28rc2"
Jul 30 21:15:02.898705 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:15:02.898676    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-01bc1b/auth-test-model-01bc1b-kserve-7ccf49fc67-28rc2"]
Jul 30 21:15:02.900812 ip-10-0-142-69 kubenswrapper[2583]: W0730 21:15:02.900778    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podec4b7e13_62fb_4990_be1e_0102d3a2a885.slice/crio-d506ec2b15b3b5818b37c9cce8f2c110c3d0875fcde6e7df85157d0d3a84f87d WatchSource:0}: Error finding container d506ec2b15b3b5818b37c9cce8f2c110c3d0875fcde6e7df85157d0d3a84f87d: Status 404 returned error can't find the container with id d506ec2b15b3b5818b37c9cce8f2c110c3d0875fcde6e7df85157d0d3a84f87d
Jul 30 21:15:03.024152 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:15:03.024055    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-01bc1b/auth-test-model-01bc1b-kserve-7ccf49fc67-28rc2" event={"ID":"ec4b7e13-62fb-4990-be1e-0102d3a2a885","Type":"ContainerStarted","Data":"29b665803820f30657b05387b9976b3bfc3714d469d4918f22cccf091963f1b9"}
Jul 30 21:15:03.024152 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:15:03.024104    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-01bc1b/auth-test-model-01bc1b-kserve-7ccf49fc67-28rc2" event={"ID":"ec4b7e13-62fb-4990-be1e-0102d3a2a885","Type":"ContainerStarted","Data":"d506ec2b15b3b5818b37c9cce8f2c110c3d0875fcde6e7df85157d0d3a84f87d"}
Jul 30 21:15:03.040365 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:15:03.040273    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-01bc1b/auth-test-model-01bc1b-kserve-7ccf49fc67-28rc2" podStartSLOduration=1.040256524 podStartE2EDuration="1.040256524s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 21:15:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 21:15:03.037863966 +0000 UTC m=+3014.879339587" watchObservedRunningTime="2026-07-30 21:15:03.040256524 +0000 UTC m=+3014.881732145"
Jul 30 21:15:03.164262 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:15:03.164232    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757435-76j8z"
Jul 30 21:15:03.180757 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:15:03.180727    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-155c1d-29757435-klbvl"
Jul 30 21:15:03.191585 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:15:03.191564    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-01bc1b-29757435-mllkr"
Jul 30 21:15:04.030991 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:15:04.030961    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-155c1d-29757435-klbvl"
Jul 30 21:15:04.031405 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:15:04.030959    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-155c1d-29757435-klbvl" event={"ID":"aa7818dc-2b8c-4cae-bc85-e5e625683d2c","Type":"ContainerDied","Data":"c9c2a843b9015fbf6c7152b4fd3cdfcb04dfb88973b8b1471ab0912972169de2"}
Jul 30 21:15:04.031405 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:15:04.031080    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c9c2a843b9015fbf6c7152b4fd3cdfcb04dfb88973b8b1471ab0912972169de2"
Jul 30 21:15:04.032405 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:15:04.032384    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757435-76j8z"
Jul 30 21:15:04.032405 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:15:04.032388    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757435-76j8z" event={"ID":"0f9ef2d5-e7a0-43e3-9a07-707eda0bbbbf","Type":"ContainerDied","Data":"f0f4435ea4110d68873ead431d11dca86f34cc8c6e7a20d8072dbdf7151044d6"}
Jul 30 21:15:04.032578 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:15:04.032432    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f0f4435ea4110d68873ead431d11dca86f34cc8c6e7a20d8072dbdf7151044d6"
Jul 30 21:15:04.033818 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:15:04.033800    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-01bc1b-29757435-mllkr"
Jul 30 21:15:04.033899 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:15:04.033834    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-01bc1b-29757435-mllkr" event={"ID":"ed44b979-46b3-424d-8b53-f25c58b5a1b1","Type":"ContainerDied","Data":"9d4ce617e34961cfe34d007013ebc9613acaef631aedd8728888e06d2bfe6b45"}
Jul 30 21:15:04.033899 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:15:04.033876    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9d4ce617e34961cfe34d007013ebc9613acaef631aedd8728888e06d2bfe6b45"
Jul 30 21:15:04.952131 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:15:04.952098    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 21:15:12.763277 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:15:12.763245    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-01bc1b/auth-test-model-01bc1b-kserve-7ccf49fc67-28rc2"
Jul 30 21:15:12.763744 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:15:12.763290    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-01bc1b/auth-test-model-01bc1b-kserve-7ccf49fc67-28rc2"
Jul 30 21:15:12.775237 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:15:12.775216    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-01bc1b/auth-test-model-01bc1b-kserve-7ccf49fc67-28rc2"
Jul 30 21:15:13.094814 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:15:13.094733    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-01bc1b/auth-test-model-01bc1b-kserve-7ccf49fc67-28rc2"
Jul 30 21:15:31.427038 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:15:31.427006    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:15:39.059338 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:15:39.059294    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 21:15:52.548362 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:15:52.548329    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 21:16:00.848133 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:16:00.848101    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 21:16:09.347894 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:16:09.347858    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 21:16:24.551826 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:16:24.551797    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 21:16:36.153927 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:16:36.153895    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 21:16:50.948594 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:16:50.948557    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 21:17:01.046946 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:17:01.046910    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 21:17:09.061726 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:17:09.061686    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 21:17:10.591125 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:17:10.591016    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:17:21.349885 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:17:21.349843    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 21:17:28.046957 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:17:28.046920    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 21:17:37.152717 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:17:37.152676    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 21:17:49.036330 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:17:49.036300    2583 scope.go:117] "RemoveContainer" containerID="a427c50167d959464f7443f64962568fc488ebc71ad94e818ac8b1adc2e5ed1f"
Jul 30 21:17:49.045502 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:17:49.045483    2583 scope.go:117] "RemoveContainer" containerID="f396414373c281514c97a3e210fe4fc94413102a2fb5fbcb3de13d7c6507f972"
Jul 30 21:17:52.154439 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:17:52.154394    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 21:18:03.261489 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:18:03.261451    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 21:18:18.046015 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:18:18.045975    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 21:18:22.226102 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:18:22.226068    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-155c1d/auth-test-model-155c1d-kserve-5d4f776955-mczcr"]
Jul 30 21:18:22.244917 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:18:22.244889    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:18:23.152701 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:18:23.152669    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-01bc1b/auth-test-model-01bc1b-kserve-7ccf49fc67-28rc2"]
Jul 30 21:18:23.170077 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:18:23.170037    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:18:28.552040 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:18:28.552002    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 21:18:35.053200 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:18:35.053161    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-155c1d/sub-test-model-155c1d-kserve-66d656ff9c-lnsjj"]
Jul 30 21:18:35.053585 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:18:35.053556    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f9ef2d5-e7a0-43e3-9a07-707eda0bbbbf" containerName="cleanup"
Jul 30 21:18:35.053585 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:18:35.053568    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f9ef2d5-e7a0-43e3-9a07-707eda0bbbbf" containerName="cleanup"
Jul 30 21:18:35.053585 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:18:35.053583    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa7818dc-2b8c-4cae-bc85-e5e625683d2c" containerName="cleanup"
Jul 30 21:18:35.053694 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:18:35.053589    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa7818dc-2b8c-4cae-bc85-e5e625683d2c" containerName="cleanup"
Jul 30 21:18:35.053694 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:18:35.053597    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed44b979-46b3-424d-8b53-f25c58b5a1b1" containerName="cleanup"
Jul 30 21:18:35.053694 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:18:35.053603    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed44b979-46b3-424d-8b53-f25c58b5a1b1" containerName="cleanup"
Jul 30 21:18:35.053694 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:18:35.053676    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f9ef2d5-e7a0-43e3-9a07-707eda0bbbbf" containerName="cleanup"
Jul 30 21:18:35.053694 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:18:35.053686    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa7818dc-2b8c-4cae-bc85-e5e625683d2c" containerName="cleanup"
Jul 30 21:18:35.053694 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:18:35.053691    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed44b979-46b3-424d-8b53-f25c58b5a1b1" containerName="cleanup"
Jul 30 21:18:35.056749 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:18:35.056730    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-155c1d/sub-test-model-155c1d-kserve-66d656ff9c-lnsjj"
Jul 30 21:18:35.058752 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:18:35.058732    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-155c1d\"/\"sub-test-model-155c1d-kserve-self-signed-certs\""
Jul 30 21:18:35.063407 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:18:35.063365    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-155c1d/sub-test-model-155c1d-kserve-66d656ff9c-lnsjj"]
Jul 30 21:18:35.066233 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:18:35.066208    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:18:35.129672 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:18:35.129639    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8f5e70c0-3831-4c27-b1c3-7f5c5e333802-tls-certs\") pod \"sub-test-model-155c1d-kserve-66d656ff9c-lnsjj\" (UID: \"8f5e70c0-3831-4c27-b1c3-7f5c5e333802\") " pod="ai-tenant-e2e-shared-a-155c1d/sub-test-model-155c1d-kserve-66d656ff9c-lnsjj"
Jul 30 21:18:35.129672 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:18:35.129676    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8f5e70c0-3831-4c27-b1c3-7f5c5e333802-model-cache\") pod \"sub-test-model-155c1d-kserve-66d656ff9c-lnsjj\" (UID: \"8f5e70c0-3831-4c27-b1c3-7f5c5e333802\") " pod="ai-tenant-e2e-shared-a-155c1d/sub-test-model-155c1d-kserve-66d656ff9c-lnsjj"
Jul 30 21:18:35.129913 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:18:35.129719    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8f5e70c0-3831-4c27-b1c3-7f5c5e333802-home\") pod \"sub-test-model-155c1d-kserve-66d656ff9c-lnsjj\" (UID: \"8f5e70c0-3831-4c27-b1c3-7f5c5e333802\") " pod="ai-tenant-e2e-shared-a-155c1d/sub-test-model-155c1d-kserve-66d656ff9c-lnsjj"
Jul 30 21:18:35.129913 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:18:35.129754    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8f5e70c0-3831-4c27-b1c3-7f5c5e333802-tmp-dir\") pod \"sub-test-model-155c1d-kserve-66d656ff9c-lnsjj\" (UID: \"8f5e70c0-3831-4c27-b1c3-7f5c5e333802\") " pod="ai-tenant-e2e-shared-a-155c1d/sub-test-model-155c1d-kserve-66d656ff9c-lnsjj"
Jul 30 21:18:35.129913 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:18:35.129824    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8f5e70c0-3831-4c27-b1c3-7f5c5e333802-dshm\") pod \"sub-test-model-155c1d-kserve-66d656ff9c-lnsjj\" (UID: \"8f5e70c0-3831-4c27-b1c3-7f5c5e333802\") " pod="ai-tenant-e2e-shared-a-155c1d/sub-test-model-155c1d-kserve-66d656ff9c-lnsjj"
Jul 30 21:18:35.129913 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:18:35.129901    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q568l\" (UniqueName: \"kubernetes.io/projected/8f5e70c0-3831-4c27-b1c3-7f5c5e333802-kube-api-access-q568l\") pod \"sub-test-model-155c1d-kserve-66d656ff9c-lnsjj\" (UID: \"8f5e70c0-3831-4c27-b1c3-7f5c5e333802\") " pod="ai-tenant-e2e-shared-a-155c1d/sub-test-model-155c1d-kserve-66d656ff9c-lnsjj"
Jul 30 21:18:35.231252 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:18:35.231215    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8f5e70c0-3831-4c27-b1c3-7f5c5e333802-tmp-dir\") pod \"sub-test-model-155c1d-kserve-66d656ff9c-lnsjj\" (UID: \"8f5e70c0-3831-4c27-b1c3-7f5c5e333802\") " pod="ai-tenant-e2e-shared-a-155c1d/sub-test-model-155c1d-kserve-66d656ff9c-lnsjj"
Jul 30 21:18:35.231252 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:18:35.231261    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8f5e70c0-3831-4c27-b1c3-7f5c5e333802-dshm\") pod \"sub-test-model-155c1d-kserve-66d656ff9c-lnsjj\" (UID: \"8f5e70c0-3831-4c27-b1c3-7f5c5e333802\") " pod="ai-tenant-e2e-shared-a-155c1d/sub-test-model-155c1d-kserve-66d656ff9c-lnsjj"
Jul 30 21:18:35.231531 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:18:35.231319    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q568l\" (UniqueName: \"kubernetes.io/projected/8f5e70c0-3831-4c27-b1c3-7f5c5e333802-kube-api-access-q568l\") pod \"sub-test-model-155c1d-kserve-66d656ff9c-lnsjj\" (UID: \"8f5e70c0-3831-4c27-b1c3-7f5c5e333802\") " pod="ai-tenant-e2e-shared-a-155c1d/sub-test-model-155c1d-kserve-66d656ff9c-lnsjj"
Jul 30 21:18:35.231531 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:18:35.231360    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8f5e70c0-3831-4c27-b1c3-7f5c5e333802-tls-certs\") pod \"sub-test-model-155c1d-kserve-66d656ff9c-lnsjj\" (UID: \"8f5e70c0-3831-4c27-b1c3-7f5c5e333802\") " pod="ai-tenant-e2e-shared-a-155c1d/sub-test-model-155c1d-kserve-66d656ff9c-lnsjj"
Jul 30 21:18:35.231531 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:18:35.231385    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8f5e70c0-3831-4c27-b1c3-7f5c5e333802-model-cache\") pod \"sub-test-model-155c1d-kserve-66d656ff9c-lnsjj\" (UID: \"8f5e70c0-3831-4c27-b1c3-7f5c5e333802\") " pod="ai-tenant-e2e-shared-a-155c1d/sub-test-model-155c1d-kserve-66d656ff9c-lnsjj"
Jul 30 21:18:35.231531 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:18:35.231413    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8f5e70c0-3831-4c27-b1c3-7f5c5e333802-home\") pod \"sub-test-model-155c1d-kserve-66d656ff9c-lnsjj\" (UID: \"8f5e70c0-3831-4c27-b1c3-7f5c5e333802\") " pod="ai-tenant-e2e-shared-a-155c1d/sub-test-model-155c1d-kserve-66d656ff9c-lnsjj"
Jul 30 21:18:35.231752 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:18:35.231678    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8f5e70c0-3831-4c27-b1c3-7f5c5e333802-tmp-dir\") pod \"sub-test-model-155c1d-kserve-66d656ff9c-lnsjj\" (UID: \"8f5e70c0-3831-4c27-b1c3-7f5c5e333802\") " pod="ai-tenant-e2e-shared-a-155c1d/sub-test-model-155c1d-kserve-66d656ff9c-lnsjj"
Jul 30 21:18:35.231832 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:18:35.231806    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8f5e70c0-3831-4c27-b1c3-7f5c5e333802-model-cache\") pod \"sub-test-model-155c1d-kserve-66d656ff9c-lnsjj\" (UID: \"8f5e70c0-3831-4c27-b1c3-7f5c5e333802\") " pod="ai-tenant-e2e-shared-a-155c1d/sub-test-model-155c1d-kserve-66d656ff9c-lnsjj"
Jul 30 21:18:35.231882 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:18:35.231816    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8f5e70c0-3831-4c27-b1c3-7f5c5e333802-home\") pod \"sub-test-model-155c1d-kserve-66d656ff9c-lnsjj\" (UID: \"8f5e70c0-3831-4c27-b1c3-7f5c5e333802\") " pod="ai-tenant-e2e-shared-a-155c1d/sub-test-model-155c1d-kserve-66d656ff9c-lnsjj"
Jul 30 21:18:35.233759 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:18:35.233737    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8f5e70c0-3831-4c27-b1c3-7f5c5e333802-dshm\") pod \"sub-test-model-155c1d-kserve-66d656ff9c-lnsjj\" (UID: \"8f5e70c0-3831-4c27-b1c3-7f5c5e333802\") " pod="ai-tenant-e2e-shared-a-155c1d/sub-test-model-155c1d-kserve-66d656ff9c-lnsjj"
Jul 30 21:18:35.233930 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:18:35.233913    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8f5e70c0-3831-4c27-b1c3-7f5c5e333802-tls-certs\") pod \"sub-test-model-155c1d-kserve-66d656ff9c-lnsjj\" (UID: \"8f5e70c0-3831-4c27-b1c3-7f5c5e333802\") " pod="ai-tenant-e2e-shared-a-155c1d/sub-test-model-155c1d-kserve-66d656ff9c-lnsjj"
Jul 30 21:18:35.239561 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:18:35.239538    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q568l\" (UniqueName: \"kubernetes.io/projected/8f5e70c0-3831-4c27-b1c3-7f5c5e333802-kube-api-access-q568l\") pod \"sub-test-model-155c1d-kserve-66d656ff9c-lnsjj\" (UID: \"8f5e70c0-3831-4c27-b1c3-7f5c5e333802\") " pod="ai-tenant-e2e-shared-a-155c1d/sub-test-model-155c1d-kserve-66d656ff9c-lnsjj"
Jul 30 21:18:35.367253 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:18:35.367131    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-155c1d/sub-test-model-155c1d-kserve-66d656ff9c-lnsjj"
Jul 30 21:18:35.506278 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:18:35.506252    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-155c1d/sub-test-model-155c1d-kserve-66d656ff9c-lnsjj"]
Jul 30 21:18:35.508071 ip-10-0-142-69 kubenswrapper[2583]: W0730 21:18:35.508037    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8f5e70c0_3831_4c27_b1c3_7f5c5e333802.slice/crio-48bc7feacd48933eaeca023f95d0aee130a39c99c31f910943e77f5b6d7cca85 WatchSource:0}: Error finding container 48bc7feacd48933eaeca023f95d0aee130a39c99c31f910943e77f5b6d7cca85: Status 404 returned error can't find the container with id 48bc7feacd48933eaeca023f95d0aee130a39c99c31f910943e77f5b6d7cca85
Jul 30 21:18:36.254346 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:18:36.254308    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-155c1d/sub-test-model-155c1d-kserve-66d656ff9c-lnsjj" event={"ID":"8f5e70c0-3831-4c27-b1c3-7f5c5e333802","Type":"ContainerStarted","Data":"420d549524dccf0acb17e00469eed7e50e1c780bcac521e19b74ff96eb7bea46"}
Jul 30 21:18:36.254346 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:18:36.254353    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-155c1d/sub-test-model-155c1d-kserve-66d656ff9c-lnsjj" event={"ID":"8f5e70c0-3831-4c27-b1c3-7f5c5e333802","Type":"ContainerStarted","Data":"48bc7feacd48933eaeca023f95d0aee130a39c99c31f910943e77f5b6d7cca85"}
Jul 30 21:18:36.271222 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:18:36.271161    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-155c1d/sub-test-model-155c1d-kserve-66d656ff9c-lnsjj" podStartSLOduration=1.271127334 podStartE2EDuration="1.271127334s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 21:18:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 21:18:36.270218563 +0000 UTC m=+3228.111694184" watchObservedRunningTime="2026-07-30 21:18:36.271127334 +0000 UTC m=+3228.112602955"
Jul 30 21:18:37.245872 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:18:37.245800    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-155c1d/auth-test-model-155c1d-kserve-5d4f776955-mczcr" podUID="0d4a43c1-c9a1-4543-b489-14208bfcd87e" containerName="main" containerID="cri-o://cf0247c220981f4bcdd0d61df6e49595403c00b7d14fb2bc5bbe96c1753e16e5" gracePeriod=45
Jul 30 21:18:37.355008 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:18:37.354973    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 21:18:37.504080 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:18:37.504009    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-155c1d/auth-test-model-155c1d-kserve-5d4f776955-mczcr"
Jul 30 21:18:37.552241 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:18:37.552207    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0d4a43c1-c9a1-4543-b489-14208bfcd87e-dshm\") pod \"0d4a43c1-c9a1-4543-b489-14208bfcd87e\" (UID: \"0d4a43c1-c9a1-4543-b489-14208bfcd87e\") "
Jul 30 21:18:37.552241 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:18:37.552243    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0d4a43c1-c9a1-4543-b489-14208bfcd87e-home\") pod \"0d4a43c1-c9a1-4543-b489-14208bfcd87e\" (UID: \"0d4a43c1-c9a1-4543-b489-14208bfcd87e\") "
Jul 30 21:18:37.552505 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:18:37.552274    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0d4a43c1-c9a1-4543-b489-14208bfcd87e-tmp-dir\") pod \"0d4a43c1-c9a1-4543-b489-14208bfcd87e\" (UID: \"0d4a43c1-c9a1-4543-b489-14208bfcd87e\") "
Jul 30 21:18:37.552505 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:18:37.552307    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0d4a43c1-c9a1-4543-b489-14208bfcd87e-tls-certs\") pod \"0d4a43c1-c9a1-4543-b489-14208bfcd87e\" (UID: \"0d4a43c1-c9a1-4543-b489-14208bfcd87e\") "
Jul 30 21:18:37.552505 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:18:37.552386    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0d4a43c1-c9a1-4543-b489-14208bfcd87e-model-cache\") pod \"0d4a43c1-c9a1-4543-b489-14208bfcd87e\" (UID: \"0d4a43c1-c9a1-4543-b489-14208bfcd87e\") "
Jul 30 21:18:37.552505 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:18:37.552443    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xvj97\" (UniqueName: \"kubernetes.io/projected/0d4a43c1-c9a1-4543-b489-14208bfcd87e-kube-api-access-xvj97\") pod \"0d4a43c1-c9a1-4543-b489-14208bfcd87e\" (UID: \"0d4a43c1-c9a1-4543-b489-14208bfcd87e\") "
Jul 30 21:18:37.552713 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:18:37.552539    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d4a43c1-c9a1-4543-b489-14208bfcd87e-home" (OuterVolumeSpecName: "home") pod "0d4a43c1-c9a1-4543-b489-14208bfcd87e" (UID: "0d4a43c1-c9a1-4543-b489-14208bfcd87e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:18:37.552713 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:18:37.552568    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d4a43c1-c9a1-4543-b489-14208bfcd87e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "0d4a43c1-c9a1-4543-b489-14208bfcd87e" (UID: "0d4a43c1-c9a1-4543-b489-14208bfcd87e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:18:37.552713 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:18:37.552663    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d4a43c1-c9a1-4543-b489-14208bfcd87e-model-cache" (OuterVolumeSpecName: "model-cache") pod "0d4a43c1-c9a1-4543-b489-14208bfcd87e" (UID: "0d4a43c1-c9a1-4543-b489-14208bfcd87e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:18:37.552850 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:18:37.552791    2583 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0d4a43c1-c9a1-4543-b489-14208bfcd87e-model-cache\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 21:18:37.552850 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:18:37.552805    2583 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0d4a43c1-c9a1-4543-b489-14208bfcd87e-home\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 21:18:37.552850 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:18:37.552814    2583 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0d4a43c1-c9a1-4543-b489-14208bfcd87e-tmp-dir\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 21:18:37.554790 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:18:37.554764    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d4a43c1-c9a1-4543-b489-14208bfcd87e-dshm" (OuterVolumeSpecName: "dshm") pod "0d4a43c1-c9a1-4543-b489-14208bfcd87e" (UID: "0d4a43c1-c9a1-4543-b489-14208bfcd87e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:18:37.554790 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:18:37.554765    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0d4a43c1-c9a1-4543-b489-14208bfcd87e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "0d4a43c1-c9a1-4543-b489-14208bfcd87e" (UID: "0d4a43c1-c9a1-4543-b489-14208bfcd87e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 21:18:37.554949 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:18:37.554845    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d4a43c1-c9a1-4543-b489-14208bfcd87e-kube-api-access-xvj97" (OuterVolumeSpecName: "kube-api-access-xvj97") pod "0d4a43c1-c9a1-4543-b489-14208bfcd87e" (UID: "0d4a43c1-c9a1-4543-b489-14208bfcd87e"). InnerVolumeSpecName "kube-api-access-xvj97". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 21:18:37.653650 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:18:37.653613    2583 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0d4a43c1-c9a1-4543-b489-14208bfcd87e-tls-certs\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 21:18:37.653650 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:18:37.653644    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xvj97\" (UniqueName: \"kubernetes.io/projected/0d4a43c1-c9a1-4543-b489-14208bfcd87e-kube-api-access-xvj97\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 21:18:37.653650 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:18:37.653653    2583 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0d4a43c1-c9a1-4543-b489-14208bfcd87e-dshm\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 21:18:38.172782 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:18:38.172737    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-01bc1b/auth-test-model-01bc1b-kserve-7ccf49fc67-28rc2" podUID="ec4b7e13-62fb-4990-be1e-0102d3a2a885" containerName="main" containerID="cri-o://29b665803820f30657b05387b9976b3bfc3714d469d4918f22cccf091963f1b9" gracePeriod=45
Jul 30 21:18:38.268783 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:18:38.268747    2583 generic.go:356] "Generic (PLEG): container finished" podID="0d4a43c1-c9a1-4543-b489-14208bfcd87e" containerID="cf0247c220981f4bcdd0d61df6e49595403c00b7d14fb2bc5bbe96c1753e16e5" exitCode=0
Jul 30 21:18:38.268979 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:18:38.268803    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-155c1d/auth-test-model-155c1d-kserve-5d4f776955-mczcr"
Jul 30 21:18:38.268979 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:18:38.268837    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-155c1d/auth-test-model-155c1d-kserve-5d4f776955-mczcr" event={"ID":"0d4a43c1-c9a1-4543-b489-14208bfcd87e","Type":"ContainerDied","Data":"cf0247c220981f4bcdd0d61df6e49595403c00b7d14fb2bc5bbe96c1753e16e5"}
Jul 30 21:18:38.268979 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:18:38.268880    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-155c1d/auth-test-model-155c1d-kserve-5d4f776955-mczcr" event={"ID":"0d4a43c1-c9a1-4543-b489-14208bfcd87e","Type":"ContainerDied","Data":"b9824ec782e6289f8acf495cfe01f7600458e4887a026ea1c327d514a97e85dc"}
Jul 30 21:18:38.268979 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:18:38.268897    2583 scope.go:117] "RemoveContainer" containerID="cf0247c220981f4bcdd0d61df6e49595403c00b7d14fb2bc5bbe96c1753e16e5"
Jul 30 21:18:38.284843 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:18:38.284826    2583 scope.go:117] "RemoveContainer" containerID="cf0247c220981f4bcdd0d61df6e49595403c00b7d14fb2bc5bbe96c1753e16e5"
Jul 30 21:18:38.285293 ip-10-0-142-69 kubenswrapper[2583]: E0730 21:18:38.285230    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cf0247c220981f4bcdd0d61df6e49595403c00b7d14fb2bc5bbe96c1753e16e5\": container with ID starting with cf0247c220981f4bcdd0d61df6e49595403c00b7d14fb2bc5bbe96c1753e16e5 not found: ID does not exist" containerID="cf0247c220981f4bcdd0d61df6e49595403c00b7d14fb2bc5bbe96c1753e16e5"
Jul 30 21:18:38.285293 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:18:38.285276    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf0247c220981f4bcdd0d61df6e49595403c00b7d14fb2bc5bbe96c1753e16e5"} err="failed to get container status \"cf0247c220981f4bcdd0d61df6e49595403c00b7d14fb2bc5bbe96c1753e16e5\": rpc error: code = NotFound desc = could not find container \"cf0247c220981f4bcdd0d61df6e49595403c00b7d14fb2bc5bbe96c1753e16e5\": container with ID starting with cf0247c220981f4bcdd0d61df6e49595403c00b7d14fb2bc5bbe96c1753e16e5 not found: ID does not exist"
Jul 30 21:18:38.290792 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:18:38.290764    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-155c1d/auth-test-model-155c1d-kserve-5d4f776955-mczcr"]
Jul 30 21:18:38.294193 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:18:38.294167    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-155c1d/auth-test-model-155c1d-kserve-5d4f776955-mczcr"]
Jul 30 21:18:38.428533 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:18:38.428471    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-01bc1b/auth-test-model-01bc1b-kserve-7ccf49fc67-28rc2"
Jul 30 21:18:38.461080 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:18:38.461051    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ec4b7e13-62fb-4990-be1e-0102d3a2a885-dshm\") pod \"ec4b7e13-62fb-4990-be1e-0102d3a2a885\" (UID: \"ec4b7e13-62fb-4990-be1e-0102d3a2a885\") "
Jul 30 21:18:38.461281 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:18:38.461091    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2j2v4\" (UniqueName: \"kubernetes.io/projected/ec4b7e13-62fb-4990-be1e-0102d3a2a885-kube-api-access-2j2v4\") pod \"ec4b7e13-62fb-4990-be1e-0102d3a2a885\" (UID: \"ec4b7e13-62fb-4990-be1e-0102d3a2a885\") "
Jul 30 21:18:38.461281 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:18:38.461126    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ec4b7e13-62fb-4990-be1e-0102d3a2a885-home\") pod \"ec4b7e13-62fb-4990-be1e-0102d3a2a885\" (UID: \"ec4b7e13-62fb-4990-be1e-0102d3a2a885\") "
Jul 30 21:18:38.461281 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:18:38.461202    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ec4b7e13-62fb-4990-be1e-0102d3a2a885-tmp-dir\") pod \"ec4b7e13-62fb-4990-be1e-0102d3a2a885\" (UID: \"ec4b7e13-62fb-4990-be1e-0102d3a2a885\") "
Jul 30 21:18:38.461281 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:18:38.461278    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ec4b7e13-62fb-4990-be1e-0102d3a2a885-model-cache\") pod \"ec4b7e13-62fb-4990-be1e-0102d3a2a885\" (UID: \"ec4b7e13-62fb-4990-be1e-0102d3a2a885\") "
Jul 30 21:18:38.461502 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:18:38.461326    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ec4b7e13-62fb-4990-be1e-0102d3a2a885-tls-certs\") pod \"ec4b7e13-62fb-4990-be1e-0102d3a2a885\" (UID: \"ec4b7e13-62fb-4990-be1e-0102d3a2a885\") "
Jul 30 21:18:38.461645 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:18:38.461618    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec4b7e13-62fb-4990-be1e-0102d3a2a885-home" (OuterVolumeSpecName: "home") pod "ec4b7e13-62fb-4990-be1e-0102d3a2a885" (UID: "ec4b7e13-62fb-4990-be1e-0102d3a2a885"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:18:38.461973 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:18:38.461821    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec4b7e13-62fb-4990-be1e-0102d3a2a885-model-cache" (OuterVolumeSpecName: "model-cache") pod "ec4b7e13-62fb-4990-be1e-0102d3a2a885" (UID: "ec4b7e13-62fb-4990-be1e-0102d3a2a885"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:18:38.462099 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:18:38.462016    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec4b7e13-62fb-4990-be1e-0102d3a2a885-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "ec4b7e13-62fb-4990-be1e-0102d3a2a885" (UID: "ec4b7e13-62fb-4990-be1e-0102d3a2a885"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:18:38.463639 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:18:38.463612    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ec4b7e13-62fb-4990-be1e-0102d3a2a885-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ec4b7e13-62fb-4990-be1e-0102d3a2a885" (UID: "ec4b7e13-62fb-4990-be1e-0102d3a2a885"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 21:18:38.463731 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:18:38.463648    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec4b7e13-62fb-4990-be1e-0102d3a2a885-kube-api-access-2j2v4" (OuterVolumeSpecName: "kube-api-access-2j2v4") pod "ec4b7e13-62fb-4990-be1e-0102d3a2a885" (UID: "ec4b7e13-62fb-4990-be1e-0102d3a2a885"). InnerVolumeSpecName "kube-api-access-2j2v4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 21:18:38.463731 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:18:38.463651    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec4b7e13-62fb-4990-be1e-0102d3a2a885-dshm" (OuterVolumeSpecName: "dshm") pod "ec4b7e13-62fb-4990-be1e-0102d3a2a885" (UID: "ec4b7e13-62fb-4990-be1e-0102d3a2a885"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:18:38.562726 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:18:38.562677    2583 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ec4b7e13-62fb-4990-be1e-0102d3a2a885-home\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 21:18:38.562726 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:18:38.562720    2583 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ec4b7e13-62fb-4990-be1e-0102d3a2a885-tmp-dir\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 21:18:38.562726 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:18:38.562729    2583 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ec4b7e13-62fb-4990-be1e-0102d3a2a885-model-cache\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 21:18:38.562726 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:18:38.562740    2583 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ec4b7e13-62fb-4990-be1e-0102d3a2a885-tls-certs\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 21:18:38.562726 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:18:38.562748    2583 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ec4b7e13-62fb-4990-be1e-0102d3a2a885-dshm\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 21:18:38.563045 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:18:38.562756    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2j2v4\" (UniqueName: \"kubernetes.io/projected/ec4b7e13-62fb-4990-be1e-0102d3a2a885-kube-api-access-2j2v4\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 21:18:38.676862 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:18:38.676820    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0d4a43c1-c9a1-4543-b489-14208bfcd87e" path="/var/lib/kubelet/pods/0d4a43c1-c9a1-4543-b489-14208bfcd87e/volumes"
Jul 30 21:18:39.275490 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:18:39.275455    2583 generic.go:356] "Generic (PLEG): container finished" podID="ec4b7e13-62fb-4990-be1e-0102d3a2a885" containerID="29b665803820f30657b05387b9976b3bfc3714d469d4918f22cccf091963f1b9" exitCode=0
Jul 30 21:18:39.275689 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:18:39.275505    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-01bc1b/auth-test-model-01bc1b-kserve-7ccf49fc67-28rc2"
Jul 30 21:18:39.275689 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:18:39.275547    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-01bc1b/auth-test-model-01bc1b-kserve-7ccf49fc67-28rc2" event={"ID":"ec4b7e13-62fb-4990-be1e-0102d3a2a885","Type":"ContainerDied","Data":"29b665803820f30657b05387b9976b3bfc3714d469d4918f22cccf091963f1b9"}
Jul 30 21:18:39.275689 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:18:39.275597    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-01bc1b/auth-test-model-01bc1b-kserve-7ccf49fc67-28rc2" event={"ID":"ec4b7e13-62fb-4990-be1e-0102d3a2a885","Type":"ContainerDied","Data":"d506ec2b15b3b5818b37c9cce8f2c110c3d0875fcde6e7df85157d0d3a84f87d"}
Jul 30 21:18:39.275689 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:18:39.275617    2583 scope.go:117] "RemoveContainer" containerID="29b665803820f30657b05387b9976b3bfc3714d469d4918f22cccf091963f1b9"
Jul 30 21:18:39.285182 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:18:39.285164    2583 scope.go:117] "RemoveContainer" containerID="29b665803820f30657b05387b9976b3bfc3714d469d4918f22cccf091963f1b9"
Jul 30 21:18:39.285465 ip-10-0-142-69 kubenswrapper[2583]: E0730 21:18:39.285441    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"29b665803820f30657b05387b9976b3bfc3714d469d4918f22cccf091963f1b9\": container with ID starting with 29b665803820f30657b05387b9976b3bfc3714d469d4918f22cccf091963f1b9 not found: ID does not exist" containerID="29b665803820f30657b05387b9976b3bfc3714d469d4918f22cccf091963f1b9"
Jul 30 21:18:39.285563 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:18:39.285473    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29b665803820f30657b05387b9976b3bfc3714d469d4918f22cccf091963f1b9"} err="failed to get container status \"29b665803820f30657b05387b9976b3bfc3714d469d4918f22cccf091963f1b9\": rpc error: code = NotFound desc = could not find container \"29b665803820f30657b05387b9976b3bfc3714d469d4918f22cccf091963f1b9\": container with ID starting with 29b665803820f30657b05387b9976b3bfc3714d469d4918f22cccf091963f1b9 not found: ID does not exist"
Jul 30 21:18:39.290500 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:18:39.290477    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-01bc1b/auth-test-model-01bc1b-kserve-7ccf49fc67-28rc2"]
Jul 30 21:18:39.294269 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:18:39.294246    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-01bc1b/auth-test-model-01bc1b-kserve-7ccf49fc67-28rc2"]
Jul 30 21:18:40.675678 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:18:40.675641    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ec4b7e13-62fb-4990-be1e-0102d3a2a885" path="/var/lib/kubelet/pods/ec4b7e13-62fb-4990-be1e-0102d3a2a885/volumes"
Jul 30 21:18:45.367766 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:18:45.367730    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-155c1d/sub-test-model-155c1d-kserve-66d656ff9c-lnsjj"
Jul 30 21:18:45.368183 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:18:45.367778    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-155c1d/sub-test-model-155c1d-kserve-66d656ff9c-lnsjj"
Jul 30 21:18:45.380748 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:18:45.380714    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-155c1d/sub-test-model-155c1d-kserve-66d656ff9c-lnsjj"
Jul 30 21:18:46.331677 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:18:46.331645    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-155c1d/sub-test-model-155c1d-kserve-66d656ff9c-lnsjj"
Jul 30 21:18:48.993587 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:18:48.993550    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:19:18.258171 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:19:18.258106    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-01bc1b/sub-test-model-01bc1b-kserve-75b48cbff7-llmqv"]
Jul 30 21:19:18.258757 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:19:18.258669    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec4b7e13-62fb-4990-be1e-0102d3a2a885" containerName="main"
Jul 30 21:19:18.258757 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:19:18.258691    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec4b7e13-62fb-4990-be1e-0102d3a2a885" containerName="main"
Jul 30 21:19:18.258757 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:19:18.258721    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d4a43c1-c9a1-4543-b489-14208bfcd87e" containerName="main"
Jul 30 21:19:18.258757 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:19:18.258731    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d4a43c1-c9a1-4543-b489-14208bfcd87e" containerName="main"
Jul 30 21:19:18.258972 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:19:18.258831    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d4a43c1-c9a1-4543-b489-14208bfcd87e" containerName="main"
Jul 30 21:19:18.258972 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:19:18.258851    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec4b7e13-62fb-4990-be1e-0102d3a2a885" containerName="main"
Jul 30 21:19:18.262066 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:19:18.262045    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-01bc1b/sub-test-model-01bc1b-kserve-75b48cbff7-llmqv"
Jul 30 21:19:18.264085 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:19:18.264061    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-01bc1b\"/\"openshift-service-ca.crt\""
Jul 30 21:19:18.264200 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:19:18.264154    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-01bc1b\"/\"kube-root-ca.crt\""
Jul 30 21:19:18.264200 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:19:18.264175    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-01bc1b\"/\"default-dockercfg-b6qdq\""
Jul 30 21:19:18.264741 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:19:18.264723    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-01bc1b\"/\"sub-test-model-01bc1b-kserve-self-signed-certs\""
Jul 30 21:19:18.268713 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:19:18.268692    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-01bc1b/sub-test-model-01bc1b-kserve-75b48cbff7-llmqv"]
Jul 30 21:19:18.314051 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:19:18.314022    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d66d4154-7f41-416e-b5d2-3bac201fa918-tmp-dir\") pod \"sub-test-model-01bc1b-kserve-75b48cbff7-llmqv\" (UID: \"d66d4154-7f41-416e-b5d2-3bac201fa918\") " pod="ai-tenant-e2e-shared-b-01bc1b/sub-test-model-01bc1b-kserve-75b48cbff7-llmqv"
Jul 30 21:19:18.314234 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:19:18.314078    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tm7ff\" (UniqueName: \"kubernetes.io/projected/d66d4154-7f41-416e-b5d2-3bac201fa918-kube-api-access-tm7ff\") pod \"sub-test-model-01bc1b-kserve-75b48cbff7-llmqv\" (UID: \"d66d4154-7f41-416e-b5d2-3bac201fa918\") " pod="ai-tenant-e2e-shared-b-01bc1b/sub-test-model-01bc1b-kserve-75b48cbff7-llmqv"
Jul 30 21:19:18.314234 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:19:18.314196    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d66d4154-7f41-416e-b5d2-3bac201fa918-model-cache\") pod \"sub-test-model-01bc1b-kserve-75b48cbff7-llmqv\" (UID: \"d66d4154-7f41-416e-b5d2-3bac201fa918\") " pod="ai-tenant-e2e-shared-b-01bc1b/sub-test-model-01bc1b-kserve-75b48cbff7-llmqv"
Jul 30 21:19:18.314325 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:19:18.314262    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d66d4154-7f41-416e-b5d2-3bac201fa918-home\") pod \"sub-test-model-01bc1b-kserve-75b48cbff7-llmqv\" (UID: \"d66d4154-7f41-416e-b5d2-3bac201fa918\") " pod="ai-tenant-e2e-shared-b-01bc1b/sub-test-model-01bc1b-kserve-75b48cbff7-llmqv"
Jul 30 21:19:18.314325 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:19:18.314313    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d66d4154-7f41-416e-b5d2-3bac201fa918-dshm\") pod \"sub-test-model-01bc1b-kserve-75b48cbff7-llmqv\" (UID: \"d66d4154-7f41-416e-b5d2-3bac201fa918\") " pod="ai-tenant-e2e-shared-b-01bc1b/sub-test-model-01bc1b-kserve-75b48cbff7-llmqv"
Jul 30 21:19:18.314391 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:19:18.314372    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d66d4154-7f41-416e-b5d2-3bac201fa918-tls-certs\") pod \"sub-test-model-01bc1b-kserve-75b48cbff7-llmqv\" (UID: \"d66d4154-7f41-416e-b5d2-3bac201fa918\") " pod="ai-tenant-e2e-shared-b-01bc1b/sub-test-model-01bc1b-kserve-75b48cbff7-llmqv"
Jul 30 21:19:18.415564 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:19:18.415534    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d66d4154-7f41-416e-b5d2-3bac201fa918-dshm\") pod \"sub-test-model-01bc1b-kserve-75b48cbff7-llmqv\" (UID: \"d66d4154-7f41-416e-b5d2-3bac201fa918\") " pod="ai-tenant-e2e-shared-b-01bc1b/sub-test-model-01bc1b-kserve-75b48cbff7-llmqv"
Jul 30 21:19:18.415744 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:19:18.415577    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d66d4154-7f41-416e-b5d2-3bac201fa918-tls-certs\") pod \"sub-test-model-01bc1b-kserve-75b48cbff7-llmqv\" (UID: \"d66d4154-7f41-416e-b5d2-3bac201fa918\") " pod="ai-tenant-e2e-shared-b-01bc1b/sub-test-model-01bc1b-kserve-75b48cbff7-llmqv"
Jul 30 21:19:18.415744 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:19:18.415614    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d66d4154-7f41-416e-b5d2-3bac201fa918-tmp-dir\") pod \"sub-test-model-01bc1b-kserve-75b48cbff7-llmqv\" (UID: \"d66d4154-7f41-416e-b5d2-3bac201fa918\") " pod="ai-tenant-e2e-shared-b-01bc1b/sub-test-model-01bc1b-kserve-75b48cbff7-llmqv"
Jul 30 21:19:18.415744 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:19:18.415647    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tm7ff\" (UniqueName: \"kubernetes.io/projected/d66d4154-7f41-416e-b5d2-3bac201fa918-kube-api-access-tm7ff\") pod \"sub-test-model-01bc1b-kserve-75b48cbff7-llmqv\" (UID: \"d66d4154-7f41-416e-b5d2-3bac201fa918\") " pod="ai-tenant-e2e-shared-b-01bc1b/sub-test-model-01bc1b-kserve-75b48cbff7-llmqv"
Jul 30 21:19:18.415744 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:19:18.415677    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d66d4154-7f41-416e-b5d2-3bac201fa918-model-cache\") pod \"sub-test-model-01bc1b-kserve-75b48cbff7-llmqv\" (UID: \"d66d4154-7f41-416e-b5d2-3bac201fa918\") " pod="ai-tenant-e2e-shared-b-01bc1b/sub-test-model-01bc1b-kserve-75b48cbff7-llmqv"
Jul 30 21:19:18.415744 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:19:18.415704    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d66d4154-7f41-416e-b5d2-3bac201fa918-home\") pod \"sub-test-model-01bc1b-kserve-75b48cbff7-llmqv\" (UID: \"d66d4154-7f41-416e-b5d2-3bac201fa918\") " pod="ai-tenant-e2e-shared-b-01bc1b/sub-test-model-01bc1b-kserve-75b48cbff7-llmqv"
Jul 30 21:19:18.415991 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:19:18.415975    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d66d4154-7f41-416e-b5d2-3bac201fa918-home\") pod \"sub-test-model-01bc1b-kserve-75b48cbff7-llmqv\" (UID: \"d66d4154-7f41-416e-b5d2-3bac201fa918\") " pod="ai-tenant-e2e-shared-b-01bc1b/sub-test-model-01bc1b-kserve-75b48cbff7-llmqv"
Jul 30 21:19:18.416079 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:19:18.416052    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d66d4154-7f41-416e-b5d2-3bac201fa918-tmp-dir\") pod \"sub-test-model-01bc1b-kserve-75b48cbff7-llmqv\" (UID: \"d66d4154-7f41-416e-b5d2-3bac201fa918\") " pod="ai-tenant-e2e-shared-b-01bc1b/sub-test-model-01bc1b-kserve-75b48cbff7-llmqv"
Jul 30 21:19:18.416217 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:19:18.416196    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d66d4154-7f41-416e-b5d2-3bac201fa918-model-cache\") pod \"sub-test-model-01bc1b-kserve-75b48cbff7-llmqv\" (UID: \"d66d4154-7f41-416e-b5d2-3bac201fa918\") " pod="ai-tenant-e2e-shared-b-01bc1b/sub-test-model-01bc1b-kserve-75b48cbff7-llmqv"
Jul 30 21:19:18.418102 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:19:18.418070    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d66d4154-7f41-416e-b5d2-3bac201fa918-dshm\") pod \"sub-test-model-01bc1b-kserve-75b48cbff7-llmqv\" (UID: \"d66d4154-7f41-416e-b5d2-3bac201fa918\") " pod="ai-tenant-e2e-shared-b-01bc1b/sub-test-model-01bc1b-kserve-75b48cbff7-llmqv"
Jul 30 21:19:18.418253 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:19:18.418236    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d66d4154-7f41-416e-b5d2-3bac201fa918-tls-certs\") pod \"sub-test-model-01bc1b-kserve-75b48cbff7-llmqv\" (UID: \"d66d4154-7f41-416e-b5d2-3bac201fa918\") " pod="ai-tenant-e2e-shared-b-01bc1b/sub-test-model-01bc1b-kserve-75b48cbff7-llmqv"
Jul 30 21:19:18.423254 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:19:18.423235    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tm7ff\" (UniqueName: \"kubernetes.io/projected/d66d4154-7f41-416e-b5d2-3bac201fa918-kube-api-access-tm7ff\") pod \"sub-test-model-01bc1b-kserve-75b48cbff7-llmqv\" (UID: \"d66d4154-7f41-416e-b5d2-3bac201fa918\") " pod="ai-tenant-e2e-shared-b-01bc1b/sub-test-model-01bc1b-kserve-75b48cbff7-llmqv"
Jul 30 21:19:18.573373 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:19:18.573287    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-01bc1b/sub-test-model-01bc1b-kserve-75b48cbff7-llmqv"
Jul 30 21:19:18.713582 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:19:18.713553    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-01bc1b/sub-test-model-01bc1b-kserve-75b48cbff7-llmqv"]
Jul 30 21:19:18.715513 ip-10-0-142-69 kubenswrapper[2583]: W0730 21:19:18.715477    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd66d4154_7f41_416e_b5d2_3bac201fa918.slice/crio-64306e3e56eef013d336036f36d2948d603df2f7623c8cdcc2081a904291a48f WatchSource:0}: Error finding container 64306e3e56eef013d336036f36d2948d603df2f7623c8cdcc2081a904291a48f: Status 404 returned error can't find the container with id 64306e3e56eef013d336036f36d2948d603df2f7623c8cdcc2081a904291a48f
Jul 30 21:19:19.424346 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:19:19.424311    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:19:19.520116 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:19:19.520074    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-01bc1b/sub-test-model-01bc1b-kserve-75b48cbff7-llmqv" event={"ID":"d66d4154-7f41-416e-b5d2-3bac201fa918","Type":"ContainerStarted","Data":"6192d64efac3a1873a371841aa3bceab97e11d13c8401a75731e339845587662"}
Jul 30 21:19:19.520294 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:19:19.520124    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-01bc1b/sub-test-model-01bc1b-kserve-75b48cbff7-llmqv" event={"ID":"d66d4154-7f41-416e-b5d2-3bac201fa918","Type":"ContainerStarted","Data":"64306e3e56eef013d336036f36d2948d603df2f7623c8cdcc2081a904291a48f"}
Jul 30 21:19:19.537825 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:19:19.537770    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-01bc1b/sub-test-model-01bc1b-kserve-75b48cbff7-llmqv" podStartSLOduration=1.537757011 podStartE2EDuration="1.537757011s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 21:19:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 21:19:19.535558305 +0000 UTC m=+3271.377033939" watchObservedRunningTime="2026-07-30 21:19:19.537757011 +0000 UTC m=+3271.379232633"
Jul 30 21:19:21.449503 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:19:21.449464    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 21:19:28.573836 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:19:28.573798    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-01bc1b/sub-test-model-01bc1b-kserve-75b48cbff7-llmqv"
Jul 30 21:19:28.574355 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:19:28.573845    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-01bc1b/sub-test-model-01bc1b-kserve-75b48cbff7-llmqv"
Jul 30 21:19:28.586532 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:19:28.586506    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-01bc1b/sub-test-model-01bc1b-kserve-75b48cbff7-llmqv"
Jul 30 21:19:29.589420 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:19:29.589390    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-01bc1b/sub-test-model-01bc1b-kserve-75b48cbff7-llmqv"
Jul 30 21:19:49.091441 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:19:49.091408    2583 scope.go:117] "RemoveContainer" containerID="9bfc0b8f23537a0a1948e55eda8098d619a4f23078b00b79f636ec8bc3462f24"
Jul 30 21:19:56.245156 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:19:56.245103    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 21:20:08.760624 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:20:08.760589    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 21:20:19.843799 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:20:19.843716    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 21:20:24.697501 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:20:24.697467    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-155c1d/sub-test-model-155c1d-kserve-66d656ff9c-lnsjj"]
Jul 30 21:20:24.715402 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:20:24.715375    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:20:25.733695 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:20:25.733664    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-01bc1b/sub-test-model-01bc1b-kserve-75b48cbff7-llmqv"]
Jul 30 21:20:26.333463 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:20:26.333434    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:20:30.955789 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:20:30.955750    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 21:20:33.637908 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:20:33.637876    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-155c1d/rate-test-model-155c1d-kserve-57869bcccf-75h9w"]
Jul 30 21:20:33.640985 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:20:33.640967    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-155c1d/rate-test-model-155c1d-kserve-57869bcccf-75h9w"
Jul 30 21:20:33.643042 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:20:33.643019    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-155c1d\"/\"rate-test-model-155c1d-kserve-self-signed-certs\""
Jul 30 21:20:33.650319 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:20:33.650285    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-155c1d/rate-test-model-155c1d-kserve-57869bcccf-75h9w"]
Jul 30 21:20:33.668926 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:20:33.668899    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:20:33.798944 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:20:33.798918    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d6547089-25f6-41b0-8ab0-ba37a4fa06b3-model-cache\") pod \"rate-test-model-155c1d-kserve-57869bcccf-75h9w\" (UID: \"d6547089-25f6-41b0-8ab0-ba37a4fa06b3\") " pod="ai-tenant-e2e-shared-a-155c1d/rate-test-model-155c1d-kserve-57869bcccf-75h9w"
Jul 30 21:20:33.799048 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:20:33.798953    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d6547089-25f6-41b0-8ab0-ba37a4fa06b3-home\") pod \"rate-test-model-155c1d-kserve-57869bcccf-75h9w\" (UID: \"d6547089-25f6-41b0-8ab0-ba37a4fa06b3\") " pod="ai-tenant-e2e-shared-a-155c1d/rate-test-model-155c1d-kserve-57869bcccf-75h9w"
Jul 30 21:20:33.799048 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:20:33.799010    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d6547089-25f6-41b0-8ab0-ba37a4fa06b3-tls-certs\") pod \"rate-test-model-155c1d-kserve-57869bcccf-75h9w\" (UID: \"d6547089-25f6-41b0-8ab0-ba37a4fa06b3\") " pod="ai-tenant-e2e-shared-a-155c1d/rate-test-model-155c1d-kserve-57869bcccf-75h9w"
Jul 30 21:20:33.799128 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:20:33.799049    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d6547089-25f6-41b0-8ab0-ba37a4fa06b3-dshm\") pod \"rate-test-model-155c1d-kserve-57869bcccf-75h9w\" (UID: \"d6547089-25f6-41b0-8ab0-ba37a4fa06b3\") " pod="ai-tenant-e2e-shared-a-155c1d/rate-test-model-155c1d-kserve-57869bcccf-75h9w"
Jul 30 21:20:33.799128 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:20:33.799072    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d6547089-25f6-41b0-8ab0-ba37a4fa06b3-tmp-dir\") pod \"rate-test-model-155c1d-kserve-57869bcccf-75h9w\" (UID: \"d6547089-25f6-41b0-8ab0-ba37a4fa06b3\") " pod="ai-tenant-e2e-shared-a-155c1d/rate-test-model-155c1d-kserve-57869bcccf-75h9w"
Jul 30 21:20:33.799128 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:20:33.799117    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwdgz\" (UniqueName: \"kubernetes.io/projected/d6547089-25f6-41b0-8ab0-ba37a4fa06b3-kube-api-access-xwdgz\") pod \"rate-test-model-155c1d-kserve-57869bcccf-75h9w\" (UID: \"d6547089-25f6-41b0-8ab0-ba37a4fa06b3\") " pod="ai-tenant-e2e-shared-a-155c1d/rate-test-model-155c1d-kserve-57869bcccf-75h9w"
Jul 30 21:20:33.900509 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:20:33.900485    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d6547089-25f6-41b0-8ab0-ba37a4fa06b3-tls-certs\") pod \"rate-test-model-155c1d-kserve-57869bcccf-75h9w\" (UID: \"d6547089-25f6-41b0-8ab0-ba37a4fa06b3\") " pod="ai-tenant-e2e-shared-a-155c1d/rate-test-model-155c1d-kserve-57869bcccf-75h9w"
Jul 30 21:20:33.900611 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:20:33.900520    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d6547089-25f6-41b0-8ab0-ba37a4fa06b3-dshm\") pod \"rate-test-model-155c1d-kserve-57869bcccf-75h9w\" (UID: \"d6547089-25f6-41b0-8ab0-ba37a4fa06b3\") " pod="ai-tenant-e2e-shared-a-155c1d/rate-test-model-155c1d-kserve-57869bcccf-75h9w"
Jul 30 21:20:33.900611 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:20:33.900541    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d6547089-25f6-41b0-8ab0-ba37a4fa06b3-tmp-dir\") pod \"rate-test-model-155c1d-kserve-57869bcccf-75h9w\" (UID: \"d6547089-25f6-41b0-8ab0-ba37a4fa06b3\") " pod="ai-tenant-e2e-shared-a-155c1d/rate-test-model-155c1d-kserve-57869bcccf-75h9w"
Jul 30 21:20:33.900611 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:20:33.900596    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwdgz\" (UniqueName: \"kubernetes.io/projected/d6547089-25f6-41b0-8ab0-ba37a4fa06b3-kube-api-access-xwdgz\") pod \"rate-test-model-155c1d-kserve-57869bcccf-75h9w\" (UID: \"d6547089-25f6-41b0-8ab0-ba37a4fa06b3\") " pod="ai-tenant-e2e-shared-a-155c1d/rate-test-model-155c1d-kserve-57869bcccf-75h9w"
Jul 30 21:20:33.900755 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:20:33.900641    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d6547089-25f6-41b0-8ab0-ba37a4fa06b3-model-cache\") pod \"rate-test-model-155c1d-kserve-57869bcccf-75h9w\" (UID: \"d6547089-25f6-41b0-8ab0-ba37a4fa06b3\") " pod="ai-tenant-e2e-shared-a-155c1d/rate-test-model-155c1d-kserve-57869bcccf-75h9w"
Jul 30 21:20:33.900815 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:20:33.900772    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d6547089-25f6-41b0-8ab0-ba37a4fa06b3-home\") pod \"rate-test-model-155c1d-kserve-57869bcccf-75h9w\" (UID: \"d6547089-25f6-41b0-8ab0-ba37a4fa06b3\") " pod="ai-tenant-e2e-shared-a-155c1d/rate-test-model-155c1d-kserve-57869bcccf-75h9w"
Jul 30 21:20:33.901004 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:20:33.900983    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d6547089-25f6-41b0-8ab0-ba37a4fa06b3-tmp-dir\") pod \"rate-test-model-155c1d-kserve-57869bcccf-75h9w\" (UID: \"d6547089-25f6-41b0-8ab0-ba37a4fa06b3\") " pod="ai-tenant-e2e-shared-a-155c1d/rate-test-model-155c1d-kserve-57869bcccf-75h9w"
Jul 30 21:20:33.901090 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:20:33.901006    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d6547089-25f6-41b0-8ab0-ba37a4fa06b3-model-cache\") pod \"rate-test-model-155c1d-kserve-57869bcccf-75h9w\" (UID: \"d6547089-25f6-41b0-8ab0-ba37a4fa06b3\") " pod="ai-tenant-e2e-shared-a-155c1d/rate-test-model-155c1d-kserve-57869bcccf-75h9w"
Jul 30 21:20:33.901252 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:20:33.901230    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d6547089-25f6-41b0-8ab0-ba37a4fa06b3-home\") pod \"rate-test-model-155c1d-kserve-57869bcccf-75h9w\" (UID: \"d6547089-25f6-41b0-8ab0-ba37a4fa06b3\") " pod="ai-tenant-e2e-shared-a-155c1d/rate-test-model-155c1d-kserve-57869bcccf-75h9w"
Jul 30 21:20:33.902935 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:20:33.902909    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d6547089-25f6-41b0-8ab0-ba37a4fa06b3-dshm\") pod \"rate-test-model-155c1d-kserve-57869bcccf-75h9w\" (UID: \"d6547089-25f6-41b0-8ab0-ba37a4fa06b3\") " pod="ai-tenant-e2e-shared-a-155c1d/rate-test-model-155c1d-kserve-57869bcccf-75h9w"
Jul 30 21:20:33.903100 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:20:33.903084    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d6547089-25f6-41b0-8ab0-ba37a4fa06b3-tls-certs\") pod \"rate-test-model-155c1d-kserve-57869bcccf-75h9w\" (UID: \"d6547089-25f6-41b0-8ab0-ba37a4fa06b3\") " pod="ai-tenant-e2e-shared-a-155c1d/rate-test-model-155c1d-kserve-57869bcccf-75h9w"
Jul 30 21:20:33.907576 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:20:33.907556    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwdgz\" (UniqueName: \"kubernetes.io/projected/d6547089-25f6-41b0-8ab0-ba37a4fa06b3-kube-api-access-xwdgz\") pod \"rate-test-model-155c1d-kserve-57869bcccf-75h9w\" (UID: \"d6547089-25f6-41b0-8ab0-ba37a4fa06b3\") " pod="ai-tenant-e2e-shared-a-155c1d/rate-test-model-155c1d-kserve-57869bcccf-75h9w"
Jul 30 21:20:33.951745 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:20:33.951722    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-155c1d/rate-test-model-155c1d-kserve-57869bcccf-75h9w"
Jul 30 21:20:34.086575 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:20:34.086532    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-155c1d/rate-test-model-155c1d-kserve-57869bcccf-75h9w"]
Jul 30 21:20:34.088449 ip-10-0-142-69 kubenswrapper[2583]: W0730 21:20:34.088425    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd6547089_25f6_41b0_8ab0_ba37a4fa06b3.slice/crio-3536a8f70ed621cd7b5d2a85a848f24deffb12c1b6a1e3034a24e880122d4f06 WatchSource:0}: Error finding container 3536a8f70ed621cd7b5d2a85a848f24deffb12c1b6a1e3034a24e880122d4f06: Status 404 returned error can't find the container with id 3536a8f70ed621cd7b5d2a85a848f24deffb12c1b6a1e3034a24e880122d4f06
Jul 30 21:20:34.950177 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:20:34.950051    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-155c1d/rate-test-model-155c1d-kserve-57869bcccf-75h9w" event={"ID":"d6547089-25f6-41b0-8ab0-ba37a4fa06b3","Type":"ContainerStarted","Data":"52294b3760d0893c974250d37e81ce14ae648905c2d74059838fbced960d5ef1"}
Jul 30 21:20:34.950559 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:20:34.950112    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-155c1d/rate-test-model-155c1d-kserve-57869bcccf-75h9w" event={"ID":"d6547089-25f6-41b0-8ab0-ba37a4fa06b3","Type":"ContainerStarted","Data":"3536a8f70ed621cd7b5d2a85a848f24deffb12c1b6a1e3034a24e880122d4f06"}
Jul 30 21:20:34.967170 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:20:34.967111    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-155c1d/rate-test-model-155c1d-kserve-57869bcccf-75h9w" podStartSLOduration=1.967096584 podStartE2EDuration="1.967096584s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 21:20:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 21:20:34.964959015 +0000 UTC m=+3346.806434640" watchObservedRunningTime="2026-07-30 21:20:34.967096584 +0000 UTC m=+3346.808572206"
Jul 30 21:20:36.444555 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:20:36.444520    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 21:20:39.717016 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:20:39.716969    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-155c1d/sub-test-model-155c1d-kserve-66d656ff9c-lnsjj" podUID="8f5e70c0-3831-4c27-b1c3-7f5c5e333802" containerName="main" containerID="cri-o://420d549524dccf0acb17e00469eed7e50e1c780bcac521e19b74ff96eb7bea46" gracePeriod=45
Jul 30 21:20:39.971948 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:20:39.971883    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-155c1d/sub-test-model-155c1d-kserve-66d656ff9c-lnsjj"
Jul 30 21:20:39.977749 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:20:39.977723    2583 generic.go:356] "Generic (PLEG): container finished" podID="8f5e70c0-3831-4c27-b1c3-7f5c5e333802" containerID="420d549524dccf0acb17e00469eed7e50e1c780bcac521e19b74ff96eb7bea46" exitCode=0
Jul 30 21:20:39.977845 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:20:39.977758    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-155c1d/sub-test-model-155c1d-kserve-66d656ff9c-lnsjj"
Jul 30 21:20:39.977845 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:20:39.977758    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-155c1d/sub-test-model-155c1d-kserve-66d656ff9c-lnsjj" event={"ID":"8f5e70c0-3831-4c27-b1c3-7f5c5e333802","Type":"ContainerDied","Data":"420d549524dccf0acb17e00469eed7e50e1c780bcac521e19b74ff96eb7bea46"}
Jul 30 21:20:39.977845 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:20:39.977799    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-155c1d/sub-test-model-155c1d-kserve-66d656ff9c-lnsjj" event={"ID":"8f5e70c0-3831-4c27-b1c3-7f5c5e333802","Type":"ContainerDied","Data":"48bc7feacd48933eaeca023f95d0aee130a39c99c31f910943e77f5b6d7cca85"}
Jul 30 21:20:39.977845 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:20:39.977819    2583 scope.go:117] "RemoveContainer" containerID="420d549524dccf0acb17e00469eed7e50e1c780bcac521e19b74ff96eb7bea46"
Jul 30 21:20:39.987115 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:20:39.987088    2583 scope.go:117] "RemoveContainer" containerID="420d549524dccf0acb17e00469eed7e50e1c780bcac521e19b74ff96eb7bea46"
Jul 30 21:20:39.987517 ip-10-0-142-69 kubenswrapper[2583]: E0730 21:20:39.987498    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"420d549524dccf0acb17e00469eed7e50e1c780bcac521e19b74ff96eb7bea46\": container with ID starting with 420d549524dccf0acb17e00469eed7e50e1c780bcac521e19b74ff96eb7bea46 not found: ID does not exist" containerID="420d549524dccf0acb17e00469eed7e50e1c780bcac521e19b74ff96eb7bea46"
Jul 30 21:20:39.987641 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:20:39.987524    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"420d549524dccf0acb17e00469eed7e50e1c780bcac521e19b74ff96eb7bea46"} err="failed to get container status \"420d549524dccf0acb17e00469eed7e50e1c780bcac521e19b74ff96eb7bea46\": rpc error: code = NotFound desc = could not find container \"420d549524dccf0acb17e00469eed7e50e1c780bcac521e19b74ff96eb7bea46\": container with ID starting with 420d549524dccf0acb17e00469eed7e50e1c780bcac521e19b74ff96eb7bea46 not found: ID does not exist"
Jul 30 21:20:40.055091 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:20:40.055064    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8f5e70c0-3831-4c27-b1c3-7f5c5e333802-tls-certs\") pod \"8f5e70c0-3831-4c27-b1c3-7f5c5e333802\" (UID: \"8f5e70c0-3831-4c27-b1c3-7f5c5e333802\") "
Jul 30 21:20:40.055091 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:20:40.055092    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q568l\" (UniqueName: \"kubernetes.io/projected/8f5e70c0-3831-4c27-b1c3-7f5c5e333802-kube-api-access-q568l\") pod \"8f5e70c0-3831-4c27-b1c3-7f5c5e333802\" (UID: \"8f5e70c0-3831-4c27-b1c3-7f5c5e333802\") "
Jul 30 21:20:40.055333 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:20:40.055157    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8f5e70c0-3831-4c27-b1c3-7f5c5e333802-home\") pod \"8f5e70c0-3831-4c27-b1c3-7f5c5e333802\" (UID: \"8f5e70c0-3831-4c27-b1c3-7f5c5e333802\") "
Jul 30 21:20:40.055395 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:20:40.055340    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8f5e70c0-3831-4c27-b1c3-7f5c5e333802-model-cache\") pod \"8f5e70c0-3831-4c27-b1c3-7f5c5e333802\" (UID: \"8f5e70c0-3831-4c27-b1c3-7f5c5e333802\") "
Jul 30 21:20:40.055395 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:20:40.055374    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8f5e70c0-3831-4c27-b1c3-7f5c5e333802-tmp-dir\") pod \"8f5e70c0-3831-4c27-b1c3-7f5c5e333802\" (UID: \"8f5e70c0-3831-4c27-b1c3-7f5c5e333802\") "
Jul 30 21:20:40.055500 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:20:40.055397    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f5e70c0-3831-4c27-b1c3-7f5c5e333802-home" (OuterVolumeSpecName: "home") pod "8f5e70c0-3831-4c27-b1c3-7f5c5e333802" (UID: "8f5e70c0-3831-4c27-b1c3-7f5c5e333802"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:20:40.055500 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:20:40.055416    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8f5e70c0-3831-4c27-b1c3-7f5c5e333802-dshm\") pod \"8f5e70c0-3831-4c27-b1c3-7f5c5e333802\" (UID: \"8f5e70c0-3831-4c27-b1c3-7f5c5e333802\") "
Jul 30 21:20:40.055618 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:20:40.055581    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f5e70c0-3831-4c27-b1c3-7f5c5e333802-model-cache" (OuterVolumeSpecName: "model-cache") pod "8f5e70c0-3831-4c27-b1c3-7f5c5e333802" (UID: "8f5e70c0-3831-4c27-b1c3-7f5c5e333802"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:20:40.055618 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:20:40.055589    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f5e70c0-3831-4c27-b1c3-7f5c5e333802-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "8f5e70c0-3831-4c27-b1c3-7f5c5e333802" (UID: "8f5e70c0-3831-4c27-b1c3-7f5c5e333802"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:20:40.055831 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:20:40.055810    2583 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8f5e70c0-3831-4c27-b1c3-7f5c5e333802-home\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 21:20:40.055831 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:20:40.055832    2583 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8f5e70c0-3831-4c27-b1c3-7f5c5e333802-model-cache\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 21:20:40.055992 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:20:40.055867    2583 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8f5e70c0-3831-4c27-b1c3-7f5c5e333802-tmp-dir\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 21:20:40.057434 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:20:40.057404    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f5e70c0-3831-4c27-b1c3-7f5c5e333802-kube-api-access-q568l" (OuterVolumeSpecName: "kube-api-access-q568l") pod "8f5e70c0-3831-4c27-b1c3-7f5c5e333802" (UID: "8f5e70c0-3831-4c27-b1c3-7f5c5e333802"). InnerVolumeSpecName "kube-api-access-q568l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 21:20:40.057434 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:20:40.057410    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f5e70c0-3831-4c27-b1c3-7f5c5e333802-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "8f5e70c0-3831-4c27-b1c3-7f5c5e333802" (UID: "8f5e70c0-3831-4c27-b1c3-7f5c5e333802"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 21:20:40.057556 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:20:40.057469    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f5e70c0-3831-4c27-b1c3-7f5c5e333802-dshm" (OuterVolumeSpecName: "dshm") pod "8f5e70c0-3831-4c27-b1c3-7f5c5e333802" (UID: "8f5e70c0-3831-4c27-b1c3-7f5c5e333802"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:20:40.157011 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:20:40.156980    2583 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8f5e70c0-3831-4c27-b1c3-7f5c5e333802-dshm\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 21:20:40.157011 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:20:40.157006    2583 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8f5e70c0-3831-4c27-b1c3-7f5c5e333802-tls-certs\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 21:20:40.157198 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:20:40.157022    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q568l\" (UniqueName: \"kubernetes.io/projected/8f5e70c0-3831-4c27-b1c3-7f5c5e333802-kube-api-access-q568l\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 21:20:40.299459 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:20:40.299423    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-155c1d/sub-test-model-155c1d-kserve-66d656ff9c-lnsjj"]
Jul 30 21:20:40.306588 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:20:40.306566    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-155c1d/sub-test-model-155c1d-kserve-66d656ff9c-lnsjj"]
Jul 30 21:20:40.676476 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:20:40.676436    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8f5e70c0-3831-4c27-b1c3-7f5c5e333802" path="/var/lib/kubelet/pods/8f5e70c0-3831-4c27-b1c3-7f5c5e333802/volumes"
Jul 30 21:20:40.752896 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:20:40.752860    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-01bc1b/sub-test-model-01bc1b-kserve-75b48cbff7-llmqv" podUID="d66d4154-7f41-416e-b5d2-3bac201fa918" containerName="main" containerID="cri-o://6192d64efac3a1873a371841aa3bceab97e11d13c8401a75731e339845587662" gracePeriod=45
Jul 30 21:20:40.985317 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:20:40.985244    2583 generic.go:356] "Generic (PLEG): container finished" podID="d66d4154-7f41-416e-b5d2-3bac201fa918" containerID="6192d64efac3a1873a371841aa3bceab97e11d13c8401a75731e339845587662" exitCode=0
Jul 30 21:20:40.985449 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:20:40.985313    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-01bc1b/sub-test-model-01bc1b-kserve-75b48cbff7-llmqv" event={"ID":"d66d4154-7f41-416e-b5d2-3bac201fa918","Type":"ContainerDied","Data":"6192d64efac3a1873a371841aa3bceab97e11d13c8401a75731e339845587662"}
Jul 30 21:20:41.009056 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:20:41.009031    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-01bc1b/sub-test-model-01bc1b-kserve-75b48cbff7-llmqv"
Jul 30 21:20:41.168417 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:20:41.168387    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d66d4154-7f41-416e-b5d2-3bac201fa918-tls-certs\") pod \"d66d4154-7f41-416e-b5d2-3bac201fa918\" (UID: \"d66d4154-7f41-416e-b5d2-3bac201fa918\") "
Jul 30 21:20:41.168558 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:20:41.168425    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d66d4154-7f41-416e-b5d2-3bac201fa918-home\") pod \"d66d4154-7f41-416e-b5d2-3bac201fa918\" (UID: \"d66d4154-7f41-416e-b5d2-3bac201fa918\") "
Jul 30 21:20:41.168558 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:20:41.168496    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d66d4154-7f41-416e-b5d2-3bac201fa918-tmp-dir\") pod \"d66d4154-7f41-416e-b5d2-3bac201fa918\" (UID: \"d66d4154-7f41-416e-b5d2-3bac201fa918\") "
Jul 30 21:20:41.168558 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:20:41.168514    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tm7ff\" (UniqueName: \"kubernetes.io/projected/d66d4154-7f41-416e-b5d2-3bac201fa918-kube-api-access-tm7ff\") pod \"d66d4154-7f41-416e-b5d2-3bac201fa918\" (UID: \"d66d4154-7f41-416e-b5d2-3bac201fa918\") "
Jul 30 21:20:41.168558 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:20:41.168543    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d66d4154-7f41-416e-b5d2-3bac201fa918-dshm\") pod \"d66d4154-7f41-416e-b5d2-3bac201fa918\" (UID: \"d66d4154-7f41-416e-b5d2-3bac201fa918\") "
Jul 30 21:20:41.168775 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:20:41.168564    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d66d4154-7f41-416e-b5d2-3bac201fa918-model-cache\") pod \"d66d4154-7f41-416e-b5d2-3bac201fa918\" (UID: \"d66d4154-7f41-416e-b5d2-3bac201fa918\") "
Jul 30 21:20:41.168775 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:20:41.168735    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d66d4154-7f41-416e-b5d2-3bac201fa918-home" (OuterVolumeSpecName: "home") pod "d66d4154-7f41-416e-b5d2-3bac201fa918" (UID: "d66d4154-7f41-416e-b5d2-3bac201fa918"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:20:41.168775 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:20:41.168766    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d66d4154-7f41-416e-b5d2-3bac201fa918-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d66d4154-7f41-416e-b5d2-3bac201fa918" (UID: "d66d4154-7f41-416e-b5d2-3bac201fa918"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:20:41.168927 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:20:41.168860    2583 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d66d4154-7f41-416e-b5d2-3bac201fa918-home\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 21:20:41.168927 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:20:41.168879    2583 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d66d4154-7f41-416e-b5d2-3bac201fa918-tmp-dir\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 21:20:41.169010 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:20:41.168924    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d66d4154-7f41-416e-b5d2-3bac201fa918-model-cache" (OuterVolumeSpecName: "model-cache") pod "d66d4154-7f41-416e-b5d2-3bac201fa918" (UID: "d66d4154-7f41-416e-b5d2-3bac201fa918"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:20:41.170765 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:20:41.170733    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d66d4154-7f41-416e-b5d2-3bac201fa918-dshm" (OuterVolumeSpecName: "dshm") pod "d66d4154-7f41-416e-b5d2-3bac201fa918" (UID: "d66d4154-7f41-416e-b5d2-3bac201fa918"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:20:41.170855 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:20:41.170778    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d66d4154-7f41-416e-b5d2-3bac201fa918-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d66d4154-7f41-416e-b5d2-3bac201fa918" (UID: "d66d4154-7f41-416e-b5d2-3bac201fa918"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 21:20:41.170855 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:20:41.170825    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d66d4154-7f41-416e-b5d2-3bac201fa918-kube-api-access-tm7ff" (OuterVolumeSpecName: "kube-api-access-tm7ff") pod "d66d4154-7f41-416e-b5d2-3bac201fa918" (UID: "d66d4154-7f41-416e-b5d2-3bac201fa918"). InnerVolumeSpecName "kube-api-access-tm7ff". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 21:20:41.269622 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:20:41.269554    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tm7ff\" (UniqueName: \"kubernetes.io/projected/d66d4154-7f41-416e-b5d2-3bac201fa918-kube-api-access-tm7ff\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 21:20:41.269622 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:20:41.269577    2583 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d66d4154-7f41-416e-b5d2-3bac201fa918-dshm\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 21:20:41.269622 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:20:41.269590    2583 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d66d4154-7f41-416e-b5d2-3bac201fa918-model-cache\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 21:20:41.269622 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:20:41.269604    2583 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d66d4154-7f41-416e-b5d2-3bac201fa918-tls-certs\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 21:20:41.993393 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:20:41.993362    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-01bc1b/sub-test-model-01bc1b-kserve-75b48cbff7-llmqv"
Jul 30 21:20:41.993813 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:20:41.993402    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-01bc1b/sub-test-model-01bc1b-kserve-75b48cbff7-llmqv" event={"ID":"d66d4154-7f41-416e-b5d2-3bac201fa918","Type":"ContainerDied","Data":"64306e3e56eef013d336036f36d2948d603df2f7623c8cdcc2081a904291a48f"}
Jul 30 21:20:41.993813 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:20:41.993453    2583 scope.go:117] "RemoveContainer" containerID="6192d64efac3a1873a371841aa3bceab97e11d13c8401a75731e339845587662"
Jul 30 21:20:42.014505 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:20:42.014480    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-01bc1b/sub-test-model-01bc1b-kserve-75b48cbff7-llmqv"]
Jul 30 21:20:42.019553 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:20:42.019532    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-01bc1b/sub-test-model-01bc1b-kserve-75b48cbff7-llmqv"]
Jul 30 21:20:42.677223 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:20:42.677189    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d66d4154-7f41-416e-b5d2-3bac201fa918" path="/var/lib/kubelet/pods/d66d4154-7f41-416e-b5d2-3bac201fa918/volumes"
Jul 30 21:20:43.952182 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:20:43.952119    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-155c1d/rate-test-model-155c1d-kserve-57869bcccf-75h9w"
Jul 30 21:20:43.952182 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:20:43.952191    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-155c1d/rate-test-model-155c1d-kserve-57869bcccf-75h9w"
Jul 30 21:20:43.964788 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:20:43.964763    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-155c1d/rate-test-model-155c1d-kserve-57869bcccf-75h9w"
Jul 30 21:20:44.019197 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:20:44.019162    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-155c1d/rate-test-model-155c1d-kserve-57869bcccf-75h9w"
Jul 30 21:21:06.049353 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:21:06.049322    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:21:31.250307 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:21:31.250266    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-01bc1b/rate-test-model-01bc1b-kserve-6474c5cc9f-wwcs2"]
Jul 30 21:21:31.250852 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:21:31.250834    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f5e70c0-3831-4c27-b1c3-7f5c5e333802" containerName="main"
Jul 30 21:21:31.250902 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:21:31.250855    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f5e70c0-3831-4c27-b1c3-7f5c5e333802" containerName="main"
Jul 30 21:21:31.250902 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:21:31.250868    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d66d4154-7f41-416e-b5d2-3bac201fa918" containerName="main"
Jul 30 21:21:31.250902 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:21:31.250874    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="d66d4154-7f41-416e-b5d2-3bac201fa918" containerName="main"
Jul 30 21:21:31.251011 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:21:31.250956    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f5e70c0-3831-4c27-b1c3-7f5c5e333802" containerName="main"
Jul 30 21:21:31.251011 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:21:31.250965    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="d66d4154-7f41-416e-b5d2-3bac201fa918" containerName="main"
Jul 30 21:21:31.253967 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:21:31.253950    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-01bc1b/rate-test-model-01bc1b-kserve-6474c5cc9f-wwcs2"
Jul 30 21:21:31.256905 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:21:31.256883    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-01bc1b\"/\"kube-root-ca.crt\""
Jul 30 21:21:31.257040 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:21:31.256910    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-01bc1b\"/\"default-dockercfg-b6qdq\""
Jul 30 21:21:31.257040 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:21:31.256945    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-01bc1b\"/\"openshift-service-ca.crt\""
Jul 30 21:21:31.257040 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:21:31.256881    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-01bc1b\"/\"rate-test-model-01bc1b-kserve-self-signed-certs\""
Jul 30 21:21:31.268519 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:21:31.268498    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-01bc1b/rate-test-model-01bc1b-kserve-6474c5cc9f-wwcs2"]
Jul 30 21:21:31.287319 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:21:31.287294    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:21:31.386985 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:21:31.386959    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/04d47359-abf0-49c4-8afa-61410b1dc87b-model-cache\") pod \"rate-test-model-01bc1b-kserve-6474c5cc9f-wwcs2\" (UID: \"04d47359-abf0-49c4-8afa-61410b1dc87b\") " pod="ai-tenant-e2e-shared-b-01bc1b/rate-test-model-01bc1b-kserve-6474c5cc9f-wwcs2"
Jul 30 21:21:31.387087 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:21:31.387002    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/04d47359-abf0-49c4-8afa-61410b1dc87b-home\") pod \"rate-test-model-01bc1b-kserve-6474c5cc9f-wwcs2\" (UID: \"04d47359-abf0-49c4-8afa-61410b1dc87b\") " pod="ai-tenant-e2e-shared-b-01bc1b/rate-test-model-01bc1b-kserve-6474c5cc9f-wwcs2"
Jul 30 21:21:31.387087 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:21:31.387067    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/04d47359-abf0-49c4-8afa-61410b1dc87b-tmp-dir\") pod \"rate-test-model-01bc1b-kserve-6474c5cc9f-wwcs2\" (UID: \"04d47359-abf0-49c4-8afa-61410b1dc87b\") " pod="ai-tenant-e2e-shared-b-01bc1b/rate-test-model-01bc1b-kserve-6474c5cc9f-wwcs2"
Jul 30 21:21:31.387265 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:21:31.387090    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/04d47359-abf0-49c4-8afa-61410b1dc87b-dshm\") pod \"rate-test-model-01bc1b-kserve-6474c5cc9f-wwcs2\" (UID: \"04d47359-abf0-49c4-8afa-61410b1dc87b\") " pod="ai-tenant-e2e-shared-b-01bc1b/rate-test-model-01bc1b-kserve-6474c5cc9f-wwcs2"
Jul 30 21:21:31.387265 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:21:31.387190    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/04d47359-abf0-49c4-8afa-61410b1dc87b-tls-certs\") pod \"rate-test-model-01bc1b-kserve-6474c5cc9f-wwcs2\" (UID: \"04d47359-abf0-49c4-8afa-61410b1dc87b\") " pod="ai-tenant-e2e-shared-b-01bc1b/rate-test-model-01bc1b-kserve-6474c5cc9f-wwcs2"
Jul 30 21:21:31.387265 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:21:31.387217    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2m9gm\" (UniqueName: \"kubernetes.io/projected/04d47359-abf0-49c4-8afa-61410b1dc87b-kube-api-access-2m9gm\") pod \"rate-test-model-01bc1b-kserve-6474c5cc9f-wwcs2\" (UID: \"04d47359-abf0-49c4-8afa-61410b1dc87b\") " pod="ai-tenant-e2e-shared-b-01bc1b/rate-test-model-01bc1b-kserve-6474c5cc9f-wwcs2"
Jul 30 21:21:31.488439 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:21:31.488420    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/04d47359-abf0-49c4-8afa-61410b1dc87b-model-cache\") pod \"rate-test-model-01bc1b-kserve-6474c5cc9f-wwcs2\" (UID: \"04d47359-abf0-49c4-8afa-61410b1dc87b\") " pod="ai-tenant-e2e-shared-b-01bc1b/rate-test-model-01bc1b-kserve-6474c5cc9f-wwcs2"
Jul 30 21:21:31.488525 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:21:31.488448    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/04d47359-abf0-49c4-8afa-61410b1dc87b-home\") pod \"rate-test-model-01bc1b-kserve-6474c5cc9f-wwcs2\" (UID: \"04d47359-abf0-49c4-8afa-61410b1dc87b\") " pod="ai-tenant-e2e-shared-b-01bc1b/rate-test-model-01bc1b-kserve-6474c5cc9f-wwcs2"
Jul 30 21:21:31.488525 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:21:31.488479    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/04d47359-abf0-49c4-8afa-61410b1dc87b-tmp-dir\") pod \"rate-test-model-01bc1b-kserve-6474c5cc9f-wwcs2\" (UID: \"04d47359-abf0-49c4-8afa-61410b1dc87b\") " pod="ai-tenant-e2e-shared-b-01bc1b/rate-test-model-01bc1b-kserve-6474c5cc9f-wwcs2"
Jul 30 21:21:31.488631 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:21:31.488594    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/04d47359-abf0-49c4-8afa-61410b1dc87b-dshm\") pod \"rate-test-model-01bc1b-kserve-6474c5cc9f-wwcs2\" (UID: \"04d47359-abf0-49c4-8afa-61410b1dc87b\") " pod="ai-tenant-e2e-shared-b-01bc1b/rate-test-model-01bc1b-kserve-6474c5cc9f-wwcs2"
Jul 30 21:21:31.488685 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:21:31.488663    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/04d47359-abf0-49c4-8afa-61410b1dc87b-tls-certs\") pod \"rate-test-model-01bc1b-kserve-6474c5cc9f-wwcs2\" (UID: \"04d47359-abf0-49c4-8afa-61410b1dc87b\") " pod="ai-tenant-e2e-shared-b-01bc1b/rate-test-model-01bc1b-kserve-6474c5cc9f-wwcs2"
Jul 30 21:21:31.488752 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:21:31.488688    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2m9gm\" (UniqueName: \"kubernetes.io/projected/04d47359-abf0-49c4-8afa-61410b1dc87b-kube-api-access-2m9gm\") pod \"rate-test-model-01bc1b-kserve-6474c5cc9f-wwcs2\" (UID: \"04d47359-abf0-49c4-8afa-61410b1dc87b\") " pod="ai-tenant-e2e-shared-b-01bc1b/rate-test-model-01bc1b-kserve-6474c5cc9f-wwcs2"
Jul 30 21:21:31.488805 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:21:31.488750    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/04d47359-abf0-49c4-8afa-61410b1dc87b-home\") pod \"rate-test-model-01bc1b-kserve-6474c5cc9f-wwcs2\" (UID: \"04d47359-abf0-49c4-8afa-61410b1dc87b\") " pod="ai-tenant-e2e-shared-b-01bc1b/rate-test-model-01bc1b-kserve-6474c5cc9f-wwcs2"
Jul 30 21:21:31.488863 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:21:31.488827    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/04d47359-abf0-49c4-8afa-61410b1dc87b-model-cache\") pod \"rate-test-model-01bc1b-kserve-6474c5cc9f-wwcs2\" (UID: \"04d47359-abf0-49c4-8afa-61410b1dc87b\") " pod="ai-tenant-e2e-shared-b-01bc1b/rate-test-model-01bc1b-kserve-6474c5cc9f-wwcs2"
Jul 30 21:21:31.488915 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:21:31.488879    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/04d47359-abf0-49c4-8afa-61410b1dc87b-tmp-dir\") pod \"rate-test-model-01bc1b-kserve-6474c5cc9f-wwcs2\" (UID: \"04d47359-abf0-49c4-8afa-61410b1dc87b\") " pod="ai-tenant-e2e-shared-b-01bc1b/rate-test-model-01bc1b-kserve-6474c5cc9f-wwcs2"
Jul 30 21:21:31.490881 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:21:31.490861    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/04d47359-abf0-49c4-8afa-61410b1dc87b-dshm\") pod \"rate-test-model-01bc1b-kserve-6474c5cc9f-wwcs2\" (UID: \"04d47359-abf0-49c4-8afa-61410b1dc87b\") " pod="ai-tenant-e2e-shared-b-01bc1b/rate-test-model-01bc1b-kserve-6474c5cc9f-wwcs2"
Jul 30 21:21:31.491170 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:21:31.491125    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/04d47359-abf0-49c4-8afa-61410b1dc87b-tls-certs\") pod \"rate-test-model-01bc1b-kserve-6474c5cc9f-wwcs2\" (UID: \"04d47359-abf0-49c4-8afa-61410b1dc87b\") " pod="ai-tenant-e2e-shared-b-01bc1b/rate-test-model-01bc1b-kserve-6474c5cc9f-wwcs2"
Jul 30 21:21:31.500750 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:21:31.500693    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2m9gm\" (UniqueName: \"kubernetes.io/projected/04d47359-abf0-49c4-8afa-61410b1dc87b-kube-api-access-2m9gm\") pod \"rate-test-model-01bc1b-kserve-6474c5cc9f-wwcs2\" (UID: \"04d47359-abf0-49c4-8afa-61410b1dc87b\") " pod="ai-tenant-e2e-shared-b-01bc1b/rate-test-model-01bc1b-kserve-6474c5cc9f-wwcs2"
Jul 30 21:21:31.562610 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:21:31.562585    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-01bc1b/rate-test-model-01bc1b-kserve-6474c5cc9f-wwcs2"
Jul 30 21:21:31.695130 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:21:31.695108    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-01bc1b/rate-test-model-01bc1b-kserve-6474c5cc9f-wwcs2"]
Jul 30 21:21:31.697321 ip-10-0-142-69 kubenswrapper[2583]: W0730 21:21:31.697295    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod04d47359_abf0_49c4_8afa_61410b1dc87b.slice/crio-42166f1681aa28d7a746090e3a5c815139e04b977b247a5b93b7b60be8daa274 WatchSource:0}: Error finding container 42166f1681aa28d7a746090e3a5c815139e04b977b247a5b93b7b60be8daa274: Status 404 returned error can't find the container with id 42166f1681aa28d7a746090e3a5c815139e04b977b247a5b93b7b60be8daa274
Jul 30 21:21:32.283192 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:21:32.283132    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-01bc1b/rate-test-model-01bc1b-kserve-6474c5cc9f-wwcs2" event={"ID":"04d47359-abf0-49c4-8afa-61410b1dc87b","Type":"ContainerStarted","Data":"fb5964a46b73b333492a06774021609802368ae516419b1b2e133f4ed7b0d372"}
Jul 30 21:21:32.283192 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:21:32.283200    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-01bc1b/rate-test-model-01bc1b-kserve-6474c5cc9f-wwcs2" event={"ID":"04d47359-abf0-49c4-8afa-61410b1dc87b","Type":"ContainerStarted","Data":"42166f1681aa28d7a746090e3a5c815139e04b977b247a5b93b7b60be8daa274"}
Jul 30 21:21:32.298250 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:21:32.298207    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-01bc1b/rate-test-model-01bc1b-kserve-6474c5cc9f-wwcs2" podStartSLOduration=1.298191955 podStartE2EDuration="1.298191955s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 21:21:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 21:21:32.297070119 +0000 UTC m=+3404.138545732" watchObservedRunningTime="2026-07-30 21:21:32.298191955 +0000 UTC m=+3404.139667574"
Jul 30 21:21:33.847975 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:21:33.847944    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 21:21:41.563480 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:21:41.563404    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-01bc1b/rate-test-model-01bc1b-kserve-6474c5cc9f-wwcs2"
Jul 30 21:21:41.563480 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:21:41.563450    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-01bc1b/rate-test-model-01bc1b-kserve-6474c5cc9f-wwcs2"
Jul 30 21:21:41.575825 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:21:41.575798    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-01bc1b/rate-test-model-01bc1b-kserve-6474c5cc9f-wwcs2"
Jul 30 21:21:42.351817 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:21:42.351785    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-01bc1b/rate-test-model-01bc1b-kserve-6474c5cc9f-wwcs2"
Jul 30 21:22:09.061318 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:09.061281    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 21:22:17.359122 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:17.359089    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 21:22:18.493407 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:18.493374    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:22:33.653865 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:33.653830    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 21:22:39.430857 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:39.430826    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-155c1d/rate-test-model-155c1d-kserve-57869bcccf-75h9w"]
Jul 30 21:22:39.453648 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:39.453621    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:22:40.622835 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:40.622804    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-01bc1b/rate-test-model-01bc1b-kserve-6474c5cc9f-wwcs2"]
Jul 30 21:22:40.640725 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:40.640693    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:22:41.680398 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:41.680366    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7635-140254617898672"]
Jul 30 21:22:41.683653 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:41.683637    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7635-140254617898672"
Jul 30 21:22:41.685507 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:41.685489    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-bsbpz\""
Jul 30 21:22:41.691983 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:41.691962    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7635-140254617898672"]
Jul 30 21:22:41.787352 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:41.787323    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bx2dh\" (UniqueName: \"kubernetes.io/projected/691eb5e4-8223-41e4-b996-e12df14f705e-kube-api-access-bx2dh\") pod \"test-curl-7635-140254617898672\" (UID: \"691eb5e4-8223-41e4-b996-e12df14f705e\") " pod="opendatahub/test-curl-7635-140254617898672"
Jul 30 21:22:41.888824 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:41.888790    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bx2dh\" (UniqueName: \"kubernetes.io/projected/691eb5e4-8223-41e4-b996-e12df14f705e-kube-api-access-bx2dh\") pod \"test-curl-7635-140254617898672\" (UID: \"691eb5e4-8223-41e4-b996-e12df14f705e\") " pod="opendatahub/test-curl-7635-140254617898672"
Jul 30 21:22:41.896885 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:41.896855    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bx2dh\" (UniqueName: \"kubernetes.io/projected/691eb5e4-8223-41e4-b996-e12df14f705e-kube-api-access-bx2dh\") pod \"test-curl-7635-140254617898672\" (UID: \"691eb5e4-8223-41e4-b996-e12df14f705e\") " pod="opendatahub/test-curl-7635-140254617898672"
Jul 30 21:22:41.994125 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:41.994068    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7635-140254617898672"
Jul 30 21:22:42.127347 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:42.127318    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7635-140254617898672"]
Jul 30 21:22:42.127844 ip-10-0-142-69 kubenswrapper[2583]: W0730 21:22:42.127822    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod691eb5e4_8223_41e4_b996_e12df14f705e.slice/crio-28f9d9f86819e083fa0bc677bfc3373f7b09d24fd26e664422fd524ddfedc014 WatchSource:0}: Error finding container 28f9d9f86819e083fa0bc677bfc3373f7b09d24fd26e664422fd524ddfedc014: Status 404 returned error can't find the container with id 28f9d9f86819e083fa0bc677bfc3373f7b09d24fd26e664422fd524ddfedc014
Jul 30 21:22:42.129130 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:42.129113    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 30 21:22:42.146614 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:42.146592    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 21:22:42.679427 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:42.679389    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7635-140254617898672" event={"ID":"691eb5e4-8223-41e4-b996-e12df14f705e","Type":"ContainerStarted","Data":"28f9d9f86819e083fa0bc677bfc3373f7b09d24fd26e664422fd524ddfedc014"}
Jul 30 21:22:43.686306 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:43.686273    2583 generic.go:356] "Generic (PLEG): container finished" podID="691eb5e4-8223-41e4-b996-e12df14f705e" containerID="a5ed44709059569f92859ed4ba07ac0babdfbb69214591814caf0b19824985c0" exitCode=0
Jul 30 21:22:43.686719 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:43.686382    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7635-140254617898672" event={"ID":"691eb5e4-8223-41e4-b996-e12df14f705e","Type":"ContainerDied","Data":"a5ed44709059569f92859ed4ba07ac0babdfbb69214591814caf0b19824985c0"}
Jul 30 21:22:44.824483 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:44.824461    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7635-140254617898672"
Jul 30 21:22:44.844147 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:44.844111    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7635-140254617898672_691eb5e4-8223-41e4-b996-e12df14f705e/test-curl-7635-140254617898672/0.log"
Jul 30 21:22:44.868440 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:44.868419    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7635-140254617898672"]
Jul 30 21:22:44.870598 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:44.870578    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7635-140254617898672"]
Jul 30 21:22:44.911843 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:44.911822    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bx2dh\" (UniqueName: \"kubernetes.io/projected/691eb5e4-8223-41e4-b996-e12df14f705e-kube-api-access-bx2dh\") pod \"691eb5e4-8223-41e4-b996-e12df14f705e\" (UID: \"691eb5e4-8223-41e4-b996-e12df14f705e\") "
Jul 30 21:22:44.913978 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:44.913960    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/691eb5e4-8223-41e4-b996-e12df14f705e-kube-api-access-bx2dh" (OuterVolumeSpecName: "kube-api-access-bx2dh") pod "691eb5e4-8223-41e4-b996-e12df14f705e" (UID: "691eb5e4-8223-41e4-b996-e12df14f705e"). InnerVolumeSpecName "kube-api-access-bx2dh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 21:22:45.002042 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:45.001985    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7635-140254617927728"]
Jul 30 21:22:45.002417 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:45.002402    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="691eb5e4-8223-41e4-b996-e12df14f705e" containerName="test-curl-7635-140254617898672"
Jul 30 21:22:45.002469 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:45.002419    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="691eb5e4-8223-41e4-b996-e12df14f705e" containerName="test-curl-7635-140254617898672"
Jul 30 21:22:45.002522 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:45.002511    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="691eb5e4-8223-41e4-b996-e12df14f705e" containerName="test-curl-7635-140254617898672"
Jul 30 21:22:45.005548 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:45.005534    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7635-140254617927728"
Jul 30 21:22:45.009472 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:45.009452    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7635-140254617927728"]
Jul 30 21:22:45.012581 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:45.012554    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kqkwg\" (UniqueName: \"kubernetes.io/projected/e26a7d8e-b5b9-48c6-b51e-cf121c42c928-kube-api-access-kqkwg\") pod \"test-curl-7635-140254617927728\" (UID: \"e26a7d8e-b5b9-48c6-b51e-cf121c42c928\") " pod="opendatahub/test-curl-7635-140254617927728"
Jul 30 21:22:45.012698 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:45.012635    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bx2dh\" (UniqueName: \"kubernetes.io/projected/691eb5e4-8223-41e4-b996-e12df14f705e-kube-api-access-bx2dh\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 21:22:45.113745 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:45.113720    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kqkwg\" (UniqueName: \"kubernetes.io/projected/e26a7d8e-b5b9-48c6-b51e-cf121c42c928-kube-api-access-kqkwg\") pod \"test-curl-7635-140254617927728\" (UID: \"e26a7d8e-b5b9-48c6-b51e-cf121c42c928\") " pod="opendatahub/test-curl-7635-140254617927728"
Jul 30 21:22:45.121945 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:45.121917    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kqkwg\" (UniqueName: \"kubernetes.io/projected/e26a7d8e-b5b9-48c6-b51e-cf121c42c928-kube-api-access-kqkwg\") pod \"test-curl-7635-140254617927728\" (UID: \"e26a7d8e-b5b9-48c6-b51e-cf121c42c928\") " pod="opendatahub/test-curl-7635-140254617927728"
Jul 30 21:22:45.315858 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:45.315776    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7635-140254617927728"
Jul 30 21:22:45.447843 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:45.447815    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7635-140254617927728"]
Jul 30 21:22:45.449649 ip-10-0-142-69 kubenswrapper[2583]: W0730 21:22:45.449628    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode26a7d8e_b5b9_48c6_b51e_cf121c42c928.slice/crio-223c75b9fbacba9607d579ae663176f24963d9f8a8ae0f7fb65aa04363c953aa WatchSource:0}: Error finding container 223c75b9fbacba9607d579ae663176f24963d9f8a8ae0f7fb65aa04363c953aa: Status 404 returned error can't find the container with id 223c75b9fbacba9607d579ae663176f24963d9f8a8ae0f7fb65aa04363c953aa
Jul 30 21:22:45.698786 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:45.698764    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7635-140254617898672"
Jul 30 21:22:45.698786 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:45.698775    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="28f9d9f86819e083fa0bc677bfc3373f7b09d24fd26e664422fd524ddfedc014"
Jul 30 21:22:45.699968 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:45.699944    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7635-140254617927728" event={"ID":"e26a7d8e-b5b9-48c6-b51e-cf121c42c928","Type":"ContainerStarted","Data":"223c75b9fbacba9607d579ae663176f24963d9f8a8ae0f7fb65aa04363c953aa"}
Jul 30 21:22:45.708492 ip-10-0-142-69 kubenswrapper[2583]: E0730 21:22:45.708471    2583 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7635-140254617898672\" is forbidden: User \"system:node:ip-10-0-142-69.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-142-69.ec2.internal' and this object" podUID="691eb5e4-8223-41e4-b996-e12df14f705e" pod="opendatahub/test-curl-7635-140254617898672"
Jul 30 21:22:46.675660 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:46.675629    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="691eb5e4-8223-41e4-b996-e12df14f705e" path="/var/lib/kubelet/pods/691eb5e4-8223-41e4-b996-e12df14f705e/volumes"
Jul 30 21:22:46.706764 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:46.706731    2583 generic.go:356] "Generic (PLEG): container finished" podID="e26a7d8e-b5b9-48c6-b51e-cf121c42c928" containerID="1bcad465d8cd006dd9e4a75be2ee06d405c004c9d5fc0098659486cce8e934f0" exitCode=0
Jul 30 21:22:46.706919 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:46.706779    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7635-140254617927728" event={"ID":"e26a7d8e-b5b9-48c6-b51e-cf121c42c928","Type":"ContainerDied","Data":"1bcad465d8cd006dd9e4a75be2ee06d405c004c9d5fc0098659486cce8e934f0"}
Jul 30 21:22:47.850027 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:47.849996    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7635-140254617927728"
Jul 30 21:22:47.867419 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:47.867393    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7635-140254617927728_e26a7d8e-b5b9-48c6-b51e-cf121c42c928/test-curl-7635-140254617927728/0.log"
Jul 30 21:22:47.886805 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:47.886781    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7635-140254617927728"]
Jul 30 21:22:47.890028 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:47.890009    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7635-140254617927728"]
Jul 30 21:22:47.935378 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:47.935355    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kqkwg\" (UniqueName: \"kubernetes.io/projected/e26a7d8e-b5b9-48c6-b51e-cf121c42c928-kube-api-access-kqkwg\") pod \"e26a7d8e-b5b9-48c6-b51e-cf121c42c928\" (UID: \"e26a7d8e-b5b9-48c6-b51e-cf121c42c928\") "
Jul 30 21:22:47.937391 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:47.937371    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e26a7d8e-b5b9-48c6-b51e-cf121c42c928-kube-api-access-kqkwg" (OuterVolumeSpecName: "kube-api-access-kqkwg") pod "e26a7d8e-b5b9-48c6-b51e-cf121c42c928" (UID: "e26a7d8e-b5b9-48c6-b51e-cf121c42c928"). InnerVolumeSpecName "kube-api-access-kqkwg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 21:22:48.036183 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:48.036105    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kqkwg\" (UniqueName: \"kubernetes.io/projected/e26a7d8e-b5b9-48c6-b51e-cf121c42c928-kube-api-access-kqkwg\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 21:22:48.054727 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:48.054698    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7635-140254617754768"]
Jul 30 21:22:48.055066 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:48.055053    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e26a7d8e-b5b9-48c6-b51e-cf121c42c928" containerName="test-curl-7635-140254617927728"
Jul 30 21:22:48.055119 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:48.055068    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="e26a7d8e-b5b9-48c6-b51e-cf121c42c928" containerName="test-curl-7635-140254617927728"
Jul 30 21:22:48.055194 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:48.055173    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="e26a7d8e-b5b9-48c6-b51e-cf121c42c928" containerName="test-curl-7635-140254617927728"
Jul 30 21:22:48.058232 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:48.058218    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7635-140254617754768"
Jul 30 21:22:48.064502 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:48.064482    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7635-140254617754768"]
Jul 30 21:22:48.136601 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:48.136572    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72xnh\" (UniqueName: \"kubernetes.io/projected/43e8a9ce-b2c2-4feb-a3fa-b24d1e34079c-kube-api-access-72xnh\") pod \"test-curl-7635-140254617754768\" (UID: \"43e8a9ce-b2c2-4feb-a3fa-b24d1e34079c\") " pod="opendatahub/test-curl-7635-140254617754768"
Jul 30 21:22:48.237576 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:48.237552    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72xnh\" (UniqueName: \"kubernetes.io/projected/43e8a9ce-b2c2-4feb-a3fa-b24d1e34079c-kube-api-access-72xnh\") pod \"test-curl-7635-140254617754768\" (UID: \"43e8a9ce-b2c2-4feb-a3fa-b24d1e34079c\") " pod="opendatahub/test-curl-7635-140254617754768"
Jul 30 21:22:48.245979 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:48.245948    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-72xnh\" (UniqueName: \"kubernetes.io/projected/43e8a9ce-b2c2-4feb-a3fa-b24d1e34079c-kube-api-access-72xnh\") pod \"test-curl-7635-140254617754768\" (UID: \"43e8a9ce-b2c2-4feb-a3fa-b24d1e34079c\") " pod="opendatahub/test-curl-7635-140254617754768"
Jul 30 21:22:48.368554 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:48.368464    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7635-140254617754768"
Jul 30 21:22:48.503409 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:48.503383    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7635-140254617754768"]
Jul 30 21:22:48.505042 ip-10-0-142-69 kubenswrapper[2583]: W0730 21:22:48.505009    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod43e8a9ce_b2c2_4feb_a3fa_b24d1e34079c.slice/crio-ed9ce321ab888d5f0ab6d79c9258b2b79fa627472774644a893aa27757f2fc9a WatchSource:0}: Error finding container ed9ce321ab888d5f0ab6d79c9258b2b79fa627472774644a893aa27757f2fc9a: Status 404 returned error can't find the container with id ed9ce321ab888d5f0ab6d79c9258b2b79fa627472774644a893aa27757f2fc9a
Jul 30 21:22:48.676460 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:48.676431    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e26a7d8e-b5b9-48c6-b51e-cf121c42c928" path="/var/lib/kubelet/pods/e26a7d8e-b5b9-48c6-b51e-cf121c42c928/volumes"
Jul 30 21:22:48.719789 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:48.719758    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7635-140254617927728"
Jul 30 21:22:48.719898 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:48.719801    2583 scope.go:117] "RemoveContainer" containerID="1bcad465d8cd006dd9e4a75be2ee06d405c004c9d5fc0098659486cce8e934f0"
Jul 30 21:22:48.721190 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:48.721089    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7635-140254617754768" event={"ID":"43e8a9ce-b2c2-4feb-a3fa-b24d1e34079c","Type":"ContainerStarted","Data":"ed9ce321ab888d5f0ab6d79c9258b2b79fa627472774644a893aa27757f2fc9a"}
Jul 30 21:22:49.728490 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:49.728454    2583 generic.go:356] "Generic (PLEG): container finished" podID="43e8a9ce-b2c2-4feb-a3fa-b24d1e34079c" containerID="85f3054cc507e51c1c56ff681f56f88fc431d233fb67deeaf0de1ca5139f915c" exitCode=0
Jul 30 21:22:49.728853 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:49.728497    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7635-140254617754768" event={"ID":"43e8a9ce-b2c2-4feb-a3fa-b24d1e34079c","Type":"ContainerDied","Data":"85f3054cc507e51c1c56ff681f56f88fc431d233fb67deeaf0de1ca5139f915c"}
Jul 30 21:22:50.883031 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:50.883003    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7635-140254617754768"
Jul 30 21:22:50.900458 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:50.900428    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7635-140254617754768_43e8a9ce-b2c2-4feb-a3fa-b24d1e34079c/test-curl-7635-140254617754768/0.log"
Jul 30 21:22:50.919714 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:50.919685    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7635-140254617754768"]
Jul 30 21:22:50.923232 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:50.923209    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7635-140254617754768"]
Jul 30 21:22:50.956717 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:50.956692    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-72xnh\" (UniqueName: \"kubernetes.io/projected/43e8a9ce-b2c2-4feb-a3fa-b24d1e34079c-kube-api-access-72xnh\") pod \"43e8a9ce-b2c2-4feb-a3fa-b24d1e34079c\" (UID: \"43e8a9ce-b2c2-4feb-a3fa-b24d1e34079c\") "
Jul 30 21:22:50.958842 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:50.958819    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/43e8a9ce-b2c2-4feb-a3fa-b24d1e34079c-kube-api-access-72xnh" (OuterVolumeSpecName: "kube-api-access-72xnh") pod "43e8a9ce-b2c2-4feb-a3fa-b24d1e34079c" (UID: "43e8a9ce-b2c2-4feb-a3fa-b24d1e34079c"). InnerVolumeSpecName "kube-api-access-72xnh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 21:22:51.057421 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:51.057339    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-72xnh\" (UniqueName: \"kubernetes.io/projected/43e8a9ce-b2c2-4feb-a3fa-b24d1e34079c-kube-api-access-72xnh\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 21:22:51.057599 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:51.057574    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7635-140254617754768"]
Jul 30 21:22:51.058009 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:51.057991    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43e8a9ce-b2c2-4feb-a3fa-b24d1e34079c" containerName="test-curl-7635-140254617754768"
Jul 30 21:22:51.058092 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:51.058011    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="43e8a9ce-b2c2-4feb-a3fa-b24d1e34079c" containerName="test-curl-7635-140254617754768"
Jul 30 21:22:51.058186 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:51.058173    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="43e8a9ce-b2c2-4feb-a3fa-b24d1e34079c" containerName="test-curl-7635-140254617754768"
Jul 30 21:22:51.061235 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:51.061216    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7635-140254617754768"
Jul 30 21:22:51.066106 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:51.066086    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7635-140254617754768"]
Jul 30 21:22:51.157701 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:51.157677    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrs6s\" (UniqueName: \"kubernetes.io/projected/ecd3f28b-af5f-4164-ab92-dd73422ed91b-kube-api-access-vrs6s\") pod \"test-curl-7635-140254617754768\" (UID: \"ecd3f28b-af5f-4164-ab92-dd73422ed91b\") " pod="opendatahub/test-curl-7635-140254617754768"
Jul 30 21:22:51.258506 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:51.258478    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vrs6s\" (UniqueName: \"kubernetes.io/projected/ecd3f28b-af5f-4164-ab92-dd73422ed91b-kube-api-access-vrs6s\") pod \"test-curl-7635-140254617754768\" (UID: \"ecd3f28b-af5f-4164-ab92-dd73422ed91b\") " pod="opendatahub/test-curl-7635-140254617754768"
Jul 30 21:22:51.266212 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:51.266189    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrs6s\" (UniqueName: \"kubernetes.io/projected/ecd3f28b-af5f-4164-ab92-dd73422ed91b-kube-api-access-vrs6s\") pod \"test-curl-7635-140254617754768\" (UID: \"ecd3f28b-af5f-4164-ab92-dd73422ed91b\") " pod="opendatahub/test-curl-7635-140254617754768"
Jul 30 21:22:51.371882 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:51.371809    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7635-140254617754768"
Jul 30 21:22:51.501308 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:51.501283    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7635-140254617754768"]
Jul 30 21:22:51.503117 ip-10-0-142-69 kubenswrapper[2583]: W0730 21:22:51.503090    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podecd3f28b_af5f_4164_ab92_dd73422ed91b.slice/crio-719ae3012493033ff9c5efa7f1d18f1208d3b2311dac2b164108e6404c592bec WatchSource:0}: Error finding container 719ae3012493033ff9c5efa7f1d18f1208d3b2311dac2b164108e6404c592bec: Status 404 returned error can't find the container with id 719ae3012493033ff9c5efa7f1d18f1208d3b2311dac2b164108e6404c592bec
Jul 30 21:22:51.747541 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:51.747518    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7635-140254617754768"
Jul 30 21:22:51.747691 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:51.747570    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ed9ce321ab888d5f0ab6d79c9258b2b79fa627472774644a893aa27757f2fc9a"
Jul 30 21:22:51.748614 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:51.748593    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7635-140254617754768" event={"ID":"ecd3f28b-af5f-4164-ab92-dd73422ed91b","Type":"ContainerStarted","Data":"719ae3012493033ff9c5efa7f1d18f1208d3b2311dac2b164108e6404c592bec"}
Jul 30 21:22:51.758109 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:51.758079    2583 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7635-140254617754768" oldPodUID="43e8a9ce-b2c2-4feb-a3fa-b24d1e34079c" podUID="ecd3f28b-af5f-4164-ab92-dd73422ed91b"
Jul 30 21:22:52.677307 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:52.677277    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="43e8a9ce-b2c2-4feb-a3fa-b24d1e34079c" path="/var/lib/kubelet/pods/43e8a9ce-b2c2-4feb-a3fa-b24d1e34079c/volumes"
Jul 30 21:22:52.755971 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:52.755945    2583 generic.go:356] "Generic (PLEG): container finished" podID="ecd3f28b-af5f-4164-ab92-dd73422ed91b" containerID="cc0f745554e92c684093857c6fe8a2da184b72aae805965758d46cf1cf8e881b" exitCode=0
Jul 30 21:22:52.756114 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:52.756023    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7635-140254617754768" event={"ID":"ecd3f28b-af5f-4164-ab92-dd73422ed91b","Type":"ContainerDied","Data":"cc0f745554e92c684093857c6fe8a2da184b72aae805965758d46cf1cf8e881b"}
Jul 30 21:22:53.898183 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:53.898159    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7635-140254617754768"
Jul 30 21:22:53.923342 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:53.923318    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7635-140254617754768_ecd3f28b-af5f-4164-ab92-dd73422ed91b/test-curl-7635-140254617754768/0.log"
Jul 30 21:22:53.943599 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:53.943575    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7635-140254617754768"]
Jul 30 21:22:53.947719 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:53.947699    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7635-140254617754768"]
Jul 30 21:22:53.982749 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:53.982729    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vrs6s\" (UniqueName: \"kubernetes.io/projected/ecd3f28b-af5f-4164-ab92-dd73422ed91b-kube-api-access-vrs6s\") pod \"ecd3f28b-af5f-4164-ab92-dd73422ed91b\" (UID: \"ecd3f28b-af5f-4164-ab92-dd73422ed91b\") "
Jul 30 21:22:53.984834 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:53.984809    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ecd3f28b-af5f-4164-ab92-dd73422ed91b-kube-api-access-vrs6s" (OuterVolumeSpecName: "kube-api-access-vrs6s") pod "ecd3f28b-af5f-4164-ab92-dd73422ed91b" (UID: "ecd3f28b-af5f-4164-ab92-dd73422ed91b"). InnerVolumeSpecName "kube-api-access-vrs6s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 21:22:54.072958 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:54.072901    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7635-140254617886768"]
Jul 30 21:22:54.073302 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:54.073288    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ecd3f28b-af5f-4164-ab92-dd73422ed91b" containerName="test-curl-7635-140254617754768"
Jul 30 21:22:54.073302 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:54.073303    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="ecd3f28b-af5f-4164-ab92-dd73422ed91b" containerName="test-curl-7635-140254617754768"
Jul 30 21:22:54.073395 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:54.073378    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="ecd3f28b-af5f-4164-ab92-dd73422ed91b" containerName="test-curl-7635-140254617754768"
Jul 30 21:22:54.076336 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:54.076322    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7635-140254617886768"
Jul 30 21:22:54.080482 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:54.080457    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7635-140254617886768"]
Jul 30 21:22:54.083802 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:54.083779    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b274z\" (UniqueName: \"kubernetes.io/projected/61ffa832-2c70-475b-8a44-34cf6a5c6b8f-kube-api-access-b274z\") pod \"test-curl-7635-140254617886768\" (UID: \"61ffa832-2c70-475b-8a44-34cf6a5c6b8f\") " pod="opendatahub/test-curl-7635-140254617886768"
Jul 30 21:22:54.083915 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:54.083857    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vrs6s\" (UniqueName: \"kubernetes.io/projected/ecd3f28b-af5f-4164-ab92-dd73422ed91b-kube-api-access-vrs6s\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 21:22:54.184369 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:54.184339    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b274z\" (UniqueName: \"kubernetes.io/projected/61ffa832-2c70-475b-8a44-34cf6a5c6b8f-kube-api-access-b274z\") pod \"test-curl-7635-140254617886768\" (UID: \"61ffa832-2c70-475b-8a44-34cf6a5c6b8f\") " pod="opendatahub/test-curl-7635-140254617886768"
Jul 30 21:22:54.194750 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:54.194726    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b274z\" (UniqueName: \"kubernetes.io/projected/61ffa832-2c70-475b-8a44-34cf6a5c6b8f-kube-api-access-b274z\") pod \"test-curl-7635-140254617886768\" (UID: \"61ffa832-2c70-475b-8a44-34cf6a5c6b8f\") " pod="opendatahub/test-curl-7635-140254617886768"
Jul 30 21:22:54.386631 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:54.386575    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7635-140254617886768"
Jul 30 21:22:54.449745 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:54.449710    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-155c1d/rate-test-model-155c1d-kserve-57869bcccf-75h9w" podUID="d6547089-25f6-41b0-8ab0-ba37a4fa06b3" containerName="main" containerID="cri-o://52294b3760d0893c974250d37e81ce14ae648905c2d74059838fbced960d5ef1" gracePeriod=45
Jul 30 21:22:54.518928 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:54.518907    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7635-140254617886768"]
Jul 30 21:22:54.529089 ip-10-0-142-69 kubenswrapper[2583]: W0730 21:22:54.529056    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod61ffa832_2c70_475b_8a44_34cf6a5c6b8f.slice/crio-c72ff538d3c803ef96550ba56bf6a98304dcc21bd4aa8555b1634ea16000c9f1 WatchSource:0}: Error finding container c72ff538d3c803ef96550ba56bf6a98304dcc21bd4aa8555b1634ea16000c9f1: Status 404 returned error can't find the container with id c72ff538d3c803ef96550ba56bf6a98304dcc21bd4aa8555b1634ea16000c9f1
Jul 30 21:22:54.683593 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:54.683560    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ecd3f28b-af5f-4164-ab92-dd73422ed91b" path="/var/lib/kubelet/pods/ecd3f28b-af5f-4164-ab92-dd73422ed91b/volumes"
Jul 30 21:22:54.695644 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:54.695623    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-155c1d/rate-test-model-155c1d-kserve-57869bcccf-75h9w"
Jul 30 21:22:54.768637 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:54.768605    2583 generic.go:356] "Generic (PLEG): container finished" podID="d6547089-25f6-41b0-8ab0-ba37a4fa06b3" containerID="52294b3760d0893c974250d37e81ce14ae648905c2d74059838fbced960d5ef1" exitCode=0
Jul 30 21:22:54.768763 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:54.768645    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-155c1d/rate-test-model-155c1d-kserve-57869bcccf-75h9w"
Jul 30 21:22:54.768763 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:54.768694    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-155c1d/rate-test-model-155c1d-kserve-57869bcccf-75h9w" event={"ID":"d6547089-25f6-41b0-8ab0-ba37a4fa06b3","Type":"ContainerDied","Data":"52294b3760d0893c974250d37e81ce14ae648905c2d74059838fbced960d5ef1"}
Jul 30 21:22:54.768763 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:54.768729    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-155c1d/rate-test-model-155c1d-kserve-57869bcccf-75h9w" event={"ID":"d6547089-25f6-41b0-8ab0-ba37a4fa06b3","Type":"ContainerDied","Data":"3536a8f70ed621cd7b5d2a85a848f24deffb12c1b6a1e3034a24e880122d4f06"}
Jul 30 21:22:54.768763 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:54.768752    2583 scope.go:117] "RemoveContainer" containerID="52294b3760d0893c974250d37e81ce14ae648905c2d74059838fbced960d5ef1"
Jul 30 21:22:54.769994 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:54.769977    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7635-140254617886768" event={"ID":"61ffa832-2c70-475b-8a44-34cf6a5c6b8f","Type":"ContainerStarted","Data":"c72ff538d3c803ef96550ba56bf6a98304dcc21bd4aa8555b1634ea16000c9f1"}
Jul 30 21:22:54.771369 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:54.771353    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7635-140254617754768"
Jul 30 21:22:54.777642 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:54.777626    2583 scope.go:117] "RemoveContainer" containerID="52294b3760d0893c974250d37e81ce14ae648905c2d74059838fbced960d5ef1"
Jul 30 21:22:54.777894 ip-10-0-142-69 kubenswrapper[2583]: E0730 21:22:54.777876    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"52294b3760d0893c974250d37e81ce14ae648905c2d74059838fbced960d5ef1\": container with ID starting with 52294b3760d0893c974250d37e81ce14ae648905c2d74059838fbced960d5ef1 not found: ID does not exist" containerID="52294b3760d0893c974250d37e81ce14ae648905c2d74059838fbced960d5ef1"
Jul 30 21:22:54.777968 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:54.777907    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52294b3760d0893c974250d37e81ce14ae648905c2d74059838fbced960d5ef1"} err="failed to get container status \"52294b3760d0893c974250d37e81ce14ae648905c2d74059838fbced960d5ef1\": rpc error: code = NotFound desc = could not find container \"52294b3760d0893c974250d37e81ce14ae648905c2d74059838fbced960d5ef1\": container with ID starting with 52294b3760d0893c974250d37e81ce14ae648905c2d74059838fbced960d5ef1 not found: ID does not exist"
Jul 30 21:22:54.777968 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:54.777930    2583 scope.go:117] "RemoveContainer" containerID="cc0f745554e92c684093857c6fe8a2da184b72aae805965758d46cf1cf8e881b"
Jul 30 21:22:54.790022 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:54.790006    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xwdgz\" (UniqueName: \"kubernetes.io/projected/d6547089-25f6-41b0-8ab0-ba37a4fa06b3-kube-api-access-xwdgz\") pod \"d6547089-25f6-41b0-8ab0-ba37a4fa06b3\" (UID: \"d6547089-25f6-41b0-8ab0-ba37a4fa06b3\") "
Jul 30 21:22:54.790120 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:54.790090    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d6547089-25f6-41b0-8ab0-ba37a4fa06b3-tls-certs\") pod \"d6547089-25f6-41b0-8ab0-ba37a4fa06b3\" (UID: \"d6547089-25f6-41b0-8ab0-ba37a4fa06b3\") "
Jul 30 21:22:54.790202 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:54.790117    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d6547089-25f6-41b0-8ab0-ba37a4fa06b3-home\") pod \"d6547089-25f6-41b0-8ab0-ba37a4fa06b3\" (UID: \"d6547089-25f6-41b0-8ab0-ba37a4fa06b3\") "
Jul 30 21:22:54.790202 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:54.790187    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d6547089-25f6-41b0-8ab0-ba37a4fa06b3-tmp-dir\") pod \"d6547089-25f6-41b0-8ab0-ba37a4fa06b3\" (UID: \"d6547089-25f6-41b0-8ab0-ba37a4fa06b3\") "
Jul 30 21:22:54.790299 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:54.790234    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d6547089-25f6-41b0-8ab0-ba37a4fa06b3-model-cache\") pod \"d6547089-25f6-41b0-8ab0-ba37a4fa06b3\" (UID: \"d6547089-25f6-41b0-8ab0-ba37a4fa06b3\") "
Jul 30 21:22:54.790299 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:54.790274    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d6547089-25f6-41b0-8ab0-ba37a4fa06b3-dshm\") pod \"d6547089-25f6-41b0-8ab0-ba37a4fa06b3\" (UID: \"d6547089-25f6-41b0-8ab0-ba37a4fa06b3\") "
Jul 30 21:22:54.790484 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:54.790455    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6547089-25f6-41b0-8ab0-ba37a4fa06b3-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d6547089-25f6-41b0-8ab0-ba37a4fa06b3" (UID: "d6547089-25f6-41b0-8ab0-ba37a4fa06b3"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:22:54.790591 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:54.790469    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6547089-25f6-41b0-8ab0-ba37a4fa06b3-home" (OuterVolumeSpecName: "home") pod "d6547089-25f6-41b0-8ab0-ba37a4fa06b3" (UID: "d6547089-25f6-41b0-8ab0-ba37a4fa06b3"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:22:54.790591 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:54.790538    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6547089-25f6-41b0-8ab0-ba37a4fa06b3-model-cache" (OuterVolumeSpecName: "model-cache") pod "d6547089-25f6-41b0-8ab0-ba37a4fa06b3" (UID: "d6547089-25f6-41b0-8ab0-ba37a4fa06b3"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:22:54.790833 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:54.790811    2583 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d6547089-25f6-41b0-8ab0-ba37a4fa06b3-home\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 21:22:54.791122 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:54.790851    2583 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d6547089-25f6-41b0-8ab0-ba37a4fa06b3-tmp-dir\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 21:22:54.791122 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:54.790866    2583 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d6547089-25f6-41b0-8ab0-ba37a4fa06b3-model-cache\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 21:22:54.792172 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:54.792126    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6547089-25f6-41b0-8ab0-ba37a4fa06b3-kube-api-access-xwdgz" (OuterVolumeSpecName: "kube-api-access-xwdgz") pod "d6547089-25f6-41b0-8ab0-ba37a4fa06b3" (UID: "d6547089-25f6-41b0-8ab0-ba37a4fa06b3"). InnerVolumeSpecName "kube-api-access-xwdgz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 21:22:54.792248 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:54.792216    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d6547089-25f6-41b0-8ab0-ba37a4fa06b3-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d6547089-25f6-41b0-8ab0-ba37a4fa06b3" (UID: "d6547089-25f6-41b0-8ab0-ba37a4fa06b3"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 21:22:54.792375 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:54.792354    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6547089-25f6-41b0-8ab0-ba37a4fa06b3-dshm" (OuterVolumeSpecName: "dshm") pod "d6547089-25f6-41b0-8ab0-ba37a4fa06b3" (UID: "d6547089-25f6-41b0-8ab0-ba37a4fa06b3"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:22:54.892228 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:54.892205    2583 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d6547089-25f6-41b0-8ab0-ba37a4fa06b3-tls-certs\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 21:22:54.892309 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:54.892234    2583 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d6547089-25f6-41b0-8ab0-ba37a4fa06b3-dshm\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 21:22:54.892309 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:54.892247    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xwdgz\" (UniqueName: \"kubernetes.io/projected/d6547089-25f6-41b0-8ab0-ba37a4fa06b3-kube-api-access-xwdgz\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 21:22:55.091003 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:55.090978    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-155c1d/rate-test-model-155c1d-kserve-57869bcccf-75h9w"]
Jul 30 21:22:55.093275 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:55.093254    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-155c1d/rate-test-model-155c1d-kserve-57869bcccf-75h9w"]
Jul 30 21:22:55.642197 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:55.642118    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-01bc1b/rate-test-model-01bc1b-kserve-6474c5cc9f-wwcs2" podUID="04d47359-abf0-49c4-8afa-61410b1dc87b" containerName="main" containerID="cri-o://fb5964a46b73b333492a06774021609802368ae516419b1b2e133f4ed7b0d372" gracePeriod=45
Jul 30 21:22:55.779306 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:55.779278    2583 generic.go:356] "Generic (PLEG): container finished" podID="04d47359-abf0-49c4-8afa-61410b1dc87b" containerID="fb5964a46b73b333492a06774021609802368ae516419b1b2e133f4ed7b0d372" exitCode=0
Jul 30 21:22:55.779443 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:55.779351    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-01bc1b/rate-test-model-01bc1b-kserve-6474c5cc9f-wwcs2" event={"ID":"04d47359-abf0-49c4-8afa-61410b1dc87b","Type":"ContainerDied","Data":"fb5964a46b73b333492a06774021609802368ae516419b1b2e133f4ed7b0d372"}
Jul 30 21:22:55.781873 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:55.781851    2583 generic.go:356] "Generic (PLEG): container finished" podID="61ffa832-2c70-475b-8a44-34cf6a5c6b8f" containerID="4e3d76aa87c6cee779b4425af84a1ea18f0760f85a905183cb369897013b839a" exitCode=0
Jul 30 21:22:55.781983 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:55.781889    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7635-140254617886768" event={"ID":"61ffa832-2c70-475b-8a44-34cf6a5c6b8f","Type":"ContainerDied","Data":"4e3d76aa87c6cee779b4425af84a1ea18f0760f85a905183cb369897013b839a"}
Jul 30 21:22:55.897233 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:55.897184    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-01bc1b/rate-test-model-01bc1b-kserve-6474c5cc9f-wwcs2"
Jul 30 21:22:56.002004 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:56.001975    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/04d47359-abf0-49c4-8afa-61410b1dc87b-dshm\") pod \"04d47359-abf0-49c4-8afa-61410b1dc87b\" (UID: \"04d47359-abf0-49c4-8afa-61410b1dc87b\") "
Jul 30 21:22:56.002123 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:56.002050    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/04d47359-abf0-49c4-8afa-61410b1dc87b-tmp-dir\") pod \"04d47359-abf0-49c4-8afa-61410b1dc87b\" (UID: \"04d47359-abf0-49c4-8afa-61410b1dc87b\") "
Jul 30 21:22:56.002123 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:56.002080    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/04d47359-abf0-49c4-8afa-61410b1dc87b-model-cache\") pod \"04d47359-abf0-49c4-8afa-61410b1dc87b\" (UID: \"04d47359-abf0-49c4-8afa-61410b1dc87b\") "
Jul 30 21:22:56.002123 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:56.002099    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/04d47359-abf0-49c4-8afa-61410b1dc87b-home\") pod \"04d47359-abf0-49c4-8afa-61410b1dc87b\" (UID: \"04d47359-abf0-49c4-8afa-61410b1dc87b\") "
Jul 30 21:22:56.002301 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:56.002127    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/04d47359-abf0-49c4-8afa-61410b1dc87b-tls-certs\") pod \"04d47359-abf0-49c4-8afa-61410b1dc87b\" (UID: \"04d47359-abf0-49c4-8afa-61410b1dc87b\") "
Jul 30 21:22:56.002301 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:56.002187    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2m9gm\" (UniqueName: \"kubernetes.io/projected/04d47359-abf0-49c4-8afa-61410b1dc87b-kube-api-access-2m9gm\") pod \"04d47359-abf0-49c4-8afa-61410b1dc87b\" (UID: \"04d47359-abf0-49c4-8afa-61410b1dc87b\") "
Jul 30 21:22:56.002436 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:56.002358    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04d47359-abf0-49c4-8afa-61410b1dc87b-model-cache" (OuterVolumeSpecName: "model-cache") pod "04d47359-abf0-49c4-8afa-61410b1dc87b" (UID: "04d47359-abf0-49c4-8afa-61410b1dc87b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:22:56.002436 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:56.002391    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04d47359-abf0-49c4-8afa-61410b1dc87b-home" (OuterVolumeSpecName: "home") pod "04d47359-abf0-49c4-8afa-61410b1dc87b" (UID: "04d47359-abf0-49c4-8afa-61410b1dc87b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:22:56.002436 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:56.002407    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04d47359-abf0-49c4-8afa-61410b1dc87b-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "04d47359-abf0-49c4-8afa-61410b1dc87b" (UID: "04d47359-abf0-49c4-8afa-61410b1dc87b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:22:56.002662 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:56.002502    2583 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/04d47359-abf0-49c4-8afa-61410b1dc87b-tmp-dir\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 21:22:56.002662 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:56.002517    2583 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/04d47359-abf0-49c4-8afa-61410b1dc87b-model-cache\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 21:22:56.002662 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:56.002530    2583 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/04d47359-abf0-49c4-8afa-61410b1dc87b-home\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 21:22:56.004290 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:56.004265    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04d47359-abf0-49c4-8afa-61410b1dc87b-dshm" (OuterVolumeSpecName: "dshm") pod "04d47359-abf0-49c4-8afa-61410b1dc87b" (UID: "04d47359-abf0-49c4-8afa-61410b1dc87b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:22:56.004433 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:56.004411    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/04d47359-abf0-49c4-8afa-61410b1dc87b-kube-api-access-2m9gm" (OuterVolumeSpecName: "kube-api-access-2m9gm") pod "04d47359-abf0-49c4-8afa-61410b1dc87b" (UID: "04d47359-abf0-49c4-8afa-61410b1dc87b"). InnerVolumeSpecName "kube-api-access-2m9gm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 21:22:56.004507 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:56.004436    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/04d47359-abf0-49c4-8afa-61410b1dc87b-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "04d47359-abf0-49c4-8afa-61410b1dc87b" (UID: "04d47359-abf0-49c4-8afa-61410b1dc87b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 21:22:56.103331 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:56.103301    2583 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/04d47359-abf0-49c4-8afa-61410b1dc87b-dshm\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 21:22:56.103331 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:56.103326    2583 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/04d47359-abf0-49c4-8afa-61410b1dc87b-tls-certs\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 21:22:56.103331 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:56.103336    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2m9gm\" (UniqueName: \"kubernetes.io/projected/04d47359-abf0-49c4-8afa-61410b1dc87b-kube-api-access-2m9gm\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 21:22:56.675891 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:56.675858    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d6547089-25f6-41b0-8ab0-ba37a4fa06b3" path="/var/lib/kubelet/pods/d6547089-25f6-41b0-8ab0-ba37a4fa06b3/volumes"
Jul 30 21:22:56.788493 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:56.788468    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-01bc1b/rate-test-model-01bc1b-kserve-6474c5cc9f-wwcs2"
Jul 30 21:22:56.788606 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:56.788468    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-01bc1b/rate-test-model-01bc1b-kserve-6474c5cc9f-wwcs2" event={"ID":"04d47359-abf0-49c4-8afa-61410b1dc87b","Type":"ContainerDied","Data":"42166f1681aa28d7a746090e3a5c815139e04b977b247a5b93b7b60be8daa274"}
Jul 30 21:22:56.788606 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:56.788589    2583 scope.go:117] "RemoveContainer" containerID="fb5964a46b73b333492a06774021609802368ae516419b1b2e133f4ed7b0d372"
Jul 30 21:22:56.807587 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:56.807563    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-01bc1b/rate-test-model-01bc1b-kserve-6474c5cc9f-wwcs2"]
Jul 30 21:22:56.813315 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:56.813293    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-01bc1b/rate-test-model-01bc1b-kserve-6474c5cc9f-wwcs2"]
Jul 30 21:22:56.914215 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:56.914189    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7635-140254617886768"
Jul 30 21:22:56.939060 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:56.939002    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7635-140254617886768_61ffa832-2c70-475b-8a44-34cf6a5c6b8f/test-curl-7635-140254617886768/0.log"
Jul 30 21:22:56.961659 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:56.961631    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7635-140254617886768"]
Jul 30 21:22:56.965510 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:56.965490    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7635-140254617886768"]
Jul 30 21:22:57.010798 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:57.010774    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b274z\" (UniqueName: \"kubernetes.io/projected/61ffa832-2c70-475b-8a44-34cf6a5c6b8f-kube-api-access-b274z\") pod \"61ffa832-2c70-475b-8a44-34cf6a5c6b8f\" (UID: \"61ffa832-2c70-475b-8a44-34cf6a5c6b8f\") "
Jul 30 21:22:57.012860 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:57.012838    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61ffa832-2c70-475b-8a44-34cf6a5c6b8f-kube-api-access-b274z" (OuterVolumeSpecName: "kube-api-access-b274z") pod "61ffa832-2c70-475b-8a44-34cf6a5c6b8f" (UID: "61ffa832-2c70-475b-8a44-34cf6a5c6b8f"). InnerVolumeSpecName "kube-api-access-b274z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 21:22:57.092192 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:57.092162    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7635-140254617886768"]
Jul 30 21:22:57.092527 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:57.092515    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04d47359-abf0-49c4-8afa-61410b1dc87b" containerName="main"
Jul 30 21:22:57.092571 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:57.092529    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="04d47359-abf0-49c4-8afa-61410b1dc87b" containerName="main"
Jul 30 21:22:57.092571 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:57.092545    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6547089-25f6-41b0-8ab0-ba37a4fa06b3" containerName="main"
Jul 30 21:22:57.092571 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:57.092550    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6547089-25f6-41b0-8ab0-ba37a4fa06b3" containerName="main"
Jul 30 21:22:57.092571 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:57.092557    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61ffa832-2c70-475b-8a44-34cf6a5c6b8f" containerName="test-curl-7635-140254617886768"
Jul 30 21:22:57.092571 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:57.092563    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="61ffa832-2c70-475b-8a44-34cf6a5c6b8f" containerName="test-curl-7635-140254617886768"
Jul 30 21:22:57.092733 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:57.092629    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="04d47359-abf0-49c4-8afa-61410b1dc87b" containerName="main"
Jul 30 21:22:57.092733 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:57.092639    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="61ffa832-2c70-475b-8a44-34cf6a5c6b8f" containerName="test-curl-7635-140254617886768"
Jul 30 21:22:57.092733 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:57.092645    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="d6547089-25f6-41b0-8ab0-ba37a4fa06b3" containerName="main"
Jul 30 21:22:57.095688 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:57.095675    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7635-140254617886768"
Jul 30 21:22:57.102615 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:57.102588    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7635-140254617886768"]
Jul 30 21:22:57.111825 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:57.111799    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d2tvv\" (UniqueName: \"kubernetes.io/projected/8c8e15c4-704e-42b0-9ade-69ab93a32a99-kube-api-access-d2tvv\") pod \"test-curl-7635-140254617886768\" (UID: \"8c8e15c4-704e-42b0-9ade-69ab93a32a99\") " pod="opendatahub/test-curl-7635-140254617886768"
Jul 30 21:22:57.112097 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:57.111918    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b274z\" (UniqueName: \"kubernetes.io/projected/61ffa832-2c70-475b-8a44-34cf6a5c6b8f-kube-api-access-b274z\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 21:22:57.213246 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:57.213192    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2tvv\" (UniqueName: \"kubernetes.io/projected/8c8e15c4-704e-42b0-9ade-69ab93a32a99-kube-api-access-d2tvv\") pod \"test-curl-7635-140254617886768\" (UID: \"8c8e15c4-704e-42b0-9ade-69ab93a32a99\") " pod="opendatahub/test-curl-7635-140254617886768"
Jul 30 21:22:57.221935 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:57.221909    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d2tvv\" (UniqueName: \"kubernetes.io/projected/8c8e15c4-704e-42b0-9ade-69ab93a32a99-kube-api-access-d2tvv\") pod \"test-curl-7635-140254617886768\" (UID: \"8c8e15c4-704e-42b0-9ade-69ab93a32a99\") " pod="opendatahub/test-curl-7635-140254617886768"
Jul 30 21:22:57.404834 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:57.404810    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7635-140254617886768"
Jul 30 21:22:57.754323 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:57.754300    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7635-140254617886768"]
Jul 30 21:22:57.755992 ip-10-0-142-69 kubenswrapper[2583]: W0730 21:22:57.755966    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8c8e15c4_704e_42b0_9ade_69ab93a32a99.slice/crio-f038507b648e58a4ca248775e9ca7c82ac2146560d3f31b976f4f99be11759ff WatchSource:0}: Error finding container f038507b648e58a4ca248775e9ca7c82ac2146560d3f31b976f4f99be11759ff: Status 404 returned error can't find the container with id f038507b648e58a4ca248775e9ca7c82ac2146560d3f31b976f4f99be11759ff
Jul 30 21:22:57.796437 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:57.796409    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7635-140254617886768" event={"ID":"8c8e15c4-704e-42b0-9ade-69ab93a32a99","Type":"ContainerStarted","Data":"f038507b648e58a4ca248775e9ca7c82ac2146560d3f31b976f4f99be11759ff"}
Jul 30 21:22:57.798494 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:57.798475    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c72ff538d3c803ef96550ba56bf6a98304dcc21bd4aa8555b1634ea16000c9f1"
Jul 30 21:22:57.798569 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:57.798506    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7635-140254617886768"
Jul 30 21:22:57.809566 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:57.809544    2583 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7635-140254617886768" oldPodUID="61ffa832-2c70-475b-8a44-34cf6a5c6b8f" podUID="8c8e15c4-704e-42b0-9ade-69ab93a32a99"
Jul 30 21:22:58.675837 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:58.675794    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="04d47359-abf0-49c4-8afa-61410b1dc87b" path="/var/lib/kubelet/pods/04d47359-abf0-49c4-8afa-61410b1dc87b/volumes"
Jul 30 21:22:58.676326 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:58.676291    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="61ffa832-2c70-475b-8a44-34cf6a5c6b8f" path="/var/lib/kubelet/pods/61ffa832-2c70-475b-8a44-34cf6a5c6b8f/volumes"
Jul 30 21:22:58.805722 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:58.805686    2583 generic.go:356] "Generic (PLEG): container finished" podID="8c8e15c4-704e-42b0-9ade-69ab93a32a99" containerID="fa3efa4e973e03ba45cd359e91ee563d6903b1a1bb74de08f3a123dcae78c855" exitCode=0
Jul 30 21:22:58.805846 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:58.805772    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7635-140254617886768" event={"ID":"8c8e15c4-704e-42b0-9ade-69ab93a32a99","Type":"ContainerDied","Data":"fa3efa4e973e03ba45cd359e91ee563d6903b1a1bb74de08f3a123dcae78c855"}
Jul 30 21:22:59.943825 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:59.943800    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7635-140254617886768"
Jul 30 21:22:59.963037 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:59.962977    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7635-140254617886768_8c8e15c4-704e-42b0-9ade-69ab93a32a99/test-curl-7635-140254617886768/0.log"
Jul 30 21:22:59.983051 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:59.983024    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7635-140254617886768"]
Jul 30 21:22:59.986265 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:22:59.986243    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7635-140254617886768"]
Jul 30 21:23:00.035582 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:00.035559    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d2tvv\" (UniqueName: \"kubernetes.io/projected/8c8e15c4-704e-42b0-9ade-69ab93a32a99-kube-api-access-d2tvv\") pod \"8c8e15c4-704e-42b0-9ade-69ab93a32a99\" (UID: \"8c8e15c4-704e-42b0-9ade-69ab93a32a99\") "
Jul 30 21:23:00.037690 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:00.037671    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c8e15c4-704e-42b0-9ade-69ab93a32a99-kube-api-access-d2tvv" (OuterVolumeSpecName: "kube-api-access-d2tvv") pod "8c8e15c4-704e-42b0-9ade-69ab93a32a99" (UID: "8c8e15c4-704e-42b0-9ade-69ab93a32a99"). InnerVolumeSpecName "kube-api-access-d2tvv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 21:23:00.136476 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:00.136402    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d2tvv\" (UniqueName: \"kubernetes.io/projected/8c8e15c4-704e-42b0-9ade-69ab93a32a99-kube-api-access-d2tvv\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 21:23:00.612183 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:00.612129    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:23:00.675416 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:00.675392    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8c8e15c4-704e-42b0-9ade-69ab93a32a99" path="/var/lib/kubelet/pods/8c8e15c4-704e-42b0-9ade-69ab93a32a99/volumes"
Jul 30 21:23:00.817849 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:00.817828    2583 scope.go:117] "RemoveContainer" containerID="fa3efa4e973e03ba45cd359e91ee563d6903b1a1bb74de08f3a123dcae78c855"
Jul 30 21:23:00.817993 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:00.817851    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7635-140254617886768"
Jul 30 21:23:00.965818 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:00.965786    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:23:01.212999 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:01.212957    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:23:04.204427 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:04.204386    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:23:04.302822 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:04.302790    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:23:05.477349 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:05.477320    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:23:05.774389 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:05.774285    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:23:06.026812 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:06.026738    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:23:06.128307 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:06.128274    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-e54afd-7f9b8fb4dd-mmzmn"]
Jul 30 21:23:06.128649 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:06.128636    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c8e15c4-704e-42b0-9ade-69ab93a32a99" containerName="test-curl-7635-140254617886768"
Jul 30 21:23:06.128687 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:06.128651    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c8e15c4-704e-42b0-9ade-69ab93a32a99" containerName="test-curl-7635-140254617886768"
Jul 30 21:23:06.128734 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:06.128713    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c8e15c4-704e-42b0-9ade-69ab93a32a99" containerName="test-curl-7635-140254617886768"
Jul 30 21:23:06.129933 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:06.129910    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:23:06.131923 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:06.131910    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-e54afd-7f9b8fb4dd-mmzmn"
Jul 30 21:23:06.133839 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:06.133821    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-e54afd\""
Jul 30 21:23:06.133941 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:06.133884    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-e54afd-dockercfg-862nf\""
Jul 30 21:23:06.141281 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:06.141256    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-e54afd-7f9b8fb4dd-mmzmn"]
Jul 30 21:23:06.185594 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:06.185566    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fztt2\" (UniqueName: \"kubernetes.io/projected/755c2954-96f9-43fc-bebc-81956e0c14d8-kube-api-access-fztt2\") pod \"payload-pre-processing-e2e-ipp-a-e54afd-7f9b8fb4dd-mmzmn\" (UID: \"755c2954-96f9-43fc-bebc-81956e0c14d8\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-e54afd-7f9b8fb4dd-mmzmn"
Jul 30 21:23:06.185727 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:06.185627    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/755c2954-96f9-43fc-bebc-81956e0c14d8-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-e54afd-7f9b8fb4dd-mmzmn\" (UID: \"755c2954-96f9-43fc-bebc-81956e0c14d8\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-e54afd-7f9b8fb4dd-mmzmn"
Jul 30 21:23:06.286966 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:06.286897    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fztt2\" (UniqueName: \"kubernetes.io/projected/755c2954-96f9-43fc-bebc-81956e0c14d8-kube-api-access-fztt2\") pod \"payload-pre-processing-e2e-ipp-a-e54afd-7f9b8fb4dd-mmzmn\" (UID: \"755c2954-96f9-43fc-bebc-81956e0c14d8\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-e54afd-7f9b8fb4dd-mmzmn"
Jul 30 21:23:06.287089 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:06.286979    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/755c2954-96f9-43fc-bebc-81956e0c14d8-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-e54afd-7f9b8fb4dd-mmzmn\" (UID: \"755c2954-96f9-43fc-bebc-81956e0c14d8\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-e54afd-7f9b8fb4dd-mmzmn"
Jul 30 21:23:06.287659 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:06.287637    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/755c2954-96f9-43fc-bebc-81956e0c14d8-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-e54afd-7f9b8fb4dd-mmzmn\" (UID: \"755c2954-96f9-43fc-bebc-81956e0c14d8\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-e54afd-7f9b8fb4dd-mmzmn"
Jul 30 21:23:06.294457 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:06.294440    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fztt2\" (UniqueName: \"kubernetes.io/projected/755c2954-96f9-43fc-bebc-81956e0c14d8-kube-api-access-fztt2\") pod \"payload-pre-processing-e2e-ipp-a-e54afd-7f9b8fb4dd-mmzmn\" (UID: \"755c2954-96f9-43fc-bebc-81956e0c14d8\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-e54afd-7f9b8fb4dd-mmzmn"
Jul 30 21:23:06.443059 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:06.443032    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-e54afd-7f9b8fb4dd-mmzmn"
Jul 30 21:23:06.575780 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:06.575753    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-e54afd-7f9b8fb4dd-mmzmn"]
Jul 30 21:23:06.577231 ip-10-0-142-69 kubenswrapper[2583]: W0730 21:23:06.577201    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod755c2954_96f9_43fc_bebc_81956e0c14d8.slice/crio-4b1eeaa0ad29543fe3651a02e1efb4122f2b87f066ade987b0bc222ad6d35750 WatchSource:0}: Error finding container 4b1eeaa0ad29543fe3651a02e1efb4122f2b87f066ade987b0bc222ad6d35750: Status 404 returned error can't find the container with id 4b1eeaa0ad29543fe3651a02e1efb4122f2b87f066ade987b0bc222ad6d35750
Jul 30 21:23:06.853046 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:06.852958    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-e54afd-7f9b8fb4dd-mmzmn" event={"ID":"755c2954-96f9-43fc-bebc-81956e0c14d8","Type":"ContainerStarted","Data":"69d6f685c8a0d7c8d20b8c837e89f49ad957468fb0c4461db261411283852ea7"}
Jul 30 21:23:06.853046 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:06.853018    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-e54afd-7f9b8fb4dd-mmzmn" event={"ID":"755c2954-96f9-43fc-bebc-81956e0c14d8","Type":"ContainerStarted","Data":"4b1eeaa0ad29543fe3651a02e1efb4122f2b87f066ade987b0bc222ad6d35750"}
Jul 30 21:23:06.853268 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:06.853167    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-e54afd-7f9b8fb4dd-mmzmn"
Jul 30 21:23:06.868569 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:06.868522    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-e54afd-7f9b8fb4dd-mmzmn" podStartSLOduration=0.868507009 podStartE2EDuration="868.507009ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 21:23:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 21:23:06.865657329 +0000 UTC m=+3498.707132961" watchObservedRunningTime="2026-07-30 21:23:06.868507009 +0000 UTC m=+3498.709982638"
Jul 30 21:23:08.352233 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:08.352194    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 21:23:17.861129 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:17.861059    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-e54afd-7f9b8fb4dd-mmzmn"
Jul 30 21:23:29.381319 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:29.381282    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:23:30.110575 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:30.110546    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:23:30.528931 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:30.528893    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-296998-openshift-default-6cc8987c78-klg8n"]
Jul 30 21:23:30.534276 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:30.534252    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-296998-openshift-default-6cc8987c78-klg8n"
Jul 30 21:23:30.539767 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:30.539745    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 30 21:23:30.550819 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:30.550789    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-296998-openshift-default-dockercfg-4lwj5\""
Jul 30 21:23:30.686161 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:30.686103    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-296998-openshift-default-6cc8987c78-klg8n"]
Jul 30 21:23:30.699116 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:30.699082    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:23:30.699284 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:30.699192    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e-workload-certs\") pod \"e2e-ipp-b-296998-openshift-default-6cc8987c78-klg8n\" (UID: \"d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e\") " pod="openshift-ingress/e2e-ipp-b-296998-openshift-default-6cc8987c78-klg8n"
Jul 30 21:23:30.699284 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:30.699227    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e-istiod-ca-cert\") pod \"e2e-ipp-b-296998-openshift-default-6cc8987c78-klg8n\" (UID: \"d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e\") " pod="openshift-ingress/e2e-ipp-b-296998-openshift-default-6cc8987c78-klg8n"
Jul 30 21:23:30.699284 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:30.699252    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e-workload-socket\") pod \"e2e-ipp-b-296998-openshift-default-6cc8987c78-klg8n\" (UID: \"d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e\") " pod="openshift-ingress/e2e-ipp-b-296998-openshift-default-6cc8987c78-klg8n"
Jul 30 21:23:30.699284 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:30.699267    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-psjl8\" (UniqueName: \"kubernetes.io/projected/d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e-kube-api-access-psjl8\") pod \"e2e-ipp-b-296998-openshift-default-6cc8987c78-klg8n\" (UID: \"d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e\") " pod="openshift-ingress/e2e-ipp-b-296998-openshift-default-6cc8987c78-klg8n"
Jul 30 21:23:30.699496 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:30.699291    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e-istio-data\") pod \"e2e-ipp-b-296998-openshift-default-6cc8987c78-klg8n\" (UID: \"d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e\") " pod="openshift-ingress/e2e-ipp-b-296998-openshift-default-6cc8987c78-klg8n"
Jul 30 21:23:30.699496 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:30.699316    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e-istio-podinfo\") pod \"e2e-ipp-b-296998-openshift-default-6cc8987c78-klg8n\" (UID: \"d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e\") " pod="openshift-ingress/e2e-ipp-b-296998-openshift-default-6cc8987c78-klg8n"
Jul 30 21:23:30.699496 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:30.699426    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e-credential-socket\") pod \"e2e-ipp-b-296998-openshift-default-6cc8987c78-klg8n\" (UID: \"d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e\") " pod="openshift-ingress/e2e-ipp-b-296998-openshift-default-6cc8987c78-klg8n"
Jul 30 21:23:30.699496 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:30.699468    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e-istio-token\") pod \"e2e-ipp-b-296998-openshift-default-6cc8987c78-klg8n\" (UID: \"d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e\") " pod="openshift-ingress/e2e-ipp-b-296998-openshift-default-6cc8987c78-klg8n"
Jul 30 21:23:30.699645 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:30.699561    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e-istio-envoy\") pod \"e2e-ipp-b-296998-openshift-default-6cc8987c78-klg8n\" (UID: \"d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e\") " pod="openshift-ingress/e2e-ipp-b-296998-openshift-default-6cc8987c78-klg8n"
Jul 30 21:23:30.801087 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:30.800990    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e-workload-certs\") pod \"e2e-ipp-b-296998-openshift-default-6cc8987c78-klg8n\" (UID: \"d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e\") " pod="openshift-ingress/e2e-ipp-b-296998-openshift-default-6cc8987c78-klg8n"
Jul 30 21:23:30.801087 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:30.801036    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e-istiod-ca-cert\") pod \"e2e-ipp-b-296998-openshift-default-6cc8987c78-klg8n\" (UID: \"d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e\") " pod="openshift-ingress/e2e-ipp-b-296998-openshift-default-6cc8987c78-klg8n"
Jul 30 21:23:30.801087 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:30.801065    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e-workload-socket\") pod \"e2e-ipp-b-296998-openshift-default-6cc8987c78-klg8n\" (UID: \"d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e\") " pod="openshift-ingress/e2e-ipp-b-296998-openshift-default-6cc8987c78-klg8n"
Jul 30 21:23:30.801087 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:30.801088    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-psjl8\" (UniqueName: \"kubernetes.io/projected/d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e-kube-api-access-psjl8\") pod \"e2e-ipp-b-296998-openshift-default-6cc8987c78-klg8n\" (UID: \"d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e\") " pod="openshift-ingress/e2e-ipp-b-296998-openshift-default-6cc8987c78-klg8n"
Jul 30 21:23:30.801458 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:30.801112    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e-istio-data\") pod \"e2e-ipp-b-296998-openshift-default-6cc8987c78-klg8n\" (UID: \"d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e\") " pod="openshift-ingress/e2e-ipp-b-296998-openshift-default-6cc8987c78-klg8n"
Jul 30 21:23:30.801458 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:30.801182    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e-istio-podinfo\") pod \"e2e-ipp-b-296998-openshift-default-6cc8987c78-klg8n\" (UID: \"d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e\") " pod="openshift-ingress/e2e-ipp-b-296998-openshift-default-6cc8987c78-klg8n"
Jul 30 21:23:30.801458 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:30.801260    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e-credential-socket\") pod \"e2e-ipp-b-296998-openshift-default-6cc8987c78-klg8n\" (UID: \"d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e\") " pod="openshift-ingress/e2e-ipp-b-296998-openshift-default-6cc8987c78-klg8n"
Jul 30 21:23:30.801458 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:30.801304    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e-istio-token\") pod \"e2e-ipp-b-296998-openshift-default-6cc8987c78-klg8n\" (UID: \"d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e\") " pod="openshift-ingress/e2e-ipp-b-296998-openshift-default-6cc8987c78-klg8n"
Jul 30 21:23:30.801458 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:30.801345    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e-istio-envoy\") pod \"e2e-ipp-b-296998-openshift-default-6cc8987c78-klg8n\" (UID: \"d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e\") " pod="openshift-ingress/e2e-ipp-b-296998-openshift-default-6cc8987c78-klg8n"
Jul 30 21:23:30.801717 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:30.801493    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e-workload-certs\") pod \"e2e-ipp-b-296998-openshift-default-6cc8987c78-klg8n\" (UID: \"d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e\") " pod="openshift-ingress/e2e-ipp-b-296998-openshift-default-6cc8987c78-klg8n"
Jul 30 21:23:30.801717 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:30.801516    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e-workload-socket\") pod \"e2e-ipp-b-296998-openshift-default-6cc8987c78-klg8n\" (UID: \"d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e\") " pod="openshift-ingress/e2e-ipp-b-296998-openshift-default-6cc8987c78-klg8n"
Jul 30 21:23:30.801717 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:30.801695    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e-istio-data\") pod \"e2e-ipp-b-296998-openshift-default-6cc8987c78-klg8n\" (UID: \"d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e\") " pod="openshift-ingress/e2e-ipp-b-296998-openshift-default-6cc8987c78-klg8n"
Jul 30 21:23:30.801995 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:30.801971    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e-credential-socket\") pod \"e2e-ipp-b-296998-openshift-default-6cc8987c78-klg8n\" (UID: \"d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e\") " pod="openshift-ingress/e2e-ipp-b-296998-openshift-default-6cc8987c78-klg8n"
Jul 30 21:23:30.802260 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:30.802206    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e-istiod-ca-cert\") pod \"e2e-ipp-b-296998-openshift-default-6cc8987c78-klg8n\" (UID: \"d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e\") " pod="openshift-ingress/e2e-ipp-b-296998-openshift-default-6cc8987c78-klg8n"
Jul 30 21:23:30.803923 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:30.803896    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e-istio-envoy\") pod \"e2e-ipp-b-296998-openshift-default-6cc8987c78-klg8n\" (UID: \"d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e\") " pod="openshift-ingress/e2e-ipp-b-296998-openshift-default-6cc8987c78-klg8n"
Jul 30 21:23:30.804162 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:30.804121    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e-istio-podinfo\") pod \"e2e-ipp-b-296998-openshift-default-6cc8987c78-klg8n\" (UID: \"d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e\") " pod="openshift-ingress/e2e-ipp-b-296998-openshift-default-6cc8987c78-klg8n"
Jul 30 21:23:30.815375 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:30.815354    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-psjl8\" (UniqueName: \"kubernetes.io/projected/d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e-kube-api-access-psjl8\") pod \"e2e-ipp-b-296998-openshift-default-6cc8987c78-klg8n\" (UID: \"d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e\") " pod="openshift-ingress/e2e-ipp-b-296998-openshift-default-6cc8987c78-klg8n"
Jul 30 21:23:30.821505 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:30.821486    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e-istio-token\") pod \"e2e-ipp-b-296998-openshift-default-6cc8987c78-klg8n\" (UID: \"d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e\") " pod="openshift-ingress/e2e-ipp-b-296998-openshift-default-6cc8987c78-klg8n"
Jul 30 21:23:30.846553 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:30.846524    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-296998-openshift-default-6cc8987c78-klg8n"
Jul 30 21:23:30.927674 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:30.927643    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:23:31.019564 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:31.019542    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-296998-openshift-default-6cc8987c78-klg8n"]
Jul 30 21:23:31.021708 ip-10-0-142-69 kubenswrapper[2583]: W0730 21:23:31.021685    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3ba5e90_4cb2_4f7d_910b_ba97a5ef958e.slice/crio-f8905ad039213d693fd169835c94cc0f6e3139125bb8a6f03eae6856c782acfb WatchSource:0}: Error finding container f8905ad039213d693fd169835c94cc0f6e3139125bb8a6f03eae6856c782acfb: Status 404 returned error can't find the container with id f8905ad039213d693fd169835c94cc0f6e3139125bb8a6f03eae6856c782acfb
Jul 30 21:23:31.994221 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:31.994184    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-296998-openshift-default-6cc8987c78-klg8n" event={"ID":"d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e","Type":"ContainerStarted","Data":"f8905ad039213d693fd169835c94cc0f6e3139125bb8a6f03eae6856c782acfb"}
Jul 30 21:23:33.626622 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:33.626581    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 30 21:23:33.626921 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:33.626690    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 30 21:23:33.626921 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:33.626730    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 30 21:23:34.007979 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:34.007943    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-296998-openshift-default-6cc8987c78-klg8n" event={"ID":"d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e","Type":"ContainerStarted","Data":"4b10bcd4caf6e526727b1553589f224fcbf1b5228b3aaa203a30657c6e17ce24"}
Jul 30 21:23:34.846944 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:34.846910    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-296998-openshift-default-6cc8987c78-klg8n"
Jul 30 21:23:34.851839 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:34.851812    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-296998-openshift-default-6cc8987c78-klg8n"
Jul 30 21:23:34.888056 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:34.887986    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-296998-openshift-default-6cc8987c78-klg8n" podStartSLOduration=2.285536113 podStartE2EDuration="4.88796688s" totalImagesPullingTime="2.602430767s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 21:23:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 21:23:34.052251143 +0000 UTC m=+3525.893726764" watchObservedRunningTime="2026-07-30 21:23:34.88796688 +0000 UTC m=+3526.729442500"
Jul 30 21:23:35.014455 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:35.014341    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-296998-openshift-default-6cc8987c78-klg8n"
Jul 30 21:23:35.015402 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:35.015379    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-296998-openshift-default-6cc8987c78-klg8n"
Jul 30 21:23:36.248445 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:36.248413    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:23:36.369265 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:36.369229    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:23:37.403573 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:37.403535    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:23:37.619258 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:37.619221    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:23:38.191034 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:38.191001    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:23:38.299829 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:38.299796    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:23:38.395845 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:38.395815    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-296998-d957d4796-2wfm6"]
Jul 30 21:23:38.399766 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:38.399745    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-296998-d957d4796-2wfm6"
Jul 30 21:23:38.407398 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:38.407379    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-296998\""
Jul 30 21:23:38.408462 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:38.408445    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-296998-dockercfg-qnc5n\""
Jul 30 21:23:38.424755 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:38.424736    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-296998-d957d4796-2wfm6"]
Jul 30 21:23:38.478181 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:38.478078    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/389d8c06-1bc8-4d26-9ba5-7406b779880f-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-296998-d957d4796-2wfm6\" (UID: \"389d8c06-1bc8-4d26-9ba5-7406b779880f\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-296998-d957d4796-2wfm6"
Jul 30 21:23:38.478181 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:38.478125    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sq6jl\" (UniqueName: \"kubernetes.io/projected/389d8c06-1bc8-4d26-9ba5-7406b779880f-kube-api-access-sq6jl\") pod \"payload-pre-processing-e2e-ipp-b-296998-d957d4796-2wfm6\" (UID: \"389d8c06-1bc8-4d26-9ba5-7406b779880f\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-296998-d957d4796-2wfm6"
Jul 30 21:23:38.500205 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:38.500172    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-296998-78f6886cf4-w2nsq"]
Jul 30 21:23:38.503789 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:38.503768    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-296998-78f6886cf4-w2nsq"
Jul 30 21:23:38.517159 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:38.517106    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-296998-78f6886cf4-w2nsq"]
Jul 30 21:23:38.579564 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:38.579528    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m492n\" (UniqueName: \"kubernetes.io/projected/164586fd-0ddb-4a02-ab98-2dba9664d826-kube-api-access-m492n\") pod \"payload-processing-e2e-ipp-b-296998-78f6886cf4-w2nsq\" (UID: \"164586fd-0ddb-4a02-ab98-2dba9664d826\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-296998-78f6886cf4-w2nsq"
Jul 30 21:23:38.579735 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:38.579602    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/389d8c06-1bc8-4d26-9ba5-7406b779880f-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-296998-d957d4796-2wfm6\" (UID: \"389d8c06-1bc8-4d26-9ba5-7406b779880f\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-296998-d957d4796-2wfm6"
Jul 30 21:23:38.579735 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:38.579661    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sq6jl\" (UniqueName: \"kubernetes.io/projected/389d8c06-1bc8-4d26-9ba5-7406b779880f-kube-api-access-sq6jl\") pod \"payload-pre-processing-e2e-ipp-b-296998-d957d4796-2wfm6\" (UID: \"389d8c06-1bc8-4d26-9ba5-7406b779880f\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-296998-d957d4796-2wfm6"
Jul 30 21:23:38.579735 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:38.579685    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/164586fd-0ddb-4a02-ab98-2dba9664d826-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-296998-78f6886cf4-w2nsq\" (UID: \"164586fd-0ddb-4a02-ab98-2dba9664d826\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-296998-78f6886cf4-w2nsq"
Jul 30 21:23:38.580393 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:38.580374    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/389d8c06-1bc8-4d26-9ba5-7406b779880f-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-296998-d957d4796-2wfm6\" (UID: \"389d8c06-1bc8-4d26-9ba5-7406b779880f\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-296998-d957d4796-2wfm6"
Jul 30 21:23:38.589186 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:38.589164    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sq6jl\" (UniqueName: \"kubernetes.io/projected/389d8c06-1bc8-4d26-9ba5-7406b779880f-kube-api-access-sq6jl\") pod \"payload-pre-processing-e2e-ipp-b-296998-d957d4796-2wfm6\" (UID: \"389d8c06-1bc8-4d26-9ba5-7406b779880f\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-296998-d957d4796-2wfm6"
Jul 30 21:23:38.680702 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:38.680667    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m492n\" (UniqueName: \"kubernetes.io/projected/164586fd-0ddb-4a02-ab98-2dba9664d826-kube-api-access-m492n\") pod \"payload-processing-e2e-ipp-b-296998-78f6886cf4-w2nsq\" (UID: \"164586fd-0ddb-4a02-ab98-2dba9664d826\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-296998-78f6886cf4-w2nsq"
Jul 30 21:23:38.680878 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:38.680798    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/164586fd-0ddb-4a02-ab98-2dba9664d826-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-296998-78f6886cf4-w2nsq\" (UID: \"164586fd-0ddb-4a02-ab98-2dba9664d826\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-296998-78f6886cf4-w2nsq"
Jul 30 21:23:38.681586 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:38.681565    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/164586fd-0ddb-4a02-ab98-2dba9664d826-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-296998-78f6886cf4-w2nsq\" (UID: \"164586fd-0ddb-4a02-ab98-2dba9664d826\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-296998-78f6886cf4-w2nsq"
Jul 30 21:23:38.690208 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:38.690181    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m492n\" (UniqueName: \"kubernetes.io/projected/164586fd-0ddb-4a02-ab98-2dba9664d826-kube-api-access-m492n\") pod \"payload-processing-e2e-ipp-b-296998-78f6886cf4-w2nsq\" (UID: \"164586fd-0ddb-4a02-ab98-2dba9664d826\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-296998-78f6886cf4-w2nsq"
Jul 30 21:23:38.709041 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:38.709019    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-296998-d957d4796-2wfm6"
Jul 30 21:23:38.813517 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:38.813491    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-296998-78f6886cf4-w2nsq"
Jul 30 21:23:38.845124 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:38.845098    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-296998-d957d4796-2wfm6"]
Jul 30 21:23:38.846826 ip-10-0-142-69 kubenswrapper[2583]: W0730 21:23:38.846797    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod389d8c06_1bc8_4d26_9ba5_7406b779880f.slice/crio-2db6980fe10dc5b5790f33a04dd5cf865bc9a70807a29dd2d24dc793397aa6e0 WatchSource:0}: Error finding container 2db6980fe10dc5b5790f33a04dd5cf865bc9a70807a29dd2d24dc793397aa6e0: Status 404 returned error can't find the container with id 2db6980fe10dc5b5790f33a04dd5cf865bc9a70807a29dd2d24dc793397aa6e0
Jul 30 21:23:38.966198 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:38.966170    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-296998-78f6886cf4-w2nsq"]
Jul 30 21:23:38.967985 ip-10-0-142-69 kubenswrapper[2583]: W0730 21:23:38.967957    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod164586fd_0ddb_4a02_ab98_2dba9664d826.slice/crio-a3f961f750c4f97eecf62330099ec6d735fedb5c8e4a40df79632a1a2c2c80b8 WatchSource:0}: Error finding container a3f961f750c4f97eecf62330099ec6d735fedb5c8e4a40df79632a1a2c2c80b8: Status 404 returned error can't find the container with id a3f961f750c4f97eecf62330099ec6d735fedb5c8e4a40df79632a1a2c2c80b8
Jul 30 21:23:39.043796 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:39.043763    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-296998-78f6886cf4-w2nsq" event={"ID":"164586fd-0ddb-4a02-ab98-2dba9664d826","Type":"ContainerStarted","Data":"ddbdb693e8394d897e6a2ef1a7f17a89c48158367a39d436a481bad28d28adc1"}
Jul 30 21:23:39.044113 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:39.043818    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-296998-78f6886cf4-w2nsq"
Jul 30 21:23:39.044113 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:39.043838    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-296998-78f6886cf4-w2nsq" event={"ID":"164586fd-0ddb-4a02-ab98-2dba9664d826","Type":"ContainerStarted","Data":"a3f961f750c4f97eecf62330099ec6d735fedb5c8e4a40df79632a1a2c2c80b8"}
Jul 30 21:23:39.045545 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:39.045521    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-296998-d957d4796-2wfm6" event={"ID":"389d8c06-1bc8-4d26-9ba5-7406b779880f","Type":"ContainerStarted","Data":"a62a931f7ef89cdfcefa1d1bbab0d6b361296144d8e3f687bebae2d1353fb7e8"}
Jul 30 21:23:39.045675 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:39.045563    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-296998-d957d4796-2wfm6" event={"ID":"389d8c06-1bc8-4d26-9ba5-7406b779880f","Type":"ContainerStarted","Data":"2db6980fe10dc5b5790f33a04dd5cf865bc9a70807a29dd2d24dc793397aa6e0"}
Jul 30 21:23:39.045675 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:39.045597    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-296998-d957d4796-2wfm6"
Jul 30 21:23:39.077577 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:39.077522    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-b-296998-78f6886cf4-w2nsq" podStartSLOduration=1.077507927 podStartE2EDuration="1.077507927s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 21:23:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 21:23:39.075595352 +0000 UTC m=+3530.917070972" watchObservedRunningTime="2026-07-30 21:23:39.077507927 +0000 UTC m=+3530.918983546"
Jul 30 21:23:39.130219 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:39.130151    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-296998-d957d4796-2wfm6" podStartSLOduration=1.1301175780000001 podStartE2EDuration="1.130117578s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 21:23:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 21:23:39.126630522 +0000 UTC m=+3530.968106145" watchObservedRunningTime="2026-07-30 21:23:39.130117578 +0000 UTC m=+3530.971593200"
Jul 30 21:23:41.094211 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:41.094181    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 21:23:50.053797 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:50.053762    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-296998-d957d4796-2wfm6"
Jul 30 21:23:50.054328 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:50.053839    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-296998-78f6886cf4-w2nsq"
Jul 30 21:23:51.058704 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:51.057305    2583 patch_prober.go:28] interesting pod/e2e-ipp-b-296998-openshift-default-6cc8987c78-klg8n container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 30 21:23:51.058704 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:51.057375    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-296998-openshift-default-6cc8987c78-klg8n" podUID="d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 30 21:23:51.121007 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:51.120973    2583 generic.go:356] "Generic (PLEG): container finished" podID="d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e" containerID="4b10bcd4caf6e526727b1553589f224fcbf1b5228b3aaa203a30657c6e17ce24" exitCode=0
Jul 30 21:23:51.121158 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:51.121035    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-296998-openshift-default-6cc8987c78-klg8n" event={"ID":"d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e","Type":"ContainerDied","Data":"4b10bcd4caf6e526727b1553589f224fcbf1b5228b3aaa203a30657c6e17ce24"}
Jul 30 21:23:51.121410 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:51.121396    2583 scope.go:117] "RemoveContainer" containerID="4b10bcd4caf6e526727b1553589f224fcbf1b5228b3aaa203a30657c6e17ce24"
Jul 30 21:23:51.122491 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:51.122457    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 30 21:23:51.122597 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:51.122544    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 30 21:23:51.122661 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:51.122596    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 30 21:23:52.129475 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:52.129442    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-296998-openshift-default-6cc8987c78-klg8n" event={"ID":"d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e","Type":"ContainerStarted","Data":"fc0d036a90e3a8411623e1df93e4328c5f9e69c10807219abdb32ad5a90e25ca"}
Jul 30 21:23:52.847511 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:52.847471    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-296998-openshift-default-6cc8987c78-klg8n"
Jul 30 21:23:52.847788 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:52.847748    2583 patch_prober.go:28] interesting pod/e2e-ipp-b-296998-openshift-default-6cc8987c78-klg8n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Jul 30 21:23:52.847881 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:52.847809    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-296998-openshift-default-6cc8987c78-klg8n" podUID="d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Jul 30 21:23:53.847256 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:53.847213    2583 patch_prober.go:28] interesting pod/e2e-ipp-b-296998-openshift-default-6cc8987c78-klg8n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Jul 30 21:23:53.847749 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:53.847281    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-296998-openshift-default-6cc8987c78-klg8n" podUID="d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Jul 30 21:23:54.847041 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:54.846997    2583 patch_prober.go:28] interesting pod/e2e-ipp-b-296998-openshift-default-6cc8987c78-klg8n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Jul 30 21:23:54.847288 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:54.847066    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-296998-openshift-default-6cc8987c78-klg8n" podUID="d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Jul 30 21:23:55.847354 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:55.847319    2583 patch_prober.go:28] interesting pod/e2e-ipp-b-296998-openshift-default-6cc8987c78-klg8n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Jul 30 21:23:55.847769 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:55.847378    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-296998-openshift-default-6cc8987c78-klg8n" podUID="d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Jul 30 21:23:56.847436 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:56.847400    2583 patch_prober.go:28] interesting pod/e2e-ipp-b-296998-openshift-default-6cc8987c78-klg8n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Jul 30 21:23:56.847845 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:56.847456    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-296998-openshift-default-6cc8987c78-klg8n" podUID="d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Jul 30 21:23:57.851267 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:57.851241    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-296998-openshift-default-6cc8987c78-klg8n"
Jul 30 21:23:57.851729 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:57.851713    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-296998-openshift-default-6cc8987c78-klg8n"
Jul 30 21:23:57.852328 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:23:57.852308    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-296998-openshift-default-6cc8987c78-klg8n"
Jul 30 21:24:01.186655 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:24:01.186622    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:24:08.178868 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:24:08.178839    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-frt6g_88f255a7-c387-47df-a88b-e13110fa654c/payload-processing/0.log"
Jul 30 21:24:08.329526 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:24:08.329497    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-296998-78f6886cf4-w2nsq_164586fd-0ddb-4a02-ab98-2dba9664d826/payload-processing/0.log"
Jul 30 21:24:09.962426 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:24:09.962374    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:24:26.582847 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:24:26.582814    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-ipp-a-e54afd/ipp-route-e54afd-kserve-65fd56bcf5-vps9d"]
Jul 30 21:24:26.586538 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:24:26.586518    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-e54afd/ipp-route-e54afd-kserve-65fd56bcf5-vps9d"
Jul 30 21:24:26.588890 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:24:26.588868    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-e54afd\"/\"ipp-route-e54afd-kserve-self-signed-certs\""
Jul 30 21:24:26.589759 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:24:26.589737    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-e54afd\"/\"openshift-service-ca.crt\""
Jul 30 21:24:26.589950 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:24:26.589928    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-e54afd\"/\"kube-root-ca.crt\""
Jul 30 21:24:26.591318 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:24:26.591293    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-e54afd\"/\"default-dockercfg-lcgnt\""
Jul 30 21:24:26.611205 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:24:26.611183    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-e54afd/ipp-route-e54afd-kserve-65fd56bcf5-vps9d"]
Jul 30 21:24:26.615316 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:24:26.615293    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6e186177-1f99-4d19-85d4-6d894034416d-dshm\") pod \"ipp-route-e54afd-kserve-65fd56bcf5-vps9d\" (UID: \"6e186177-1f99-4d19-85d4-6d894034416d\") " pod="ai-tenant-e2e-ipp-a-e54afd/ipp-route-e54afd-kserve-65fd56bcf5-vps9d"
Jul 30 21:24:26.615409 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:24:26.615330    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6e186177-1f99-4d19-85d4-6d894034416d-tmp-dir\") pod \"ipp-route-e54afd-kserve-65fd56bcf5-vps9d\" (UID: \"6e186177-1f99-4d19-85d4-6d894034416d\") " pod="ai-tenant-e2e-ipp-a-e54afd/ipp-route-e54afd-kserve-65fd56bcf5-vps9d"
Jul 30 21:24:26.615409 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:24:26.615389    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6e186177-1f99-4d19-85d4-6d894034416d-model-cache\") pod \"ipp-route-e54afd-kserve-65fd56bcf5-vps9d\" (UID: \"6e186177-1f99-4d19-85d4-6d894034416d\") " pod="ai-tenant-e2e-ipp-a-e54afd/ipp-route-e54afd-kserve-65fd56bcf5-vps9d"
Jul 30 21:24:26.615535 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:24:26.615418    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6e186177-1f99-4d19-85d4-6d894034416d-home\") pod \"ipp-route-e54afd-kserve-65fd56bcf5-vps9d\" (UID: \"6e186177-1f99-4d19-85d4-6d894034416d\") " pod="ai-tenant-e2e-ipp-a-e54afd/ipp-route-e54afd-kserve-65fd56bcf5-vps9d"
Jul 30 21:24:26.615535 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:24:26.615514    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6e186177-1f99-4d19-85d4-6d894034416d-tls-certs\") pod \"ipp-route-e54afd-kserve-65fd56bcf5-vps9d\" (UID: \"6e186177-1f99-4d19-85d4-6d894034416d\") " pod="ai-tenant-e2e-ipp-a-e54afd/ipp-route-e54afd-kserve-65fd56bcf5-vps9d"
Jul 30 21:24:26.615631 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:24:26.615550    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xcqs4\" (UniqueName: \"kubernetes.io/projected/6e186177-1f99-4d19-85d4-6d894034416d-kube-api-access-xcqs4\") pod \"ipp-route-e54afd-kserve-65fd56bcf5-vps9d\" (UID: \"6e186177-1f99-4d19-85d4-6d894034416d\") " pod="ai-tenant-e2e-ipp-a-e54afd/ipp-route-e54afd-kserve-65fd56bcf5-vps9d"
Jul 30 21:24:26.637994 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:24:26.637971    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:24:26.716022 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:24:26.715996    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6e186177-1f99-4d19-85d4-6d894034416d-tls-certs\") pod \"ipp-route-e54afd-kserve-65fd56bcf5-vps9d\" (UID: \"6e186177-1f99-4d19-85d4-6d894034416d\") " pod="ai-tenant-e2e-ipp-a-e54afd/ipp-route-e54afd-kserve-65fd56bcf5-vps9d"
Jul 30 21:24:26.716163 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:24:26.716024    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xcqs4\" (UniqueName: \"kubernetes.io/projected/6e186177-1f99-4d19-85d4-6d894034416d-kube-api-access-xcqs4\") pod \"ipp-route-e54afd-kserve-65fd56bcf5-vps9d\" (UID: \"6e186177-1f99-4d19-85d4-6d894034416d\") " pod="ai-tenant-e2e-ipp-a-e54afd/ipp-route-e54afd-kserve-65fd56bcf5-vps9d"
Jul 30 21:24:26.716215 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:24:26.716167    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6e186177-1f99-4d19-85d4-6d894034416d-dshm\") pod \"ipp-route-e54afd-kserve-65fd56bcf5-vps9d\" (UID: \"6e186177-1f99-4d19-85d4-6d894034416d\") " pod="ai-tenant-e2e-ipp-a-e54afd/ipp-route-e54afd-kserve-65fd56bcf5-vps9d"
Jul 30 21:24:26.716259 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:24:26.716212    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6e186177-1f99-4d19-85d4-6d894034416d-tmp-dir\") pod \"ipp-route-e54afd-kserve-65fd56bcf5-vps9d\" (UID: \"6e186177-1f99-4d19-85d4-6d894034416d\") " pod="ai-tenant-e2e-ipp-a-e54afd/ipp-route-e54afd-kserve-65fd56bcf5-vps9d"
Jul 30 21:24:26.716311 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:24:26.716294    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6e186177-1f99-4d19-85d4-6d894034416d-model-cache\") pod \"ipp-route-e54afd-kserve-65fd56bcf5-vps9d\" (UID: \"6e186177-1f99-4d19-85d4-6d894034416d\") " pod="ai-tenant-e2e-ipp-a-e54afd/ipp-route-e54afd-kserve-65fd56bcf5-vps9d"
Jul 30 21:24:26.716518 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:24:26.716486    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6e186177-1f99-4d19-85d4-6d894034416d-home\") pod \"ipp-route-e54afd-kserve-65fd56bcf5-vps9d\" (UID: \"6e186177-1f99-4d19-85d4-6d894034416d\") " pod="ai-tenant-e2e-ipp-a-e54afd/ipp-route-e54afd-kserve-65fd56bcf5-vps9d"
Jul 30 21:24:26.716624 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:24:26.716597    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6e186177-1f99-4d19-85d4-6d894034416d-tmp-dir\") pod \"ipp-route-e54afd-kserve-65fd56bcf5-vps9d\" (UID: \"6e186177-1f99-4d19-85d4-6d894034416d\") " pod="ai-tenant-e2e-ipp-a-e54afd/ipp-route-e54afd-kserve-65fd56bcf5-vps9d"
Jul 30 21:24:26.716688 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:24:26.716669    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6e186177-1f99-4d19-85d4-6d894034416d-model-cache\") pod \"ipp-route-e54afd-kserve-65fd56bcf5-vps9d\" (UID: \"6e186177-1f99-4d19-85d4-6d894034416d\") " pod="ai-tenant-e2e-ipp-a-e54afd/ipp-route-e54afd-kserve-65fd56bcf5-vps9d"
Jul 30 21:24:26.716728 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:24:26.716702    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6e186177-1f99-4d19-85d4-6d894034416d-home\") pod \"ipp-route-e54afd-kserve-65fd56bcf5-vps9d\" (UID: \"6e186177-1f99-4d19-85d4-6d894034416d\") " pod="ai-tenant-e2e-ipp-a-e54afd/ipp-route-e54afd-kserve-65fd56bcf5-vps9d"
Jul 30 21:24:26.718589 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:24:26.718573    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6e186177-1f99-4d19-85d4-6d894034416d-dshm\") pod \"ipp-route-e54afd-kserve-65fd56bcf5-vps9d\" (UID: \"6e186177-1f99-4d19-85d4-6d894034416d\") " pod="ai-tenant-e2e-ipp-a-e54afd/ipp-route-e54afd-kserve-65fd56bcf5-vps9d"
Jul 30 21:24:26.718833 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:24:26.718815    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6e186177-1f99-4d19-85d4-6d894034416d-tls-certs\") pod \"ipp-route-e54afd-kserve-65fd56bcf5-vps9d\" (UID: \"6e186177-1f99-4d19-85d4-6d894034416d\") " pod="ai-tenant-e2e-ipp-a-e54afd/ipp-route-e54afd-kserve-65fd56bcf5-vps9d"
Jul 30 21:24:26.726359 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:24:26.726335    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xcqs4\" (UniqueName: \"kubernetes.io/projected/6e186177-1f99-4d19-85d4-6d894034416d-kube-api-access-xcqs4\") pod \"ipp-route-e54afd-kserve-65fd56bcf5-vps9d\" (UID: \"6e186177-1f99-4d19-85d4-6d894034416d\") " pod="ai-tenant-e2e-ipp-a-e54afd/ipp-route-e54afd-kserve-65fd56bcf5-vps9d"
Jul 30 21:24:26.896045 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:24:26.895965    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-e54afd/ipp-route-e54afd-kserve-65fd56bcf5-vps9d"
Jul 30 21:24:27.031354 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:24:27.031330    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-e54afd/ipp-route-e54afd-kserve-65fd56bcf5-vps9d"]
Jul 30 21:24:27.032748 ip-10-0-142-69 kubenswrapper[2583]: W0730 21:24:27.032716    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6e186177_1f99_4d19_85d4_6d894034416d.slice/crio-ba44b893a0b04d99e07aa0df2b52b88824f118b7f348f637675b6b473dcdef35 WatchSource:0}: Error finding container ba44b893a0b04d99e07aa0df2b52b88824f118b7f348f637675b6b473dcdef35: Status 404 returned error can't find the container with id ba44b893a0b04d99e07aa0df2b52b88824f118b7f348f637675b6b473dcdef35
Jul 30 21:24:27.329234 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:24:27.329195    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-e54afd/ipp-route-e54afd-kserve-65fd56bcf5-vps9d" event={"ID":"6e186177-1f99-4d19-85d4-6d894034416d","Type":"ContainerStarted","Data":"b75a21726b5a6d0e05326511d567fe2b49ff8ea3246ca0c0c5edf991a8a85e3b"}
Jul 30 21:24:27.329434 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:24:27.329246    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-e54afd/ipp-route-e54afd-kserve-65fd56bcf5-vps9d" event={"ID":"6e186177-1f99-4d19-85d4-6d894034416d","Type":"ContainerStarted","Data":"ba44b893a0b04d99e07aa0df2b52b88824f118b7f348f637675b6b473dcdef35"}
Jul 30 21:24:27.352931 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:24:27.352883    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-ipp-a-e54afd/ipp-route-e54afd-kserve-65fd56bcf5-vps9d" podStartSLOduration=1.35286825 podStartE2EDuration="1.35286825s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 21:24:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 21:24:27.350800232 +0000 UTC m=+3579.192275855" watchObservedRunningTime="2026-07-30 21:24:27.35286825 +0000 UTC m=+3579.194343907"
Jul 30 21:24:29.156972 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:24:29.156935    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 21:24:36.896196 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:24:36.896162    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-ipp-a-e54afd/ipp-route-e54afd-kserve-65fd56bcf5-vps9d"
Jul 30 21:24:36.896752 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:24:36.896225    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-ipp-a-e54afd/ipp-route-e54afd-kserve-65fd56bcf5-vps9d"
Jul 30 21:24:36.909879 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:24:36.909854    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-ipp-a-e54afd/ipp-route-e54afd-kserve-65fd56bcf5-vps9d"
Jul 30 21:24:37.396895 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:24:37.396867    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-ipp-a-e54afd/ipp-route-e54afd-kserve-65fd56bcf5-vps9d"
Jul 30 21:24:57.554819 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:24:57.554779    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 21:25:08.730703 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:25:08.730673    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-frt6g_88f255a7-c387-47df-a88b-e13110fa654c/payload-processing/0.log"
Jul 30 21:25:08.850114 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:25:08.850081    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-296998-78f6886cf4-w2nsq_164586fd-0ddb-4a02-ab98-2dba9664d826/payload-processing/0.log"
Jul 30 21:25:09.126498 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:25:09.126385    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:25:09.460091 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:25:09.460061    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:25:09.722419 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:25:09.722312    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:25:12.916914 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:25:12.916870    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:25:13.016939 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:25:13.016908    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:25:14.087544 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:25:14.087501    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:25:14.301521 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:25:14.301489    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:25:14.697440 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:25:14.697404    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:25:14.790473 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:25:14.790441    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:25:19.556820 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:25:19.556790    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 21:25:38.028328 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:25:38.028296    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:25:38.761858 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:25:38.761826    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-83307c-nntzx"]
Jul 30 21:25:38.765264 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:25:38.765249    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-83307c-nntzx"
Jul 30 21:25:38.767190 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:25:38.767116    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 30 21:25:38.767310 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:25:38.767244    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zm2hs\""
Jul 30 21:25:38.773334 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:25:38.773309    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-83307c-nntzx"]
Jul 30 21:25:38.849304 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:25:38.849278    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d862886-65a9-4eff-bb33-86537068de55-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-83307c-nntzx\" (UID: \"3d862886-65a9-4eff-bb33-86537068de55\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-83307c-nntzx"
Jul 30 21:25:38.950650 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:25:38.950621    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d862886-65a9-4eff-bb33-86537068de55-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-83307c-nntzx\" (UID: \"3d862886-65a9-4eff-bb33-86537068de55\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-83307c-nntzx"
Jul 30 21:25:38.951315 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:25:38.951297    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d862886-65a9-4eff-bb33-86537068de55-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-83307c-nntzx\" (UID: \"3d862886-65a9-4eff-bb33-86537068de55\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-83307c-nntzx"
Jul 30 21:25:39.077281 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:25:39.077213    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-83307c-nntzx"
Jul 30 21:25:39.418114 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:25:39.418088    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-83307c-nntzx"]
Jul 30 21:25:39.419462 ip-10-0-142-69 kubenswrapper[2583]: W0730 21:25:39.419435    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d862886_65a9_4eff_bb33_86537068de55.slice/crio-d8bcced75115d54cb03ca72e9527a628fcf1b3b465873fb0113b1592832464d5 WatchSource:0}: Error finding container d8bcced75115d54cb03ca72e9527a628fcf1b3b465873fb0113b1592832464d5: Status 404 returned error can't find the container with id d8bcced75115d54cb03ca72e9527a628fcf1b3b465873fb0113b1592832464d5
Jul 30 21:25:39.740263 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:25:39.740190    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-83307c-nntzx" event={"ID":"3d862886-65a9-4eff-bb33-86537068de55","Type":"ContainerStarted","Data":"37f4f0e34aa6179f837691e1c1c21161e98660a45f1cc0261e3c0d80d104dd58"}
Jul 30 21:25:39.740396 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:25:39.740259    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-83307c-nntzx" event={"ID":"3d862886-65a9-4eff-bb33-86537068de55","Type":"ContainerStarted","Data":"d8bcced75115d54cb03ca72e9527a628fcf1b3b465873fb0113b1592832464d5"}
Jul 30 21:25:39.757428 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:25:39.757365    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-83307c-nntzx" podStartSLOduration=1.757348102 podStartE2EDuration="1.757348102s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 21:25:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 21:25:39.754713701 +0000 UTC m=+3651.596189318" watchObservedRunningTime="2026-07-30 21:25:39.757348102 +0000 UTC m=+3651.598823723"
Jul 30 21:25:40.746996 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:25:40.746960    2583 generic.go:356] "Generic (PLEG): container finished" podID="3d862886-65a9-4eff-bb33-86537068de55" containerID="37f4f0e34aa6179f837691e1c1c21161e98660a45f1cc0261e3c0d80d104dd58" exitCode=0
Jul 30 21:25:40.747410 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:25:40.747053    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-83307c-nntzx" event={"ID":"3d862886-65a9-4eff-bb33-86537068de55","Type":"ContainerDied","Data":"37f4f0e34aa6179f837691e1c1c21161e98660a45f1cc0261e3c0d80d104dd58"}
Jul 30 21:25:41.892345 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:25:41.892321    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-83307c-nntzx"
Jul 30 21:25:41.981734 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:25:41.981707    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d862886-65a9-4eff-bb33-86537068de55-maas-api-service-ca\") pod \"3d862886-65a9-4eff-bb33-86537068de55\" (UID: \"3d862886-65a9-4eff-bb33-86537068de55\") "
Jul 30 21:25:41.982026 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:25:41.982003    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d862886-65a9-4eff-bb33-86537068de55-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "3d862886-65a9-4eff-bb33-86537068de55" (UID: "3d862886-65a9-4eff-bb33-86537068de55"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 21:25:42.082902 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:25:42.082824    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d862886-65a9-4eff-bb33-86537068de55-maas-api-service-ca\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 21:25:42.759958 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:25:42.759918    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-83307c-nntzx"
Jul 30 21:25:42.760102 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:25:42.759974    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-83307c-nntzx" event={"ID":"3d862886-65a9-4eff-bb33-86537068de55","Type":"ContainerDied","Data":"d8bcced75115d54cb03ca72e9527a628fcf1b3b465873fb0113b1592832464d5"}
Jul 30 21:25:42.760102 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:25:42.760019    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d8bcced75115d54cb03ca72e9527a628fcf1b3b465873fb0113b1592832464d5"
Jul 30 21:25:44.733662 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:25:44.733629    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:25:44.825609 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:25:44.825578    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:25:44.935883 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:25:44.935856    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:25:44.991728 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:25:44.991643    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-83307c-nntzx"]
Jul 30 21:25:45.000568 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:25:45.000542    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-83307c-nntzx"]
Jul 30 21:25:45.026495 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:25:45.026467    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:25:45.385642 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:25:45.385559    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:25:46.675639 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:25:46.675602    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3d862886-65a9-4eff-bb33-86537068de55" path="/var/lib/kubelet/pods/3d862886-65a9-4eff-bb33-86537068de55/volumes"
Jul 30 21:25:47.551670 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:25:47.551626    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 21:25:51.073158 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:25:51.073118    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:25:51.136232 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:25:51.136203    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:25:51.384018 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:25:51.383930    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:25:51.689517 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:25:51.689487    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:25:55.367455 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:25:55.367419    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-e54afd-hd2gl"]
Jul 30 21:25:55.367831 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:25:55.367824    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d862886-65a9-4eff-bb33-86537068de55" containerName="revoke-keys"
Jul 30 21:25:55.367881 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:25:55.367835    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d862886-65a9-4eff-bb33-86537068de55" containerName="revoke-keys"
Jul 30 21:25:55.367916 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:25:55.367902    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d862886-65a9-4eff-bb33-86537068de55" containerName="revoke-keys"
Jul 30 21:25:55.371203 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:25:55.371188    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-e54afd-hd2gl"
Jul 30 21:25:55.373155 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:25:55.373123    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 30 21:25:55.373257 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:25:55.373179    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zm2hs\""
Jul 30 21:25:55.377306 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:25:55.377282    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-e54afd-hd2gl"]
Jul 30 21:25:55.409311 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:25:55.409280    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/04c5378a-6441-4806-b743-fcc1ac67c200-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-e54afd-hd2gl\" (UID: \"04c5378a-6441-4806-b743-fcc1ac67c200\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-e54afd-hd2gl"
Jul 30 21:25:55.509832 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:25:55.509801    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/04c5378a-6441-4806-b743-fcc1ac67c200-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-e54afd-hd2gl\" (UID: \"04c5378a-6441-4806-b743-fcc1ac67c200\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-e54afd-hd2gl"
Jul 30 21:25:55.510448 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:25:55.510425    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/04c5378a-6441-4806-b743-fcc1ac67c200-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-e54afd-hd2gl\" (UID: \"04c5378a-6441-4806-b743-fcc1ac67c200\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-e54afd-hd2gl"
Jul 30 21:25:55.683214 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:25:55.683186    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-e54afd-hd2gl"
Jul 30 21:25:55.816301 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:25:55.816278    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-e54afd-hd2gl"]
Jul 30 21:25:55.818005 ip-10-0-142-69 kubenswrapper[2583]: W0730 21:25:55.817980    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04c5378a_6441_4806_b743_fcc1ac67c200.slice/crio-47b96ae936ca1b141589799ba33e7e497f43c88f0f47d2a7f9007ddea7d04f9e WatchSource:0}: Error finding container 47b96ae936ca1b141589799ba33e7e497f43c88f0f47d2a7f9007ddea7d04f9e: Status 404 returned error can't find the container with id 47b96ae936ca1b141589799ba33e7e497f43c88f0f47d2a7f9007ddea7d04f9e
Jul 30 21:25:55.836612 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:25:55.836582    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-e54afd-hd2gl" event={"ID":"04c5378a-6441-4806-b743-fcc1ac67c200","Type":"ContainerStarted","Data":"47b96ae936ca1b141589799ba33e7e497f43c88f0f47d2a7f9007ddea7d04f9e"}
Jul 30 21:25:56.844420 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:25:56.844338    2583 generic.go:356] "Generic (PLEG): container finished" podID="04c5378a-6441-4806-b743-fcc1ac67c200" containerID="d25462d4291e2c3ba8f118c3b5fe6a9cb7443caf285385c62298fe4504ae4f04" exitCode=0
Jul 30 21:25:56.844420 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:25:56.844418    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-e54afd-hd2gl" event={"ID":"04c5378a-6441-4806-b743-fcc1ac67c200","Type":"ContainerDied","Data":"d25462d4291e2c3ba8f118c3b5fe6a9cb7443caf285385c62298fe4504ae4f04"}
Jul 30 21:25:57.986518 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:25:57.986495    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-e54afd-hd2gl"
Jul 30 21:25:58.030069 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:25:58.030039    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/04c5378a-6441-4806-b743-fcc1ac67c200-maas-api-service-ca\") pod \"04c5378a-6441-4806-b743-fcc1ac67c200\" (UID: \"04c5378a-6441-4806-b743-fcc1ac67c200\") "
Jul 30 21:25:58.030355 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:25:58.030334    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/04c5378a-6441-4806-b743-fcc1ac67c200-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "04c5378a-6441-4806-b743-fcc1ac67c200" (UID: "04c5378a-6441-4806-b743-fcc1ac67c200"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 21:25:58.131600 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:25:58.131527    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/04c5378a-6441-4806-b743-fcc1ac67c200-maas-api-service-ca\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 21:25:58.857963 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:25:58.857932    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-e54afd-hd2gl"
Jul 30 21:25:58.857963 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:25:58.857943    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-e54afd-hd2gl" event={"ID":"04c5378a-6441-4806-b743-fcc1ac67c200","Type":"ContainerDied","Data":"47b96ae936ca1b141589799ba33e7e497f43c88f0f47d2a7f9007ddea7d04f9e"}
Jul 30 21:25:58.858230 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:25:58.857989    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="47b96ae936ca1b141589799ba33e7e497f43c88f0f47d2a7f9007ddea7d04f9e"
Jul 30 21:26:08.756160 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:26:08.756093    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 21:26:11.037258 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:26:11.037058    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-e54afd-7f9b8fb4dd-mmzmn"]
Jul 30 21:26:11.037839 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:26:11.037811    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-e54afd-7f9b8fb4dd-mmzmn" podUID="755c2954-96f9-43fc-bebc-81956e0c14d8" containerName="payload-pre-processing" containerID="cri-o://69d6f685c8a0d7c8d20b8c837e89f49ad957468fb0c4461db261411283852ea7" gracePeriod=30
Jul 30 21:26:11.176661 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:26:11.176631    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-e54afd-hd2gl"]
Jul 30 21:26:11.180636 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:26:11.180604    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-e54afd-hd2gl"]
Jul 30 21:26:11.288023 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:26:11.287969    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-e54afd-7f9b8fb4dd-mmzmn"
Jul 30 21:26:11.349918 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:26:11.349884    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/755c2954-96f9-43fc-bebc-81956e0c14d8-plugins-config-volume\") pod \"755c2954-96f9-43fc-bebc-81956e0c14d8\" (UID: \"755c2954-96f9-43fc-bebc-81956e0c14d8\") "
Jul 30 21:26:11.350056 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:26:11.349936    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fztt2\" (UniqueName: \"kubernetes.io/projected/755c2954-96f9-43fc-bebc-81956e0c14d8-kube-api-access-fztt2\") pod \"755c2954-96f9-43fc-bebc-81956e0c14d8\" (UID: \"755c2954-96f9-43fc-bebc-81956e0c14d8\") "
Jul 30 21:26:11.350353 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:26:11.350325    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/755c2954-96f9-43fc-bebc-81956e0c14d8-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "755c2954-96f9-43fc-bebc-81956e0c14d8" (UID: "755c2954-96f9-43fc-bebc-81956e0c14d8"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 21:26:11.352613 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:26:11.352589    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/755c2954-96f9-43fc-bebc-81956e0c14d8-kube-api-access-fztt2" (OuterVolumeSpecName: "kube-api-access-fztt2") pod "755c2954-96f9-43fc-bebc-81956e0c14d8" (UID: "755c2954-96f9-43fc-bebc-81956e0c14d8"). InnerVolumeSpecName "kube-api-access-fztt2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 21:26:11.451626 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:26:11.451602    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/755c2954-96f9-43fc-bebc-81956e0c14d8-plugins-config-volume\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 21:26:11.451626 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:26:11.451625    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fztt2\" (UniqueName: \"kubernetes.io/projected/755c2954-96f9-43fc-bebc-81956e0c14d8-kube-api-access-fztt2\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 21:26:11.706835 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:26:11.706796    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:26:11.807084 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:26:11.807054    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:26:11.932665 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:26:11.932639    2583 generic.go:356] "Generic (PLEG): container finished" podID="755c2954-96f9-43fc-bebc-81956e0c14d8" containerID="69d6f685c8a0d7c8d20b8c837e89f49ad957468fb0c4461db261411283852ea7" exitCode=0
Jul 30 21:26:11.932803 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:26:11.932676    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-e54afd-7f9b8fb4dd-mmzmn"
Jul 30 21:26:11.932803 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:26:11.932728    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-e54afd-7f9b8fb4dd-mmzmn" event={"ID":"755c2954-96f9-43fc-bebc-81956e0c14d8","Type":"ContainerDied","Data":"69d6f685c8a0d7c8d20b8c837e89f49ad957468fb0c4461db261411283852ea7"}
Jul 30 21:26:11.932803 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:26:11.932779    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-e54afd-7f9b8fb4dd-mmzmn" event={"ID":"755c2954-96f9-43fc-bebc-81956e0c14d8","Type":"ContainerDied","Data":"4b1eeaa0ad29543fe3651a02e1efb4122f2b87f066ade987b0bc222ad6d35750"}
Jul 30 21:26:11.932803 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:26:11.932804    2583 scope.go:117] "RemoveContainer" containerID="69d6f685c8a0d7c8d20b8c837e89f49ad957468fb0c4461db261411283852ea7"
Jul 30 21:26:11.942432 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:26:11.942413    2583 scope.go:117] "RemoveContainer" containerID="69d6f685c8a0d7c8d20b8c837e89f49ad957468fb0c4461db261411283852ea7"
Jul 30 21:26:11.942669 ip-10-0-142-69 kubenswrapper[2583]: E0730 21:26:11.942649    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"69d6f685c8a0d7c8d20b8c837e89f49ad957468fb0c4461db261411283852ea7\": container with ID starting with 69d6f685c8a0d7c8d20b8c837e89f49ad957468fb0c4461db261411283852ea7 not found: ID does not exist" containerID="69d6f685c8a0d7c8d20b8c837e89f49ad957468fb0c4461db261411283852ea7"
Jul 30 21:26:11.942740 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:26:11.942678    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69d6f685c8a0d7c8d20b8c837e89f49ad957468fb0c4461db261411283852ea7"} err="failed to get container status \"69d6f685c8a0d7c8d20b8c837e89f49ad957468fb0c4461db261411283852ea7\": rpc error: code = NotFound desc = could not find container \"69d6f685c8a0d7c8d20b8c837e89f49ad957468fb0c4461db261411283852ea7\": container with ID starting with 69d6f685c8a0d7c8d20b8c837e89f49ad957468fb0c4461db261411283852ea7 not found: ID does not exist"
Jul 30 21:26:11.953804 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:26:11.953783    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-e54afd-7f9b8fb4dd-mmzmn"]
Jul 30 21:26:11.957590 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:26:11.957541    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-e54afd-7f9b8fb4dd-mmzmn"]
Jul 30 21:26:12.676388 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:26:12.676351    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="04c5378a-6441-4806-b743-fcc1ac67c200" path="/var/lib/kubelet/pods/04c5378a-6441-4806-b743-fcc1ac67c200/volumes"
Jul 30 21:26:12.676759 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:26:12.676718    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="755c2954-96f9-43fc-bebc-81956e0c14d8" path="/var/lib/kubelet/pods/755c2954-96f9-43fc-bebc-81956e0c14d8/volumes"
Jul 30 21:26:16.572733 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:26:16.572694    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-e54afd/ipp-route-e54afd-kserve-65fd56bcf5-vps9d"]
Jul 30 21:26:16.623697 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:26:16.623661    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:26:17.951204 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:26:17.951172    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 21:26:31.592472 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:26:31.592434    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-ipp-a-e54afd/ipp-route-e54afd-kserve-65fd56bcf5-vps9d" podUID="6e186177-1f99-4d19-85d4-6d894034416d" containerName="main" containerID="cri-o://b75a21726b5a6d0e05326511d567fe2b49ff8ea3246ca0c0c5edf991a8a85e3b" gracePeriod=45
Jul 30 21:26:31.843072 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:26:31.843010    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-e54afd/ipp-route-e54afd-kserve-65fd56bcf5-vps9d"
Jul 30 21:26:31.936057 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:26:31.936021    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6e186177-1f99-4d19-85d4-6d894034416d-model-cache\") pod \"6e186177-1f99-4d19-85d4-6d894034416d\" (UID: \"6e186177-1f99-4d19-85d4-6d894034416d\") "
Jul 30 21:26:31.936250 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:26:31.936071    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6e186177-1f99-4d19-85d4-6d894034416d-dshm\") pod \"6e186177-1f99-4d19-85d4-6d894034416d\" (UID: \"6e186177-1f99-4d19-85d4-6d894034416d\") "
Jul 30 21:26:31.936250 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:26:31.936093    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6e186177-1f99-4d19-85d4-6d894034416d-tmp-dir\") pod \"6e186177-1f99-4d19-85d4-6d894034416d\" (UID: \"6e186177-1f99-4d19-85d4-6d894034416d\") "
Jul 30 21:26:31.936250 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:26:31.936121    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6e186177-1f99-4d19-85d4-6d894034416d-tls-certs\") pod \"6e186177-1f99-4d19-85d4-6d894034416d\" (UID: \"6e186177-1f99-4d19-85d4-6d894034416d\") "
Jul 30 21:26:31.936250 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:26:31.936212    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6e186177-1f99-4d19-85d4-6d894034416d-home\") pod \"6e186177-1f99-4d19-85d4-6d894034416d\" (UID: \"6e186177-1f99-4d19-85d4-6d894034416d\") "
Jul 30 21:26:31.936250 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:26:31.936239    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xcqs4\" (UniqueName: \"kubernetes.io/projected/6e186177-1f99-4d19-85d4-6d894034416d-kube-api-access-xcqs4\") pod \"6e186177-1f99-4d19-85d4-6d894034416d\" (UID: \"6e186177-1f99-4d19-85d4-6d894034416d\") "
Jul 30 21:26:31.936512 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:26:31.936338    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e186177-1f99-4d19-85d4-6d894034416d-model-cache" (OuterVolumeSpecName: "model-cache") pod "6e186177-1f99-4d19-85d4-6d894034416d" (UID: "6e186177-1f99-4d19-85d4-6d894034416d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:26:31.936512 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:26:31.936385    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e186177-1f99-4d19-85d4-6d894034416d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "6e186177-1f99-4d19-85d4-6d894034416d" (UID: "6e186177-1f99-4d19-85d4-6d894034416d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:26:31.936623 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:26:31.936518    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e186177-1f99-4d19-85d4-6d894034416d-home" (OuterVolumeSpecName: "home") pod "6e186177-1f99-4d19-85d4-6d894034416d" (UID: "6e186177-1f99-4d19-85d4-6d894034416d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:26:31.936623 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:26:31.936607    2583 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6e186177-1f99-4d19-85d4-6d894034416d-home\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 21:26:31.936730 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:26:31.936624    2583 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6e186177-1f99-4d19-85d4-6d894034416d-model-cache\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 21:26:31.936730 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:26:31.936638    2583 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6e186177-1f99-4d19-85d4-6d894034416d-tmp-dir\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 21:26:31.938337 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:26:31.938315    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e186177-1f99-4d19-85d4-6d894034416d-dshm" (OuterVolumeSpecName: "dshm") pod "6e186177-1f99-4d19-85d4-6d894034416d" (UID: "6e186177-1f99-4d19-85d4-6d894034416d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:26:31.938471 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:26:31.938335    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e186177-1f99-4d19-85d4-6d894034416d-kube-api-access-xcqs4" (OuterVolumeSpecName: "kube-api-access-xcqs4") pod "6e186177-1f99-4d19-85d4-6d894034416d" (UID: "6e186177-1f99-4d19-85d4-6d894034416d"). InnerVolumeSpecName "kube-api-access-xcqs4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 21:26:31.938471 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:26:31.938347    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6e186177-1f99-4d19-85d4-6d894034416d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "6e186177-1f99-4d19-85d4-6d894034416d" (UID: "6e186177-1f99-4d19-85d4-6d894034416d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 21:26:32.037079 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:26:32.037040    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xcqs4\" (UniqueName: \"kubernetes.io/projected/6e186177-1f99-4d19-85d4-6d894034416d-kube-api-access-xcqs4\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 21:26:32.037079 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:26:32.037072    2583 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6e186177-1f99-4d19-85d4-6d894034416d-dshm\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 21:26:32.037079 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:26:32.037082    2583 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6e186177-1f99-4d19-85d4-6d894034416d-tls-certs\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 21:26:32.053549 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:26:32.053519    2583 generic.go:356] "Generic (PLEG): container finished" podID="6e186177-1f99-4d19-85d4-6d894034416d" containerID="b75a21726b5a6d0e05326511d567fe2b49ff8ea3246ca0c0c5edf991a8a85e3b" exitCode=0
Jul 30 21:26:32.053698 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:26:32.053568    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-e54afd/ipp-route-e54afd-kserve-65fd56bcf5-vps9d"
Jul 30 21:26:32.053698 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:26:32.053599    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-e54afd/ipp-route-e54afd-kserve-65fd56bcf5-vps9d" event={"ID":"6e186177-1f99-4d19-85d4-6d894034416d","Type":"ContainerDied","Data":"b75a21726b5a6d0e05326511d567fe2b49ff8ea3246ca0c0c5edf991a8a85e3b"}
Jul 30 21:26:32.053698 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:26:32.053649    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-e54afd/ipp-route-e54afd-kserve-65fd56bcf5-vps9d" event={"ID":"6e186177-1f99-4d19-85d4-6d894034416d","Type":"ContainerDied","Data":"ba44b893a0b04d99e07aa0df2b52b88824f118b7f348f637675b6b473dcdef35"}
Jul 30 21:26:32.053698 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:26:32.053672    2583 scope.go:117] "RemoveContainer" containerID="b75a21726b5a6d0e05326511d567fe2b49ff8ea3246ca0c0c5edf991a8a85e3b"
Jul 30 21:26:32.065529 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:26:32.065508    2583 scope.go:117] "RemoveContainer" containerID="b75a21726b5a6d0e05326511d567fe2b49ff8ea3246ca0c0c5edf991a8a85e3b"
Jul 30 21:26:32.065821 ip-10-0-142-69 kubenswrapper[2583]: E0730 21:26:32.065801    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b75a21726b5a6d0e05326511d567fe2b49ff8ea3246ca0c0c5edf991a8a85e3b\": container with ID starting with b75a21726b5a6d0e05326511d567fe2b49ff8ea3246ca0c0c5edf991a8a85e3b not found: ID does not exist" containerID="b75a21726b5a6d0e05326511d567fe2b49ff8ea3246ca0c0c5edf991a8a85e3b"
Jul 30 21:26:32.065867 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:26:32.065829    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b75a21726b5a6d0e05326511d567fe2b49ff8ea3246ca0c0c5edf991a8a85e3b"} err="failed to get container status \"b75a21726b5a6d0e05326511d567fe2b49ff8ea3246ca0c0c5edf991a8a85e3b\": rpc error: code = NotFound desc = could not find container \"b75a21726b5a6d0e05326511d567fe2b49ff8ea3246ca0c0c5edf991a8a85e3b\": container with ID starting with b75a21726b5a6d0e05326511d567fe2b49ff8ea3246ca0c0c5edf991a8a85e3b not found: ID does not exist"
Jul 30 21:26:32.078067 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:26:32.078038    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-e54afd/ipp-route-e54afd-kserve-65fd56bcf5-vps9d"]
Jul 30 21:26:32.081237 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:26:32.081217    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-ipp-a-e54afd/ipp-route-e54afd-kserve-65fd56bcf5-vps9d"]
Jul 30 21:26:32.676486 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:26:32.676456    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6e186177-1f99-4d19-85d4-6d894034416d" path="/var/lib/kubelet/pods/6e186177-1f99-4d19-85d4-6d894034416d/volumes"
Jul 30 21:26:52.847518 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:26:52.847467    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:26:53.797657 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:26:53.797620    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:26:59.287543 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:26:59.287505    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:26:59.351613 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:26:59.351585    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:26:59.631662 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:26:59.631587    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:26:59.823320 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:26:59.823289    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:27:10.527435 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:10.527403    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:27:10.552801 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:10.552773    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-296998-78f6886cf4-w2nsq"]
Jul 30 21:27:10.553107 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:10.553056    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-b-296998-78f6886cf4-w2nsq" podUID="164586fd-0ddb-4a02-ab98-2dba9664d826" containerName="payload-processing" containerID="cri-o://ddbdb693e8394d897e6a2ef1a7f17a89c48158367a39d436a481bad28d28adc1" gracePeriod=30
Jul 30 21:27:10.559197 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:10.559174    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-296998-d957d4796-2wfm6"]
Jul 30 21:27:10.559383 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:10.559364    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-296998-d957d4796-2wfm6" podUID="389d8c06-1bc8-4d26-9ba5-7406b779880f" containerName="payload-pre-processing" containerID="cri-o://a62a931f7ef89cdfcefa1d1bbab0d6b361296144d8e3f687bebae2d1353fb7e8" gracePeriod=30
Jul 30 21:27:10.627008 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:10.626982    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:27:10.706834 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:10.706790    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:27:10.777522 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:10.777435    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:27:10.840698 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:10.840677    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-296998-78f6886cf4-w2nsq"
Jul 30 21:27:10.850738 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:10.850698    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-296998-d957d4796-2wfm6"
Jul 30 21:27:10.959766 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:10.959740    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/164586fd-0ddb-4a02-ab98-2dba9664d826-plugins-config-volume\") pod \"164586fd-0ddb-4a02-ab98-2dba9664d826\" (UID: \"164586fd-0ddb-4a02-ab98-2dba9664d826\") "
Jul 30 21:27:10.959956 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:10.959778    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/389d8c06-1bc8-4d26-9ba5-7406b779880f-plugins-config-volume\") pod \"389d8c06-1bc8-4d26-9ba5-7406b779880f\" (UID: \"389d8c06-1bc8-4d26-9ba5-7406b779880f\") "
Jul 30 21:27:10.959956 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:10.959830    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m492n\" (UniqueName: \"kubernetes.io/projected/164586fd-0ddb-4a02-ab98-2dba9664d826-kube-api-access-m492n\") pod \"164586fd-0ddb-4a02-ab98-2dba9664d826\" (UID: \"164586fd-0ddb-4a02-ab98-2dba9664d826\") "
Jul 30 21:27:10.959956 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:10.959880    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sq6jl\" (UniqueName: \"kubernetes.io/projected/389d8c06-1bc8-4d26-9ba5-7406b779880f-kube-api-access-sq6jl\") pod \"389d8c06-1bc8-4d26-9ba5-7406b779880f\" (UID: \"389d8c06-1bc8-4d26-9ba5-7406b779880f\") "
Jul 30 21:27:10.960217 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:10.960191    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/164586fd-0ddb-4a02-ab98-2dba9664d826-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "164586fd-0ddb-4a02-ab98-2dba9664d826" (UID: "164586fd-0ddb-4a02-ab98-2dba9664d826"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 21:27:10.960313 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:10.960214    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/389d8c06-1bc8-4d26-9ba5-7406b779880f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "389d8c06-1bc8-4d26-9ba5-7406b779880f" (UID: "389d8c06-1bc8-4d26-9ba5-7406b779880f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 21:27:10.961994 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:10.961971    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/389d8c06-1bc8-4d26-9ba5-7406b779880f-kube-api-access-sq6jl" (OuterVolumeSpecName: "kube-api-access-sq6jl") pod "389d8c06-1bc8-4d26-9ba5-7406b779880f" (UID: "389d8c06-1bc8-4d26-9ba5-7406b779880f"). InnerVolumeSpecName "kube-api-access-sq6jl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 21:27:10.962076 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:10.962001    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/164586fd-0ddb-4a02-ab98-2dba9664d826-kube-api-access-m492n" (OuterVolumeSpecName: "kube-api-access-m492n") pod "164586fd-0ddb-4a02-ab98-2dba9664d826" (UID: "164586fd-0ddb-4a02-ab98-2dba9664d826"). InnerVolumeSpecName "kube-api-access-m492n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 21:27:11.060816 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:11.060716    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/164586fd-0ddb-4a02-ab98-2dba9664d826-plugins-config-volume\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 21:27:11.060816 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:11.060752    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/389d8c06-1bc8-4d26-9ba5-7406b779880f-plugins-config-volume\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 21:27:11.060816 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:11.060761    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m492n\" (UniqueName: \"kubernetes.io/projected/164586fd-0ddb-4a02-ab98-2dba9664d826-kube-api-access-m492n\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 21:27:11.060816 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:11.060770    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sq6jl\" (UniqueName: \"kubernetes.io/projected/389d8c06-1bc8-4d26-9ba5-7406b779880f-kube-api-access-sq6jl\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 21:27:11.083895 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:11.083864    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:27:11.281928 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:11.281893    2583 generic.go:356] "Generic (PLEG): container finished" podID="164586fd-0ddb-4a02-ab98-2dba9664d826" containerID="ddbdb693e8394d897e6a2ef1a7f17a89c48158367a39d436a481bad28d28adc1" exitCode=0
Jul 30 21:27:11.282121 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:11.281934    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-296998-78f6886cf4-w2nsq"
Jul 30 21:27:11.282121 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:11.281982    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-296998-78f6886cf4-w2nsq" event={"ID":"164586fd-0ddb-4a02-ab98-2dba9664d826","Type":"ContainerDied","Data":"ddbdb693e8394d897e6a2ef1a7f17a89c48158367a39d436a481bad28d28adc1"}
Jul 30 21:27:11.282121 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:11.282037    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-296998-78f6886cf4-w2nsq" event={"ID":"164586fd-0ddb-4a02-ab98-2dba9664d826","Type":"ContainerDied","Data":"a3f961f750c4f97eecf62330099ec6d735fedb5c8e4a40df79632a1a2c2c80b8"}
Jul 30 21:27:11.282121 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:11.282060    2583 scope.go:117] "RemoveContainer" containerID="ddbdb693e8394d897e6a2ef1a7f17a89c48158367a39d436a481bad28d28adc1"
Jul 30 21:27:11.283572 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:11.283546    2583 generic.go:356] "Generic (PLEG): container finished" podID="389d8c06-1bc8-4d26-9ba5-7406b779880f" containerID="a62a931f7ef89cdfcefa1d1bbab0d6b361296144d8e3f687bebae2d1353fb7e8" exitCode=0
Jul 30 21:27:11.283696 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:11.283600    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-296998-d957d4796-2wfm6"
Jul 30 21:27:11.283696 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:11.283627    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-296998-d957d4796-2wfm6" event={"ID":"389d8c06-1bc8-4d26-9ba5-7406b779880f","Type":"ContainerDied","Data":"a62a931f7ef89cdfcefa1d1bbab0d6b361296144d8e3f687bebae2d1353fb7e8"}
Jul 30 21:27:11.283696 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:11.283669    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-296998-d957d4796-2wfm6" event={"ID":"389d8c06-1bc8-4d26-9ba5-7406b779880f","Type":"ContainerDied","Data":"2db6980fe10dc5b5790f33a04dd5cf865bc9a70807a29dd2d24dc793397aa6e0"}
Jul 30 21:27:11.292207 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:11.292188    2583 scope.go:117] "RemoveContainer" containerID="ddbdb693e8394d897e6a2ef1a7f17a89c48158367a39d436a481bad28d28adc1"
Jul 30 21:27:11.292625 ip-10-0-142-69 kubenswrapper[2583]: E0730 21:27:11.292597    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ddbdb693e8394d897e6a2ef1a7f17a89c48158367a39d436a481bad28d28adc1\": container with ID starting with ddbdb693e8394d897e6a2ef1a7f17a89c48158367a39d436a481bad28d28adc1 not found: ID does not exist" containerID="ddbdb693e8394d897e6a2ef1a7f17a89c48158367a39d436a481bad28d28adc1"
Jul 30 21:27:11.292720 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:11.292638    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ddbdb693e8394d897e6a2ef1a7f17a89c48158367a39d436a481bad28d28adc1"} err="failed to get container status \"ddbdb693e8394d897e6a2ef1a7f17a89c48158367a39d436a481bad28d28adc1\": rpc error: code = NotFound desc = could not find container \"ddbdb693e8394d897e6a2ef1a7f17a89c48158367a39d436a481bad28d28adc1\": container with ID starting with ddbdb693e8394d897e6a2ef1a7f17a89c48158367a39d436a481bad28d28adc1 not found: ID does not exist"
Jul 30 21:27:11.292720 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:11.292662    2583 scope.go:117] "RemoveContainer" containerID="a62a931f7ef89cdfcefa1d1bbab0d6b361296144d8e3f687bebae2d1353fb7e8"
Jul 30 21:27:11.301107 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:11.301091    2583 scope.go:117] "RemoveContainer" containerID="a62a931f7ef89cdfcefa1d1bbab0d6b361296144d8e3f687bebae2d1353fb7e8"
Jul 30 21:27:11.301363 ip-10-0-142-69 kubenswrapper[2583]: E0730 21:27:11.301344    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a62a931f7ef89cdfcefa1d1bbab0d6b361296144d8e3f687bebae2d1353fb7e8\": container with ID starting with a62a931f7ef89cdfcefa1d1bbab0d6b361296144d8e3f687bebae2d1353fb7e8 not found: ID does not exist" containerID="a62a931f7ef89cdfcefa1d1bbab0d6b361296144d8e3f687bebae2d1353fb7e8"
Jul 30 21:27:11.301421 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:11.301372    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a62a931f7ef89cdfcefa1d1bbab0d6b361296144d8e3f687bebae2d1353fb7e8"} err="failed to get container status \"a62a931f7ef89cdfcefa1d1bbab0d6b361296144d8e3f687bebae2d1353fb7e8\": rpc error: code = NotFound desc = could not find container \"a62a931f7ef89cdfcefa1d1bbab0d6b361296144d8e3f687bebae2d1353fb7e8\": container with ID starting with a62a931f7ef89cdfcefa1d1bbab0d6b361296144d8e3f687bebae2d1353fb7e8 not found: ID does not exist"
Jul 30 21:27:11.306664 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:11.306639    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-296998-d957d4796-2wfm6"]
Jul 30 21:27:11.310219 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:11.310196    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-296998-d957d4796-2wfm6"]
Jul 30 21:27:11.319341 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:11.319292    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-296998-78f6886cf4-w2nsq"]
Jul 30 21:27:11.323045 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:11.323026    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-296998-78f6886cf4-w2nsq"]
Jul 30 21:27:12.675682 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:12.675649    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="164586fd-0ddb-4a02-ab98-2dba9664d826" path="/var/lib/kubelet/pods/164586fd-0ddb-4a02-ab98-2dba9664d826/volumes"
Jul 30 21:27:12.676184 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:12.676112    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="389d8c06-1bc8-4d26-9ba5-7406b779880f" path="/var/lib/kubelet/pods/389d8c06-1bc8-4d26-9ba5-7406b779880f/volumes"
Jul 30 21:27:12.852350 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:12.852322    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 21:27:16.815552 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:16.815521    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:27:16.920196 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:16.920162    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:27:17.123888 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:17.123815    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-296998-openshift-default-6cc8987c78-klg8n"]
Jul 30 21:27:17.124048 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:17.124026    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-296998-openshift-default-6cc8987c78-klg8n" podUID="d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e" containerName="istio-proxy" containerID="cri-o://fc0d036a90e3a8411623e1df93e4328c5f9e69c10807219abdb32ad5a90e25ca" gracePeriod=30
Jul 30 21:27:17.247479 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:17.247447    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:27:17.388795 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:17.388716    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:27:17.507747 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:17.507716    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-155c1d-mj5rd"]
Jul 30 21:27:17.508097 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:17.508084    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="164586fd-0ddb-4a02-ab98-2dba9664d826" containerName="payload-processing"
Jul 30 21:27:17.508163 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:17.508099    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="164586fd-0ddb-4a02-ab98-2dba9664d826" containerName="payload-processing"
Jul 30 21:27:17.508163 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:17.508110    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e186177-1f99-4d19-85d4-6d894034416d" containerName="main"
Jul 30 21:27:17.508163 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:17.508117    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e186177-1f99-4d19-85d4-6d894034416d" containerName="main"
Jul 30 21:27:17.508163 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:17.508124    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04c5378a-6441-4806-b743-fcc1ac67c200" containerName="revoke-keys"
Jul 30 21:27:17.508163 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:17.508129    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="04c5378a-6441-4806-b743-fcc1ac67c200" containerName="revoke-keys"
Jul 30 21:27:17.508163 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:17.508152    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="755c2954-96f9-43fc-bebc-81956e0c14d8" containerName="payload-pre-processing"
Jul 30 21:27:17.508163 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:17.508160    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="755c2954-96f9-43fc-bebc-81956e0c14d8" containerName="payload-pre-processing"
Jul 30 21:27:17.508372 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:17.508175    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="389d8c06-1bc8-4d26-9ba5-7406b779880f" containerName="payload-pre-processing"
Jul 30 21:27:17.508372 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:17.508184    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="389d8c06-1bc8-4d26-9ba5-7406b779880f" containerName="payload-pre-processing"
Jul 30 21:27:17.508372 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:17.508273    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="755c2954-96f9-43fc-bebc-81956e0c14d8" containerName="payload-pre-processing"
Jul 30 21:27:17.508372 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:17.508282    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="389d8c06-1bc8-4d26-9ba5-7406b779880f" containerName="payload-pre-processing"
Jul 30 21:27:17.508372 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:17.508288    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e186177-1f99-4d19-85d4-6d894034416d" containerName="main"
Jul 30 21:27:17.508372 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:17.508294    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="164586fd-0ddb-4a02-ab98-2dba9664d826" containerName="payload-processing"
Jul 30 21:27:17.508372 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:17.508300    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="04c5378a-6441-4806-b743-fcc1ac67c200" containerName="revoke-keys"
Jul 30 21:27:17.513095 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:17.513079    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-155c1d-mj5rd"
Jul 30 21:27:17.515350 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:17.515321    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zm2hs\""
Jul 30 21:27:17.515350 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:17.515342    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 30 21:27:17.519205 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:17.519182    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-155c1d-mj5rd"]
Jul 30 21:27:17.616974 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:17.616939    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/47e1c6e5-ffc9-48ff-b62f-982196e9e096-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-155c1d-mj5rd\" (UID: \"47e1c6e5-ffc9-48ff-b62f-982196e9e096\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-155c1d-mj5rd"
Jul 30 21:27:17.717715 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:17.717686    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/47e1c6e5-ffc9-48ff-b62f-982196e9e096-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-155c1d-mj5rd\" (UID: \"47e1c6e5-ffc9-48ff-b62f-982196e9e096\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-155c1d-mj5rd"
Jul 30 21:27:17.718274 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:17.718255    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/47e1c6e5-ffc9-48ff-b62f-982196e9e096-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-155c1d-mj5rd\" (UID: \"47e1c6e5-ffc9-48ff-b62f-982196e9e096\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-155c1d-mj5rd"
Jul 30 21:27:17.825002 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:17.824973    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-155c1d-mj5rd"
Jul 30 21:27:17.956051 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:17.956020    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-155c1d-mj5rd"]
Jul 30 21:27:17.957686 ip-10-0-142-69 kubenswrapper[2583]: W0730 21:27:17.957659    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47e1c6e5_ffc9_48ff_b62f_982196e9e096.slice/crio-a048a7ad8c745619ccf07ba7634e3b0e73f8b71c0a573a150e1e00d6b38fbb40 WatchSource:0}: Error finding container a048a7ad8c745619ccf07ba7634e3b0e73f8b71c0a573a150e1e00d6b38fbb40: Status 404 returned error can't find the container with id a048a7ad8c745619ccf07ba7634e3b0e73f8b71c0a573a150e1e00d6b38fbb40
Jul 30 21:27:18.326700 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:18.326616    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-155c1d-mj5rd" event={"ID":"47e1c6e5-ffc9-48ff-b62f-982196e9e096","Type":"ContainerStarted","Data":"2eed3e592b08ff2e155ba7942cb893875d12b4f9e498f18f3387cbf8b7548b23"}
Jul 30 21:27:18.326700 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:18.326683    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-155c1d-mj5rd" event={"ID":"47e1c6e5-ffc9-48ff-b62f-982196e9e096","Type":"ContainerStarted","Data":"a048a7ad8c745619ccf07ba7634e3b0e73f8b71c0a573a150e1e00d6b38fbb40"}
Jul 30 21:27:18.342234 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:18.342189    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-155c1d-mj5rd" podStartSLOduration=1.342175131 podStartE2EDuration="1.342175131s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 21:27:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 21:27:18.340692842 +0000 UTC m=+3750.182168464" watchObservedRunningTime="2026-07-30 21:27:18.342175131 +0000 UTC m=+3750.183650760"
Jul 30 21:27:19.340399 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:19.340359    2583 generic.go:356] "Generic (PLEG): container finished" podID="47e1c6e5-ffc9-48ff-b62f-982196e9e096" containerID="2eed3e592b08ff2e155ba7942cb893875d12b4f9e498f18f3387cbf8b7548b23" exitCode=0
Jul 30 21:27:19.340766 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:19.340448    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-155c1d-mj5rd" event={"ID":"47e1c6e5-ffc9-48ff-b62f-982196e9e096","Type":"ContainerDied","Data":"2eed3e592b08ff2e155ba7942cb893875d12b4f9e498f18f3387cbf8b7548b23"}
Jul 30 21:27:20.478723 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:20.478704    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-155c1d-mj5rd"
Jul 30 21:27:20.641844 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:20.641770    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/47e1c6e5-ffc9-48ff-b62f-982196e9e096-maas-api-service-ca\") pod \"47e1c6e5-ffc9-48ff-b62f-982196e9e096\" (UID: \"47e1c6e5-ffc9-48ff-b62f-982196e9e096\") "
Jul 30 21:27:20.642164 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:20.642124    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/47e1c6e5-ffc9-48ff-b62f-982196e9e096-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "47e1c6e5-ffc9-48ff-b62f-982196e9e096" (UID: "47e1c6e5-ffc9-48ff-b62f-982196e9e096"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 21:27:20.742938 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:20.742916    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/47e1c6e5-ffc9-48ff-b62f-982196e9e096-maas-api-service-ca\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 21:27:21.352154 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:21.352123    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-155c1d-mj5rd"
Jul 30 21:27:21.352323 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:21.352161    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-155c1d-mj5rd" event={"ID":"47e1c6e5-ffc9-48ff-b62f-982196e9e096","Type":"ContainerDied","Data":"a048a7ad8c745619ccf07ba7634e3b0e73f8b71c0a573a150e1e00d6b38fbb40"}
Jul 30 21:27:21.352323 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:21.352206    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a048a7ad8c745619ccf07ba7634e3b0e73f8b71c0a573a150e1e00d6b38fbb40"
Jul 30 21:27:22.361432 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:22.361403    2583 generic.go:356] "Generic (PLEG): container finished" podID="d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e" containerID="fc0d036a90e3a8411623e1df93e4328c5f9e69c10807219abdb32ad5a90e25ca" exitCode=0
Jul 30 21:27:22.361740 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:22.361479    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-296998-openshift-default-6cc8987c78-klg8n" event={"ID":"d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e","Type":"ContainerDied","Data":"fc0d036a90e3a8411623e1df93e4328c5f9e69c10807219abdb32ad5a90e25ca"}
Jul 30 21:27:22.361740 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:22.361550    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-296998-openshift-default-6cc8987c78-klg8n" event={"ID":"d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e","Type":"ContainerDied","Data":"f8905ad039213d693fd169835c94cc0f6e3139125bb8a6f03eae6856c782acfb"}
Jul 30 21:27:22.361740 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:22.361574    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f8905ad039213d693fd169835c94cc0f6e3139125bb8a6f03eae6856c782acfb"
Jul 30 21:27:22.361740 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:22.361592    2583 scope.go:117] "RemoveContainer" containerID="4b10bcd4caf6e526727b1553589f224fcbf1b5228b3aaa203a30657c6e17ce24"
Jul 30 21:27:22.376764 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:22.376748    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-296998-openshift-default-6cc8987c78-klg8n"
Jul 30 21:27:22.454812 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:22.454788    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e-workload-socket\") pod \"d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e\" (UID: \"d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e\") "
Jul 30 21:27:22.454909 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:22.454817    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e-istio-token\") pod \"d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e\" (UID: \"d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e\") "
Jul 30 21:27:22.454909 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:22.454862    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e-istiod-ca-cert\") pod \"d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e\" (UID: \"d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e\") "
Jul 30 21:27:22.454909 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:22.454896    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e-istio-podinfo\") pod \"d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e\" (UID: \"d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e\") "
Jul 30 21:27:22.455024 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:22.454922    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e-istio-envoy\") pod \"d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e\" (UID: \"d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e\") "
Jul 30 21:27:22.455024 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:22.454987    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e-istio-data\") pod \"d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e\" (UID: \"d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e\") "
Jul 30 21:27:22.455024 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:22.455010    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e-credential-socket\") pod \"d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e\" (UID: \"d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e\") "
Jul 30 21:27:22.455190 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:22.455054    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-psjl8\" (UniqueName: \"kubernetes.io/projected/d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e-kube-api-access-psjl8\") pod \"d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e\" (UID: \"d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e\") "
Jul 30 21:27:22.455190 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:22.455063    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e" (UID: "d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:27:22.455190 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:22.455123    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e-workload-certs\") pod \"d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e\" (UID: \"d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e\") "
Jul 30 21:27:22.455347 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:22.455327    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e" (UID: "d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:27:22.455405 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:22.455345    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e-istio-data" (OuterVolumeSpecName: "istio-data") pod "d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e" (UID: "d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:27:22.455539 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:22.455511    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e-istio-data\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 21:27:22.455660 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:22.455553    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e-credential-socket\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 21:27:22.455660 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:22.455569    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e-workload-socket\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 21:27:22.455660 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:22.455523    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e" (UID: "d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:27:22.455660 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:22.455579    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e" (UID: "d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 21:27:22.457347 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:22.457324    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e" (UID: "d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:27:22.457347 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:22.457340    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e-kube-api-access-psjl8" (OuterVolumeSpecName: "kube-api-access-psjl8") pod "d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e" (UID: "d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e"). InnerVolumeSpecName "kube-api-access-psjl8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 21:27:22.457617 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:22.457595    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e" (UID: "d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 30 21:27:22.457683 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:22.457599    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e-istio-token" (OuterVolumeSpecName: "istio-token") pod "d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e" (UID: "d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 21:27:22.556361 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:22.556338    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e-istio-token\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 21:27:22.556361 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:22.556361    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e-istiod-ca-cert\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 21:27:22.556519 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:22.556369    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e-istio-podinfo\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 21:27:22.556519 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:22.556377    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e-istio-envoy\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 21:27:22.556519 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:22.556385    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-psjl8\" (UniqueName: \"kubernetes.io/projected/d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e-kube-api-access-psjl8\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 21:27:22.556519 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:22.556394    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e-workload-certs\") on node \"ip-10-0-142-69.ec2.internal\" DevicePath \"\""
Jul 30 21:27:23.368693 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:23.368666    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-296998-openshift-default-6cc8987c78-klg8n"
Jul 30 21:27:23.399306 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:23.399276    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-296998-openshift-default-6cc8987c78-klg8n"]
Jul 30 21:27:23.403502 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:23.403467    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-296998-openshift-default-6cc8987c78-klg8n"]
Jul 30 21:27:24.675640 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:24.675608    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e" path="/var/lib/kubelet/pods/d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e/volumes"
Jul 30 21:27:26.512097 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:26.512064    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:27:27.987421 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:27.987383    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-155c1d-29757435-klbvl"]
Jul 30 21:27:27.988349 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:27.988313    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:27:27.990283 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:27.990263    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-155c1d-29757435-klbvl"]
Jul 30 21:27:28.068727 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:28.068697    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:27:28.149947 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:28.149919    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:27:28.199542 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:28.199516    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-155c1d-mj5rd"]
Jul 30 21:27:28.202361 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:28.202332    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-155c1d-mj5rd"]
Jul 30 21:27:28.223308 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:28.223285    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:27:28.592788 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:28.592758    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:27:28.676580 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:28.676555    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="47e1c6e5-ffc9-48ff-b62f-982196e9e096" path="/var/lib/kubelet/pods/47e1c6e5-ffc9-48ff-b62f-982196e9e096/volumes"
Jul 30 21:27:28.676813 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:28.676800    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aa7818dc-2b8c-4cae-bc85-e5e625683d2c" path="/var/lib/kubelet/pods/aa7818dc-2b8c-4cae-bc85-e5e625683d2c/volumes"
Jul 30 21:27:30.354980 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:30.354945    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 21:27:34.509391 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:34.509356    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:27:34.610578 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:34.610548    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:27:34.710044 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:34.710012    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:27:34.769319 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:34.769268    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:27:34.992244 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:34.992211    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:27:35.293610 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:35.293569    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:27:40.136222 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:40.136131    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:27:40.137879 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:40.137854    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-01bc1b-29757435-mllkr"]
Jul 30 21:27:40.142974 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:40.142951    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-01bc1b-29757435-mllkr"]
Jul 30 21:27:40.215950 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:40.215922    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:27:40.276800 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:40.276769    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:27:40.377369 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:40.377341    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:27:40.674779 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:40.674745    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ed44b979-46b3-424d-8b53-f25c58b5a1b1" path="/var/lib/kubelet/pods/ed44b979-46b3-424d-8b53-f25c58b5a1b1/volumes"
Jul 30 21:27:40.755152 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:40.755095    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:27:42.259186 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:42.259154    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-85k8g"]
Jul 30 21:27:46.841800 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:46.841767    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:27:46.903025 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:46.902996    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:27:47.136879 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:47.136795    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:27:47.355080 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:47.355043    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:27:49.217906 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:49.217874    2583 scope.go:117] "RemoveContainer" containerID="9e352622cb281921613e3a60de94f37180e622034075ae557ea441738f5b8df3"
Jul 30 21:27:49.226529 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:49.226505    2583 scope.go:117] "RemoveContainer" containerID="c8c355871cc2b6c097272bc5fcf3d92934683cf64f52cba6b8694fa795c0f5fd"
Jul 30 21:27:51.597803 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:51.597766    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:27:53.910424 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:53.910379    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7fd799f58b-6p5j9_3e86153a-f7e1-440c-8b64-118a0a3ceba3/copy-manifests/0.log"
Jul 30 21:27:53.915941 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:53.915918    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7fd799f58b-6p5j9_3e86153a-f7e1-440c-8b64-118a0a3ceba3/manager/0.log"
Jul 30 21:27:54.859012 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:54.858984    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29757435-76j8z_0f9ef2d5-e7a0-43e3-9a07-707eda0bbbbf/cleanup/0.log"
Jul 30 21:27:56.106076 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:56.106045    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-598f86468b-d78pg_7adbbb32-e65e-4802-987e-5a950b3cde51/kuadrant-console-plugin/0.log"
Jul 30 21:27:56.334792 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:56.334767    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-85d9db4d5d-85k8g_03b2e9b7-cb54-4932-b5f3-0986ec8d143b/limitador/0.log"
Jul 30 21:27:57.188468 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:57.188438    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-66684cbb98-9m4n8_ca860230-adcc-4965-90bc-992b6aa0b787/kube-auth-proxy/0.log"
Jul 30 21:27:57.565414 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:57.565338    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-frt6g_88f255a7-c387-47df-a88b-e13110fa654c/payload-processing/0.log"
Jul 30 21:27:58.044211 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:58.044183    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-9ts7j_85e0a1f2-3d9c-4d33-b32c-8894ff503ab0/main/0.log"
Jul 30 21:27:58.643772 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:27:58.643742    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-mvtkb_f57c6bd8-b83d-4f61-b31a-49f2a8e1dd09/main/0.log"
Jul 30 21:28:04.819319 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:28:04.819284    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-9kzmr/must-gather-w4dxd"]
Jul 30 21:28:04.819694 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:28:04.819674    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47e1c6e5-ffc9-48ff-b62f-982196e9e096" containerName="revoke-keys"
Jul 30 21:28:04.819694 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:28:04.819686    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="47e1c6e5-ffc9-48ff-b62f-982196e9e096" containerName="revoke-keys"
Jul 30 21:28:04.819764 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:28:04.819702    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e" containerName="istio-proxy"
Jul 30 21:28:04.819764 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:28:04.819707    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e" containerName="istio-proxy"
Jul 30 21:28:04.819764 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:28:04.819727    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e" containerName="istio-proxy"
Jul 30 21:28:04.819764 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:28:04.819733    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e" containerName="istio-proxy"
Jul 30 21:28:04.819890 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:28:04.819796    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e" containerName="istio-proxy"
Jul 30 21:28:04.819890 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:28:04.819806    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3ba5e90-4cb2-4f7d-910b-ba97a5ef958e" containerName="istio-proxy"
Jul 30 21:28:04.819890 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:28:04.819812    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="47e1c6e5-ffc9-48ff-b62f-982196e9e096" containerName="revoke-keys"
Jul 30 21:28:04.823019 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:28:04.823004    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9kzmr/must-gather-w4dxd"
Jul 30 21:28:04.826709 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:28:04.826688    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9kzmr\"/\"kube-root-ca.crt\""
Jul 30 21:28:04.826923 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:28:04.826908    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-9kzmr\"/\"default-dockercfg-xgkwf\""
Jul 30 21:28:04.827283 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:28:04.827265    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9kzmr\"/\"openshift-service-ca.crt\""
Jul 30 21:28:04.836607 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:28:04.836584    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9kzmr/must-gather-w4dxd"]
Jul 30 21:28:04.839367 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:28:04.839346    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:28:04.915861 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:28:04.915837    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a9750748-b321-4a56-8d1c-d728119cd89b-must-gather-output\") pod \"must-gather-w4dxd\" (UID: \"a9750748-b321-4a56-8d1c-d728119cd89b\") " pod="openshift-must-gather-9kzmr/must-gather-w4dxd"
Jul 30 21:28:04.915955 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:28:04.915901    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2lps\" (UniqueName: \"kubernetes.io/projected/a9750748-b321-4a56-8d1c-d728119cd89b-kube-api-access-s2lps\") pod \"must-gather-w4dxd\" (UID: \"a9750748-b321-4a56-8d1c-d728119cd89b\") " pod="openshift-must-gather-9kzmr/must-gather-w4dxd"
Jul 30 21:28:04.928931 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:28:04.928910    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log" limit=1024
Jul 30 21:28:05.016675 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:28:05.016646    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s2lps\" (UniqueName: \"kubernetes.io/projected/a9750748-b321-4a56-8d1c-d728119cd89b-kube-api-access-s2lps\") pod \"must-gather-w4dxd\" (UID: \"a9750748-b321-4a56-8d1c-d728119cd89b\") " pod="openshift-must-gather-9kzmr/must-gather-w4dxd"
Jul 30 21:28:05.016787 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:28:05.016753    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a9750748-b321-4a56-8d1c-d728119cd89b-must-gather-output\") pod \"must-gather-w4dxd\" (UID: \"a9750748-b321-4a56-8d1c-d728119cd89b\") " pod="openshift-must-gather-9kzmr/must-gather-w4dxd"
Jul 30 21:28:05.017037 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:28:05.017019    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a9750748-b321-4a56-8d1c-d728119cd89b-must-gather-output\") pod \"must-gather-w4dxd\" (UID: \"a9750748-b321-4a56-8d1c-d728119cd89b\") " pod="openshift-must-gather-9kzmr/must-gather-w4dxd"
Jul 30 21:28:05.024405 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:28:05.024383    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2lps\" (UniqueName: \"kubernetes.io/projected/a9750748-b321-4a56-8d1c-d728119cd89b-kube-api-access-s2lps\") pod \"must-gather-w4dxd\" (UID: \"a9750748-b321-4a56-8d1c-d728119cd89b\") " pod="openshift-must-gather-9kzmr/must-gather-w4dxd"
Jul 30 21:28:05.131968 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:28:05.131884    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9kzmr/must-gather-w4dxd"
Jul 30 21:28:05.264800 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:28:05.264775    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9kzmr/must-gather-w4dxd"]
Jul 30 21:28:05.266708 ip-10-0-142-69 kubenswrapper[2583]: W0730 21:28:05.266675    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda9750748_b321_4a56_8d1c_d728119cd89b.slice/crio-8e1f5b0948039c54293bf8d9c3470bc028a6a3e8af44ce3ab071d82e1a847a21 WatchSource:0}: Error finding container 8e1f5b0948039c54293bf8d9c3470bc028a6a3e8af44ce3ab071d82e1a847a21: Status 404 returned error can't find the container with id 8e1f5b0948039c54293bf8d9c3470bc028a6a3e8af44ce3ab071d82e1a847a21
Jul 30 21:28:05.268656 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:28:05.268637    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 30 21:28:05.612979 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:28:05.612951    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9kzmr/must-gather-w4dxd" event={"ID":"a9750748-b321-4a56-8d1c-d728119cd89b","Type":"ContainerStarted","Data":"8e1f5b0948039c54293bf8d9c3470bc028a6a3e8af44ce3ab071d82e1a847a21"}
Jul 30 21:28:06.623641 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:28:06.623292    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9kzmr/must-gather-w4dxd" event={"ID":"a9750748-b321-4a56-8d1c-d728119cd89b","Type":"ContainerStarted","Data":"146b3153e28762cc8cbad28995005a79e278b6fa954d8017cf3dd74e3aceb8fb"}
Jul 30 21:28:06.623641 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:28:06.623361    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9kzmr/must-gather-w4dxd" event={"ID":"a9750748-b321-4a56-8d1c-d728119cd89b","Type":"ContainerStarted","Data":"47862e0b7c4702c761264df9d59ad9cefd38f67ae40dfc897ee5e073b851563f"}
Jul 30 21:28:06.640959 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:28:06.640908    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-9kzmr/must-gather-w4dxd" podStartSLOduration=1.668306495 podStartE2EDuration="2.640894076s" totalImagesPullingTime="972.587581ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 21:28:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 21:28:06.637265532 +0000 UTC m=+3798.478741154" watchObservedRunningTime="2026-07-30 21:28:06.640894076 +0000 UTC m=+3798.482369696"
Jul 30 21:28:07.806518 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:28:07.806478    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-8g9tl_01f71a23-f22f-44f3-b7d6-3ba3050b69fa/global-pull-secret-syncer/0.log"
Jul 30 21:28:07.944774 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:28:07.944745    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-hkpd5_4c453060-5f5c-4686-846e-a8875d6d9ead/konnectivity-agent/0.log"
Jul 30 21:28:08.100025 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:28:08.099953    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-69.ec2.internal_2601b49689453982163e65b62bf2dbc3/haproxy/0.log"
Jul 30 21:28:12.679070 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:28:12.679041    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-598f86468b-d78pg_7adbbb32-e65e-4802-987e-5a950b3cde51/kuadrant-console-plugin/0.log"
Jul 30 21:28:12.788293 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:28:12.788260    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-85d9db4d5d-85k8g_03b2e9b7-cb54-4932-b5f3-0986ec8d143b/limitador/0.log"
Jul 30 21:28:14.474160 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:28:14.474075    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6f55c4f58d-n7kff_93b4f477-32ac-45e9-8a6a-e80bd8b8e403/cluster-monitoring-operator/0.log"
Jul 30 21:28:14.611264 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:28:14.611178    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-6dffbbd67-nl4s4_29e70bb0-fd24-4335-a99d-d4e1e6481dcc/monitoring-plugin/0.log"
Jul 30 21:28:14.731550 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:28:14.731440    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-94r7j_ccd4c6cf-512d-4b96-91d3-b36dfe5d9b8c/node-exporter/0.log"
Jul 30 21:28:14.767522 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:28:14.767480    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-94r7j_ccd4c6cf-512d-4b96-91d3-b36dfe5d9b8c/kube-rbac-proxy/0.log"
Jul 30 21:28:14.789359 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:28:14.789325    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-94r7j_ccd4c6cf-512d-4b96-91d3-b36dfe5d9b8c/init-textfile/0.log"
Jul 30 21:28:14.899622 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:28:14.899585    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6bb4d7b4dd-gzzvz_59382b27-3d72-4e9c-94de-9fcc4505bfe8/kube-rbac-proxy-main/0.log"
Jul 30 21:28:14.922454 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:28:14.922428    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6bb4d7b4dd-gzzvz_59382b27-3d72-4e9c-94de-9fcc4505bfe8/kube-rbac-proxy-self/0.log"
Jul 30 21:28:14.948331 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:28:14.948289    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6bb4d7b4dd-gzzvz_59382b27-3d72-4e9c-94de-9fcc4505bfe8/openshift-state-metrics/0.log"
Jul 30 21:28:15.358630 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:28:15.358547    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-758d7cb874-gprrk_55b86f40-b396-4670-894b-8573499634d6/prometheus-operator/0.log"
Jul 30 21:28:15.385104 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:28:15.385032    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-758d7cb874-gprrk_55b86f40-b396-4670-894b-8573499634d6/kube-rbac-proxy/0.log"
Jul 30 21:28:15.413358 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:28:15.413328    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-66685ff6d4-sm726_54a094da-81d1-4759-b29d-59e6a94cc246/prometheus-operator-admission-webhook/0.log"
Jul 30 21:28:15.446057 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:28:15.446023    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-89bc6d7f5-ldnwg_bf2dcf72-0a9e-4eb3-b788-142d3c0d7cf1/telemeter-client/0.log"
Jul 30 21:28:15.469849 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:28:15.469814    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-89bc6d7f5-ldnwg_bf2dcf72-0a9e-4eb3-b788-142d3c0d7cf1/reload/0.log"
Jul 30 21:28:15.491833 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:28:15.491800    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-89bc6d7f5-ldnwg_bf2dcf72-0a9e-4eb3-b788-142d3c0d7cf1/kube-rbac-proxy/0.log"
Jul 30 21:28:15.525322 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:28:15.525290    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-576d9f695b-67q7v_a03e1308-6f47-4afc-b370-a17ad76bdb89/thanos-query/0.log"
Jul 30 21:28:15.547018 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:28:15.546986    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-576d9f695b-67q7v_a03e1308-6f47-4afc-b370-a17ad76bdb89/kube-rbac-proxy-web/0.log"
Jul 30 21:28:15.576806 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:28:15.576775    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-576d9f695b-67q7v_a03e1308-6f47-4afc-b370-a17ad76bdb89/kube-rbac-proxy/0.log"
Jul 30 21:28:15.599303 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:28:15.599273    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-576d9f695b-67q7v_a03e1308-6f47-4afc-b370-a17ad76bdb89/prom-label-proxy/0.log"
Jul 30 21:28:15.627329 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:28:15.627234    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-576d9f695b-67q7v_a03e1308-6f47-4afc-b370-a17ad76bdb89/kube-rbac-proxy-rules/0.log"
Jul 30 21:28:15.648021 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:28:15.647992    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-576d9f695b-67q7v_a03e1308-6f47-4afc-b370-a17ad76bdb89/kube-rbac-proxy-metrics/0.log"
Jul 30 21:28:17.001962 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:28:17.001933    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-f77f48c6d-jljn6_d00fb7ce-08f2-4e8e-bcb8-78e0d393e74f/networking-console-plugin/0.log"
Jul 30 21:28:18.543061 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:28:18.543020    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-9kzmr/perf-node-gather-daemonset-l4vz9"]
Jul 30 21:28:18.550047 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:28:18.550008    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9kzmr/perf-node-gather-daemonset-l4vz9"
Jul 30 21:28:18.553047 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:28:18.553012    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ec8a1c5e-f55a-4436-a2f4-0010a461b33d-lib-modules\") pod \"perf-node-gather-daemonset-l4vz9\" (UID: \"ec8a1c5e-f55a-4436-a2f4-0010a461b33d\") " pod="openshift-must-gather-9kzmr/perf-node-gather-daemonset-l4vz9"
Jul 30 21:28:18.553226 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:28:18.553063    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ec8a1c5e-f55a-4436-a2f4-0010a461b33d-sys\") pod \"perf-node-gather-daemonset-l4vz9\" (UID: \"ec8a1c5e-f55a-4436-a2f4-0010a461b33d\") " pod="openshift-must-gather-9kzmr/perf-node-gather-daemonset-l4vz9"
Jul 30 21:28:18.553226 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:28:18.553090    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ec8a1c5e-f55a-4436-a2f4-0010a461b33d-proc\") pod \"perf-node-gather-daemonset-l4vz9\" (UID: \"ec8a1c5e-f55a-4436-a2f4-0010a461b33d\") " pod="openshift-must-gather-9kzmr/perf-node-gather-daemonset-l4vz9"
Jul 30 21:28:18.553226 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:28:18.553190    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cv6p6\" (UniqueName: \"kubernetes.io/projected/ec8a1c5e-f55a-4436-a2f4-0010a461b33d-kube-api-access-cv6p6\") pod \"perf-node-gather-daemonset-l4vz9\" (UID: \"ec8a1c5e-f55a-4436-a2f4-0010a461b33d\") " pod="openshift-must-gather-9kzmr/perf-node-gather-daemonset-l4vz9"
Jul 30 21:28:18.553226 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:28:18.553229    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ec8a1c5e-f55a-4436-a2f4-0010a461b33d-podres\") pod \"perf-node-gather-daemonset-l4vz9\" (UID: \"ec8a1c5e-f55a-4436-a2f4-0010a461b33d\") " pod="openshift-must-gather-9kzmr/perf-node-gather-daemonset-l4vz9"
Jul 30 21:28:18.556193 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:28:18.556131    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9kzmr/perf-node-gather-daemonset-l4vz9"]
Jul 30 21:28:18.654484 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:28:18.654430    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ec8a1c5e-f55a-4436-a2f4-0010a461b33d-lib-modules\") pod \"perf-node-gather-daemonset-l4vz9\" (UID: \"ec8a1c5e-f55a-4436-a2f4-0010a461b33d\") " pod="openshift-must-gather-9kzmr/perf-node-gather-daemonset-l4vz9"
Jul 30 21:28:18.654669 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:28:18.654502    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ec8a1c5e-f55a-4436-a2f4-0010a461b33d-sys\") pod \"perf-node-gather-daemonset-l4vz9\" (UID: \"ec8a1c5e-f55a-4436-a2f4-0010a461b33d\") " pod="openshift-must-gather-9kzmr/perf-node-gather-daemonset-l4vz9"
Jul 30 21:28:18.654669 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:28:18.654531    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ec8a1c5e-f55a-4436-a2f4-0010a461b33d-proc\") pod \"perf-node-gather-daemonset-l4vz9\" (UID: \"ec8a1c5e-f55a-4436-a2f4-0010a461b33d\") " pod="openshift-must-gather-9kzmr/perf-node-gather-daemonset-l4vz9"
Jul 30 21:28:18.654669 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:28:18.654606    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ec8a1c5e-f55a-4436-a2f4-0010a461b33d-lib-modules\") pod \"perf-node-gather-daemonset-l4vz9\" (UID: \"ec8a1c5e-f55a-4436-a2f4-0010a461b33d\") " pod="openshift-must-gather-9kzmr/perf-node-gather-daemonset-l4vz9"
Jul 30 21:28:18.654669 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:28:18.654613    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cv6p6\" (UniqueName: \"kubernetes.io/projected/ec8a1c5e-f55a-4436-a2f4-0010a461b33d-kube-api-access-cv6p6\") pod \"perf-node-gather-daemonset-l4vz9\" (UID: \"ec8a1c5e-f55a-4436-a2f4-0010a461b33d\") " pod="openshift-must-gather-9kzmr/perf-node-gather-daemonset-l4vz9"
Jul 30 21:28:18.654669 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:28:18.654623    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ec8a1c5e-f55a-4436-a2f4-0010a461b33d-sys\") pod \"perf-node-gather-daemonset-l4vz9\" (UID: \"ec8a1c5e-f55a-4436-a2f4-0010a461b33d\") " pod="openshift-must-gather-9kzmr/perf-node-gather-daemonset-l4vz9"
Jul 30 21:28:18.654669 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:28:18.654665    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ec8a1c5e-f55a-4436-a2f4-0010a461b33d-podres\") pod \"perf-node-gather-daemonset-l4vz9\" (UID: \"ec8a1c5e-f55a-4436-a2f4-0010a461b33d\") " pod="openshift-must-gather-9kzmr/perf-node-gather-daemonset-l4vz9"
Jul 30 21:28:18.654908 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:28:18.654673    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ec8a1c5e-f55a-4436-a2f4-0010a461b33d-proc\") pod \"perf-node-gather-daemonset-l4vz9\" (UID: \"ec8a1c5e-f55a-4436-a2f4-0010a461b33d\") " pod="openshift-must-gather-9kzmr/perf-node-gather-daemonset-l4vz9"
Jul 30 21:28:18.654908 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:28:18.654757    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ec8a1c5e-f55a-4436-a2f4-0010a461b33d-podres\") pod \"perf-node-gather-daemonset-l4vz9\" (UID: \"ec8a1c5e-f55a-4436-a2f4-0010a461b33d\") " pod="openshift-must-gather-9kzmr/perf-node-gather-daemonset-l4vz9"
Jul 30 21:28:18.663709 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:28:18.663680    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cv6p6\" (UniqueName: \"kubernetes.io/projected/ec8a1c5e-f55a-4436-a2f4-0010a461b33d-kube-api-access-cv6p6\") pod \"perf-node-gather-daemonset-l4vz9\" (UID: \"ec8a1c5e-f55a-4436-a2f4-0010a461b33d\") " pod="openshift-must-gather-9kzmr/perf-node-gather-daemonset-l4vz9"
Jul 30 21:28:18.839634 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:28:18.839561    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5b8776669-b6prf_fc525264-4726-43fd-81d6-dd9beb8cf415/volume-data-source-validator/0.log"
Jul 30 21:28:18.866534 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:28:18.866504    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9kzmr/perf-node-gather-daemonset-l4vz9"
Jul 30 21:28:19.055500 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:28:19.055460    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9kzmr/perf-node-gather-daemonset-l4vz9"]
Jul 30 21:28:19.057416 ip-10-0-142-69 kubenswrapper[2583]: W0730 21:28:19.057385    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podec8a1c5e_f55a_4436_a2f4_0010a461b33d.slice/crio-59755baae446c8b5e304c806bd8ecaf034dc53c863271a79181cd67f7f6889a3 WatchSource:0}: Error finding container 59755baae446c8b5e304c806bd8ecaf034dc53c863271a79181cd67f7f6889a3: Status 404 returned error can't find the container with id 59755baae446c8b5e304c806bd8ecaf034dc53c863271a79181cd67f7f6889a3
Jul 30 21:28:19.765055 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:28:19.765011    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9kzmr/perf-node-gather-daemonset-l4vz9" event={"ID":"ec8a1c5e-f55a-4436-a2f4-0010a461b33d","Type":"ContainerStarted","Data":"cda0a29a76cf45f3f3363f8151f1e3597e5a64a3f13becf1bb8649ae03ae2292"}
Jul 30 21:28:19.765560 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:28:19.765081    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9kzmr/perf-node-gather-daemonset-l4vz9" event={"ID":"ec8a1c5e-f55a-4436-a2f4-0010a461b33d","Type":"ContainerStarted","Data":"59755baae446c8b5e304c806bd8ecaf034dc53c863271a79181cd67f7f6889a3"}
Jul 30 21:28:19.765560 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:28:19.765414    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-9kzmr/perf-node-gather-daemonset-l4vz9"
Jul 30 21:28:19.781205 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:28:19.781158    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-9kzmr/perf-node-gather-daemonset-l4vz9" podStartSLOduration=1.7811276409999999 podStartE2EDuration="1.781127641s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 21:28:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 21:28:19.780127963 +0000 UTC m=+3811.621603584" watchObservedRunningTime="2026-07-30 21:28:19.781127641 +0000 UTC m=+3811.622603262"
Jul 30 21:28:20.073929 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:28:20.073841    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-tlhdq_de47806e-aced-40b0-a9da-07fd79b4672a/dns/0.log"
Jul 30 21:28:20.094798 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:28:20.094722    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-tlhdq_de47806e-aced-40b0-a9da-07fd79b4672a/kube-rbac-proxy/0.log"
Jul 30 21:28:20.117544 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:28:20.117517    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-26tfg_346ac985-5c0d-4134-bc10-7727a294ef1f/dns-node-resolver/0.log"
Jul 30 21:28:20.745548 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:28:20.745514    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-czmdm_e5d61971-62cc-436c-9d5c-a3abec7a47d4/node-ca/0.log"
Jul 30 21:28:21.891904 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:28:21.891859    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-66684cbb98-9m4n8_ca860230-adcc-4965-90bc-992b6aa0b787/kube-auth-proxy/0.log"
Jul 30 21:28:21.996360 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:28:21.996329    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-frt6g_88f255a7-c387-47df-a88b-e13110fa654c/payload-processing/0.log"
Jul 30 21:28:22.862594 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:28:22.862566    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-txjtr_d1d63b84-5b7c-4792-9a2e-79c6b75e7bcf/serve-healthcheck-canary/0.log"
Jul 30 21:28:23.326470 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:28:23.326431    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-77696685b-dqzbs_812ee652-511e-4dab-9074-2628140ca8a3/insights-operator/0.log"
Jul 30 21:28:23.326998 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:28:23.326981    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-77696685b-dqzbs_812ee652-511e-4dab-9074-2628140ca8a3/insights-operator/1.log"
Jul 30 21:28:23.498922 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:28:23.498896    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rr72x_72fcf9b4-8b2b-4143-be8b-52047fc8086c/kube-rbac-proxy/0.log"
Jul 30 21:28:23.522192 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:28:23.522170    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rr72x_72fcf9b4-8b2b-4143-be8b-52047fc8086c/exporter/0.log"
Jul 30 21:28:23.541698 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:28:23.541671    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rr72x_72fcf9b4-8b2b-4143-be8b-52047fc8086c/extractor/0.log"
Jul 30 21:28:25.782490 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:28:25.782457    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-9kzmr/perf-node-gather-daemonset-l4vz9"
Jul 30 21:28:26.421024 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:28:26.420993    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7fd799f58b-6p5j9_3e86153a-f7e1-440c-8b64-118a0a3ceba3/manager/0.log"
Jul 30 21:28:26.441348 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:28:26.441325    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7fd799f58b-6p5j9_3e86153a-f7e1-440c-8b64-118a0a3ceba3/copy-manifests/0.log"
Jul 30 21:28:28.060627 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:28:28.060596    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5b6c8b8c96-d4pmz_a79474e8-d1c1-45d9-a457-b487b0f55951/manager/0.log"
Jul 30 21:28:28.062943 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:28:28.062915    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-66684cbb98-9m4n8_ca860230-adcc-4965-90bc-992b6aa0b787/kube-auth-proxy/0.log"
Jul 30 21:28:28.114273 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:28:28.114246    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-h5qk9_d6df703b-3ff8-4492-a840-d4fe64bc63c5/openshift-lws-operator/0.log"
Jul 30 21:28:28.152867 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:28:28.152842    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-frt6g_88f255a7-c387-47df-a88b-e13110fa654c/payload-processing/0.log"
Jul 30 21:28:29.783949 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:28:29.783918    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-66684cbb98-9m4n8_ca860230-adcc-4965-90bc-992b6aa0b787/kube-auth-proxy/0.log"
Jul 30 21:28:29.866932 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:28:29.866893    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-frt6g_88f255a7-c387-47df-a88b-e13110fa654c/payload-processing/0.log"
Jul 30 21:28:33.054646 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:28:33.054616    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-68bc745d87-ntrxv_855c65f8-558f-4da3-8b83-ae508d2f7d62/migrator/0.log"
Jul 30 21:28:33.073499 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:28:33.073477    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-68bc745d87-ntrxv_855c65f8-558f-4da3-8b83-ae508d2f7d62/graceful-termination/0.log"
Jul 30 21:28:33.421086 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:28:33.421060    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7878f4b88c-84jg4_3a311c25-3179-42a6-a5cc-99c05ae6c65a/kube-storage-version-migrator-operator/1.log"
Jul 30 21:28:33.421838 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:28:33.421820    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7878f4b88c-84jg4_3a311c25-3179-42a6-a5cc-99c05ae6c65a/kube-storage-version-migrator-operator/0.log"
Jul 30 21:28:34.755829 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:28:34.755801    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nlpd2_b5ea3ceb-c9e3-4ef4-920c-9b618c947bee/kube-multus-additional-cni-plugins/0.log"
Jul 30 21:28:34.776587 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:28:34.776566    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nlpd2_b5ea3ceb-c9e3-4ef4-920c-9b618c947bee/egress-router-binary-copy/0.log"
Jul 30 21:28:34.803994 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:28:34.798765    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nlpd2_b5ea3ceb-c9e3-4ef4-920c-9b618c947bee/cni-plugins/0.log"
Jul 30 21:28:34.822705 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:28:34.822686    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nlpd2_b5ea3ceb-c9e3-4ef4-920c-9b618c947bee/bond-cni-plugin/0.log"
Jul 30 21:28:34.842921 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:28:34.842900    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nlpd2_b5ea3ceb-c9e3-4ef4-920c-9b618c947bee/routeoverride-cni/0.log"
Jul 30 21:28:34.864059 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:28:34.864038    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nlpd2_b5ea3ceb-c9e3-4ef4-920c-9b618c947bee/whereabouts-cni-bincopy/0.log"
Jul 30 21:28:34.886676 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:28:34.886654    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nlpd2_b5ea3ceb-c9e3-4ef4-920c-9b618c947bee/whereabouts-cni/0.log"
Jul 30 21:28:34.928842 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:28:34.928786    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-gdkdh_208efd11-d3ba-46c5-8afb-269d1fbf7217/kube-multus/0.log"
Jul 30 21:28:34.985074 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:28:34.985041    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-jfpt4_9c27cd9e-72be-4a13-8deb-f4c3ffe3ecea/network-metrics-daemon/0.log"
Jul 30 21:28:35.003736 ip-10-0-142-69 kubenswrapper[2583]: I0730 21:28:35.003713    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-jfpt4_9c27cd9e-72be-4a13-8deb-f4c3ffe3ecea/kube-rbac-proxy/0.log"