Jul 06 14:22:51.311611 ip-10-0-137-145 systemd[1]: Starting Kubernetes Kubelet...
Jul 06 14:22:51.618142 ip-10-0-137-145 kubenswrapper[2582]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 14:22:51.618142 ip-10-0-137-145 kubenswrapper[2582]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 06 14:22:51.618142 ip-10-0-137-145 kubenswrapper[2582]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 14:22:51.618142 ip-10-0-137-145 kubenswrapper[2582]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 06 14:22:51.618142 ip-10-0-137-145 kubenswrapper[2582]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 14:22:51.618142 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.617608    2582 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 06 14:22:51.745235 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.622982    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 14:22:51.745235 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.622995    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 14:22:51.745235 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.622999    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 14:22:51.745235 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.623002    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 14:22:51.745235 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.623005    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 14:22:51.745235 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.623008    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 14:22:51.745235 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.623011    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 14:22:51.745235 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.623014    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 14:22:51.745235 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.623016    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 14:22:51.745235 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.623019    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 14:22:51.745235 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.623021    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 14:22:51.745235 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.623024    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 14:22:51.745235 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.623028    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 14:22:51.745235 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.623030    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 14:22:51.745235 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.623033    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 14:22:51.745235 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.623035    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 14:22:51.745235 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.623038    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 14:22:51.745235 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.623041    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 14:22:51.745235 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.623043    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 14:22:51.745235 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.623046    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 14:22:51.684040 ip-10-0-137-145 systemd[1]: Started Kubernetes Kubelet.
Jul 06 14:22:51.746046 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.623050    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 14:22:51.746046 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.623052    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 14:22:51.746046 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.623055    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 14:22:51.746046 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.623062    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 14:22:51.746046 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.623065    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 14:22:51.746046 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.623068    2582 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 14:22:51.746046 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.623072    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 14:22:51.746046 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.623076    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 14:22:51.746046 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.623079    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 14:22:51.746046 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.623082    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 14:22:51.746046 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.623085    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 14:22:51.746046 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.623088    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 14:22:51.746046 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.623090    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 14:22:51.746046 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.623093    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 14:22:51.746046 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.623096    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 14:22:51.746046 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.623098    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 14:22:51.746046 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.623101    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 14:22:51.746046 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.623104    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 14:22:51.746046 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.623106    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 14:22:51.919226 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.623109    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 14:22:51.919226 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.623112    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 14:22:51.919226 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.623114    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 14:22:51.919226 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.623116    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 14:22:51.919226 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.623119    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 14:22:51.919226 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.623121    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 14:22:51.919226 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.623124    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 14:22:51.919226 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.623126    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 14:22:51.919226 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.623129    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 14:22:51.919226 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.623132    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 14:22:51.919226 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.623134    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 14:22:51.919226 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.623137    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 14:22:51.919226 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.623139    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 14:22:51.919226 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.623142    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 14:22:51.919226 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.623144    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 14:22:51.919226 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.623147    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 14:22:51.919226 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.623149    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 14:22:51.919226 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.623152    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 14:22:51.919226 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.623155    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 14:22:51.919226 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.623157    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 14:22:51.921577 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.623160    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 14:22:51.921577 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.623163    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 14:22:51.921577 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.623171    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 14:22:51.921577 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.623176    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 14:22:51.921577 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.623179    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 14:22:51.921577 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.623182    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 14:22:51.921577 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.623185    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 14:22:51.921577 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.623188    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 14:22:51.921577 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.623191    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 14:22:51.921577 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.623194    2582 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 14:22:51.921577 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.623196    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 14:22:51.921577 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.623199    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 14:22:51.921577 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.623203    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 14:22:51.921577 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.623208    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 14:22:51.921577 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.623210    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 14:22:51.921577 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.623213    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 14:22:51.921577 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.623215    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 14:22:51.921577 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.623218    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 14:22:51.921577 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.623220    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 14:22:51.921577 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.623223    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 14:22:51.923583 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.623225    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 14:22:51.923583 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.623228    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 14:22:51.923583 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.623230    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 14:22:51.923583 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.623233    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 14:22:51.923583 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.623235    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 14:22:51.923583 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.623238    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 14:22:51.923583 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.623241    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 14:22:51.923583 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.623244    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 14:22:51.923583 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.623246    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 14:22:51.923583 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.623249    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 14:22:51.923583 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.623254    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 14:22:51.923583 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.623258    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 14:22:51.923583 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.623260    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 14:22:51.923583 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.623263    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 14:22:51.923583 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.623266    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 14:22:51.923583 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.623269    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 14:22:51.923583 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.623272    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 14:22:51.923583 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.623275    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 14:22:51.923583 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.623278    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 14:22:51.925275 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.623281    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 14:22:51.925275 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.623990    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 14:22:51.925275 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.623997    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 14:22:51.925275 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624000    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 14:22:51.925275 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624003    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 14:22:51.925275 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624006    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 14:22:51.925275 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624010    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 14:22:51.925275 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624013    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 14:22:51.925275 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624016    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 14:22:51.925275 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624018    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 14:22:51.925275 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624021    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 14:22:51.925275 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624024    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 14:22:51.925275 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624027    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 14:22:51.925275 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624029    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 14:22:51.925275 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624031    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 14:22:51.925275 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624034    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 14:22:51.925275 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624037    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 14:22:51.925275 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624039    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 14:22:51.925275 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624042    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 14:22:51.925275 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624044    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 14:22:51.926356 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624047    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 14:22:51.926356 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624049    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 14:22:51.926356 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624052    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 14:22:51.926356 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624055    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 14:22:51.926356 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624058    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 14:22:51.926356 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624060    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 14:22:51.926356 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624067    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 14:22:51.926356 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624070    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 14:22:51.926356 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624072    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 14:22:51.926356 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624075    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 14:22:51.926356 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624077    2582 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 14:22:51.926356 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624081    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 14:22:51.926356 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624083    2582 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 14:22:51.926356 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624086    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 14:22:51.926356 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624088    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 14:22:51.926356 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624092    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 14:22:51.926356 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624094    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 14:22:51.926356 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624096    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 14:22:51.926356 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624099    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 14:22:51.926356 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624103    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 14:22:51.927048 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624105    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 14:22:51.927048 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624108    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 14:22:51.927048 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624110    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 14:22:51.927048 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624113    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 14:22:51.927048 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624115    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 14:22:51.927048 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624120    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 14:22:51.927048 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624123    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 14:22:51.927048 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624126    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 14:22:51.927048 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624129    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 14:22:51.927048 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624132    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 14:22:51.927048 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624134    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 14:22:51.927048 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624137    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 14:22:51.927048 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624140    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 14:22:51.927048 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624142    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 14:22:51.927048 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624145    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 14:22:51.927048 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624147    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 14:22:51.927048 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624150    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 14:22:51.927048 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624152    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 14:22:51.927048 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624156    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 14:22:51.927048 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624159    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 14:22:51.927749 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624162    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 14:22:51.927749 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624165    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 14:22:51.927749 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624168    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 14:22:51.927749 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624171    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 14:22:51.927749 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624174    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 14:22:51.927749 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624176    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 14:22:51.927749 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624179    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 14:22:51.927749 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624182    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 14:22:51.927749 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624184    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 14:22:51.927749 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624187    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 14:22:51.927749 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624189    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 14:22:51.927749 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624192    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 14:22:51.927749 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624195    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 14:22:51.927749 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624198    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 14:22:51.927749 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624200    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 14:22:51.927749 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624203    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 14:22:51.927749 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624207    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 14:22:51.927749 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624210    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 14:22:51.927749 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624213    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 14:22:51.928465 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624215    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 14:22:51.928465 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624219    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 14:22:51.928465 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624222    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 14:22:51.928465 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624224    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 14:22:51.928465 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624227    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 14:22:51.928465 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624229    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 14:22:51.928465 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624232    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 14:22:51.928465 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624234    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 14:22:51.928465 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624237    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 14:22:51.928465 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624239    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 14:22:51.928465 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624242    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 14:22:51.928465 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624248    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 14:22:51.928465 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624251    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 14:22:51.928465 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624253    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 14:22:51.928465 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624256    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 14:22:51.928465 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624260    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 14:22:51.928465 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624262    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 14:22:51.928465 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624265    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 14:22:51.928465 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624267    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 14:22:51.929091 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624270    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 14:22:51.929091 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624273    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 14:22:51.929091 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624654    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 14:22:51.929091 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624659    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 14:22:51.929091 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624661    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 14:22:51.929091 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624664    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 14:22:51.929091 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624668    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 14:22:51.929091 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624671    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 14:22:51.929091 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624674    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 14:22:51.929091 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624677    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 14:22:51.929091 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624679    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 14:22:51.929091 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624682    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 14:22:51.929091 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624685    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 14:22:51.929091 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624688    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 14:22:51.929091 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624690    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 14:22:51.929091 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624693    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 14:22:51.929091 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624696    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 14:22:51.929091 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624698    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 14:22:51.929091 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624701    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 14:22:51.929091 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624703    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 14:22:51.929836 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624706    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 14:22:51.929836 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624708    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 14:22:51.929836 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624711    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 14:22:51.929836 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624714    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 14:22:51.929836 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624718    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 14:22:51.929836 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624721    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 14:22:51.929836 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624724    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 14:22:51.929836 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624726    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 14:22:51.929836 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624729    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 14:22:51.929836 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624731    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 14:22:51.929836 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624734    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 14:22:51.929836 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624738    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 14:22:51.929836 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624742    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 14:22:51.929836 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624744    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 14:22:51.929836 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624747    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 14:22:51.929836 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624750    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 14:22:51.929836 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624753    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 14:22:51.929836 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624756    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 14:22:51.929836 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624758    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 14:22:51.930577 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624762    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 14:22:51.930577 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624765    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 14:22:51.930577 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624767    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 14:22:51.930577 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624770    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 14:22:51.930577 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624773    2582 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 14:22:51.930577 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624776    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 14:22:51.930577 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624778    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 14:22:51.930577 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624780    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 14:22:51.930577 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624783    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 14:22:51.930577 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624785    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 14:22:51.930577 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624788    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 14:22:51.930577 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624790    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 14:22:51.930577 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624793    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 14:22:51.930577 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624795    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 14:22:51.930577 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624798    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 14:22:51.930577 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624801    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 14:22:51.930577 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624803    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 14:22:51.930577 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624807    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 14:22:51.930577 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624810    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 14:22:51.930577 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624812    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 14:22:51.931271 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624815    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 14:22:51.931271 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624817    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 14:22:51.931271 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624820    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 14:22:51.931271 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624823    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 14:22:51.931271 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624825    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 14:22:51.931271 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624828    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 14:22:51.931271 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624832    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 14:22:51.931271 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624835    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 14:22:51.931271 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624838    2582 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 14:22:51.931271 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624841    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 14:22:51.931271 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624845    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 14:22:51.931271 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624848    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 14:22:51.931271 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624850    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 14:22:51.931271 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624853    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 14:22:51.931271 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624856    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 14:22:51.931271 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624859    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 14:22:51.931271 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624861    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 14:22:51.931271 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624864    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 14:22:51.931271 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624868    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 14:22:51.931271 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624871    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 14:22:51.931839 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624873    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 14:22:51.931839 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624876    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 14:22:51.931839 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624878    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 14:22:51.931839 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624881    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 14:22:51.931839 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624883    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 14:22:51.931839 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624885    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 14:22:51.931839 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624888    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 14:22:51.931839 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624890    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 14:22:51.931839 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624893    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 14:22:51.931839 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624897    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 14:22:51.931839 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624899    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 14:22:51.931839 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624902    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 14:22:51.931839 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624904    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 14:22:51.931839 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624906    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 14:22:51.931839 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624909    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 14:22:51.931839 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624916    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 14:22:51.931839 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624918    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 14:22:51.931839 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624921    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 14:22:51.931839 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624923    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 14:22:51.931839 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624926    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 14:22:51.932429 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624929    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 14:22:51.932429 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.624931    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 14:22:51.932429 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.624993    2582 flags.go:64] FLAG: --address="0.0.0.0"
Jul 06 14:22:51.932429 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625000    2582 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 06 14:22:51.932429 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625005    2582 flags.go:64] FLAG: --anonymous-auth="true"
Jul 06 14:22:51.932429 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625010    2582 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 06 14:22:51.932429 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625015    2582 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 06 14:22:51.932429 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625018    2582 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 06 14:22:51.932429 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625022    2582 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 06 14:22:51.932429 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625026    2582 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 06 14:22:51.932429 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625029    2582 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 06 14:22:51.932429 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625032    2582 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 06 14:22:51.932429 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625036    2582 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 06 14:22:51.932429 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625039    2582 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 06 14:22:51.932429 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625042    2582 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 06 14:22:51.932429 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625045    2582 flags.go:64] FLAG: --cgroup-root=""
Jul 06 14:22:51.932429 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625048    2582 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 06 14:22:51.932429 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625051    2582 flags.go:64] FLAG: --client-ca-file=""
Jul 06 14:22:51.932429 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625054    2582 flags.go:64] FLAG: --cloud-provider="external"
Jul 06 14:22:51.932429 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625057    2582 flags.go:64] FLAG: --cluster-dns="[]"
Jul 06 14:22:51.932429 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625061    2582 flags.go:64] FLAG: --cluster-domain=""
Jul 06 14:22:51.932429 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625065    2582 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 06 14:22:51.932429 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625068    2582 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 06 14:22:51.932429 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625071    2582 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 06 14:22:51.933057 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625074    2582 flags.go:64] FLAG: --container-log-max-files="5"
Jul 06 14:22:51.933057 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625078    2582 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 06 14:22:51.933057 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625081    2582 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 06 14:22:51.933057 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625085    2582 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 06 14:22:51.933057 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625089    2582 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 06 14:22:51.933057 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625091    2582 flags.go:64] FLAG: --contention-profiling="false"
Jul 06 14:22:51.933057 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625094    2582 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 06 14:22:51.933057 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625097    2582 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 06 14:22:51.933057 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625100    2582 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 06 14:22:51.933057 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625104    2582 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 06 14:22:51.933057 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625108    2582 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 06 14:22:51.933057 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625110    2582 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 06 14:22:51.933057 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625113    2582 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 06 14:22:51.933057 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625116    2582 flags.go:64] FLAG: --enable-load-reader="false"
Jul 06 14:22:51.933057 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625119    2582 flags.go:64] FLAG: --enable-server="true"
Jul 06 14:22:51.933057 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625122    2582 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 06 14:22:51.933057 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625126    2582 flags.go:64] FLAG: --event-burst="100"
Jul 06 14:22:51.933057 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625129    2582 flags.go:64] FLAG: --event-qps="50"
Jul 06 14:22:51.933057 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625132    2582 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 06 14:22:51.933057 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625135    2582 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 06 14:22:51.933057 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625138    2582 flags.go:64] FLAG: --eviction-hard=""
Jul 06 14:22:51.933057 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625142    2582 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 06 14:22:51.933057 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625145    2582 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 06 14:22:51.933057 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625148    2582 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 06 14:22:51.933057 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625151    2582 flags.go:64] FLAG: --eviction-soft=""
Jul 06 14:22:51.933767 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625154    2582 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 06 14:22:51.933767 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625157    2582 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 06 14:22:51.933767 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625160    2582 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 06 14:22:51.933767 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625163    2582 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 06 14:22:51.933767 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625167    2582 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 06 14:22:51.933767 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625170    2582 flags.go:64] FLAG: --fail-swap-on="true"
Jul 06 14:22:51.933767 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625173    2582 flags.go:64] FLAG: --feature-gates=""
Jul 06 14:22:51.933767 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625176    2582 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 06 14:22:51.933767 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625179    2582 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 06 14:22:51.933767 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625182    2582 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 06 14:22:51.933767 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625186    2582 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 06 14:22:51.933767 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625189    2582 flags.go:64] FLAG: --healthz-port="10248"
Jul 06 14:22:51.933767 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625192    2582 flags.go:64] FLAG: --help="false"
Jul 06 14:22:51.933767 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625195    2582 flags.go:64] FLAG: --hostname-override="ip-10-0-137-145.ec2.internal"
Jul 06 14:22:51.933767 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625198    2582 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 06 14:22:51.933767 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625201    2582 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 06 14:22:51.933767 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625204    2582 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 06 14:22:51.933767 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625207    2582 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 06 14:22:51.933767 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625210    2582 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 06 14:22:51.933767 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625213    2582 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 06 14:22:51.933767 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625216    2582 flags.go:64] FLAG: --image-service-endpoint=""
Jul 06 14:22:51.933767 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625218    2582 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 06 14:22:51.933767 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625221    2582 flags.go:64] FLAG: --kube-api-burst="100"
Jul 06 14:22:51.934462 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625231    2582 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 06 14:22:51.934462 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625234    2582 flags.go:64] FLAG: --kube-api-qps="50"
Jul 06 14:22:51.934462 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625237    2582 flags.go:64] FLAG: --kube-reserved=""
Jul 06 14:22:51.934462 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625240    2582 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 06 14:22:51.934462 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625242    2582 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 06 14:22:51.934462 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625245    2582 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 06 14:22:51.934462 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625248    2582 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 06 14:22:51.934462 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625251    2582 flags.go:64] FLAG: --lock-file=""
Jul 06 14:22:51.934462 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625254    2582 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 06 14:22:51.934462 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625257    2582 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 06 14:22:51.934462 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625259    2582 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 06 14:22:51.934462 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625265    2582 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 06 14:22:51.934462 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625268    2582 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 06 14:22:51.934462 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625273    2582 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 06 14:22:51.934462 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625275    2582 flags.go:64] FLAG: --logging-format="text"
Jul 06 14:22:51.934462 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625278    2582 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 06 14:22:51.934462 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625294    2582 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 06 14:22:51.934462 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625297    2582 flags.go:64] FLAG: --manifest-url=""
Jul 06 14:22:51.934462 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625300    2582 flags.go:64] FLAG: --manifest-url-header=""
Jul 06 14:22:51.934462 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625306    2582 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 06 14:22:51.934462 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625309    2582 flags.go:64] FLAG: --max-open-files="1000000"
Jul 06 14:22:51.934462 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625313    2582 flags.go:64] FLAG: --max-pods="110"
Jul 06 14:22:51.934462 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625316    2582 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 06 14:22:51.934462 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625319    2582 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 06 14:22:51.934462 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625322    2582 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 06 14:22:51.935156 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625324    2582 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 06 14:22:51.935156 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625327    2582 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 06 14:22:51.935156 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625330    2582 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 06 14:22:51.935156 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625333    2582 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 06 14:22:51.935156 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625340    2582 flags.go:64] FLAG: --node-status-max-images="50"
Jul 06 14:22:51.935156 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625343    2582 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 06 14:22:51.935156 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625346    2582 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 06 14:22:51.935156 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625349    2582 flags.go:64] FLAG: --pod-cidr=""
Jul 06 14:22:51.935156 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625353    2582 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 06 14:22:51.935156 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625358    2582 flags.go:64] FLAG: --pod-manifest-path=""
Jul 06 14:22:51.935156 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625361    2582 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 06 14:22:51.935156 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625364    2582 flags.go:64] FLAG: --pods-per-core="0"
Jul 06 14:22:51.935156 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625367    2582 flags.go:64] FLAG: --port="10250"
Jul 06 14:22:51.935156 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625370    2582 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 06 14:22:51.935156 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625373    2582 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-02cab0141756a358a"
Jul 06 14:22:51.935156 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625376    2582 flags.go:64] FLAG: --qos-reserved=""
Jul 06 14:22:51.935156 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625379    2582 flags.go:64] FLAG: --read-only-port="10255"
Jul 06 14:22:51.935156 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625382    2582 flags.go:64] FLAG: --register-node="true"
Jul 06 14:22:51.935156 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625385    2582 flags.go:64] FLAG: --register-with-taints=""
Jul 06 14:22:51.935156 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625389    2582 flags.go:64] FLAG: --registry-burst="10"
Jul 06 14:22:51.935156 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625391    2582 flags.go:64] FLAG: --registry-qps="5"
Jul 06 14:22:51.935156 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625395    2582 flags.go:64] FLAG: --reserved-cpus=""
Jul 06 14:22:51.935156 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625398    2582 flags.go:64] FLAG: --reserved-memory=""
Jul 06 14:22:51.935156 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625402    2582 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 06 14:22:51.935156 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625405    2582 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 06 14:22:51.935828 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625408    2582 flags.go:64] FLAG: --rotate-certificates="false"
Jul 06 14:22:51.935828 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625412    2582 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 06 14:22:51.935828 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625415    2582 flags.go:64] FLAG: --runonce="false"
Jul 06 14:22:51.935828 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625418    2582 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 06 14:22:51.935828 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625421    2582 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 06 14:22:51.935828 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625424    2582 flags.go:64] FLAG: --seccomp-default="false"
Jul 06 14:22:51.935828 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625427    2582 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 06 14:22:51.935828 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625429    2582 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 06 14:22:51.935828 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625432    2582 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 06 14:22:51.935828 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625435    2582 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 06 14:22:51.935828 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625438    2582 flags.go:64] FLAG: --storage-driver-password="root"
Jul 06 14:22:51.935828 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625441    2582 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 06 14:22:51.935828 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625444    2582 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 06 14:22:51.935828 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625447    2582 flags.go:64] FLAG: --storage-driver-user="root"
Jul 06 14:22:51.935828 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625450    2582 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 06 14:22:51.935828 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625453    2582 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 06 14:22:51.935828 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625457    2582 flags.go:64] FLAG: --system-cgroups=""
Jul 06 14:22:51.935828 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625459    2582 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 06 14:22:51.935828 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625464    2582 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 06 14:22:51.935828 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625467    2582 flags.go:64] FLAG: --tls-cert-file=""
Jul 06 14:22:51.935828 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625470    2582 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 06 14:22:51.935828 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625481    2582 flags.go:64] FLAG: --tls-min-version=""
Jul 06 14:22:51.935828 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625484    2582 flags.go:64] FLAG: --tls-private-key-file=""
Jul 06 14:22:51.935828 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625487    2582 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 06 14:22:51.935828 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625489    2582 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 06 14:22:51.936533 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625492    2582 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 06 14:22:51.936533 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625495    2582 flags.go:64] FLAG: --v="2"
Jul 06 14:22:51.936533 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625503    2582 flags.go:64] FLAG: --version="false"
Jul 06 14:22:51.936533 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625508    2582 flags.go:64] FLAG: --vmodule=""
Jul 06 14:22:51.936533 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625522    2582 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 06 14:22:51.936533 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.625525    2582 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 06 14:22:51.936533 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.625688    2582 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 14:22:51.936533 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.625694    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 14:22:51.936533 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.625700    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 14:22:51.936533 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.625703    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 14:22:51.936533 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.625707    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 14:22:51.936533 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.625710    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 14:22:51.936533 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.625714    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 14:22:51.936533 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.625718    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 14:22:51.936533 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.625721    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 14:22:51.936533 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.625725    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 14:22:51.936533 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.625729    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 14:22:51.936533 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.625732    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 14:22:51.936533 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.625736    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 14:22:51.936533 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.625740    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 14:22:51.936533 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.625744    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 14:22:51.937448 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.625749    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 14:22:51.937448 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.625755    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 14:22:51.937448 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.625758    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 14:22:51.937448 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.625763    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 14:22:51.937448 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.625767    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 14:22:51.937448 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.625771    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 14:22:51.937448 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.625774    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 14:22:51.937448 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.625778    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 14:22:51.937448 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.625782    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 14:22:51.937448 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.625785    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 14:22:51.937448 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.625789    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 14:22:51.937448 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.625792    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 14:22:51.937448 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.625796    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 14:22:51.937448 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.625800    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 14:22:51.937448 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.625805    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 14:22:51.937448 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.625809    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 14:22:51.937448 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.625813    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 14:22:51.937448 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.625817    2582 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 14:22:51.937448 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.625820    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 14:22:51.937448 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.625826    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 14:22:51.938637 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.625829    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 14:22:51.938637 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.625833    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 14:22:51.938637 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.625837    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 14:22:51.938637 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.625841    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 14:22:51.938637 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.625844    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 14:22:51.938637 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.625847    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 14:22:51.938637 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.625851    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 14:22:51.938637 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.625855    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 14:22:51.938637 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.625858    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 14:22:51.938637 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.625862    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 14:22:51.938637 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.625866    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 14:22:51.938637 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.625870    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 14:22:51.938637 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.625873    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 14:22:51.938637 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.625878    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 14:22:51.938637 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.625881    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 14:22:51.938637 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.625885    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 14:22:51.938637 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.625889    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 14:22:51.938637 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.625893    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 14:22:51.938637 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.625896    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 14:22:51.938637 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.625900    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 14:22:52.091868 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.625904    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 14:22:52.091868 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.625908    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 14:22:52.091868 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.625911    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 14:22:52.091868 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.625915    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 14:22:52.091868 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.625919    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 14:22:52.091868 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.625923    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 14:22:52.091868 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.625928    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 14:22:52.091868 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.625932    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 14:22:52.091868 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.625935    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 14:22:52.091868 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.625940    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 14:22:52.091868 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.625944    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 14:22:52.091868 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.625951    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 14:22:52.091868 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.625955    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 14:22:52.091868 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.625958    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 14:22:52.091868 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.625962    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 14:22:52.091868 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.625966    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 14:22:52.091868 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.625970    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 14:22:52.091868 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.625974    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 14:22:52.091868 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.625978    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 14:22:52.091868 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.625981    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 14:22:52.092589 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.625985    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 14:22:52.092589 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.625989    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 14:22:52.092589 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.625992    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 14:22:52.092589 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.625996    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 14:22:52.092589 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.626001    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 14:22:52.092589 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.626006    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 14:22:52.092589 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.626010    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 14:22:52.092589 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.626014    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 14:22:52.092589 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.626019    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 14:22:52.092589 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.626024    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 14:22:52.092589 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.626028    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 14:22:52.092589 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.626031    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 14:22:52.092589 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.626035    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 14:22:52.092589 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.626039    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 14:22:52.092589 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.626043    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 14:22:52.092589 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.626047    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 14:22:52.092589 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.626050    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 14:22:52.092589 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.626054    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 14:22:52.092589 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.626059    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 14:22:52.093096 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.626065    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 14:22:52.093096 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.626069    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 14:22:52.093096 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.626074    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 14:22:52.093096 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.626078    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 14:22:52.093096 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.626084    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 14:22:52.093096 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.626515    2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 14:22:52.093096 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.633710    2582 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 06 14:22:52.093096 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.633729    2582 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 06 14:22:52.093096 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.634233    2582 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 06 14:22:52.093096 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.634241    2582 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 06 14:22:52.093096 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634330    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 14:22:52.093096 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634336    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 14:22:52.093096 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634340    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 14:22:52.093559 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634343    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 14:22:52.093559 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634346    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 14:22:52.093559 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634348    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 14:22:52.093559 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634351    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 14:22:52.093559 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634353    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 14:22:52.093559 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634356    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 14:22:52.093559 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634358    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 14:22:52.093559 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634361    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 14:22:52.093559 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634363    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 14:22:52.093559 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634366    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 14:22:52.093559 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634368    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 14:22:52.093559 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634371    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 14:22:52.093559 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634373    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 14:22:52.093559 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634376    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 14:22:52.093559 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634378    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 14:22:52.093559 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634383    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 14:22:52.093559 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634386    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 14:22:52.093559 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634389    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 14:22:52.093559 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634393    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 14:22:52.093559 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634395    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 14:22:52.094098 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634399    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 14:22:52.094098 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634402    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 14:22:52.094098 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634405    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 14:22:52.094098 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634408    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 14:22:52.094098 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634415    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 14:22:52.094098 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634417    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 14:22:52.094098 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634428    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 14:22:52.094098 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634430    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 14:22:52.094098 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634433    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 14:22:52.094098 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634436    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 14:22:52.094098 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634438    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 14:22:52.094098 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634441    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 14:22:52.094098 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634443    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 14:22:52.094098 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634446    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 14:22:52.094098 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634448    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 14:22:52.094098 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634451    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 14:22:52.094098 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634453    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 14:22:52.094098 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634456    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 14:22:52.094098 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634459    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 14:22:52.094663 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634461    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 14:22:52.094663 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634464    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 14:22:52.094663 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634466    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 14:22:52.094663 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634468    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 14:22:52.094663 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634471    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 14:22:52.094663 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634473    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 14:22:52.094663 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634476    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 14:22:52.094663 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634478    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 14:22:52.094663 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634481    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 14:22:52.094663 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634483    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 14:22:52.094663 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634487    2582 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 14:22:52.094663 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634491    2582 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 14:22:52.094663 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634495    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 14:22:52.094663 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634498    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 14:22:52.094663 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634500    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 14:22:52.094663 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634503    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 14:22:52.094663 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634506    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 14:22:52.094663 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634510    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 14:22:52.094663 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634513    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 14:22:52.094663 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634515    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 14:22:52.095217 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634523    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 14:22:52.095217 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634526    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 14:22:52.095217 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634528    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 14:22:52.095217 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634531    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 14:22:52.095217 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634534    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 14:22:52.095217 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634536    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 14:22:52.095217 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634538    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 14:22:52.095217 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634541    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 14:22:52.095217 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634544    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 14:22:52.095217 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634546    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 14:22:52.095217 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634548    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 14:22:52.095217 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634552    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 14:22:52.095217 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634555    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 14:22:52.095217 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634558    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 14:22:52.095217 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634561    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 14:22:52.095217 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634564    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 14:22:52.095217 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634566    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 14:22:52.095217 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634569    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 14:22:52.095217 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634571    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 14:22:52.095778 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634574    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 14:22:52.095778 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634576    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 14:22:52.095778 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634579    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 14:22:52.095778 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634581    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 14:22:52.095778 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634585    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 14:22:52.095778 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634588    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 14:22:52.095778 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634590    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 14:22:52.095778 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634593    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 14:22:52.095778 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634595    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 14:22:52.095778 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634597    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 14:22:52.095778 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634601    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 14:22:52.095778 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634603    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 14:22:52.095778 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634606    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 14:22:52.095778 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634608    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 14:22:52.095778 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634617    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 14:22:52.095778 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634619    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 14:22:52.095778 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634622    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 14:22:52.095778 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634624    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 14:22:52.096335 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.634629    2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 14:22:52.096335 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634783    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 14:22:52.096335 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634788    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 14:22:52.096335 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634791    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 14:22:52.096335 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634794    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 14:22:52.096335 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634796    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 14:22:52.096335 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634799    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 14:22:52.096335 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634802    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 14:22:52.096335 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634805    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 14:22:52.096335 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634808    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 14:22:52.096335 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634810    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 14:22:52.096335 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634813    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 14:22:52.096335 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634816    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 14:22:52.096335 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634819    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 14:22:52.096335 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634823    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 14:22:52.096856 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634826    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 14:22:52.096856 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634829    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 14:22:52.096856 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634832    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 14:22:52.096856 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634834    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 14:22:52.096856 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634838    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 14:22:52.096856 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634841    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 14:22:52.096856 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634843    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 14:22:52.096856 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634846    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 14:22:52.096856 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634849    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 14:22:52.096856 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634853    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 14:22:52.096856 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634855    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 14:22:52.096856 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634858    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 14:22:52.096856 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634860    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 14:22:52.096856 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634863    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 14:22:52.096856 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634871    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 14:22:52.096856 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634874    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 14:22:52.096856 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634877    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 14:22:52.096856 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634881    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 14:22:52.096856 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634884    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 14:22:52.097377 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634887    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 14:22:52.097377 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634890    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 14:22:52.097377 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634892    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 14:22:52.097377 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634895    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 14:22:52.097377 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634897    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 14:22:52.097377 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634900    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 14:22:52.097377 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634902    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 14:22:52.097377 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634905    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 14:22:52.097377 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634907    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 14:22:52.097377 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634910    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 14:22:52.097377 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634912    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 14:22:52.097377 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634916    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 14:22:52.097377 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634919    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 14:22:52.097377 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634922    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 14:22:52.097377 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634925    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 14:22:52.097377 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634928    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 14:22:52.097377 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634930    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 14:22:52.097377 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634934    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 14:22:52.097377 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634937    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 14:22:52.097377 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634939    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 14:22:52.098016 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634942    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 14:22:52.098016 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634945    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 14:22:52.098016 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634949    2582 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 14:22:52.098016 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634952    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 14:22:52.098016 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634954    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 14:22:52.098016 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634957    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 14:22:52.098016 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634959    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 14:22:52.098016 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634962    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 14:22:52.098016 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634970    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 14:22:52.098016 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634973    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 14:22:52.098016 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634975    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 14:22:52.098016 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634978    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 14:22:52.098016 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634980    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 14:22:52.098016 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634983    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 14:22:52.098016 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634985    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 14:22:52.098016 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634988    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 14:22:52.098016 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634990    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 14:22:52.098016 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634993    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 14:22:52.098016 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634995    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 14:22:52.098016 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.634998    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 14:22:52.098558 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.635000    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 14:22:52.098558 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.635003    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 14:22:52.098558 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.635005    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 14:22:52.098558 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.635008    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 14:22:52.098558 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.635010    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 14:22:52.098558 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.635013    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 14:22:52.098558 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.635015    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 14:22:52.098558 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.635018    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 14:22:52.098558 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.635020    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 14:22:52.098558 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.635025    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 14:22:52.098558 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.635028    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 14:22:52.098558 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.635030    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 14:22:52.098558 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.635033    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 14:22:52.098558 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.635035    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 14:22:52.098558 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.635039    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 14:22:52.098558 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.635041    2582 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 14:22:52.098558 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.635044    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 14:22:52.098558 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.635047    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 14:22:52.098558 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.635049    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 14:22:52.098558 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.635051    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 14:22:52.099105 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.635054    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 14:22:52.099105 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.635062    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 14:22:52.099105 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.635065    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 14:22:52.099105 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.635067    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 14:22:52.099105 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.635069    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 14:22:52.099105 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:51.635072    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 14:22:52.099105 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.635077    2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 14:22:52.099105 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.635221    2582 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 06 14:22:52.099105 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.637610    2582 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 06 14:22:52.099105 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.638566    2582 server.go:1019] "Starting client certificate rotation"
Jul 06 14:22:52.099105 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.638665    2582 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 06 14:22:52.099105 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.638694    2582 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 06 14:22:52.099105 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.640530    2582 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 06 14:22:52.099491 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.643706    2582 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 06 14:22:52.099491 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.653127    2582 log.go:25] "Validated CRI v1 runtime API"
Jul 06 14:22:52.099491 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.656439    2582 log.go:25] "Validated CRI v1 image API"
Jul 06 14:22:52.099491 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.657154    2582 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 06 14:22:52.099491 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.660522    2582 fs.go:135] Filesystem UUIDs: map[6ebb1e35-9b9b-4fa7-ad25-4955468ed940:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 825ac41e-bf9c-432c-8029-25f5cdc92f74:/dev/nvme0n1p3]
Jul 06 14:22:52.099491 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.660540    2582 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 06 14:22:52.099753 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.665174    2582 manager.go:216] Machine: {Timestamp:2026-07-06 14:22:51.664118363 +0000 UTC m=+0.262766682 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099378 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2e08838ad2c7050515460b740794fb SystemUUID:ec2e0883-8ad2-c705-0515-460b740794fb BootID:cbd422e8-00fd-4644-aece-87c18b737989 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:24:5b:4e:1b:09 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:24:5b:4e:1b:09 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:06:7c:b8:bb:f7:fc Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 06 14:22:52.099753 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.665270    2582 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 06 14:22:52.099753 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.665367    2582 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 06 14:22:52.099753 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.667696    2582 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 06 14:22:52.099753 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.667735    2582 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-145.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 06 14:22:52.099753 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.668807    2582 topology_manager.go:138] "Creating topology manager with none policy"
Jul 06 14:22:52.099753 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.668818    2582 container_manager_linux.go:309] "Creating device plugin manager"
Jul 06 14:22:52.099753 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.668827    2582 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 06 14:22:52.099753 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.669369    2582 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 06 14:22:52.099753 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.670368    2582 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 06 14:22:52.099753 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.672369    2582 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 06 14:22:52.099753 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.673894    2582 state_mem.go:36] "Initialized new in-memory state store"
Jul 06 14:22:52.099753 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.674010    2582 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 06 14:22:52.099753 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.674037    2582 kubelet.go:486] "Attempting to sync node with API server"
Jul 06 14:22:52.099753 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.674047    2582 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 06 14:22:52.099753 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.674058    2582 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 06 14:22:52.099753 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.674067    2582 kubelet.go:398] "Adding apiserver pod source"
Jul 06 14:22:52.100295 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.674076    2582 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 06 14:22:52.100295 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.674665    2582 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 06 14:22:52.100295 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.674683    2582 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 06 14:22:52.100295 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.676486    2582 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 06 14:22:52.100295 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.678176    2582 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 06 14:22:52.100295 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.678212    2582 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 06 14:22:52.100295 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.679068    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 06 14:22:52.100295 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.679084    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 06 14:22:52.100295 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.679092    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 06 14:22:52.100295 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.679100    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 06 14:22:52.100295 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.679113    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 06 14:22:52.100295 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.679121    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 06 14:22:52.100295 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.679133    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 06 14:22:52.100295 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.679141    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 06 14:22:52.100295 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.679150    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 06 14:22:52.100295 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.679158    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 06 14:22:52.100295 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.679169    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 06 14:22:52.100295 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.679176    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 06 14:22:52.100295 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.679712    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 06 14:22:52.100295 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.679722    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 06 14:22:52.100295 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.683040    2582 server.go:1268] "Started kubelet"
Jul 06 14:22:52.100295 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.683113    2582 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 06 14:22:52.100295 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.683193    2582 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 06 14:22:52.100295 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.683155    2582 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 06 14:22:52.100295 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.684594    2582 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 06 14:22:52.100295 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.685450    2582 server.go:310] "Adding debug handlers to kubelet server"
Jul 06 14:22:52.100295 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:22:51.688830    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-145.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 06 14:22:52.100295 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.688969    2582 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-145.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 06 14:22:52.100295 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:22:51.689062    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 06 14:22:52.100295 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:22:51.688455    2582 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-145.ec2.internal.18bfb9598a267806  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-145.ec2.internal,UID:ip-10-0-137-145.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-137-145.ec2.internal,},FirstTimestamp:2026-07-06 14:22:51.683010566 +0000 UTC m=+0.281658885,LastTimestamp:2026-07-06 14:22:51.683010566 +0000 UTC m=+0.281658885,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-145.ec2.internal,}"
Jul 06 14:22:52.100295 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:22:51.693818    2582 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 06 14:22:52.100295 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.695601    2582 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 06 14:22:52.100295 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.695621    2582 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 06 14:22:52.100295 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:22:51.695667    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-145.ec2.internal\" not found"
Jul 06 14:22:52.100295 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.696061    2582 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 06 14:22:52.100295 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.696061    2582 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 06 14:22:52.100295 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.696100    2582 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 06 14:22:52.100295 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.696273    2582 reconstruct.go:97] "Volume reconstruction finished"
Jul 06 14:22:52.100295 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.696298    2582 reconciler.go:29] "Reconciler: start to sync state"
Jul 06 14:22:52.101313 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.696480    2582 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 06 14:22:52.101313 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.696493    2582 factory.go:55] Registering systemd factory
Jul 06 14:22:52.101313 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.696502    2582 factory.go:223] Registration of the systemd container factory successfully
Jul 06 14:22:52.101313 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.696710    2582 factory.go:153] Registering CRI-O factory
Jul 06 14:22:52.101313 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.696722    2582 factory.go:223] Registration of the crio container factory successfully
Jul 06 14:22:52.101313 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.696740    2582 factory.go:103] Registering Raw factory
Jul 06 14:22:52.101313 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.696750    2582 manager.go:1196] Started watching for new ooms in manager
Jul 06 14:22:52.101313 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.697072    2582 manager.go:349] Starting recovery of all containers
Jul 06 14:22:52.101313 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:22:51.697872    2582 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-137-145.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 06 14:22:52.101313 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:22:51.697953    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 06 14:22:52.101313 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.698436    2582 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-rv289"
Jul 06 14:22:52.101313 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.706277    2582 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-rv289"
Jul 06 14:22:52.101313 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.712740    2582 manager.go:354] Recovery completed
Jul 06 14:22:52.101313 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.718785    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 14:22:52.101313 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.720675    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-145.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 14:22:52.101313 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.720711    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-145.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 14:22:52.101313 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.720723    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-145.ec2.internal" event="NodeHasSufficientPID"
Jul 06 14:22:52.101313 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.721335    2582 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 06 14:22:52.101313 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.721344    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 14:22:52.101313 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.721345    2582 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 06 14:22:52.101313 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.721409    2582 state_mem.go:36] "Initialized new in-memory state store"
Jul 06 14:22:52.101313 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.721999    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-145.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 14:22:52.101313 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.722017    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-145.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 14:22:52.101313 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.722026    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-145.ec2.internal" event="NodeHasSufficientPID"
Jul 06 14:22:52.101313 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.723473    2582 policy_none.go:49] "None policy: Start"
Jul 06 14:22:52.101313 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.723489    2582 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 06 14:22:52.101313 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.723502    2582 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 06 14:22:52.101313 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.726885    2582 policy_none.go:47] "Start"
Jul 06 14:22:52.101313 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.778937    2582 manager.go:337] "Starting Device Plugin manager"
Jul 06 14:22:52.101313 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:22:51.778975    2582 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 06 14:22:52.101313 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.778985    2582 server.go:87] "Starting device plugin registration server"
Jul 06 14:22:52.101313 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.779281    2582 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 06 14:22:52.101313 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.779318    2582 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 06 14:22:52.101313 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.779402    2582 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 06 14:22:52.101313 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.779491    2582 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 06 14:22:52.101313 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.779500    2582 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 06 14:22:52.101313 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:22:51.779981    2582 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 06 14:22:52.101313 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:22:51.780022    2582 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-145.ec2.internal\" not found"
Jul 06 14:22:52.101313 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.813254    2582 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 06 14:22:52.101313 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.814482    2582 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 06 14:22:52.101313 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.814519    2582 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 06 14:22:52.101313 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.814545    2582 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 06 14:22:52.101313 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:22:51.814586    2582 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 06 14:22:52.101313 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.816656    2582 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 14:22:52.101313 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.880261    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 14:22:52.101313 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.881279    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-145.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 14:22:52.101313 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.881327    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-145.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 14:22:52.102834 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.881340    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-145.ec2.internal" event="NodeHasSufficientPID"
Jul 06 14:22:52.102834 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.881363    2582 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-145.ec2.internal"
Jul 06 14:22:52.102834 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.889191    2582 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-145.ec2.internal"
Jul 06 14:22:52.102834 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:22:51.889212    2582 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-145.ec2.internal\": node \"ip-10-0-137-145.ec2.internal\" not found"
Jul 06 14:22:52.102834 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:22:51.906668    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-145.ec2.internal\" not found"
Jul 06 14:22:52.102834 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.915145    2582 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-145.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-145.ec2.internal"]
Jul 06 14:22:52.102834 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.915203    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 14:22:52.102834 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.916554    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-145.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 14:22:52.102834 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.916581    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-145.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 14:22:52.102834 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.916591    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-145.ec2.internal" event="NodeHasSufficientPID"
Jul 06 14:22:52.102834 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.918353    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 14:22:52.102834 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.918443    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-145.ec2.internal"
Jul 06 14:22:52.102834 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.918478    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 14:22:52.102834 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.919042    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-145.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 14:22:52.102834 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.919067    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-145.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 14:22:52.102834 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.919081    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-145.ec2.internal" event="NodeHasSufficientPID"
Jul 06 14:22:52.102834 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.919102    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-145.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 14:22:52.102834 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.919119    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-145.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 14:22:52.102834 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.919131    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-145.ec2.internal" event="NodeHasSufficientPID"
Jul 06 14:22:52.102834 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.921316    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-145.ec2.internal"
Jul 06 14:22:52.102834 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.921338    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 14:22:52.102834 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.922039    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-145.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 14:22:52.102834 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.922060    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-145.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 14:22:52.102834 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.922069    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-145.ec2.internal" event="NodeHasSufficientPID"
Jul 06 14:22:52.102834 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:22:51.959239    2582 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-145.ec2.internal\" not found" node="ip-10-0-137-145.ec2.internal"
Jul 06 14:22:52.102834 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:22:51.965331    2582 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-145.ec2.internal\" not found" node="ip-10-0-137-145.ec2.internal"
Jul 06 14:22:52.102834 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.997361    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1b497cad55f7d3abf84dbe8f19ead2fb-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-145.ec2.internal\" (UID: \"1b497cad55f7d3abf84dbe8f19ead2fb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-145.ec2.internal"
Jul 06 14:22:52.102834 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.997398    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1b497cad55f7d3abf84dbe8f19ead2fb-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-145.ec2.internal\" (UID: \"1b497cad55f7d3abf84dbe8f19ead2fb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-145.ec2.internal"
Jul 06 14:22:52.102834 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:51.997427    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2683f4c10fa530ba79d25a7535e0e727-config\") pod \"kube-apiserver-proxy-ip-10-0-137-145.ec2.internal\" (UID: \"2683f4c10fa530ba79d25a7535e0e727\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-145.ec2.internal"
Jul 06 14:22:52.102834 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:22:52.006743    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-145.ec2.internal\" not found"
Jul 06 14:22:52.102834 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:52.097639    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1b497cad55f7d3abf84dbe8f19ead2fb-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-145.ec2.internal\" (UID: \"1b497cad55f7d3abf84dbe8f19ead2fb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-145.ec2.internal"
Jul 06 14:22:52.105897 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:52.097671    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1b497cad55f7d3abf84dbe8f19ead2fb-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-145.ec2.internal\" (UID: \"1b497cad55f7d3abf84dbe8f19ead2fb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-145.ec2.internal"
Jul 06 14:22:52.105897 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:52.097685    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2683f4c10fa530ba79d25a7535e0e727-config\") pod \"kube-apiserver-proxy-ip-10-0-137-145.ec2.internal\" (UID: \"2683f4c10fa530ba79d25a7535e0e727\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-145.ec2.internal"
Jul 06 14:22:52.105897 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:52.097746    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1b497cad55f7d3abf84dbe8f19ead2fb-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-145.ec2.internal\" (UID: \"1b497cad55f7d3abf84dbe8f19ead2fb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-145.ec2.internal"
Jul 06 14:22:52.105897 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:52.097797    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1b497cad55f7d3abf84dbe8f19ead2fb-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-145.ec2.internal\" (UID: \"1b497cad55f7d3abf84dbe8f19ead2fb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-145.ec2.internal"
Jul 06 14:22:52.105897 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:52.097826    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2683f4c10fa530ba79d25a7535e0e727-config\") pod \"kube-apiserver-proxy-ip-10-0-137-145.ec2.internal\" (UID: \"2683f4c10fa530ba79d25a7535e0e727\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-145.ec2.internal"
Jul 06 14:22:53.994228 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:22:53.786095    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-145.ec2.internal\" not found"
Jul 06 14:22:53.994228 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:22:53.886970    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-145.ec2.internal\" not found"
Jul 06 14:22:53.994228 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:53.940135    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-145.ec2.internal"
Jul 06 14:22:53.994228 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:53.946841    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-145.ec2.internal"
Jul 06 14:22:53.994228 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:22:53.987367    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-145.ec2.internal\" not found"
Jul 06 14:22:54.180326 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:22:54.087853    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-145.ec2.internal\" not found"
Jul 06 14:22:54.261514 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:22:54.188439    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-145.ec2.internal\" not found"
Jul 06 14:22:54.391117 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:22:54.288991    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-145.ec2.internal\" not found"
Jul 06 14:22:54.391117 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:54.317152    2582 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 06 14:22:54.391117 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:54.317309    2582 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 06 14:22:54.391117 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:54.364344    2582 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 14:22:54.391117 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:54.388034    2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-05 14:17:53 +0000 UTC" deadline="2027-12-08 04:13:57.994847999 +0000 UTC"
Jul 06 14:22:54.391117 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:54.388064    2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12469h51m3.606787021s"
Jul 06 14:22:54.391117 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:22:54.389108    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-145.ec2.internal\" not found"
Jul 06 14:22:54.492747 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:22:54.489772    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-145.ec2.internal\" not found"
Jul 06 14:22:54.596098 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:22:54.590083    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-145.ec2.internal\" not found"
Jul 06 14:22:54.596098 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:54.593870    2582 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 14:22:54.706044 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:22:54.690461    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-145.ec2.internal\" not found"
Jul 06 14:22:54.817971 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:54.745353    2582 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 14:22:54.817971 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:54.774524    2582 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-145.ec2.internal"
Jul 06 14:22:54.817971 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:54.789968    2582 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 06 14:22:54.817971 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:54.790682    2582 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-145.ec2.internal"
Jul 06 14:22:54.817971 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:54.802588    2582 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 06 14:22:55.303144 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:55.303095    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2683f4c10fa530ba79d25a7535e0e727.slice/crio-8919b226ed06d422db1e5608e89ae112fa38cd8eaaedad3003b1f60714d4062d WatchSource:0}: Error finding container 8919b226ed06d422db1e5608e89ae112fa38cd8eaaedad3003b1f60714d4062d: Status 404 returned error can't find the container with id 8919b226ed06d422db1e5608e89ae112fa38cd8eaaedad3003b1f60714d4062d
Jul 06 14:22:55.303619 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:55.303594    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b497cad55f7d3abf84dbe8f19ead2fb.slice/crio-6ffd39b4e95f1149fa905d35a52d6377ad8d22e9e2ba25e5a60250603764175a WatchSource:0}: Error finding container 6ffd39b4e95f1149fa905d35a52d6377ad8d22e9e2ba25e5a60250603764175a: Status 404 returned error can't find the container with id 6ffd39b4e95f1149fa905d35a52d6377ad8d22e9e2ba25e5a60250603764175a
Jul 06 14:22:55.307593 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.307535    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 14:22:55.354064 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.353997    2582 apiserver.go:52] "Watching apiserver"
Jul 06 14:22:55.361505 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.361480    2582 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 06 14:22:55.362905 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.362884    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-mbkvc","kube-system/kube-apiserver-proxy-ip-10-0-137-145.ec2.internal","openshift-image-registry/node-ca-k72tt","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-145.ec2.internal","openshift-network-diagnostics/network-check-target-gx87x","openshift-network-operator/iptables-alerter-mmhv2","kube-system/konnectivity-agent-8lp29","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sljnn","openshift-cluster-node-tuning-operator/tuned-r6hzx","openshift-dns/node-resolver-95qwv","openshift-multus/multus-additional-cni-plugins-p6g5d","openshift-multus/multus-spzdt","openshift-multus/network-metrics-daemon-mqgwp","openshift-ovn-kubernetes/ovnkube-node-54jfj"]
Jul 06 14:22:55.367067 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.366678    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-95qwv"
Jul 06 14:22:55.369094 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.369064    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mqgwp"
Jul 06 14:22:55.369196 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:22:55.369167    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mqgwp" podUID="537a943a-73f7-4e98-b74c-dde1d0ff1c92"
Jul 06 14:22:55.369271 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.369254    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 06 14:22:55.369330 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.369296    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 06 14:22:55.369414 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.369399    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-4666g\""
Jul 06 14:22:55.371337 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.371321    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-k72tt"
Jul 06 14:22:55.373496 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.373472    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-c5dqx\""
Jul 06 14:22:55.373937 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.373709    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 06 14:22:55.373937 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.373726    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-54jfj"
Jul 06 14:22:55.373937 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.373732    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 06 14:22:55.373937 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.373791    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 06 14:22:55.374971 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.374950    2582 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 06 14:22:55.375932 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.375914    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 06 14:22:55.376020 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.376003    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gx87x"
Jul 06 14:22:55.376081 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:22:55.376065    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gx87x" podUID="b81991eb-ee77-4c04-b880-a34d9419ca14"
Jul 06 14:22:55.376898 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.376876    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 06 14:22:55.376898 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.376886    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 06 14:22:55.377014 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.376994    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 06 14:22:55.377192 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.377175    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 06 14:22:55.377300 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.377179    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 06 14:22:55.377300 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.377182    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-gdv6c\""
Jul 06 14:22:55.378227 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.378211    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-mmhv2"
Jul 06 14:22:55.380402 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.380383    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 06 14:22:55.380912 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.380532    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-r6hzx"
Jul 06 14:22:55.380912 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.380586    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-xfqch\""
Jul 06 14:22:55.380912 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.380620    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 06 14:22:55.380912 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.380636    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 06 14:22:55.383058 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.383043    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-8lp29"
Jul 06 14:22:55.383275 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.383259    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 06 14:22:55.383474 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.383459    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5b575f5c-4bf8-432e-ac6b-76ee25681e8b-run-ovn\") pod \"ovnkube-node-54jfj\" (UID: \"5b575f5c-4bf8-432e-ac6b-76ee25681e8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-54jfj"
Jul 06 14:22:55.383474 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.383470    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 06 14:22:55.383615 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.383487    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxvqj\" (UniqueName: \"kubernetes.io/projected/19ce583c-bcbe-4393-ae34-afd29df988b7-kube-api-access-zxvqj\") pod \"node-ca-k72tt\" (UID: \"19ce583c-bcbe-4393-ae34-afd29df988b7\") " pod="openshift-image-registry/node-ca-k72tt"
Jul 06 14:22:55.383615 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.383524    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qx4zv\" (UniqueName: \"kubernetes.io/projected/5b575f5c-4bf8-432e-ac6b-76ee25681e8b-kube-api-access-qx4zv\") pod \"ovnkube-node-54jfj\" (UID: \"5b575f5c-4bf8-432e-ac6b-76ee25681e8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-54jfj"
Jul 06 14:22:55.383615 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.383549    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6vvx\" (UniqueName: \"kubernetes.io/projected/5554b54b-fec2-4059-9f42-845d87fc9961-kube-api-access-p6vvx\") pod \"node-resolver-95qwv\" (UID: \"5554b54b-fec2-4059-9f42-845d87fc9961\") " pod="openshift-dns/node-resolver-95qwv"
Jul 06 14:22:55.383615 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.383565    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5b575f5c-4bf8-432e-ac6b-76ee25681e8b-run-systemd\") pod \"ovnkube-node-54jfj\" (UID: \"5b575f5c-4bf8-432e-ac6b-76ee25681e8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-54jfj"
Jul 06 14:22:55.383824 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.383627    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5b575f5c-4bf8-432e-ac6b-76ee25681e8b-etc-openvswitch\") pod \"ovnkube-node-54jfj\" (UID: \"5b575f5c-4bf8-432e-ac6b-76ee25681e8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-54jfj"
Jul 06 14:22:55.383824 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.383668    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5b575f5c-4bf8-432e-ac6b-76ee25681e8b-log-socket\") pod \"ovnkube-node-54jfj\" (UID: \"5b575f5c-4bf8-432e-ac6b-76ee25681e8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-54jfj"
Jul 06 14:22:55.383824 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.383687    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5b575f5c-4bf8-432e-ac6b-76ee25681e8b-host-run-ovn-kubernetes\") pod \"ovnkube-node-54jfj\" (UID: \"5b575f5c-4bf8-432e-ac6b-76ee25681e8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-54jfj"
Jul 06 14:22:55.383824 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.383704    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5b575f5c-4bf8-432e-ac6b-76ee25681e8b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-54jfj\" (UID: \"5b575f5c-4bf8-432e-ac6b-76ee25681e8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-54jfj"
Jul 06 14:22:55.383824 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.383723    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5554b54b-fec2-4059-9f42-845d87fc9961-tmp-dir\") pod \"node-resolver-95qwv\" (UID: \"5554b54b-fec2-4059-9f42-845d87fc9961\") " pod="openshift-dns/node-resolver-95qwv"
Jul 06 14:22:55.383824 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.383742    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5b575f5c-4bf8-432e-ac6b-76ee25681e8b-host-run-netns\") pod \"ovnkube-node-54jfj\" (UID: \"5b575f5c-4bf8-432e-ac6b-76ee25681e8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-54jfj"
Jul 06 14:22:55.383824 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.383770    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-ss4mf\""
Jul 06 14:22:55.383824 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.383786    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5b575f5c-4bf8-432e-ac6b-76ee25681e8b-ovnkube-config\") pod \"ovnkube-node-54jfj\" (UID: \"5b575f5c-4bf8-432e-ac6b-76ee25681e8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-54jfj"
Jul 06 14:22:55.383824 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.383821    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5b575f5c-4bf8-432e-ac6b-76ee25681e8b-env-overrides\") pod \"ovnkube-node-54jfj\" (UID: \"5b575f5c-4bf8-432e-ac6b-76ee25681e8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-54jfj"
Jul 06 14:22:55.384255 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.383847    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mn4nx\" (UniqueName: \"kubernetes.io/projected/b81991eb-ee77-4c04-b880-a34d9419ca14-kube-api-access-mn4nx\") pod \"network-check-target-gx87x\" (UID: \"b81991eb-ee77-4c04-b880-a34d9419ca14\") " pod="openshift-network-diagnostics/network-check-target-gx87x"
Jul 06 14:22:55.384255 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.383887    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5b575f5c-4bf8-432e-ac6b-76ee25681e8b-host-cni-bin\") pod \"ovnkube-node-54jfj\" (UID: \"5b575f5c-4bf8-432e-ac6b-76ee25681e8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-54jfj"
Jul 06 14:22:55.384255 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.383911    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5b575f5c-4bf8-432e-ac6b-76ee25681e8b-host-cni-netd\") pod \"ovnkube-node-54jfj\" (UID: \"5b575f5c-4bf8-432e-ac6b-76ee25681e8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-54jfj"
Jul 06 14:22:55.384255 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.383954    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5b575f5c-4bf8-432e-ac6b-76ee25681e8b-host-slash\") pod \"ovnkube-node-54jfj\" (UID: \"5b575f5c-4bf8-432e-ac6b-76ee25681e8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-54jfj"
Jul 06 14:22:55.384255 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.383980    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/537a943a-73f7-4e98-b74c-dde1d0ff1c92-metrics-certs\") pod \"network-metrics-daemon-mqgwp\" (UID: \"537a943a-73f7-4e98-b74c-dde1d0ff1c92\") " pod="openshift-multus/network-metrics-daemon-mqgwp"
Jul 06 14:22:55.384255 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.384004    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8m9m\" (UniqueName: \"kubernetes.io/projected/537a943a-73f7-4e98-b74c-dde1d0ff1c92-kube-api-access-f8m9m\") pod \"network-metrics-daemon-mqgwp\" (UID: \"537a943a-73f7-4e98-b74c-dde1d0ff1c92\") " pod="openshift-multus/network-metrics-daemon-mqgwp"
Jul 06 14:22:55.384255 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.384054    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/19ce583c-bcbe-4393-ae34-afd29df988b7-host\") pod \"node-ca-k72tt\" (UID: \"19ce583c-bcbe-4393-ae34-afd29df988b7\") " pod="openshift-image-registry/node-ca-k72tt"
Jul 06 14:22:55.384255 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.384077    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5b575f5c-4bf8-432e-ac6b-76ee25681e8b-host-kubelet\") pod \"ovnkube-node-54jfj\" (UID: \"5b575f5c-4bf8-432e-ac6b-76ee25681e8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-54jfj"
Jul 06 14:22:55.384255 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.384099    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5554b54b-fec2-4059-9f42-845d87fc9961-hosts-file\") pod \"node-resolver-95qwv\" (UID: \"5554b54b-fec2-4059-9f42-845d87fc9961\") " pod="openshift-dns/node-resolver-95qwv"
Jul 06 14:22:55.384255 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.384123    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5b575f5c-4bf8-432e-ac6b-76ee25681e8b-systemd-units\") pod \"ovnkube-node-54jfj\" (UID: \"5b575f5c-4bf8-432e-ac6b-76ee25681e8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-54jfj"
Jul 06 14:22:55.384255 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.384158    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5b575f5c-4bf8-432e-ac6b-76ee25681e8b-var-lib-openvswitch\") pod \"ovnkube-node-54jfj\" (UID: \"5b575f5c-4bf8-432e-ac6b-76ee25681e8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-54jfj"
Jul 06 14:22:55.384255 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.384185    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5b575f5c-4bf8-432e-ac6b-76ee25681e8b-node-log\") pod \"ovnkube-node-54jfj\" (UID: \"5b575f5c-4bf8-432e-ac6b-76ee25681e8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-54jfj"
Jul 06 14:22:55.384255 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.384208    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5b575f5c-4bf8-432e-ac6b-76ee25681e8b-run-openvswitch\") pod \"ovnkube-node-54jfj\" (UID: \"5b575f5c-4bf8-432e-ac6b-76ee25681e8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-54jfj"
Jul 06 14:22:55.384255 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.384231    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5b575f5c-4bf8-432e-ac6b-76ee25681e8b-ovn-node-metrics-cert\") pod \"ovnkube-node-54jfj\" (UID: \"5b575f5c-4bf8-432e-ac6b-76ee25681e8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-54jfj"
Jul 06 14:22:55.384255 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.384254    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5b575f5c-4bf8-432e-ac6b-76ee25681e8b-ovnkube-script-lib\") pod \"ovnkube-node-54jfj\" (UID: \"5b575f5c-4bf8-432e-ac6b-76ee25681e8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-54jfj"
Jul 06 14:22:55.384714 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.384276    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/19ce583c-bcbe-4393-ae34-afd29df988b7-serviceca\") pod \"node-ca-k72tt\" (UID: \"19ce583c-bcbe-4393-ae34-afd29df988b7\") " pod="openshift-image-registry/node-ca-k72tt"
Jul 06 14:22:55.385393 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.385374    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sljnn"
Jul 06 14:22:55.385463 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.385396    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 06 14:22:55.385463 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.385429    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 06 14:22:55.385561 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.385431    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-2lvfv\""
Jul 06 14:22:55.387910 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.387722    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-5h7tq\""
Jul 06 14:22:55.387910 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.387763    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 06 14:22:55.387910 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.387813    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mbkvc"
Jul 06 14:22:55.387910 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:22:55.387876    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mbkvc" podUID="201f4c6e-b9d8-4a99-9f4e-b8f59e69ad1d"
Jul 06 14:22:55.388120 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.387936    2582 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 06 14:22:55.388120 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.387997    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 06 14:22:55.388320 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.388302    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 06 14:22:55.390152 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.390136    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-p6g5d"
Jul 06 14:22:55.392325 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.392309    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 06 14:22:55.393459 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.392413    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-spzdt"
Jul 06 14:22:55.393459 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.392488    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-4gfqs\""
Jul 06 14:22:55.393459 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.392903    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 06 14:22:55.393459 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.392909    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 06 14:22:55.393459 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.393135    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 06 14:22:55.393459 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.393275    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 06 14:22:55.395813 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.395780    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-f7qzc\""
Jul 06 14:22:55.395907 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.395826    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 06 14:22:55.412092 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.412066    2582 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-wnqgr"
Jul 06 14:22:55.419553 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.419536    2582 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-wnqgr"
Jul 06 14:22:55.475843 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.475808    2582 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 06 14:22:55.484882 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.484856    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/68e9b176-5e66-41aa-8bf1-23e7b897c9a9-etc-modprobe-d\") pod \"tuned-r6hzx\" (UID: \"68e9b176-5e66-41aa-8bf1-23e7b897c9a9\") " pod="openshift-cluster-node-tuning-operator/tuned-r6hzx"
Jul 06 14:22:55.484998 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.484887    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/68e9b176-5e66-41aa-8bf1-23e7b897c9a9-etc-systemd\") pod \"tuned-r6hzx\" (UID: \"68e9b176-5e66-41aa-8bf1-23e7b897c9a9\") " pod="openshift-cluster-node-tuning-operator/tuned-r6hzx"
Jul 06 14:22:55.484998 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.484907    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/98121467-ea9e-4fdc-b195-85e95b837664-os-release\") pod \"multus-additional-cni-plugins-p6g5d\" (UID: \"98121467-ea9e-4fdc-b195-85e95b837664\") " pod="openshift-multus/multus-additional-cni-plugins-p6g5d"
Jul 06 14:22:55.484998 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.484923    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/98121467-ea9e-4fdc-b195-85e95b837664-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-p6g5d\" (UID: \"98121467-ea9e-4fdc-b195-85e95b837664\") " pod="openshift-multus/multus-additional-cni-plugins-p6g5d"
Jul 06 14:22:55.484998 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.484959    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/98121467-ea9e-4fdc-b195-85e95b837664-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-p6g5d\" (UID: \"98121467-ea9e-4fdc-b195-85e95b837664\") " pod="openshift-multus/multus-additional-cni-plugins-p6g5d"
Jul 06 14:22:55.484998 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.484994    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e7dc5ff4-a8fa-47de-a132-62d7e733a751-system-cni-dir\") pod \"multus-spzdt\" (UID: \"e7dc5ff4-a8fa-47de-a132-62d7e733a751\") " pod="openshift-multus/multus-spzdt"
Jul 06 14:22:55.485158 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.485017    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/68e9b176-5e66-41aa-8bf1-23e7b897c9a9-run\") pod \"tuned-r6hzx\" (UID: \"68e9b176-5e66-41aa-8bf1-23e7b897c9a9\") " pod="openshift-cluster-node-tuning-operator/tuned-r6hzx"
Jul 06 14:22:55.485158 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.485034    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjk9d\" (UniqueName: \"kubernetes.io/projected/68e9b176-5e66-41aa-8bf1-23e7b897c9a9-kube-api-access-xjk9d\") pod \"tuned-r6hzx\" (UID: \"68e9b176-5e66-41aa-8bf1-23e7b897c9a9\") " pod="openshift-cluster-node-tuning-operator/tuned-r6hzx"
Jul 06 14:22:55.485158 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.485049    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/aa9ce18d-f18b-4966-963d-dc7068bd5c8c-iptables-alerter-script\") pod \"iptables-alerter-mmhv2\" (UID: \"aa9ce18d-f18b-4966-963d-dc7068bd5c8c\") " pod="openshift-network-operator/iptables-alerter-mmhv2"
Jul 06 14:22:55.485158 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.485066    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e7dc5ff4-a8fa-47de-a132-62d7e733a751-cni-binary-copy\") pod \"multus-spzdt\" (UID: \"e7dc5ff4-a8fa-47de-a132-62d7e733a751\") " pod="openshift-multus/multus-spzdt"
Jul 06 14:22:55.485158 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.485095    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6vvx\" (UniqueName: \"kubernetes.io/projected/5554b54b-fec2-4059-9f42-845d87fc9961-kube-api-access-p6vvx\") pod \"node-resolver-95qwv\" (UID: \"5554b54b-fec2-4059-9f42-845d87fc9961\") " pod="openshift-dns/node-resolver-95qwv"
Jul 06 14:22:55.485295 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.485160    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5b575f5c-4bf8-432e-ac6b-76ee25681e8b-run-systemd\") pod \"ovnkube-node-54jfj\" (UID: \"5b575f5c-4bf8-432e-ac6b-76ee25681e8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-54jfj"
Jul 06 14:22:55.485295 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.485260    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5b575f5c-4bf8-432e-ac6b-76ee25681e8b-run-systemd\") pod \"ovnkube-node-54jfj\" (UID: \"5b575f5c-4bf8-432e-ac6b-76ee25681e8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-54jfj"
Jul 06 14:22:55.485295 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.485275    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5b575f5c-4bf8-432e-ac6b-76ee25681e8b-host-run-ovn-kubernetes\") pod \"ovnkube-node-54jfj\" (UID: \"5b575f5c-4bf8-432e-ac6b-76ee25681e8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-54jfj"
Jul 06 14:22:55.485384 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.485306    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ee1bac90-b7e7-41b0-a7e0-b804e6fafdef-agent-certs\") pod \"konnectivity-agent-8lp29\" (UID: \"ee1bac90-b7e7-41b0-a7e0-b804e6fafdef\") " pod="kube-system/konnectivity-agent-8lp29"
Jul 06 14:22:55.485384 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.485334    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/201f4c6e-b9d8-4a99-9f4e-b8f59e69ad1d-kubelet-config\") pod \"global-pull-secret-syncer-mbkvc\" (UID: \"201f4c6e-b9d8-4a99-9f4e-b8f59e69ad1d\") " pod="kube-system/global-pull-secret-syncer-mbkvc"
Jul 06 14:22:55.485384 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.485358    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5b575f5c-4bf8-432e-ac6b-76ee25681e8b-host-run-ovn-kubernetes\") pod \"ovnkube-node-54jfj\" (UID: \"5b575f5c-4bf8-432e-ac6b-76ee25681e8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-54jfj"
Jul 06 14:22:55.485384 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.485360    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5b575f5c-4bf8-432e-ac6b-76ee25681e8b-env-overrides\") pod \"ovnkube-node-54jfj\" (UID: \"5b575f5c-4bf8-432e-ac6b-76ee25681e8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-54jfj"
Jul 06 14:22:55.485496 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.485391    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/68e9b176-5e66-41aa-8bf1-23e7b897c9a9-sys\") pod \"tuned-r6hzx\" (UID: \"68e9b176-5e66-41aa-8bf1-23e7b897c9a9\") " pod="openshift-cluster-node-tuning-operator/tuned-r6hzx"
Jul 06 14:22:55.485496 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.485431    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mn4nx\" (UniqueName: \"kubernetes.io/projected/b81991eb-ee77-4c04-b880-a34d9419ca14-kube-api-access-mn4nx\") pod \"network-check-target-gx87x\" (UID: \"b81991eb-ee77-4c04-b880-a34d9419ca14\") " pod="openshift-network-diagnostics/network-check-target-gx87x"
Jul 06 14:22:55.485496 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.485461    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wfw9d\" (UniqueName: \"kubernetes.io/projected/98121467-ea9e-4fdc-b195-85e95b837664-kube-api-access-wfw9d\") pod \"multus-additional-cni-plugins-p6g5d\" (UID: \"98121467-ea9e-4fdc-b195-85e95b837664\") " pod="openshift-multus/multus-additional-cni-plugins-p6g5d"
Jul 06 14:22:55.485496 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.485478    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e7dc5ff4-a8fa-47de-a132-62d7e733a751-multus-daemon-config\") pod \"multus-spzdt\" (UID: \"e7dc5ff4-a8fa-47de-a132-62d7e733a751\") " pod="openshift-multus/multus-spzdt"
Jul 06 14:22:55.485613 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.485504    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/68e9b176-5e66-41aa-8bf1-23e7b897c9a9-etc-kubernetes\") pod \"tuned-r6hzx\" (UID: \"68e9b176-5e66-41aa-8bf1-23e7b897c9a9\") " pod="openshift-cluster-node-tuning-operator/tuned-r6hzx"
Jul 06 14:22:55.485613 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.485521    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/68e9b176-5e66-41aa-8bf1-23e7b897c9a9-etc-tuned\") pod \"tuned-r6hzx\" (UID: \"68e9b176-5e66-41aa-8bf1-23e7b897c9a9\") " pod="openshift-cluster-node-tuning-operator/tuned-r6hzx"
Jul 06 14:22:55.485613 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.485536    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/201f4c6e-b9d8-4a99-9f4e-b8f59e69ad1d-dbus\") pod \"global-pull-secret-syncer-mbkvc\" (UID: \"201f4c6e-b9d8-4a99-9f4e-b8f59e69ad1d\") " pod="kube-system/global-pull-secret-syncer-mbkvc"
Jul 06 14:22:55.485613 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.485552    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5b575f5c-4bf8-432e-ac6b-76ee25681e8b-run-openvswitch\") pod \"ovnkube-node-54jfj\" (UID: \"5b575f5c-4bf8-432e-ac6b-76ee25681e8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-54jfj"
Jul 06 14:22:55.485613 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.485572    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5b575f5c-4bf8-432e-ac6b-76ee25681e8b-ovnkube-script-lib\") pod \"ovnkube-node-54jfj\" (UID: \"5b575f5c-4bf8-432e-ac6b-76ee25681e8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-54jfj"
Jul 06 14:22:55.485613 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.485607    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5b575f5c-4bf8-432e-ac6b-76ee25681e8b-host-cni-bin\") pod \"ovnkube-node-54jfj\" (UID: \"5b575f5c-4bf8-432e-ac6b-76ee25681e8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-54jfj"
Jul 06 14:22:55.485901 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.485621    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5b575f5c-4bf8-432e-ac6b-76ee25681e8b-run-openvswitch\") pod \"ovnkube-node-54jfj\" (UID: \"5b575f5c-4bf8-432e-ac6b-76ee25681e8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-54jfj"
Jul 06 14:22:55.485901 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.485685    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5b575f5c-4bf8-432e-ac6b-76ee25681e8b-host-cni-netd\") pod \"ovnkube-node-54jfj\" (UID: \"5b575f5c-4bf8-432e-ac6b-76ee25681e8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-54jfj"
Jul 06 14:22:55.485901 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.485698    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5b575f5c-4bf8-432e-ac6b-76ee25681e8b-host-cni-bin\") pod \"ovnkube-node-54jfj\" (UID: \"5b575f5c-4bf8-432e-ac6b-76ee25681e8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-54jfj"
Jul 06 14:22:55.485901 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.485735    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5b575f5c-4bf8-432e-ac6b-76ee25681e8b-host-slash\") pod \"ovnkube-node-54jfj\" (UID: \"5b575f5c-4bf8-432e-ac6b-76ee25681e8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-54jfj"
Jul 06 14:22:55.485901 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.485751    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/19ce583c-bcbe-4393-ae34-afd29df988b7-host\") pod \"node-ca-k72tt\" (UID: \"19ce583c-bcbe-4393-ae34-afd29df988b7\") " pod="openshift-image-registry/node-ca-k72tt"
Jul 06 14:22:55.485901 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.485793    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5b575f5c-4bf8-432e-ac6b-76ee25681e8b-host-kubelet\") pod \"ovnkube-node-54jfj\" (UID: \"5b575f5c-4bf8-432e-ac6b-76ee25681e8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-54jfj"
Jul 06 14:22:55.485901 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.485797    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/19ce583c-bcbe-4393-ae34-afd29df988b7-host\") pod \"node-ca-k72tt\" (UID: \"19ce583c-bcbe-4393-ae34-afd29df988b7\") " pod="openshift-image-registry/node-ca-k72tt"
Jul 06 14:22:55.485901 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.485812    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5b575f5c-4bf8-432e-ac6b-76ee25681e8b-host-cni-netd\") pod \"ovnkube-node-54jfj\" (UID: \"5b575f5c-4bf8-432e-ac6b-76ee25681e8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-54jfj"
Jul 06 14:22:55.485901 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.485823    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5b575f5c-4bf8-432e-ac6b-76ee25681e8b-host-slash\") pod \"ovnkube-node-54jfj\" (UID: \"5b575f5c-4bf8-432e-ac6b-76ee25681e8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-54jfj"
Jul 06 14:22:55.485901 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.485848    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e7dc5ff4-a8fa-47de-a132-62d7e733a751-hostroot\") pod \"multus-spzdt\" (UID: \"e7dc5ff4-a8fa-47de-a132-62d7e733a751\") " pod="openshift-multus/multus-spzdt"
Jul 06 14:22:55.485901 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.485847    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5b575f5c-4bf8-432e-ac6b-76ee25681e8b-env-overrides\") pod \"ovnkube-node-54jfj\" (UID: \"5b575f5c-4bf8-432e-ac6b-76ee25681e8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-54jfj"
Jul 06 14:22:55.485901 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.485858    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5b575f5c-4bf8-432e-ac6b-76ee25681e8b-host-kubelet\") pod \"ovnkube-node-54jfj\" (UID: \"5b575f5c-4bf8-432e-ac6b-76ee25681e8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-54jfj"
Jul 06 14:22:55.485901 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.485892    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5b575f5c-4bf8-432e-ac6b-76ee25681e8b-systemd-units\") pod \"ovnkube-node-54jfj\" (UID: \"5b575f5c-4bf8-432e-ac6b-76ee25681e8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-54jfj"
Jul 06 14:22:55.486556 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.485915    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5b575f5c-4bf8-432e-ac6b-76ee25681e8b-var-lib-openvswitch\") pod \"ovnkube-node-54jfj\" (UID: \"5b575f5c-4bf8-432e-ac6b-76ee25681e8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-54jfj"
Jul 06 14:22:55.486556 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.485934    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5b575f5c-4bf8-432e-ac6b-76ee25681e8b-systemd-units\") pod \"ovnkube-node-54jfj\" (UID: \"5b575f5c-4bf8-432e-ac6b-76ee25681e8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-54jfj"
Jul 06 14:22:55.486556 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.485941    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/68e9b176-5e66-41aa-8bf1-23e7b897c9a9-var-lib-kubelet\") pod \"tuned-r6hzx\" (UID: \"68e9b176-5e66-41aa-8bf1-23e7b897c9a9\") " pod="openshift-cluster-node-tuning-operator/tuned-r6hzx"
Jul 06 14:22:55.486556 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.485975    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5b575f5c-4bf8-432e-ac6b-76ee25681e8b-var-lib-openvswitch\") pod \"ovnkube-node-54jfj\" (UID: \"5b575f5c-4bf8-432e-ac6b-76ee25681e8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-54jfj"
Jul 06 14:22:55.486556 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.485988    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/201f4c6e-b9d8-4a99-9f4e-b8f59e69ad1d-original-pull-secret\") pod \"global-pull-secret-syncer-mbkvc\" (UID: \"201f4c6e-b9d8-4a99-9f4e-b8f59e69ad1d\") " pod="kube-system/global-pull-secret-syncer-mbkvc"
Jul 06 14:22:55.486556 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.486013    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/19ce583c-bcbe-4393-ae34-afd29df988b7-serviceca\") pod \"node-ca-k72tt\" (UID: \"19ce583c-bcbe-4393-ae34-afd29df988b7\") " pod="openshift-image-registry/node-ca-k72tt"
Jul 06 14:22:55.486556 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.486030    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6105b3e2-89cf-49fb-af7f-654444a16b6a-sys-fs\") pod \"aws-ebs-csi-driver-node-sljnn\" (UID: \"6105b3e2-89cf-49fb-af7f-654444a16b6a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sljnn"
Jul 06 14:22:55.486556 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.486053    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e7dc5ff4-a8fa-47de-a132-62d7e733a751-cnibin\") pod \"multus-spzdt\" (UID: \"e7dc5ff4-a8fa-47de-a132-62d7e733a751\") " pod="openshift-multus/multus-spzdt"
Jul 06 14:22:55.486556 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.486099    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/68e9b176-5e66-41aa-8bf1-23e7b897c9a9-etc-sysctl-conf\") pod \"tuned-r6hzx\" (UID: \"68e9b176-5e66-41aa-8bf1-23e7b897c9a9\") " pod="openshift-cluster-node-tuning-operator/tuned-r6hzx"
Jul 06 14:22:55.486556 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.486123    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/98121467-ea9e-4fdc-b195-85e95b837664-system-cni-dir\") pod \"multus-additional-cni-plugins-p6g5d\" (UID: \"98121467-ea9e-4fdc-b195-85e95b837664\") " pod="openshift-multus/multus-additional-cni-plugins-p6g5d"
Jul 06 14:22:55.486556 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.486149    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e7dc5ff4-a8fa-47de-a132-62d7e733a751-os-release\") pod \"multus-spzdt\" (UID: \"e7dc5ff4-a8fa-47de-a132-62d7e733a751\") " pod="openshift-multus/multus-spzdt"
Jul 06 14:22:55.486556 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.486169    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e7dc5ff4-a8fa-47de-a132-62d7e733a751-host-run-multus-certs\") pod \"multus-spzdt\" (UID: \"e7dc5ff4-a8fa-47de-a132-62d7e733a751\") " pod="openshift-multus/multus-spzdt"
Jul 06 14:22:55.486556 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.486188    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e7dc5ff4-a8fa-47de-a132-62d7e733a751-etc-kubernetes\") pod \"multus-spzdt\" (UID: \"e7dc5ff4-a8fa-47de-a132-62d7e733a751\") " pod="openshift-multus/multus-spzdt"
Jul 06 14:22:55.486556 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.486196    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5b575f5c-4bf8-432e-ac6b-76ee25681e8b-ovnkube-script-lib\") pod \"ovnkube-node-54jfj\" (UID: \"5b575f5c-4bf8-432e-ac6b-76ee25681e8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-54jfj"
Jul 06 14:22:55.486556 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.486205    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8gscr\" (UniqueName: \"kubernetes.io/projected/e7dc5ff4-a8fa-47de-a132-62d7e733a751-kube-api-access-8gscr\") pod \"multus-spzdt\" (UID: \"e7dc5ff4-a8fa-47de-a132-62d7e733a751\") " pod="openshift-multus/multus-spzdt"
Jul 06 14:22:55.486556 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.486256    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/68e9b176-5e66-41aa-8bf1-23e7b897c9a9-etc-sysctl-d\") pod \"tuned-r6hzx\" (UID: \"68e9b176-5e66-41aa-8bf1-23e7b897c9a9\") " pod="openshift-cluster-node-tuning-operator/tuned-r6hzx"
Jul 06 14:22:55.486556 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.486286    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/68e9b176-5e66-41aa-8bf1-23e7b897c9a9-tmp\") pod \"tuned-r6hzx\" (UID: \"68e9b176-5e66-41aa-8bf1-23e7b897c9a9\") " pod="openshift-cluster-node-tuning-operator/tuned-r6hzx"
Jul 06 14:22:55.487247 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.486314    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5b575f5c-4bf8-432e-ac6b-76ee25681e8b-run-ovn\") pod \"ovnkube-node-54jfj\" (UID: \"5b575f5c-4bf8-432e-ac6b-76ee25681e8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-54jfj"
Jul 06 14:22:55.487247 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.486332    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/19ce583c-bcbe-4393-ae34-afd29df988b7-serviceca\") pod \"node-ca-k72tt\" (UID: \"19ce583c-bcbe-4393-ae34-afd29df988b7\") " pod="openshift-image-registry/node-ca-k72tt"
Jul 06 14:22:55.487247 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.486337    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxvqj\" (UniqueName: \"kubernetes.io/projected/19ce583c-bcbe-4393-ae34-afd29df988b7-kube-api-access-zxvqj\") pod \"node-ca-k72tt\" (UID: \"19ce583c-bcbe-4393-ae34-afd29df988b7\") " pod="openshift-image-registry/node-ca-k72tt"
Jul 06 14:22:55.487247 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.486368    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qx4zv\" (UniqueName: \"kubernetes.io/projected/5b575f5c-4bf8-432e-ac6b-76ee25681e8b-kube-api-access-qx4zv\") pod \"ovnkube-node-54jfj\" (UID: \"5b575f5c-4bf8-432e-ac6b-76ee25681e8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-54jfj"
Jul 06 14:22:55.487247 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.486426    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e7dc5ff4-a8fa-47de-a132-62d7e733a751-multus-socket-dir-parent\") pod \"multus-spzdt\" (UID: \"e7dc5ff4-a8fa-47de-a132-62d7e733a751\") " pod="openshift-multus/multus-spzdt"
Jul 06 14:22:55.487247 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.486454    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5b575f5c-4bf8-432e-ac6b-76ee25681e8b-run-ovn\") pod \"ovnkube-node-54jfj\" (UID: \"5b575f5c-4bf8-432e-ac6b-76ee25681e8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-54jfj"
Jul 06 14:22:55.487247 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.486494    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e7dc5ff4-a8fa-47de-a132-62d7e733a751-host-var-lib-cni-multus\") pod \"multus-spzdt\" (UID: \"e7dc5ff4-a8fa-47de-a132-62d7e733a751\") " pod="openshift-multus/multus-spzdt"
Jul 06 14:22:55.487247 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.486525    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5b575f5c-4bf8-432e-ac6b-76ee25681e8b-etc-openvswitch\") pod \"ovnkube-node-54jfj\" (UID: \"5b575f5c-4bf8-432e-ac6b-76ee25681e8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-54jfj"
Jul 06 14:22:55.487247 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.486547    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5b575f5c-4bf8-432e-ac6b-76ee25681e8b-log-socket\") pod \"ovnkube-node-54jfj\" (UID: \"5b575f5c-4bf8-432e-ac6b-76ee25681e8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-54jfj"
Jul 06 14:22:55.487247 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.486572    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5b575f5c-4bf8-432e-ac6b-76ee25681e8b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-54jfj\" (UID: \"5b575f5c-4bf8-432e-ac6b-76ee25681e8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-54jfj"
Jul 06 14:22:55.487247 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.486577    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5b575f5c-4bf8-432e-ac6b-76ee25681e8b-etc-openvswitch\") pod \"ovnkube-node-54jfj\" (UID: \"5b575f5c-4bf8-432e-ac6b-76ee25681e8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-54jfj"
Jul 06 14:22:55.487247 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.486597    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/98121467-ea9e-4fdc-b195-85e95b837664-cni-binary-copy\") pod \"multus-additional-cni-plugins-p6g5d\" (UID: \"98121467-ea9e-4fdc-b195-85e95b837664\") " pod="openshift-multus/multus-additional-cni-plugins-p6g5d"
Jul 06 14:22:55.487247 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.486607    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5b575f5c-4bf8-432e-ac6b-76ee25681e8b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-54jfj\" (UID: \"5b575f5c-4bf8-432e-ac6b-76ee25681e8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-54jfj"
Jul 06 14:22:55.487247 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.486607    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5b575f5c-4bf8-432e-ac6b-76ee25681e8b-log-socket\") pod \"ovnkube-node-54jfj\" (UID: \"5b575f5c-4bf8-432e-ac6b-76ee25681e8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-54jfj"
Jul 06 14:22:55.487247 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.486620    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/aa9ce18d-f18b-4966-963d-dc7068bd5c8c-host-slash\") pod \"iptables-alerter-mmhv2\" (UID: \"aa9ce18d-f18b-4966-963d-dc7068bd5c8c\") " pod="openshift-network-operator/iptables-alerter-mmhv2"
Jul 06 14:22:55.487247 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.486644    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5554b54b-fec2-4059-9f42-845d87fc9961-tmp-dir\") pod \"node-resolver-95qwv\" (UID: \"5554b54b-fec2-4059-9f42-845d87fc9961\") " pod="openshift-dns/node-resolver-95qwv"
Jul 06 14:22:55.487247 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.486691    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5b575f5c-4bf8-432e-ac6b-76ee25681e8b-host-run-netns\") pod \"ovnkube-node-54jfj\" (UID: \"5b575f5c-4bf8-432e-ac6b-76ee25681e8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-54jfj"
Jul 06 14:22:55.487812 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.486716    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5b575f5c-4bf8-432e-ac6b-76ee25681e8b-ovnkube-config\") pod \"ovnkube-node-54jfj\" (UID: \"5b575f5c-4bf8-432e-ac6b-76ee25681e8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-54jfj"
Jul 06 14:22:55.487812 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.486746    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5b575f5c-4bf8-432e-ac6b-76ee25681e8b-host-run-netns\") pod \"ovnkube-node-54jfj\" (UID: \"5b575f5c-4bf8-432e-ac6b-76ee25681e8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-54jfj"
Jul 06 14:22:55.487812 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.486748    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6105b3e2-89cf-49fb-af7f-654444a16b6a-socket-dir\") pod \"aws-ebs-csi-driver-node-sljnn\" (UID: \"6105b3e2-89cf-49fb-af7f-654444a16b6a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sljnn"
Jul 06 14:22:55.487812 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.486776    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6105b3e2-89cf-49fb-af7f-654444a16b6a-registration-dir\") pod \"aws-ebs-csi-driver-node-sljnn\" (UID: \"6105b3e2-89cf-49fb-af7f-654444a16b6a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sljnn"
Jul 06 14:22:55.487812 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.486793    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7ttd\" (UniqueName: \"kubernetes.io/projected/6105b3e2-89cf-49fb-af7f-654444a16b6a-kube-api-access-j7ttd\") pod \"aws-ebs-csi-driver-node-sljnn\" (UID: \"6105b3e2-89cf-49fb-af7f-654444a16b6a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sljnn"
Jul 06 14:22:55.487812 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.486808    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e7dc5ff4-a8fa-47de-a132-62d7e733a751-multus-cni-dir\") pod \"multus-spzdt\" (UID: \"e7dc5ff4-a8fa-47de-a132-62d7e733a751\") " pod="openshift-multus/multus-spzdt"
Jul 06 14:22:55.487812 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.486825    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/98121467-ea9e-4fdc-b195-85e95b837664-cnibin\") pod \"multus-additional-cni-plugins-p6g5d\" (UID: \"98121467-ea9e-4fdc-b195-85e95b837664\") " pod="openshift-multus/multus-additional-cni-plugins-p6g5d"
Jul 06 14:22:55.487812 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.486870    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/98121467-ea9e-4fdc-b195-85e95b837664-tuning-conf-dir\") pod \"multus-additional-cni-plugins-p6g5d\" (UID: \"98121467-ea9e-4fdc-b195-85e95b837664\") " pod="openshift-multus/multus-additional-cni-plugins-p6g5d"
Jul 06 14:22:55.487812 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.486886    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e7dc5ff4-a8fa-47de-a132-62d7e733a751-host-run-k8s-cni-cncf-io\") pod \"multus-spzdt\" (UID: \"e7dc5ff4-a8fa-47de-a132-62d7e733a751\") " pod="openshift-multus/multus-spzdt"
Jul 06 14:22:55.487812 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.486905    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e7dc5ff4-a8fa-47de-a132-62d7e733a751-multus-conf-dir\") pod \"multus-spzdt\" (UID: \"e7dc5ff4-a8fa-47de-a132-62d7e733a751\") " pod="openshift-multus/multus-spzdt"
Jul 06 14:22:55.487812 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.486929    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5554b54b-fec2-4059-9f42-845d87fc9961-tmp-dir\") pod \"node-resolver-95qwv\" (UID: \"5554b54b-fec2-4059-9f42-845d87fc9961\") " pod="openshift-dns/node-resolver-95qwv"
Jul 06 14:22:55.487812 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.486941    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/68e9b176-5e66-41aa-8bf1-23e7b897c9a9-etc-sysconfig\") pod \"tuned-r6hzx\" (UID: \"68e9b176-5e66-41aa-8bf1-23e7b897c9a9\") " pod="openshift-cluster-node-tuning-operator/tuned-r6hzx"
Jul 06 14:22:55.487812 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.486961    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5b575f5c-4bf8-432e-ac6b-76ee25681e8b-ovn-node-metrics-cert\") pod \"ovnkube-node-54jfj\" (UID: \"5b575f5c-4bf8-432e-ac6b-76ee25681e8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-54jfj"
Jul 06 14:22:55.487812 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.486975    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6105b3e2-89cf-49fb-af7f-654444a16b6a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-sljnn\" (UID: \"6105b3e2-89cf-49fb-af7f-654444a16b6a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sljnn"
Jul 06 14:22:55.487812 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.487005    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e7dc5ff4-a8fa-47de-a132-62d7e733a751-host-var-lib-cni-bin\") pod \"multus-spzdt\" (UID: \"e7dc5ff4-a8fa-47de-a132-62d7e733a751\") " pod="openshift-multus/multus-spzdt"
Jul 06 14:22:55.487812 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.487037    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/537a943a-73f7-4e98-b74c-dde1d0ff1c92-metrics-certs\") pod \"network-metrics-daemon-mqgwp\" (UID: \"537a943a-73f7-4e98-b74c-dde1d0ff1c92\") " pod="openshift-multus/network-metrics-daemon-mqgwp"
Jul 06 14:22:55.488257 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.487063    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8m9m\" (UniqueName: \"kubernetes.io/projected/537a943a-73f7-4e98-b74c-dde1d0ff1c92-kube-api-access-f8m9m\") pod \"network-metrics-daemon-mqgwp\" (UID: \"537a943a-73f7-4e98-b74c-dde1d0ff1c92\") " pod="openshift-multus/network-metrics-daemon-mqgwp"
Jul 06 14:22:55.488257 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.487088    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5554b54b-fec2-4059-9f42-845d87fc9961-hosts-file\") pod \"node-resolver-95qwv\" (UID: \"5554b54b-fec2-4059-9f42-845d87fc9961\") " pod="openshift-dns/node-resolver-95qwv"
Jul 06 14:22:55.488257 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.487111    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5b575f5c-4bf8-432e-ac6b-76ee25681e8b-node-log\") pod \"ovnkube-node-54jfj\" (UID: \"5b575f5c-4bf8-432e-ac6b-76ee25681e8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-54jfj"
Jul 06 14:22:55.488257 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.487135    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6105b3e2-89cf-49fb-af7f-654444a16b6a-etc-selinux\") pod \"aws-ebs-csi-driver-node-sljnn\" (UID: \"6105b3e2-89cf-49fb-af7f-654444a16b6a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sljnn"
Jul 06 14:22:55.488257 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.487160    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e7dc5ff4-a8fa-47de-a132-62d7e733a751-host-run-netns\") pod \"multus-spzdt\" (UID: \"e7dc5ff4-a8fa-47de-a132-62d7e733a751\") " pod="openshift-multus/multus-spzdt"
Jul 06 14:22:55.488257 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:22:55.487165    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 14:22:55.488257 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.487175    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5b575f5c-4bf8-432e-ac6b-76ee25681e8b-ovnkube-config\") pod \"ovnkube-node-54jfj\" (UID: \"5b575f5c-4bf8-432e-ac6b-76ee25681e8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-54jfj"
Jul 06 14:22:55.488257 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.487198    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/68e9b176-5e66-41aa-8bf1-23e7b897c9a9-lib-modules\") pod \"tuned-r6hzx\" (UID: \"68e9b176-5e66-41aa-8bf1-23e7b897c9a9\") " pod="openshift-cluster-node-tuning-operator/tuned-r6hzx"
Jul 06 14:22:55.488257 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.487203    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5b575f5c-4bf8-432e-ac6b-76ee25681e8b-node-log\") pod \"ovnkube-node-54jfj\" (UID: \"5b575f5c-4bf8-432e-ac6b-76ee25681e8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-54jfj"
Jul 06 14:22:55.488257 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.487250    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/68e9b176-5e66-41aa-8bf1-23e7b897c9a9-host\") pod \"tuned-r6hzx\" (UID: \"68e9b176-5e66-41aa-8bf1-23e7b897c9a9\") " pod="openshift-cluster-node-tuning-operator/tuned-r6hzx"
Jul 06 14:22:55.488257 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:22:55.487285    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/537a943a-73f7-4e98-b74c-dde1d0ff1c92-metrics-certs podName:537a943a-73f7-4e98-b74c-dde1d0ff1c92 nodeName:}" failed. No retries permitted until 2026-07-06 14:22:55.987265669 +0000 UTC m=+2.907546080 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/537a943a-73f7-4e98-b74c-dde1d0ff1c92-metrics-certs") pod "network-metrics-daemon-mqgwp" (UID: "537a943a-73f7-4e98-b74c-dde1d0ff1c92") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 14:22:55.488257 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.487292    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5554b54b-fec2-4059-9f42-845d87fc9961-hosts-file\") pod \"node-resolver-95qwv\" (UID: \"5554b54b-fec2-4059-9f42-845d87fc9961\") " pod="openshift-dns/node-resolver-95qwv"
Jul 06 14:22:55.488257 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.487274    2582 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 06 14:22:55.488257 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.487309    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ee1bac90-b7e7-41b0-a7e0-b804e6fafdef-konnectivity-ca\") pod \"konnectivity-agent-8lp29\" (UID: \"ee1bac90-b7e7-41b0-a7e0-b804e6fafdef\") " pod="kube-system/konnectivity-agent-8lp29"
Jul 06 14:22:55.488257 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.487393    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2n5r\" (UniqueName: \"kubernetes.io/projected/aa9ce18d-f18b-4966-963d-dc7068bd5c8c-kube-api-access-v2n5r\") pod \"iptables-alerter-mmhv2\" (UID: \"aa9ce18d-f18b-4966-963d-dc7068bd5c8c\") " pod="openshift-network-operator/iptables-alerter-mmhv2"
Jul 06 14:22:55.488257 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.487415    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6105b3e2-89cf-49fb-af7f-654444a16b6a-device-dir\") pod \"aws-ebs-csi-driver-node-sljnn\" (UID: \"6105b3e2-89cf-49fb-af7f-654444a16b6a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sljnn"
Jul 06 14:22:55.488257 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.487436    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e7dc5ff4-a8fa-47de-a132-62d7e733a751-host-var-lib-kubelet\") pod \"multus-spzdt\" (UID: \"e7dc5ff4-a8fa-47de-a132-62d7e733a751\") " pod="openshift-multus/multus-spzdt"
Jul 06 14:22:55.490373 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.490358    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5b575f5c-4bf8-432e-ac6b-76ee25681e8b-ovn-node-metrics-cert\") pod \"ovnkube-node-54jfj\" (UID: \"5b575f5c-4bf8-432e-ac6b-76ee25681e8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-54jfj"
Jul 06 14:22:55.491540 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:22:55.491524    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 14:22:55.491577 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:22:55.491546    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 14:22:55.491577 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:22:55.491560    2582 projected.go:196] Error preparing data for projected volume kube-api-access-mn4nx for pod openshift-network-diagnostics/network-check-target-gx87x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 14:22:55.491639 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:22:55.491626    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b81991eb-ee77-4c04-b880-a34d9419ca14-kube-api-access-mn4nx podName:b81991eb-ee77-4c04-b880-a34d9419ca14 nodeName:}" failed. No retries permitted until 2026-07-06 14:22:55.991609696 +0000 UTC m=+2.911890120 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-mn4nx" (UniqueName: "kubernetes.io/projected/b81991eb-ee77-4c04-b880-a34d9419ca14-kube-api-access-mn4nx") pod "network-check-target-gx87x" (UID: "b81991eb-ee77-4c04-b880-a34d9419ca14") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 14:22:55.493744 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.493721    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6vvx\" (UniqueName: \"kubernetes.io/projected/5554b54b-fec2-4059-9f42-845d87fc9961-kube-api-access-p6vvx\") pod \"node-resolver-95qwv\" (UID: \"5554b54b-fec2-4059-9f42-845d87fc9961\") " pod="openshift-dns/node-resolver-95qwv"
Jul 06 14:22:55.494320 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.494296    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qx4zv\" (UniqueName: \"kubernetes.io/projected/5b575f5c-4bf8-432e-ac6b-76ee25681e8b-kube-api-access-qx4zv\") pod \"ovnkube-node-54jfj\" (UID: \"5b575f5c-4bf8-432e-ac6b-76ee25681e8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-54jfj"
Jul 06 14:22:55.495725 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.495705    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8m9m\" (UniqueName: \"kubernetes.io/projected/537a943a-73f7-4e98-b74c-dde1d0ff1c92-kube-api-access-f8m9m\") pod \"network-metrics-daemon-mqgwp\" (UID: \"537a943a-73f7-4e98-b74c-dde1d0ff1c92\") " pod="openshift-multus/network-metrics-daemon-mqgwp"
Jul 06 14:22:55.496277 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.496258    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxvqj\" (UniqueName: \"kubernetes.io/projected/19ce583c-bcbe-4393-ae34-afd29df988b7-kube-api-access-zxvqj\") pod \"node-ca-k72tt\" (UID: \"19ce583c-bcbe-4393-ae34-afd29df988b7\") " pod="openshift-image-registry/node-ca-k72tt"
Jul 06 14:22:55.496957 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.496924    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-145.ec2.internal" event={"ID":"2683f4c10fa530ba79d25a7535e0e727","Type":"ContainerStarted","Data":"8919b226ed06d422db1e5608e89ae112fa38cd8eaaedad3003b1f60714d4062d"}
Jul 06 14:22:55.497809 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.497789    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-145.ec2.internal" event={"ID":"1b497cad55f7d3abf84dbe8f19ead2fb","Type":"ContainerStarted","Data":"6ffd39b4e95f1149fa905d35a52d6377ad8d22e9e2ba25e5a60250603764175a"}
Jul 06 14:22:55.588058 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.588023    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6105b3e2-89cf-49fb-af7f-654444a16b6a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-sljnn\" (UID: \"6105b3e2-89cf-49fb-af7f-654444a16b6a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sljnn"
Jul 06 14:22:55.588058 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.588058    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e7dc5ff4-a8fa-47de-a132-62d7e733a751-host-var-lib-cni-bin\") pod \"multus-spzdt\" (UID: \"e7dc5ff4-a8fa-47de-a132-62d7e733a751\") " pod="openshift-multus/multus-spzdt"
Jul 06 14:22:55.588291 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.588092    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6105b3e2-89cf-49fb-af7f-654444a16b6a-etc-selinux\") pod \"aws-ebs-csi-driver-node-sljnn\" (UID: \"6105b3e2-89cf-49fb-af7f-654444a16b6a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sljnn"
Jul 06 14:22:55.588291 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.588109    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e7dc5ff4-a8fa-47de-a132-62d7e733a751-host-run-netns\") pod \"multus-spzdt\" (UID: \"e7dc5ff4-a8fa-47de-a132-62d7e733a751\") " pod="openshift-multus/multus-spzdt"
Jul 06 14:22:55.588291 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.588124    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/68e9b176-5e66-41aa-8bf1-23e7b897c9a9-lib-modules\") pod \"tuned-r6hzx\" (UID: \"68e9b176-5e66-41aa-8bf1-23e7b897c9a9\") " pod="openshift-cluster-node-tuning-operator/tuned-r6hzx"
Jul 06 14:22:55.588291 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.588139    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/68e9b176-5e66-41aa-8bf1-23e7b897c9a9-host\") pod \"tuned-r6hzx\" (UID: \"68e9b176-5e66-41aa-8bf1-23e7b897c9a9\") " pod="openshift-cluster-node-tuning-operator/tuned-r6hzx"
Jul 06 14:22:55.588291 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.588149    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e7dc5ff4-a8fa-47de-a132-62d7e733a751-host-var-lib-cni-bin\") pod \"multus-spzdt\" (UID: \"e7dc5ff4-a8fa-47de-a132-62d7e733a751\") " pod="openshift-multus/multus-spzdt"
Jul 06 14:22:55.588291 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.588159    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6105b3e2-89cf-49fb-af7f-654444a16b6a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-sljnn\" (UID: \"6105b3e2-89cf-49fb-af7f-654444a16b6a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sljnn"
Jul 06 14:22:55.588291 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.588154    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ee1bac90-b7e7-41b0-a7e0-b804e6fafdef-konnectivity-ca\") pod \"konnectivity-agent-8lp29\" (UID: \"ee1bac90-b7e7-41b0-a7e0-b804e6fafdef\") " pod="kube-system/konnectivity-agent-8lp29"
Jul 06 14:22:55.588291 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.588182    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e7dc5ff4-a8fa-47de-a132-62d7e733a751-host-run-netns\") pod \"multus-spzdt\" (UID: \"e7dc5ff4-a8fa-47de-a132-62d7e733a751\") " pod="openshift-multus/multus-spzdt"
Jul 06 14:22:55.588291 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.588209    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2n5r\" (UniqueName: \"kubernetes.io/projected/aa9ce18d-f18b-4966-963d-dc7068bd5c8c-kube-api-access-v2n5r\") pod \"iptables-alerter-mmhv2\" (UID: \"aa9ce18d-f18b-4966-963d-dc7068bd5c8c\") " pod="openshift-network-operator/iptables-alerter-mmhv2"
Jul 06 14:22:55.588291 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.588224    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/68e9b176-5e66-41aa-8bf1-23e7b897c9a9-host\") pod \"tuned-r6hzx\" (UID: \"68e9b176-5e66-41aa-8bf1-23e7b897c9a9\") " pod="openshift-cluster-node-tuning-operator/tuned-r6hzx"
Jul 06 14:22:55.588291 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.588237    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6105b3e2-89cf-49fb-af7f-654444a16b6a-etc-selinux\") pod \"aws-ebs-csi-driver-node-sljnn\" (UID: \"6105b3e2-89cf-49fb-af7f-654444a16b6a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sljnn"
Jul 06 14:22:55.588291 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.588268    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/68e9b176-5e66-41aa-8bf1-23e7b897c9a9-lib-modules\") pod \"tuned-r6hzx\" (UID: \"68e9b176-5e66-41aa-8bf1-23e7b897c9a9\") " pod="openshift-cluster-node-tuning-operator/tuned-r6hzx"
Jul 06 14:22:55.588901 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.588311    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6105b3e2-89cf-49fb-af7f-654444a16b6a-device-dir\") pod \"aws-ebs-csi-driver-node-sljnn\" (UID: \"6105b3e2-89cf-49fb-af7f-654444a16b6a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sljnn"
Jul 06 14:22:55.588901 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.588336    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e7dc5ff4-a8fa-47de-a132-62d7e733a751-host-var-lib-kubelet\") pod \"multus-spzdt\" (UID: \"e7dc5ff4-a8fa-47de-a132-62d7e733a751\") " pod="openshift-multus/multus-spzdt"
Jul 06 14:22:55.588901 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.588351    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/68e9b176-5e66-41aa-8bf1-23e7b897c9a9-etc-modprobe-d\") pod \"tuned-r6hzx\" (UID: \"68e9b176-5e66-41aa-8bf1-23e7b897c9a9\") " pod="openshift-cluster-node-tuning-operator/tuned-r6hzx"
Jul 06 14:22:55.588901 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.588365    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/68e9b176-5e66-41aa-8bf1-23e7b897c9a9-etc-systemd\") pod \"tuned-r6hzx\" (UID: \"68e9b176-5e66-41aa-8bf1-23e7b897c9a9\") " pod="openshift-cluster-node-tuning-operator/tuned-r6hzx"
Jul 06 14:22:55.588901 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.588380    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/98121467-ea9e-4fdc-b195-85e95b837664-os-release\") pod \"multus-additional-cni-plugins-p6g5d\" (UID: \"98121467-ea9e-4fdc-b195-85e95b837664\") " pod="openshift-multus/multus-additional-cni-plugins-p6g5d"
Jul 06 14:22:55.588901 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.588399    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/98121467-ea9e-4fdc-b195-85e95b837664-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-p6g5d\" (UID: \"98121467-ea9e-4fdc-b195-85e95b837664\") " pod="openshift-multus/multus-additional-cni-plugins-p6g5d"
Jul 06 14:22:55.588901 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.588409    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e7dc5ff4-a8fa-47de-a132-62d7e733a751-host-var-lib-kubelet\") pod \"multus-spzdt\" (UID: \"e7dc5ff4-a8fa-47de-a132-62d7e733a751\") " pod="openshift-multus/multus-spzdt"
Jul 06 14:22:55.588901 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.588426    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/98121467-ea9e-4fdc-b195-85e95b837664-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-p6g5d\" (UID: \"98121467-ea9e-4fdc-b195-85e95b837664\") " pod="openshift-multus/multus-additional-cni-plugins-p6g5d"
Jul 06 14:22:55.588901 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.588452    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e7dc5ff4-a8fa-47de-a132-62d7e733a751-system-cni-dir\") pod \"multus-spzdt\" (UID: \"e7dc5ff4-a8fa-47de-a132-62d7e733a751\") " pod="openshift-multus/multus-spzdt"
Jul 06 14:22:55.588901 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.588460    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/68e9b176-5e66-41aa-8bf1-23e7b897c9a9-etc-modprobe-d\") pod \"tuned-r6hzx\" (UID: \"68e9b176-5e66-41aa-8bf1-23e7b897c9a9\") " pod="openshift-cluster-node-tuning-operator/tuned-r6hzx"
Jul 06 14:22:55.588901 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.588460    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6105b3e2-89cf-49fb-af7f-654444a16b6a-device-dir\") pod \"aws-ebs-csi-driver-node-sljnn\" (UID: \"6105b3e2-89cf-49fb-af7f-654444a16b6a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sljnn"
Jul 06 14:22:55.588901 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.588475    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/68e9b176-5e66-41aa-8bf1-23e7b897c9a9-run\") pod \"tuned-r6hzx\" (UID: \"68e9b176-5e66-41aa-8bf1-23e7b897c9a9\") " pod="openshift-cluster-node-tuning-operator/tuned-r6hzx"
Jul 06 14:22:55.588901 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.588485    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/98121467-ea9e-4fdc-b195-85e95b837664-os-release\") pod \"multus-additional-cni-plugins-p6g5d\" (UID: \"98121467-ea9e-4fdc-b195-85e95b837664\") " pod="openshift-multus/multus-additional-cni-plugins-p6g5d"
Jul 06 14:22:55.588901 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.588545    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e7dc5ff4-a8fa-47de-a132-62d7e733a751-system-cni-dir\") pod \"multus-spzdt\" (UID: \"e7dc5ff4-a8fa-47de-a132-62d7e733a751\") " pod="openshift-multus/multus-spzdt"
Jul 06 14:22:55.588901 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.588588    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xjk9d\" (UniqueName: \"kubernetes.io/projected/68e9b176-5e66-41aa-8bf1-23e7b897c9a9-kube-api-access-xjk9d\") pod \"tuned-r6hzx\" (UID: \"68e9b176-5e66-41aa-8bf1-23e7b897c9a9\") " pod="openshift-cluster-node-tuning-operator/tuned-r6hzx"
Jul 06 14:22:55.588901 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.588540    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/68e9b176-5e66-41aa-8bf1-23e7b897c9a9-etc-systemd\") pod \"tuned-r6hzx\" (UID: \"68e9b176-5e66-41aa-8bf1-23e7b897c9a9\") " pod="openshift-cluster-node-tuning-operator/tuned-r6hzx"
Jul 06 14:22:55.588901 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.588624    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/aa9ce18d-f18b-4966-963d-dc7068bd5c8c-iptables-alerter-script\") pod \"iptables-alerter-mmhv2\" (UID: \"aa9ce18d-f18b-4966-963d-dc7068bd5c8c\") " pod="openshift-network-operator/iptables-alerter-mmhv2"
Jul 06 14:22:55.589488 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.588671    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/68e9b176-5e66-41aa-8bf1-23e7b897c9a9-run\") pod \"tuned-r6hzx\" (UID: \"68e9b176-5e66-41aa-8bf1-23e7b897c9a9\") " pod="openshift-cluster-node-tuning-operator/tuned-r6hzx"
Jul 06 14:22:55.589488 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.588711    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e7dc5ff4-a8fa-47de-a132-62d7e733a751-cni-binary-copy\") pod \"multus-spzdt\" (UID: \"e7dc5ff4-a8fa-47de-a132-62d7e733a751\") " pod="openshift-multus/multus-spzdt"
Jul 06 14:22:55.589488 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.588820    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ee1bac90-b7e7-41b0-a7e0-b804e6fafdef-konnectivity-ca\") pod \"konnectivity-agent-8lp29\" (UID: \"ee1bac90-b7e7-41b0-a7e0-b804e6fafdef\") " pod="kube-system/konnectivity-agent-8lp29"
Jul 06 14:22:55.589488 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.588876    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ee1bac90-b7e7-41b0-a7e0-b804e6fafdef-agent-certs\") pod \"konnectivity-agent-8lp29\" (UID: \"ee1bac90-b7e7-41b0-a7e0-b804e6fafdef\") " pod="kube-system/konnectivity-agent-8lp29"
Jul 06 14:22:55.589488 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.588919    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/201f4c6e-b9d8-4a99-9f4e-b8f59e69ad1d-kubelet-config\") pod \"global-pull-secret-syncer-mbkvc\" (UID: \"201f4c6e-b9d8-4a99-9f4e-b8f59e69ad1d\") " pod="kube-system/global-pull-secret-syncer-mbkvc"
Jul 06 14:22:55.589488 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.588942    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/68e9b176-5e66-41aa-8bf1-23e7b897c9a9-sys\") pod \"tuned-r6hzx\" (UID: \"68e9b176-5e66-41aa-8bf1-23e7b897c9a9\") " pod="openshift-cluster-node-tuning-operator/tuned-r6hzx"
Jul 06 14:22:55.589488 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.588980    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wfw9d\" (UniqueName: \"kubernetes.io/projected/98121467-ea9e-4fdc-b195-85e95b837664-kube-api-access-wfw9d\") pod \"multus-additional-cni-plugins-p6g5d\" (UID: \"98121467-ea9e-4fdc-b195-85e95b837664\") " pod="openshift-multus/multus-additional-cni-plugins-p6g5d"
Jul 06 14:22:55.589488 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.589005    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e7dc5ff4-a8fa-47de-a132-62d7e733a751-multus-daemon-config\") pod \"multus-spzdt\" (UID: \"e7dc5ff4-a8fa-47de-a132-62d7e733a751\") " pod="openshift-multus/multus-spzdt"
Jul 06 14:22:55.589488 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.589047    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/68e9b176-5e66-41aa-8bf1-23e7b897c9a9-sys\") pod \"tuned-r6hzx\" (UID: \"68e9b176-5e66-41aa-8bf1-23e7b897c9a9\") " pod="openshift-cluster-node-tuning-operator/tuned-r6hzx"
Jul 06 14:22:55.589488 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.589069    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/98121467-ea9e-4fdc-b195-85e95b837664-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-p6g5d\" (UID: \"98121467-ea9e-4fdc-b195-85e95b837664\") " pod="openshift-multus/multus-additional-cni-plugins-p6g5d"
Jul 06 14:22:55.589488 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.589069    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/98121467-ea9e-4fdc-b195-85e95b837664-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-p6g5d\" (UID: \"98121467-ea9e-4fdc-b195-85e95b837664\") " pod="openshift-multus/multus-additional-cni-plugins-p6g5d"
Jul 06 14:22:55.589488 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.589103    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/68e9b176-5e66-41aa-8bf1-23e7b897c9a9-etc-kubernetes\") pod \"tuned-r6hzx\" (UID: \"68e9b176-5e66-41aa-8bf1-23e7b897c9a9\") " pod="openshift-cluster-node-tuning-operator/tuned-r6hzx"
Jul 06 14:22:55.589488 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.589240    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/aa9ce18d-f18b-4966-963d-dc7068bd5c8c-iptables-alerter-script\") pod \"iptables-alerter-mmhv2\" (UID: \"aa9ce18d-f18b-4966-963d-dc7068bd5c8c\") " pod="openshift-network-operator/iptables-alerter-mmhv2"
Jul 06 14:22:55.589488 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.589324    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e7dc5ff4-a8fa-47de-a132-62d7e733a751-cni-binary-copy\") pod \"multus-spzdt\" (UID: \"e7dc5ff4-a8fa-47de-a132-62d7e733a751\") " pod="openshift-multus/multus-spzdt"
Jul 06 14:22:55.590046 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.589592    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/201f4c6e-b9d8-4a99-9f4e-b8f59e69ad1d-kubelet-config\") pod \"global-pull-secret-syncer-mbkvc\" (UID: \"201f4c6e-b9d8-4a99-9f4e-b8f59e69ad1d\") " pod="kube-system/global-pull-secret-syncer-mbkvc"
Jul 06 14:22:55.590046 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.589593    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/68e9b176-5e66-41aa-8bf1-23e7b897c9a9-etc-tuned\") pod \"tuned-r6hzx\" (UID: \"68e9b176-5e66-41aa-8bf1-23e7b897c9a9\") " pod="openshift-cluster-node-tuning-operator/tuned-r6hzx"
Jul 06 14:22:55.590046 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.589674    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/201f4c6e-b9d8-4a99-9f4e-b8f59e69ad1d-dbus\") pod \"global-pull-secret-syncer-mbkvc\" (UID: \"201f4c6e-b9d8-4a99-9f4e-b8f59e69ad1d\") " pod="kube-system/global-pull-secret-syncer-mbkvc"
Jul 06 14:22:55.590046 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.589721    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e7dc5ff4-a8fa-47de-a132-62d7e733a751-hostroot\") pod \"multus-spzdt\" (UID: \"e7dc5ff4-a8fa-47de-a132-62d7e733a751\") " pod="openshift-multus/multus-spzdt"
Jul 06 14:22:55.590046 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.589755    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/68e9b176-5e66-41aa-8bf1-23e7b897c9a9-var-lib-kubelet\") pod \"tuned-r6hzx\" (UID: \"68e9b176-5e66-41aa-8bf1-23e7b897c9a9\") " pod="openshift-cluster-node-tuning-operator/tuned-r6hzx"
Jul 06 14:22:55.590046 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.589784    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/201f4c6e-b9d8-4a99-9f4e-b8f59e69ad1d-original-pull-secret\") pod \"global-pull-secret-syncer-mbkvc\" (UID: \"201f4c6e-b9d8-4a99-9f4e-b8f59e69ad1d\") " pod="kube-system/global-pull-secret-syncer-mbkvc"
Jul 06 14:22:55.590046 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.589787    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/68e9b176-5e66-41aa-8bf1-23e7b897c9a9-etc-kubernetes\") pod \"tuned-r6hzx\" (UID: \"68e9b176-5e66-41aa-8bf1-23e7b897c9a9\") " pod="openshift-cluster-node-tuning-operator/tuned-r6hzx"
Jul 06 14:22:55.590046 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.589809    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/201f4c6e-b9d8-4a99-9f4e-b8f59e69ad1d-dbus\") pod \"global-pull-secret-syncer-mbkvc\" (UID: \"201f4c6e-b9d8-4a99-9f4e-b8f59e69ad1d\") " pod="kube-system/global-pull-secret-syncer-mbkvc"
Jul 06 14:22:55.590046 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.589810    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6105b3e2-89cf-49fb-af7f-654444a16b6a-sys-fs\") pod \"aws-ebs-csi-driver-node-sljnn\" (UID: \"6105b3e2-89cf-49fb-af7f-654444a16b6a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sljnn"
Jul 06 14:22:55.590046 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.589842    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e7dc5ff4-a8fa-47de-a132-62d7e733a751-multus-daemon-config\") pod \"multus-spzdt\" (UID: \"e7dc5ff4-a8fa-47de-a132-62d7e733a751\") " pod="openshift-multus/multus-spzdt"
Jul 06 14:22:55.590046 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.589855    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e7dc5ff4-a8fa-47de-a132-62d7e733a751-cnibin\") pod \"multus-spzdt\" (UID: \"e7dc5ff4-a8fa-47de-a132-62d7e733a751\") " pod="openshift-multus/multus-spzdt"
Jul 06 14:22:55.590046 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.589864    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6105b3e2-89cf-49fb-af7f-654444a16b6a-sys-fs\") pod \"aws-ebs-csi-driver-node-sljnn\" (UID: \"6105b3e2-89cf-49fb-af7f-654444a16b6a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sljnn"
Jul 06 14:22:55.590046 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.589847    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e7dc5ff4-a8fa-47de-a132-62d7e733a751-hostroot\") pod \"multus-spzdt\" (UID: \"e7dc5ff4-a8fa-47de-a132-62d7e733a751\") " pod="openshift-multus/multus-spzdt"
Jul 06 14:22:55.590046 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.589878    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/68e9b176-5e66-41aa-8bf1-23e7b897c9a9-var-lib-kubelet\") pod \"tuned-r6hzx\" (UID: \"68e9b176-5e66-41aa-8bf1-23e7b897c9a9\") " pod="openshift-cluster-node-tuning-operator/tuned-r6hzx"
Jul 06 14:22:55.590046 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.589888    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/68e9b176-5e66-41aa-8bf1-23e7b897c9a9-etc-sysctl-conf\") pod \"tuned-r6hzx\" (UID: \"68e9b176-5e66-41aa-8bf1-23e7b897c9a9\") " pod="openshift-cluster-node-tuning-operator/tuned-r6hzx"
Jul 06 14:22:55.590046 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.589915    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/98121467-ea9e-4fdc-b195-85e95b837664-system-cni-dir\") pod \"multus-additional-cni-plugins-p6g5d\" (UID: \"98121467-ea9e-4fdc-b195-85e95b837664\") " pod="openshift-multus/multus-additional-cni-plugins-p6g5d"
Jul 06 14:22:55.590046 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:22:55.589929    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 14:22:55.590046 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.589936    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e7dc5ff4-a8fa-47de-a132-62d7e733a751-os-release\") pod \"multus-spzdt\" (UID: \"e7dc5ff4-a8fa-47de-a132-62d7e733a751\") " pod="openshift-multus/multus-spzdt"
Jul 06 14:22:55.590799 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.589956    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e7dc5ff4-a8fa-47de-a132-62d7e733a751-host-run-multus-certs\") pod \"multus-spzdt\" (UID: \"e7dc5ff4-a8fa-47de-a132-62d7e733a751\") " pod="openshift-multus/multus-spzdt"
Jul 06 14:22:55.590799 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.589977    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e7dc5ff4-a8fa-47de-a132-62d7e733a751-etc-kubernetes\") pod \"multus-spzdt\" (UID: \"e7dc5ff4-a8fa-47de-a132-62d7e733a751\") " pod="openshift-multus/multus-spzdt"
Jul 06 14:22:55.590799 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.589985    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e7dc5ff4-a8fa-47de-a132-62d7e733a751-cnibin\") pod \"multus-spzdt\" (UID: \"e7dc5ff4-a8fa-47de-a132-62d7e733a751\") " pod="openshift-multus/multus-spzdt"
Jul 06 14:22:55.590799 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:22:55.589994    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/201f4c6e-b9d8-4a99-9f4e-b8f59e69ad1d-original-pull-secret podName:201f4c6e-b9d8-4a99-9f4e-b8f59e69ad1d nodeName:}" failed. No retries permitted until 2026-07-06 14:22:56.089977334 +0000 UTC m=+3.010257742 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/201f4c6e-b9d8-4a99-9f4e-b8f59e69ad1d-original-pull-secret") pod "global-pull-secret-syncer-mbkvc" (UID: "201f4c6e-b9d8-4a99-9f4e-b8f59e69ad1d") : object "kube-system"/"original-pull-secret" not registered
Jul 06 14:22:55.590799 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.590010    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e7dc5ff4-a8fa-47de-a132-62d7e733a751-etc-kubernetes\") pod \"multus-spzdt\" (UID: \"e7dc5ff4-a8fa-47de-a132-62d7e733a751\") " pod="openshift-multus/multus-spzdt"
Jul 06 14:22:55.590799 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.590012    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/68e9b176-5e66-41aa-8bf1-23e7b897c9a9-etc-sysctl-conf\") pod \"tuned-r6hzx\" (UID: \"68e9b176-5e66-41aa-8bf1-23e7b897c9a9\") " pod="openshift-cluster-node-tuning-operator/tuned-r6hzx"
Jul 06 14:22:55.590799 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.590004    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/98121467-ea9e-4fdc-b195-85e95b837664-system-cni-dir\") pod \"multus-additional-cni-plugins-p6g5d\" (UID: \"98121467-ea9e-4fdc-b195-85e95b837664\") " pod="openshift-multus/multus-additional-cni-plugins-p6g5d"
Jul 06 14:22:55.590799 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.590026    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8gscr\" (UniqueName: \"kubernetes.io/projected/e7dc5ff4-a8fa-47de-a132-62d7e733a751-kube-api-access-8gscr\") pod \"multus-spzdt\" (UID: \"e7dc5ff4-a8fa-47de-a132-62d7e733a751\") " pod="openshift-multus/multus-spzdt"
Jul 06 14:22:55.590799 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.590047    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e7dc5ff4-a8fa-47de-a132-62d7e733a751-os-release\") pod \"multus-spzdt\" (UID: \"e7dc5ff4-a8fa-47de-a132-62d7e733a751\") " pod="openshift-multus/multus-spzdt"
Jul 06 14:22:55.590799 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.590051    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/68e9b176-5e66-41aa-8bf1-23e7b897c9a9-etc-sysctl-d\") pod \"tuned-r6hzx\" (UID: \"68e9b176-5e66-41aa-8bf1-23e7b897c9a9\") " pod="openshift-cluster-node-tuning-operator/tuned-r6hzx"
Jul 06 14:22:55.590799 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.590074    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/68e9b176-5e66-41aa-8bf1-23e7b897c9a9-tmp\") pod \"tuned-r6hzx\" (UID: \"68e9b176-5e66-41aa-8bf1-23e7b897c9a9\") " pod="openshift-cluster-node-tuning-operator/tuned-r6hzx"
Jul 06 14:22:55.590799 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.590050    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e7dc5ff4-a8fa-47de-a132-62d7e733a751-host-run-multus-certs\") pod \"multus-spzdt\" (UID: \"e7dc5ff4-a8fa-47de-a132-62d7e733a751\") " pod="openshift-multus/multus-spzdt"
Jul 06 14:22:55.590799 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.590147    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/68e9b176-5e66-41aa-8bf1-23e7b897c9a9-etc-sysctl-d\") pod \"tuned-r6hzx\" (UID: \"68e9b176-5e66-41aa-8bf1-23e7b897c9a9\") " pod="openshift-cluster-node-tuning-operator/tuned-r6hzx"
Jul 06 14:22:55.590799 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.590099    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e7dc5ff4-a8fa-47de-a132-62d7e733a751-multus-socket-dir-parent\") pod \"multus-spzdt\" (UID: \"e7dc5ff4-a8fa-47de-a132-62d7e733a751\") " pod="openshift-multus/multus-spzdt"
Jul 06 14:22:55.590799 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.590184    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e7dc5ff4-a8fa-47de-a132-62d7e733a751-multus-socket-dir-parent\") pod \"multus-spzdt\" (UID: \"e7dc5ff4-a8fa-47de-a132-62d7e733a751\") " pod="openshift-multus/multus-spzdt"
Jul 06 14:22:55.590799 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.590185    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e7dc5ff4-a8fa-47de-a132-62d7e733a751-host-var-lib-cni-multus\") pod \"multus-spzdt\" (UID: \"e7dc5ff4-a8fa-47de-a132-62d7e733a751\") " pod="openshift-multus/multus-spzdt"
Jul 06 14:22:55.590799 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.590216    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e7dc5ff4-a8fa-47de-a132-62d7e733a751-host-var-lib-cni-multus\") pod \"multus-spzdt\" (UID: \"e7dc5ff4-a8fa-47de-a132-62d7e733a751\") " pod="openshift-multus/multus-spzdt"
Jul 06 14:22:55.591318 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.590226    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/98121467-ea9e-4fdc-b195-85e95b837664-cni-binary-copy\") pod \"multus-additional-cni-plugins-p6g5d\" (UID: \"98121467-ea9e-4fdc-b195-85e95b837664\") " pod="openshift-multus/multus-additional-cni-plugins-p6g5d"
Jul 06 14:22:55.591318 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.590253    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/aa9ce18d-f18b-4966-963d-dc7068bd5c8c-host-slash\") pod \"iptables-alerter-mmhv2\" (UID: \"aa9ce18d-f18b-4966-963d-dc7068bd5c8c\") " pod="openshift-network-operator/iptables-alerter-mmhv2"
Jul 06 14:22:55.591318 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.590280    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6105b3e2-89cf-49fb-af7f-654444a16b6a-socket-dir\") pod \"aws-ebs-csi-driver-node-sljnn\" (UID: \"6105b3e2-89cf-49fb-af7f-654444a16b6a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sljnn"
Jul 06 14:22:55.591318 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.590306    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6105b3e2-89cf-49fb-af7f-654444a16b6a-registration-dir\") pod \"aws-ebs-csi-driver-node-sljnn\" (UID: \"6105b3e2-89cf-49fb-af7f-654444a16b6a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sljnn"
Jul 06 14:22:55.591318 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.590352    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/aa9ce18d-f18b-4966-963d-dc7068bd5c8c-host-slash\") pod \"iptables-alerter-mmhv2\" (UID: \"aa9ce18d-f18b-4966-963d-dc7068bd5c8c\") " pod="openshift-network-operator/iptables-alerter-mmhv2"
Jul 06 14:22:55.591318 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.590356    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6105b3e2-89cf-49fb-af7f-654444a16b6a-registration-dir\") pod \"aws-ebs-csi-driver-node-sljnn\" (UID: \"6105b3e2-89cf-49fb-af7f-654444a16b6a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sljnn"
Jul 06 14:22:55.591318 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.590377    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7ttd\" (UniqueName: \"kubernetes.io/projected/6105b3e2-89cf-49fb-af7f-654444a16b6a-kube-api-access-j7ttd\") pod \"aws-ebs-csi-driver-node-sljnn\" (UID: \"6105b3e2-89cf-49fb-af7f-654444a16b6a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sljnn"
Jul 06 14:22:55.591318 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.590402    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e7dc5ff4-a8fa-47de-a132-62d7e733a751-multus-cni-dir\") pod \"multus-spzdt\" (UID: \"e7dc5ff4-a8fa-47de-a132-62d7e733a751\") " pod="openshift-multus/multus-spzdt"
Jul 06 14:22:55.591318 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.590432    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6105b3e2-89cf-49fb-af7f-654444a16b6a-socket-dir\") pod \"aws-ebs-csi-driver-node-sljnn\" (UID: \"6105b3e2-89cf-49fb-af7f-654444a16b6a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sljnn"
Jul 06 14:22:55.591318 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.590484    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/98121467-ea9e-4fdc-b195-85e95b837664-cnibin\") pod \"multus-additional-cni-plugins-p6g5d\" (UID: \"98121467-ea9e-4fdc-b195-85e95b837664\") " pod="openshift-multus/multus-additional-cni-plugins-p6g5d"
Jul 06 14:22:55.591318 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.590427    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/98121467-ea9e-4fdc-b195-85e95b837664-cnibin\") pod \"multus-additional-cni-plugins-p6g5d\" (UID: \"98121467-ea9e-4fdc-b195-85e95b837664\") " pod="openshift-multus/multus-additional-cni-plugins-p6g5d"
Jul 06 14:22:55.591318 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.590486    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e7dc5ff4-a8fa-47de-a132-62d7e733a751-multus-cni-dir\") pod \"multus-spzdt\" (UID: \"e7dc5ff4-a8fa-47de-a132-62d7e733a751\") " pod="openshift-multus/multus-spzdt"
Jul 06 14:22:55.591318 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.590517    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/98121467-ea9e-4fdc-b195-85e95b837664-tuning-conf-dir\") pod \"multus-additional-cni-plugins-p6g5d\" (UID: \"98121467-ea9e-4fdc-b195-85e95b837664\") " pod="openshift-multus/multus-additional-cni-plugins-p6g5d"
Jul 06 14:22:55.591318 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.590542    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e7dc5ff4-a8fa-47de-a132-62d7e733a751-host-run-k8s-cni-cncf-io\") pod \"multus-spzdt\" (UID: \"e7dc5ff4-a8fa-47de-a132-62d7e733a751\") " pod="openshift-multus/multus-spzdt"
Jul 06 14:22:55.591318 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.590569    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e7dc5ff4-a8fa-47de-a132-62d7e733a751-multus-conf-dir\") pod \"multus-spzdt\" (UID: \"e7dc5ff4-a8fa-47de-a132-62d7e733a751\") " pod="openshift-multus/multus-spzdt"
Jul 06 14:22:55.591318 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.590592    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/68e9b176-5e66-41aa-8bf1-23e7b897c9a9-etc-sysconfig\") pod \"tuned-r6hzx\" (UID: \"68e9b176-5e66-41aa-8bf1-23e7b897c9a9\") " pod="openshift-cluster-node-tuning-operator/tuned-r6hzx"
Jul 06 14:22:55.591318 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.590621    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e7dc5ff4-a8fa-47de-a132-62d7e733a751-host-run-k8s-cni-cncf-io\") pod \"multus-spzdt\" (UID: \"e7dc5ff4-a8fa-47de-a132-62d7e733a751\") " pod="openshift-multus/multus-spzdt"
Jul 06 14:22:55.591863 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.590634    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e7dc5ff4-a8fa-47de-a132-62d7e733a751-multus-conf-dir\") pod \"multus-spzdt\" (UID: \"e7dc5ff4-a8fa-47de-a132-62d7e733a751\") " pod="openshift-multus/multus-spzdt"
Jul 06 14:22:55.591863 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.590648    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/98121467-ea9e-4fdc-b195-85e95b837664-cni-binary-copy\") pod \"multus-additional-cni-plugins-p6g5d\" (UID: \"98121467-ea9e-4fdc-b195-85e95b837664\") " pod="openshift-multus/multus-additional-cni-plugins-p6g5d"
Jul 06 14:22:55.591863 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.590679    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/68e9b176-5e66-41aa-8bf1-23e7b897c9a9-etc-sysconfig\") pod \"tuned-r6hzx\" (UID: \"68e9b176-5e66-41aa-8bf1-23e7b897c9a9\") " pod="openshift-cluster-node-tuning-operator/tuned-r6hzx"
Jul 06 14:22:55.591863 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.590799    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/98121467-ea9e-4fdc-b195-85e95b837664-tuning-conf-dir\") pod \"multus-additional-cni-plugins-p6g5d\" (UID: \"98121467-ea9e-4fdc-b195-85e95b837664\") " pod="openshift-multus/multus-additional-cni-plugins-p6g5d"
Jul 06 14:22:55.591863 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.591559    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ee1bac90-b7e7-41b0-a7e0-b804e6fafdef-agent-certs\") pod \"konnectivity-agent-8lp29\" (UID: \"ee1bac90-b7e7-41b0-a7e0-b804e6fafdef\") " pod="kube-system/konnectivity-agent-8lp29"
Jul 06 14:22:55.592462 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.592447    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/68e9b176-5e66-41aa-8bf1-23e7b897c9a9-etc-tuned\") pod \"tuned-r6hzx\" (UID: \"68e9b176-5e66-41aa-8bf1-23e7b897c9a9\") " pod="openshift-cluster-node-tuning-operator/tuned-r6hzx"
Jul 06 14:22:55.592529 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.592512    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/68e9b176-5e66-41aa-8bf1-23e7b897c9a9-tmp\") pod \"tuned-r6hzx\" (UID: \"68e9b176-5e66-41aa-8bf1-23e7b897c9a9\") " pod="openshift-cluster-node-tuning-operator/tuned-r6hzx"
Jul 06 14:22:55.598858 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.598841    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wfw9d\" (UniqueName: \"kubernetes.io/projected/98121467-ea9e-4fdc-b195-85e95b837664-kube-api-access-wfw9d\") pod \"multus-additional-cni-plugins-p6g5d\" (UID: \"98121467-ea9e-4fdc-b195-85e95b837664\") " pod="openshift-multus/multus-additional-cni-plugins-p6g5d"
Jul 06 14:22:55.599543 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.599528    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjk9d\" (UniqueName: \"kubernetes.io/projected/68e9b176-5e66-41aa-8bf1-23e7b897c9a9-kube-api-access-xjk9d\") pod \"tuned-r6hzx\" (UID: \"68e9b176-5e66-41aa-8bf1-23e7b897c9a9\") " pod="openshift-cluster-node-tuning-operator/tuned-r6hzx"
Jul 06 14:22:55.599594 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.599566    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2n5r\" (UniqueName: \"kubernetes.io/projected/aa9ce18d-f18b-4966-963d-dc7068bd5c8c-kube-api-access-v2n5r\") pod \"iptables-alerter-mmhv2\" (UID: \"aa9ce18d-f18b-4966-963d-dc7068bd5c8c\") " pod="openshift-network-operator/iptables-alerter-mmhv2"
Jul 06 14:22:55.606215 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.606165    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8gscr\" (UniqueName: \"kubernetes.io/projected/e7dc5ff4-a8fa-47de-a132-62d7e733a751-kube-api-access-8gscr\") pod \"multus-spzdt\" (UID: \"e7dc5ff4-a8fa-47de-a132-62d7e733a751\") " pod="openshift-multus/multus-spzdt"
Jul 06 14:22:55.606215 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.606167    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7ttd\" (UniqueName: \"kubernetes.io/projected/6105b3e2-89cf-49fb-af7f-654444a16b6a-kube-api-access-j7ttd\") pod \"aws-ebs-csi-driver-node-sljnn\" (UID: \"6105b3e2-89cf-49fb-af7f-654444a16b6a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sljnn"
Jul 06 14:22:55.677768 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.677737    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-95qwv"
Jul 06 14:22:55.684161 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.684141    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-k72tt"
Jul 06 14:22:55.687544 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:55.687519    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5554b54b_fec2_4059_9f42_845d87fc9961.slice/crio-d19c493abdcdbe455a3646a47ae6a231136dc7d3b3921b767ed3e6841cf0989f WatchSource:0}: Error finding container d19c493abdcdbe455a3646a47ae6a231136dc7d3b3921b767ed3e6841cf0989f: Status 404 returned error can't find the container with id d19c493abdcdbe455a3646a47ae6a231136dc7d3b3921b767ed3e6841cf0989f
Jul 06 14:22:55.691807 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.691790    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-54jfj"
Jul 06 14:22:55.692031 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:55.692013    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19ce583c_bcbe_4393_ae34_afd29df988b7.slice/crio-f1a22151c42cf359c681a3a3d98137159ab23fa74613f769dbcf24480363ff05 WatchSource:0}: Error finding container f1a22151c42cf359c681a3a3d98137159ab23fa74613f769dbcf24480363ff05: Status 404 returned error can't find the container with id f1a22151c42cf359c681a3a3d98137159ab23fa74613f769dbcf24480363ff05
Jul 06 14:22:55.698244 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.698229    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-mmhv2"
Jul 06 14:22:55.700398 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:55.700381    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b575f5c_4bf8_432e_ac6b_76ee25681e8b.slice/crio-1651a75fc303606e0aefae37550ca7e153f819727bf409fedf27674fda7d7583 WatchSource:0}: Error finding container 1651a75fc303606e0aefae37550ca7e153f819727bf409fedf27674fda7d7583: Status 404 returned error can't find the container with id 1651a75fc303606e0aefae37550ca7e153f819727bf409fedf27674fda7d7583
Jul 06 14:22:55.704148 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.704131    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-r6hzx"
Jul 06 14:22:55.707456 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:55.707437    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa9ce18d_f18b_4966_963d_dc7068bd5c8c.slice/crio-dc7f068315d3df0e80dfeb54b7d8ffe4ca3a04efb7d0e92c549cf1bd06af5545 WatchSource:0}: Error finding container dc7f068315d3df0e80dfeb54b7d8ffe4ca3a04efb7d0e92c549cf1bd06af5545: Status 404 returned error can't find the container with id dc7f068315d3df0e80dfeb54b7d8ffe4ca3a04efb7d0e92c549cf1bd06af5545
Jul 06 14:22:55.709157 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.709141    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-8lp29"
Jul 06 14:22:55.711960 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:55.711939    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68e9b176_5e66_41aa_8bf1_23e7b897c9a9.slice/crio-6f8f455fa587137cc0a23ddafdf5961384714fe95fe423ccb97e1a199df1ec11 WatchSource:0}: Error finding container 6f8f455fa587137cc0a23ddafdf5961384714fe95fe423ccb97e1a199df1ec11: Status 404 returned error can't find the container with id 6f8f455fa587137cc0a23ddafdf5961384714fe95fe423ccb97e1a199df1ec11
Jul 06 14:22:55.715459 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.715440    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sljnn"
Jul 06 14:22:55.717207 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:55.717187    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee1bac90_b7e7_41b0_a7e0_b804e6fafdef.slice/crio-8f1a765f081600aed1cd7cd10b0e920fc1a680fde1caefd930fdfa07875c6e99 WatchSource:0}: Error finding container 8f1a765f081600aed1cd7cd10b0e920fc1a680fde1caefd930fdfa07875c6e99: Status 404 returned error can't find the container with id 8f1a765f081600aed1cd7cd10b0e920fc1a680fde1caefd930fdfa07875c6e99
Jul 06 14:22:55.720349 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.720332    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-p6g5d"
Jul 06 14:22:55.724258 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.724243    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-spzdt"
Jul 06 14:22:55.724453 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:55.724436    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6105b3e2_89cf_49fb_af7f_654444a16b6a.slice/crio-47d40e8c03ef4705f85c8102ccec5137a4191ed06e0568619e6109324c9ca13f WatchSource:0}: Error finding container 47d40e8c03ef4705f85c8102ccec5137a4191ed06e0568619e6109324c9ca13f: Status 404 returned error can't find the container with id 47d40e8c03ef4705f85c8102ccec5137a4191ed06e0568619e6109324c9ca13f
Jul 06 14:22:55.732632 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:55.732613    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98121467_ea9e_4fdc_b195_85e95b837664.slice/crio-155dd7974060cb7edae4d2eb9d8f499b1a176bd54733d78c8c4fd7925e4639f0 WatchSource:0}: Error finding container 155dd7974060cb7edae4d2eb9d8f499b1a176bd54733d78c8c4fd7925e4639f0: Status 404 returned error can't find the container with id 155dd7974060cb7edae4d2eb9d8f499b1a176bd54733d78c8c4fd7925e4639f0
Jul 06 14:22:55.735546 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:22:55.735524    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7dc5ff4_a8fa_47de_a132_62d7e733a751.slice/crio-9d101873566d4686b48dd9a545f4baea9b1eb6d0b52724d603d5e07618f144ac WatchSource:0}: Error finding container 9d101873566d4686b48dd9a545f4baea9b1eb6d0b52724d603d5e07618f144ac: Status 404 returned error can't find the container with id 9d101873566d4686b48dd9a545f4baea9b1eb6d0b52724d603d5e07618f144ac
Jul 06 14:22:55.808784 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.808757    2582 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 14:22:55.993756 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.993669    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mn4nx\" (UniqueName: \"kubernetes.io/projected/b81991eb-ee77-4c04-b880-a34d9419ca14-kube-api-access-mn4nx\") pod \"network-check-target-gx87x\" (UID: \"b81991eb-ee77-4c04-b880-a34d9419ca14\") " pod="openshift-network-diagnostics/network-check-target-gx87x"
Jul 06 14:22:55.993894 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:55.993781    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/537a943a-73f7-4e98-b74c-dde1d0ff1c92-metrics-certs\") pod \"network-metrics-daemon-mqgwp\" (UID: \"537a943a-73f7-4e98-b74c-dde1d0ff1c92\") " pod="openshift-multus/network-metrics-daemon-mqgwp"
Jul 06 14:22:55.993894 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:22:55.993798    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 14:22:55.993894 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:22:55.993828    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 14:22:55.993894 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:22:55.993842    2582 projected.go:196] Error preparing data for projected volume kube-api-access-mn4nx for pod openshift-network-diagnostics/network-check-target-gx87x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 14:22:55.994068 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:22:55.993907    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 14:22:55.994068 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:22:55.993908    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b81991eb-ee77-4c04-b880-a34d9419ca14-kube-api-access-mn4nx podName:b81991eb-ee77-4c04-b880-a34d9419ca14 nodeName:}" failed. No retries permitted until 2026-07-06 14:22:56.993890057 +0000 UTC m=+3.914170477 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-mn4nx" (UniqueName: "kubernetes.io/projected/b81991eb-ee77-4c04-b880-a34d9419ca14-kube-api-access-mn4nx") pod "network-check-target-gx87x" (UID: "b81991eb-ee77-4c04-b880-a34d9419ca14") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 14:22:55.994068 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:22:55.993969    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/537a943a-73f7-4e98-b74c-dde1d0ff1c92-metrics-certs podName:537a943a-73f7-4e98-b74c-dde1d0ff1c92 nodeName:}" failed. No retries permitted until 2026-07-06 14:22:56.993954254 +0000 UTC m=+3.914234666 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/537a943a-73f7-4e98-b74c-dde1d0ff1c92-metrics-certs") pod "network-metrics-daemon-mqgwp" (UID: "537a943a-73f7-4e98-b74c-dde1d0ff1c92") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 14:22:56.095249 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:56.095108    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/201f4c6e-b9d8-4a99-9f4e-b8f59e69ad1d-original-pull-secret\") pod \"global-pull-secret-syncer-mbkvc\" (UID: \"201f4c6e-b9d8-4a99-9f4e-b8f59e69ad1d\") " pod="kube-system/global-pull-secret-syncer-mbkvc"
Jul 06 14:22:56.095249 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:22:56.095251    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 14:22:56.095540 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:22:56.095313    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/201f4c6e-b9d8-4a99-9f4e-b8f59e69ad1d-original-pull-secret podName:201f4c6e-b9d8-4a99-9f4e-b8f59e69ad1d nodeName:}" failed. No retries permitted until 2026-07-06 14:22:57.09529716 +0000 UTC m=+4.015577579 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/201f4c6e-b9d8-4a99-9f4e-b8f59e69ad1d-original-pull-secret") pod "global-pull-secret-syncer-mbkvc" (UID: "201f4c6e-b9d8-4a99-9f4e-b8f59e69ad1d") : object "kube-system"/"original-pull-secret" not registered
Jul 06 14:22:56.423556 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:56.423448    2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 14:17:55 +0000 UTC" deadline="2028-03-04 18:50:14.595778677 +0000 UTC"
Jul 06 14:22:56.423556 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:56.423494    2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14572h27m18.172289061s"
Jul 06 14:22:56.526875 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:56.526718    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-8lp29" event={"ID":"ee1bac90-b7e7-41b0-a7e0-b804e6fafdef","Type":"ContainerStarted","Data":"8f1a765f081600aed1cd7cd10b0e920fc1a680fde1caefd930fdfa07875c6e99"}
Jul 06 14:22:56.547802 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:56.547696    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-r6hzx" event={"ID":"68e9b176-5e66-41aa-8bf1-23e7b897c9a9","Type":"ContainerStarted","Data":"6f8f455fa587137cc0a23ddafdf5961384714fe95fe423ccb97e1a199df1ec11"}
Jul 06 14:22:56.570843 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:56.570802    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-mmhv2" event={"ID":"aa9ce18d-f18b-4966-963d-dc7068bd5c8c","Type":"ContainerStarted","Data":"dc7f068315d3df0e80dfeb54b7d8ffe4ca3a04efb7d0e92c549cf1bd06af5545"}
Jul 06 14:22:56.575745 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:56.575605    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-54jfj" event={"ID":"5b575f5c-4bf8-432e-ac6b-76ee25681e8b","Type":"ContainerStarted","Data":"1651a75fc303606e0aefae37550ca7e153f819727bf409fedf27674fda7d7583"}
Jul 06 14:22:56.585610 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:56.585541    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-k72tt" event={"ID":"19ce583c-bcbe-4393-ae34-afd29df988b7","Type":"ContainerStarted","Data":"f1a22151c42cf359c681a3a3d98137159ab23fa74613f769dbcf24480363ff05"}
Jul 06 14:22:56.589915 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:56.589882    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p6g5d" event={"ID":"98121467-ea9e-4fdc-b195-85e95b837664","Type":"ContainerStarted","Data":"155dd7974060cb7edae4d2eb9d8f499b1a176bd54733d78c8c4fd7925e4639f0"}
Jul 06 14:22:56.610924 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:56.610889    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-95qwv" event={"ID":"5554b54b-fec2-4059-9f42-845d87fc9961","Type":"ContainerStarted","Data":"d19c493abdcdbe455a3646a47ae6a231136dc7d3b3921b767ed3e6841cf0989f"}
Jul 06 14:22:56.625933 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:56.625898    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-spzdt" event={"ID":"e7dc5ff4-a8fa-47de-a132-62d7e733a751","Type":"ContainerStarted","Data":"9d101873566d4686b48dd9a545f4baea9b1eb6d0b52724d603d5e07618f144ac"}
Jul 06 14:22:56.649185 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:56.649142    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sljnn" event={"ID":"6105b3e2-89cf-49fb-af7f-654444a16b6a","Type":"ContainerStarted","Data":"47d40e8c03ef4705f85c8102ccec5137a4191ed06e0568619e6109324c9ca13f"}
Jul 06 14:22:57.003710 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:57.002041    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/537a943a-73f7-4e98-b74c-dde1d0ff1c92-metrics-certs\") pod \"network-metrics-daemon-mqgwp\" (UID: \"537a943a-73f7-4e98-b74c-dde1d0ff1c92\") " pod="openshift-multus/network-metrics-daemon-mqgwp"
Jul 06 14:22:57.003710 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:57.002107    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mn4nx\" (UniqueName: \"kubernetes.io/projected/b81991eb-ee77-4c04-b880-a34d9419ca14-kube-api-access-mn4nx\") pod \"network-check-target-gx87x\" (UID: \"b81991eb-ee77-4c04-b880-a34d9419ca14\") " pod="openshift-network-diagnostics/network-check-target-gx87x"
Jul 06 14:22:57.003710 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:22:57.002285    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 14:22:57.003710 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:22:57.002310    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 14:22:57.003710 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:22:57.002323    2582 projected.go:196] Error preparing data for projected volume kube-api-access-mn4nx for pod openshift-network-diagnostics/network-check-target-gx87x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 14:22:57.003710 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:22:57.002382    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b81991eb-ee77-4c04-b880-a34d9419ca14-kube-api-access-mn4nx podName:b81991eb-ee77-4c04-b880-a34d9419ca14 nodeName:}" failed. No retries permitted until 2026-07-06 14:22:59.002362595 +0000 UTC m=+5.922643033 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-mn4nx" (UniqueName: "kubernetes.io/projected/b81991eb-ee77-4c04-b880-a34d9419ca14-kube-api-access-mn4nx") pod "network-check-target-gx87x" (UID: "b81991eb-ee77-4c04-b880-a34d9419ca14") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 14:22:57.003710 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:22:57.002853    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 14:22:57.003710 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:22:57.002904    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/537a943a-73f7-4e98-b74c-dde1d0ff1c92-metrics-certs podName:537a943a-73f7-4e98-b74c-dde1d0ff1c92 nodeName:}" failed. No retries permitted until 2026-07-06 14:22:59.002888542 +0000 UTC m=+5.923168955 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/537a943a-73f7-4e98-b74c-dde1d0ff1c92-metrics-certs") pod "network-metrics-daemon-mqgwp" (UID: "537a943a-73f7-4e98-b74c-dde1d0ff1c92") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 14:22:57.103308 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:57.102754    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/201f4c6e-b9d8-4a99-9f4e-b8f59e69ad1d-original-pull-secret\") pod \"global-pull-secret-syncer-mbkvc\" (UID: \"201f4c6e-b9d8-4a99-9f4e-b8f59e69ad1d\") " pod="kube-system/global-pull-secret-syncer-mbkvc"
Jul 06 14:22:57.103308 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:22:57.102902    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 14:22:57.103308 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:22:57.102960    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/201f4c6e-b9d8-4a99-9f4e-b8f59e69ad1d-original-pull-secret podName:201f4c6e-b9d8-4a99-9f4e-b8f59e69ad1d nodeName:}" failed. No retries permitted until 2026-07-06 14:22:59.102943725 +0000 UTC m=+6.023224137 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/201f4c6e-b9d8-4a99-9f4e-b8f59e69ad1d-original-pull-secret") pod "global-pull-secret-syncer-mbkvc" (UID: "201f4c6e-b9d8-4a99-9f4e-b8f59e69ad1d") : object "kube-system"/"original-pull-secret" not registered
Jul 06 14:22:57.424242 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:57.424071    2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 14:17:55 +0000 UTC" deadline="2028-04-16 14:38:59.437859652 +0000 UTC"
Jul 06 14:22:57.424242 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:57.424139    2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15600h16m2.01372504s"
Jul 06 14:22:57.495080 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:57.495050    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mqgwp"
Jul 06 14:22:57.495246 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:22:57.495163    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mqgwp" podUID="537a943a-73f7-4e98-b74c-dde1d0ff1c92"
Jul 06 14:22:57.495488 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:57.495470    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mbkvc"
Jul 06 14:22:57.495568 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:22:57.495552    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mbkvc" podUID="201f4c6e-b9d8-4a99-9f4e-b8f59e69ad1d"
Jul 06 14:22:57.495625 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:57.495600    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gx87x"
Jul 06 14:22:57.495694 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:22:57.495667    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gx87x" podUID="b81991eb-ee77-4c04-b880-a34d9419ca14"
Jul 06 14:22:59.016122 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:59.016084    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mn4nx\" (UniqueName: \"kubernetes.io/projected/b81991eb-ee77-4c04-b880-a34d9419ca14-kube-api-access-mn4nx\") pod \"network-check-target-gx87x\" (UID: \"b81991eb-ee77-4c04-b880-a34d9419ca14\") " pod="openshift-network-diagnostics/network-check-target-gx87x"
Jul 06 14:22:59.016591 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:59.016172    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/537a943a-73f7-4e98-b74c-dde1d0ff1c92-metrics-certs\") pod \"network-metrics-daemon-mqgwp\" (UID: \"537a943a-73f7-4e98-b74c-dde1d0ff1c92\") " pod="openshift-multus/network-metrics-daemon-mqgwp"
Jul 06 14:22:59.016591 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:22:59.016293    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 14:22:59.016591 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:22:59.016378    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/537a943a-73f7-4e98-b74c-dde1d0ff1c92-metrics-certs podName:537a943a-73f7-4e98-b74c-dde1d0ff1c92 nodeName:}" failed. No retries permitted until 2026-07-06 14:23:03.016331888 +0000 UTC m=+9.936612302 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/537a943a-73f7-4e98-b74c-dde1d0ff1c92-metrics-certs") pod "network-metrics-daemon-mqgwp" (UID: "537a943a-73f7-4e98-b74c-dde1d0ff1c92") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 14:22:59.016591 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:22:59.016473    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 14:22:59.016591 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:22:59.016487    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 14:22:59.016591 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:22:59.016498    2582 projected.go:196] Error preparing data for projected volume kube-api-access-mn4nx for pod openshift-network-diagnostics/network-check-target-gx87x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 14:22:59.016591 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:22:59.016537    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b81991eb-ee77-4c04-b880-a34d9419ca14-kube-api-access-mn4nx podName:b81991eb-ee77-4c04-b880-a34d9419ca14 nodeName:}" failed. No retries permitted until 2026-07-06 14:23:03.016524543 +0000 UTC m=+9.936804953 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-mn4nx" (UniqueName: "kubernetes.io/projected/b81991eb-ee77-4c04-b880-a34d9419ca14-kube-api-access-mn4nx") pod "network-check-target-gx87x" (UID: "b81991eb-ee77-4c04-b880-a34d9419ca14") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 14:22:59.117084 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:59.117048    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/201f4c6e-b9d8-4a99-9f4e-b8f59e69ad1d-original-pull-secret\") pod \"global-pull-secret-syncer-mbkvc\" (UID: \"201f4c6e-b9d8-4a99-9f4e-b8f59e69ad1d\") " pod="kube-system/global-pull-secret-syncer-mbkvc"
Jul 06 14:22:59.117266 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:22:59.117247    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 14:22:59.117337 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:22:59.117308    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/201f4c6e-b9d8-4a99-9f4e-b8f59e69ad1d-original-pull-secret podName:201f4c6e-b9d8-4a99-9f4e-b8f59e69ad1d nodeName:}" failed. No retries permitted until 2026-07-06 14:23:03.117290356 +0000 UTC m=+10.037570786 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/201f4c6e-b9d8-4a99-9f4e-b8f59e69ad1d-original-pull-secret") pod "global-pull-secret-syncer-mbkvc" (UID: "201f4c6e-b9d8-4a99-9f4e-b8f59e69ad1d") : object "kube-system"/"original-pull-secret" not registered
Jul 06 14:22:59.494192 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:59.494158    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mqgwp"
Jul 06 14:22:59.494360 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:59.494156    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gx87x"
Jul 06 14:22:59.494360 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:22:59.494326    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mbkvc"
Jul 06 14:22:59.494360 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:22:59.494333    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mqgwp" podUID="537a943a-73f7-4e98-b74c-dde1d0ff1c92"
Jul 06 14:22:59.494532 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:22:59.494419    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gx87x" podUID="b81991eb-ee77-4c04-b880-a34d9419ca14"
Jul 06 14:22:59.494532 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:22:59.494493    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mbkvc" podUID="201f4c6e-b9d8-4a99-9f4e-b8f59e69ad1d"
Jul 06 14:23:01.493339 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:01.493241    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mbkvc"
Jul 06 14:23:01.493339 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:01.493280    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mqgwp"
Jul 06 14:23:01.493874 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:01.493241    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gx87x"
Jul 06 14:23:01.493874 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:01.493379    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mbkvc" podUID="201f4c6e-b9d8-4a99-9f4e-b8f59e69ad1d"
Jul 06 14:23:01.494173 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:01.494130    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gx87x" podUID="b81991eb-ee77-4c04-b880-a34d9419ca14"
Jul 06 14:23:01.494379 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:01.494328    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mqgwp" podUID="537a943a-73f7-4e98-b74c-dde1d0ff1c92"
Jul 06 14:23:03.050083 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:03.050043    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mn4nx\" (UniqueName: \"kubernetes.io/projected/b81991eb-ee77-4c04-b880-a34d9419ca14-kube-api-access-mn4nx\") pod \"network-check-target-gx87x\" (UID: \"b81991eb-ee77-4c04-b880-a34d9419ca14\") " pod="openshift-network-diagnostics/network-check-target-gx87x"
Jul 06 14:23:03.050575 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:03.050145    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/537a943a-73f7-4e98-b74c-dde1d0ff1c92-metrics-certs\") pod \"network-metrics-daemon-mqgwp\" (UID: \"537a943a-73f7-4e98-b74c-dde1d0ff1c92\") " pod="openshift-multus/network-metrics-daemon-mqgwp"
Jul 06 14:23:03.050575 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:03.050242    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 14:23:03.050575 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:03.050269    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 14:23:03.050575 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:03.050283    2582 projected.go:196] Error preparing data for projected volume kube-api-access-mn4nx for pod openshift-network-diagnostics/network-check-target-gx87x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 14:23:03.050575 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:03.050281    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 14:23:03.050575 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:03.050345    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b81991eb-ee77-4c04-b880-a34d9419ca14-kube-api-access-mn4nx podName:b81991eb-ee77-4c04-b880-a34d9419ca14 nodeName:}" failed. No retries permitted until 2026-07-06 14:23:11.050324697 +0000 UTC m=+17.970605123 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-mn4nx" (UniqueName: "kubernetes.io/projected/b81991eb-ee77-4c04-b880-a34d9419ca14-kube-api-access-mn4nx") pod "network-check-target-gx87x" (UID: "b81991eb-ee77-4c04-b880-a34d9419ca14") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 14:23:03.050575 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:03.050367    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/537a943a-73f7-4e98-b74c-dde1d0ff1c92-metrics-certs podName:537a943a-73f7-4e98-b74c-dde1d0ff1c92 nodeName:}" failed. No retries permitted until 2026-07-06 14:23:11.050356138 +0000 UTC m=+17.970636550 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/537a943a-73f7-4e98-b74c-dde1d0ff1c92-metrics-certs") pod "network-metrics-daemon-mqgwp" (UID: "537a943a-73f7-4e98-b74c-dde1d0ff1c92") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 14:23:03.151140 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:03.151101    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/201f4c6e-b9d8-4a99-9f4e-b8f59e69ad1d-original-pull-secret\") pod \"global-pull-secret-syncer-mbkvc\" (UID: \"201f4c6e-b9d8-4a99-9f4e-b8f59e69ad1d\") " pod="kube-system/global-pull-secret-syncer-mbkvc"
Jul 06 14:23:03.151334 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:03.151286    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 14:23:03.151400 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:03.151363    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/201f4c6e-b9d8-4a99-9f4e-b8f59e69ad1d-original-pull-secret podName:201f4c6e-b9d8-4a99-9f4e-b8f59e69ad1d nodeName:}" failed. No retries permitted until 2026-07-06 14:23:11.15134435 +0000 UTC m=+18.071624763 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/201f4c6e-b9d8-4a99-9f4e-b8f59e69ad1d-original-pull-secret") pod "global-pull-secret-syncer-mbkvc" (UID: "201f4c6e-b9d8-4a99-9f4e-b8f59e69ad1d") : object "kube-system"/"original-pull-secret" not registered
Jul 06 14:23:03.494022 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:03.493984    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mqgwp"
Jul 06 14:23:03.494200 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:03.494133    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mqgwp" podUID="537a943a-73f7-4e98-b74c-dde1d0ff1c92"
Jul 06 14:23:03.494714 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:03.494555    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mbkvc"
Jul 06 14:23:03.494714 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:03.494675    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mbkvc" podUID="201f4c6e-b9d8-4a99-9f4e-b8f59e69ad1d"
Jul 06 14:23:03.495841 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:03.495702    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gx87x"
Jul 06 14:23:03.495841 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:03.495796    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gx87x" podUID="b81991eb-ee77-4c04-b880-a34d9419ca14"
Jul 06 14:23:05.493882 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:05.493812    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mqgwp"
Jul 06 14:23:05.493882 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:05.493853    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gx87x"
Jul 06 14:23:05.494396 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:05.493813    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mbkvc"
Jul 06 14:23:05.494396 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:05.494045    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mqgwp" podUID="537a943a-73f7-4e98-b74c-dde1d0ff1c92"
Jul 06 14:23:05.494396 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:05.494176    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gx87x" podUID="b81991eb-ee77-4c04-b880-a34d9419ca14"
Jul 06 14:23:05.494396 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:05.494275    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mbkvc" podUID="201f4c6e-b9d8-4a99-9f4e-b8f59e69ad1d"
Jul 06 14:23:07.493686 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:07.493146    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mbkvc"
Jul 06 14:23:07.493686 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:07.493276    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mbkvc" podUID="201f4c6e-b9d8-4a99-9f4e-b8f59e69ad1d"
Jul 06 14:23:07.493686 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:07.493447    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gx87x"
Jul 06 14:23:07.493686 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:07.493461    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mqgwp"
Jul 06 14:23:07.493686 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:07.493552    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gx87x" podUID="b81991eb-ee77-4c04-b880-a34d9419ca14"
Jul 06 14:23:07.493686 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:07.493666    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mqgwp" podUID="537a943a-73f7-4e98-b74c-dde1d0ff1c92"
Jul 06 14:23:09.493804 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:09.493769    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mqgwp"
Jul 06 14:23:09.493804 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:09.493801    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gx87x"
Jul 06 14:23:09.494326 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:09.493773    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mbkvc"
Jul 06 14:23:09.494326 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:09.493897    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mqgwp" podUID="537a943a-73f7-4e98-b74c-dde1d0ff1c92"
Jul 06 14:23:09.494326 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:09.493975    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mbkvc" podUID="201f4c6e-b9d8-4a99-9f4e-b8f59e69ad1d"
Jul 06 14:23:09.494326 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:09.494031    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gx87x" podUID="b81991eb-ee77-4c04-b880-a34d9419ca14"
Jul 06 14:23:11.115758 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:11.115724    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/537a943a-73f7-4e98-b74c-dde1d0ff1c92-metrics-certs\") pod \"network-metrics-daemon-mqgwp\" (UID: \"537a943a-73f7-4e98-b74c-dde1d0ff1c92\") " pod="openshift-multus/network-metrics-daemon-mqgwp"
Jul 06 14:23:11.116211 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:11.115786    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mn4nx\" (UniqueName: \"kubernetes.io/projected/b81991eb-ee77-4c04-b880-a34d9419ca14-kube-api-access-mn4nx\") pod \"network-check-target-gx87x\" (UID: \"b81991eb-ee77-4c04-b880-a34d9419ca14\") " pod="openshift-network-diagnostics/network-check-target-gx87x"
Jul 06 14:23:11.116211 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:11.115900    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 14:23:11.116211 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:11.115919    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 14:23:11.116211 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:11.115940    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 14:23:11.116211 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:11.115954    2582 projected.go:196] Error preparing data for projected volume kube-api-access-mn4nx for pod openshift-network-diagnostics/network-check-target-gx87x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 14:23:11.116211 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:11.115973    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/537a943a-73f7-4e98-b74c-dde1d0ff1c92-metrics-certs podName:537a943a-73f7-4e98-b74c-dde1d0ff1c92 nodeName:}" failed. No retries permitted until 2026-07-06 14:23:27.115949028 +0000 UTC m=+34.036229446 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/537a943a-73f7-4e98-b74c-dde1d0ff1c92-metrics-certs") pod "network-metrics-daemon-mqgwp" (UID: "537a943a-73f7-4e98-b74c-dde1d0ff1c92") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 14:23:11.116211 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:11.115993    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b81991eb-ee77-4c04-b880-a34d9419ca14-kube-api-access-mn4nx podName:b81991eb-ee77-4c04-b880-a34d9419ca14 nodeName:}" failed. No retries permitted until 2026-07-06 14:23:27.115982157 +0000 UTC m=+34.036262563 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-mn4nx" (UniqueName: "kubernetes.io/projected/b81991eb-ee77-4c04-b880-a34d9419ca14-kube-api-access-mn4nx") pod "network-check-target-gx87x" (UID: "b81991eb-ee77-4c04-b880-a34d9419ca14") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 14:23:11.216116 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:11.216072    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/201f4c6e-b9d8-4a99-9f4e-b8f59e69ad1d-original-pull-secret\") pod \"global-pull-secret-syncer-mbkvc\" (UID: \"201f4c6e-b9d8-4a99-9f4e-b8f59e69ad1d\") " pod="kube-system/global-pull-secret-syncer-mbkvc"
Jul 06 14:23:11.216284 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:11.216244    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 14:23:11.216333 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:11.216312    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/201f4c6e-b9d8-4a99-9f4e-b8f59e69ad1d-original-pull-secret podName:201f4c6e-b9d8-4a99-9f4e-b8f59e69ad1d nodeName:}" failed. No retries permitted until 2026-07-06 14:23:27.216296955 +0000 UTC m=+34.136577366 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/201f4c6e-b9d8-4a99-9f4e-b8f59e69ad1d-original-pull-secret") pod "global-pull-secret-syncer-mbkvc" (UID: "201f4c6e-b9d8-4a99-9f4e-b8f59e69ad1d") : object "kube-system"/"original-pull-secret" not registered
Jul 06 14:23:11.494240 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:11.494204    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gx87x"
Jul 06 14:23:11.494240 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:11.494228    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mbkvc"
Jul 06 14:23:11.494489 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:11.494233    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mqgwp"
Jul 06 14:23:11.494489 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:11.494333    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gx87x" podUID="b81991eb-ee77-4c04-b880-a34d9419ca14"
Jul 06 14:23:11.494489 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:11.494411    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mbkvc" podUID="201f4c6e-b9d8-4a99-9f4e-b8f59e69ad1d"
Jul 06 14:23:11.494489 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:11.494474    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mqgwp" podUID="537a943a-73f7-4e98-b74c-dde1d0ff1c92"
Jul 06 14:23:13.494190 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:13.494074    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mqgwp"
Jul 06 14:23:13.494666 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:13.494195    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mbkvc"
Jul 06 14:23:13.494666 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:13.494232    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gx87x"
Jul 06 14:23:13.494666 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:13.494190    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mqgwp" podUID="537a943a-73f7-4e98-b74c-dde1d0ff1c92"
Jul 06 14:23:13.494666 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:13.494311    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mbkvc" podUID="201f4c6e-b9d8-4a99-9f4e-b8f59e69ad1d"
Jul 06 14:23:13.494666 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:13.494414    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gx87x" podUID="b81991eb-ee77-4c04-b880-a34d9419ca14"
Jul 06 14:23:15.493541 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:15.493179    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mbkvc"
Jul 06 14:23:15.493971 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:15.493645    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mbkvc" podUID="201f4c6e-b9d8-4a99-9f4e-b8f59e69ad1d"
Jul 06 14:23:15.494075 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:15.494056    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gx87x"
Jul 06 14:23:15.494180 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:15.494155    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gx87x" podUID="b81991eb-ee77-4c04-b880-a34d9419ca14"
Jul 06 14:23:15.494252 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:15.494207    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mqgwp"
Jul 06 14:23:15.494363 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:15.494346    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mqgwp" podUID="537a943a-73f7-4e98-b74c-dde1d0ff1c92"
Jul 06 14:23:15.718010 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:15.717978    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-spzdt" event={"ID":"e7dc5ff4-a8fa-47de-a132-62d7e733a751","Type":"ContainerStarted","Data":"ead2923bd339dd6b5d48afe6e9baed4397931f52bb1b53f96ce451dce2d63cac"}
Jul 06 14:23:15.719322 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:15.719299    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-r6hzx" event={"ID":"68e9b176-5e66-41aa-8bf1-23e7b897c9a9","Type":"ContainerStarted","Data":"a8ce3b692017e982ee1e3db1edee801cbd42b4fe84e06b805bfebf3b4839c4fd"}
Jul 06 14:23:15.721255 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:15.721223    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-54jfj" event={"ID":"5b575f5c-4bf8-432e-ac6b-76ee25681e8b","Type":"ContainerStarted","Data":"020c1a22b5aa124dff1774661273480e424d5bd119dd0f6cf049910eec4f3480"}
Jul 06 14:23:15.721339 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:15.721307    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-54jfj" event={"ID":"5b575f5c-4bf8-432e-ac6b-76ee25681e8b","Type":"ContainerStarted","Data":"20892af7b737179159401d5d43fd48d3e4e89cd11a20e87e114fc99cd93b03a2"}
Jul 06 14:23:15.721394 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:15.721359    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-54jfj" event={"ID":"5b575f5c-4bf8-432e-ac6b-76ee25681e8b","Type":"ContainerStarted","Data":"56cf34a5a953545892a2801bc9f513879d72c5d8c2ec1677acfb5c669f13363c"}
Jul 06 14:23:15.727291 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:15.727269    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-145.ec2.internal" event={"ID":"2683f4c10fa530ba79d25a7535e0e727","Type":"ContainerStarted","Data":"ebafd355876ec22cd77fcb83dfe6030a78afac3b3ba4a063f7f1d2169436b985"}
Jul 06 14:23:15.739273 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:15.739203    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-spzdt" podStartSLOduration=3.218479352 podStartE2EDuration="22.73918398s" totalImagesPullingTime="19.520704628s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 14:22:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:23:15.73799839 +0000 UTC m=+22.658278819" watchObservedRunningTime="2026-07-06 14:23:15.73918398 +0000 UTC m=+22.659464411"
Jul 06 14:23:15.754890 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:15.754849    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-145.ec2.internal" podStartSLOduration=21.754834058 podStartE2EDuration="21.754834058s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 14:22:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:23:15.754192041 +0000 UTC m=+22.674472470" watchObservedRunningTime="2026-07-06 14:23:15.754834058 +0000 UTC m=+22.675114483"
Jul 06 14:23:15.773637 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:15.773590    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-r6hzx" podStartSLOduration=3.239643294 podStartE2EDuration="22.773575012s" totalImagesPullingTime="19.533931718s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 14:22:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:23:15.773086588 +0000 UTC m=+22.693367018" watchObservedRunningTime="2026-07-06 14:23:15.773575012 +0000 UTC m=+22.693855434"
Jul 06 14:23:16.731141 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:16.731097    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-mmhv2" event={"ID":"aa9ce18d-f18b-4966-963d-dc7068bd5c8c","Type":"ContainerStarted","Data":"c79c84303aa6ddf422a1e5c0e27f8b13cd547794a4ca5192f3cf214b73b97828"}
Jul 06 14:23:16.734540 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:16.734513    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-54jfj" event={"ID":"5b575f5c-4bf8-432e-ac6b-76ee25681e8b","Type":"ContainerStarted","Data":"745281082b507584748fe9ac9414de3e5cb7ec914a0f9a50025be6679dd2f809"}
Jul 06 14:23:16.734683 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:16.734592    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-54jfj" event={"ID":"5b575f5c-4bf8-432e-ac6b-76ee25681e8b","Type":"ContainerStarted","Data":"6b67ff9510e93e88ada7df8400472715da5b10d1197a3cc7493fa28f2dd2ad2f"}
Jul 06 14:23:16.734683 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:16.734644    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-54jfj" event={"ID":"5b575f5c-4bf8-432e-ac6b-76ee25681e8b","Type":"ContainerStarted","Data":"411323f5a044c83c1ec6868b63ad11c346a13ef3c4c262286175d45b8fe03375"}
Jul 06 14:23:16.736147 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:16.736116    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-k72tt" event={"ID":"19ce583c-bcbe-4393-ae34-afd29df988b7","Type":"ContainerStarted","Data":"a65db8ba6b954e50256bcb4e774c0be597f0c681e224268231ac0e0db630e251"}
Jul 06 14:23:16.737843 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:16.737819    2582 generic.go:356] "Generic (PLEG): container finished" podID="1b497cad55f7d3abf84dbe8f19ead2fb" containerID="1c44561e307b64958319eb34145ee965de1737937723b85efc59658eeb685eff" exitCode=0
Jul 06 14:23:16.737941 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:16.737901    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-145.ec2.internal" event={"ID":"1b497cad55f7d3abf84dbe8f19ead2fb","Type":"ContainerDied","Data":"1c44561e307b64958319eb34145ee965de1737937723b85efc59658eeb685eff"}
Jul 06 14:23:16.739577 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:16.739550    2582 generic.go:356] "Generic (PLEG): container finished" podID="98121467-ea9e-4fdc-b195-85e95b837664" containerID="bc533852461c064ccffb14890827ab8f2cbe6ca4ea2936d0009255d8247a99e5" exitCode=0
Jul 06 14:23:16.739715 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:16.739586    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p6g5d" event={"ID":"98121467-ea9e-4fdc-b195-85e95b837664","Type":"ContainerDied","Data":"bc533852461c064ccffb14890827ab8f2cbe6ca4ea2936d0009255d8247a99e5"}
Jul 06 14:23:16.741667 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:16.741628    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-95qwv" event={"ID":"5554b54b-fec2-4059-9f42-845d87fc9961","Type":"ContainerStarted","Data":"1034aed0890efa020c0c2adc0b4e89db06747ffceea2e32169c65cadce91f30d"}
Jul 06 14:23:16.743307 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:16.743281    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sljnn" event={"ID":"6105b3e2-89cf-49fb-af7f-654444a16b6a","Type":"ContainerStarted","Data":"ff54b5caac8c0b94b4e690bf8db360792acb72b54a8eb5370914aa0ae9362fd1"}
Jul 06 14:23:16.744759 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:16.744735    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-8lp29" event={"ID":"ee1bac90-b7e7-41b0-a7e0-b804e6fafdef","Type":"ContainerStarted","Data":"6284629e6e0798207ed061ba3007e86b1c57a8f9c320b3ec0b08829a8208691e"}
Jul 06 14:23:16.747605 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:16.747572    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-mmhv2" podStartSLOduration=8.979601229 podStartE2EDuration="23.747560978s" totalImagesPullingTime="14.767959749s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 14:22:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:23:16.747414177 +0000 UTC m=+23.667694608" watchObservedRunningTime="2026-07-06 14:23:16.747560978 +0000 UTC m=+23.667841406"
Jul 06 14:23:16.781574 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:16.781382    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-95qwv" podStartSLOduration=4.22436212 podStartE2EDuration="23.78136717s" totalImagesPullingTime="19.55700505s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 14:22:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:23:16.781068463 +0000 UTC m=+23.701348891" watchObservedRunningTime="2026-07-06 14:23:16.78136717 +0000 UTC m=+23.701647599"
Jul 06 14:23:16.798236 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:16.798127    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-8lp29" podStartSLOduration=9.03955396 podStartE2EDuration="23.798112171s" totalImagesPullingTime="14.758558211s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:22:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:23:16.797517551 +0000 UTC m=+23.717797979" watchObservedRunningTime="2026-07-06 14:23:16.798112171 +0000 UTC m=+23.718392599"
Jul 06 14:23:16.840624 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:16.840580    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-k72tt" podStartSLOduration=4.309490898 podStartE2EDuration="23.840564852s" totalImagesPullingTime="19.531073954s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 14:22:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:23:16.840170638 +0000 UTC m=+23.760451067" watchObservedRunningTime="2026-07-06 14:23:16.840564852 +0000 UTC m=+23.760845280"
Jul 06 14:23:17.383959 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:17.383930    2582 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 06 14:23:17.470033 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:17.469932    2582 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-06T14:23:17.383954309Z","UUID":"d1546845-3440-4b54-b0d3-b6df63125e50","Handler":null,"Name":"","Endpoint":""}
Jul 06 14:23:17.472676 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:17.472640    2582 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 06 14:23:17.472821 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:17.472698    2582 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 06 14:23:17.493523 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:17.493489    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mbkvc"
Jul 06 14:23:17.493523 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:17.493506    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mqgwp"
Jul 06 14:23:17.493749 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:17.493590    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mbkvc" podUID="201f4c6e-b9d8-4a99-9f4e-b8f59e69ad1d"
Jul 06 14:23:17.493749 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:17.493641    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gx87x"
Jul 06 14:23:17.493817 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:17.493767    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mqgwp" podUID="537a943a-73f7-4e98-b74c-dde1d0ff1c92"
Jul 06 14:23:17.493865 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:17.493846    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gx87x" podUID="b81991eb-ee77-4c04-b880-a34d9419ca14"
Jul 06 14:23:17.749395 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:17.749356    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-145.ec2.internal" event={"ID":"1b497cad55f7d3abf84dbe8f19ead2fb","Type":"ContainerStarted","Data":"dc08c3062219f1a9bff289036cb141cc61db4e9567083a294dc1ea7edf2b1758"}
Jul 06 14:23:17.751452 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:17.751423    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sljnn" event={"ID":"6105b3e2-89cf-49fb-af7f-654444a16b6a","Type":"ContainerStarted","Data":"a3917ef63b3a25ea035a72f338b2b928dcd190067fdbe0c5fc5c8a23dc168615"}
Jul 06 14:23:17.766722 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:17.766668    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-145.ec2.internal" podStartSLOduration=23.766637327 podStartE2EDuration="23.766637327s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 14:22:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:23:17.766228361 +0000 UTC m=+24.686508793" watchObservedRunningTime="2026-07-06 14:23:17.766637327 +0000 UTC m=+24.686917756"
Jul 06 14:23:18.070559 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:18.070477    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-8lp29"
Jul 06 14:23:18.071113 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:18.071096    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-8lp29"
Jul 06 14:23:18.757323 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:18.757291    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-54jfj" event={"ID":"5b575f5c-4bf8-432e-ac6b-76ee25681e8b","Type":"ContainerStarted","Data":"e527aed480884d64b0e408337c63bcc1aace340de71f723955f66253da84c014"}
Jul 06 14:23:19.493717 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:19.493684    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mqgwp"
Jul 06 14:23:19.493882 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:19.493684    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mbkvc"
Jul 06 14:23:19.493882 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:19.493820    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mqgwp" podUID="537a943a-73f7-4e98-b74c-dde1d0ff1c92"
Jul 06 14:23:19.493882 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:19.493853    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mbkvc" podUID="201f4c6e-b9d8-4a99-9f4e-b8f59e69ad1d"
Jul 06 14:23:19.493882 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:19.493692    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gx87x"
Jul 06 14:23:19.494014 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:19.493931    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gx87x" podUID="b81991eb-ee77-4c04-b880-a34d9419ca14"
Jul 06 14:23:19.655571 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:19.655541    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-8lp29"
Jul 06 14:23:19.656146 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:19.656121    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-8lp29"
Jul 06 14:23:19.762323 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:19.762241    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sljnn" event={"ID":"6105b3e2-89cf-49fb-af7f-654444a16b6a","Type":"ContainerStarted","Data":"bd2ca9f58e978bb71d0597aedef3e154598a28938a160913b0d0226f6fa8755b"}
Jul 06 14:23:19.782551 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:19.782502    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sljnn" podStartSLOduration=4.606025419 podStartE2EDuration="26.782486293s" totalImagesPullingTime="22.176460874s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 14:22:53 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:23:19.782321519 +0000 UTC m=+26.702601949" watchObservedRunningTime="2026-07-06 14:23:19.782486293 +0000 UTC m=+26.702766730"
Jul 06 14:23:20.775612 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:20.775426    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-54jfj" event={"ID":"5b575f5c-4bf8-432e-ac6b-76ee25681e8b","Type":"ContainerStarted","Data":"113bbe80569becda0e3a7c9ec1eeac112c40352835c2ba95c08e088d7241e501"}
Jul 06 14:23:20.802420 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:20.802368    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-54jfj" podStartSLOduration=8.174809299 podStartE2EDuration="27.802351567s" totalImagesPullingTime="19.627542268s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 14:22:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:23:20.801895018 +0000 UTC m=+27.722175458" watchObservedRunningTime="2026-07-06 14:23:20.802351567 +0000 UTC m=+27.722631996"
Jul 06 14:23:21.494172 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:21.494131    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gx87x"
Jul 06 14:23:21.494347 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:21.494131    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mbkvc"
Jul 06 14:23:21.494347 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:21.494255    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mqgwp"
Jul 06 14:23:21.494347 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:21.494252    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gx87x" podUID="b81991eb-ee77-4c04-b880-a34d9419ca14"
Jul 06 14:23:21.494484 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:21.494348    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mbkvc" podUID="201f4c6e-b9d8-4a99-9f4e-b8f59e69ad1d"
Jul 06 14:23:21.494484 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:21.494450    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mqgwp" podUID="537a943a-73f7-4e98-b74c-dde1d0ff1c92"
Jul 06 14:23:21.778353 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:21.778264    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-54jfj"
Jul 06 14:23:21.779058 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:21.778360    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-54jfj"
Jul 06 14:23:21.779058 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:21.778410    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-54jfj"
Jul 06 14:23:21.795475 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:21.795447    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-54jfj"
Jul 06 14:23:21.795992 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:21.795971    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-54jfj"
Jul 06 14:23:22.786023 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:22.785989    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-mqgwp"]
Jul 06 14:23:22.786688 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:22.786094    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mqgwp"
Jul 06 14:23:22.786688 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:22.786209    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mqgwp" podUID="537a943a-73f7-4e98-b74c-dde1d0ff1c92"
Jul 06 14:23:22.786770 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:22.786736    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-mbkvc"]
Jul 06 14:23:22.786812 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:22.786801    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mbkvc"
Jul 06 14:23:22.786893 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:22.786877    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mbkvc" podUID="201f4c6e-b9d8-4a99-9f4e-b8f59e69ad1d"
Jul 06 14:23:22.787957 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:22.787937    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-gx87x"]
Jul 06 14:23:22.788045 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:22.788003    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gx87x"
Jul 06 14:23:22.788087 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:22.788070    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gx87x" podUID="b81991eb-ee77-4c04-b880-a34d9419ca14"
Jul 06 14:23:23.783272 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:23.783080    2582 generic.go:356] "Generic (PLEG): container finished" podID="98121467-ea9e-4fdc-b195-85e95b837664" containerID="8e98c18c36e187fb2022984392734c66296af4f99a08e1188dc6042d6d00f23d" exitCode=0
Jul 06 14:23:23.783495 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:23.783164    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p6g5d" event={"ID":"98121467-ea9e-4fdc-b195-85e95b837664","Type":"ContainerDied","Data":"8e98c18c36e187fb2022984392734c66296af4f99a08e1188dc6042d6d00f23d"}
Jul 06 14:23:24.494086 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:24.494055    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gx87x"
Jul 06 14:23:24.494468 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:24.494177    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gx87x" podUID="b81991eb-ee77-4c04-b880-a34d9419ca14"
Jul 06 14:23:24.494468 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:24.494073    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mqgwp"
Jul 06 14:23:24.494468 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:24.494055    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mbkvc"
Jul 06 14:23:24.494468 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:24.494266    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mqgwp" podUID="537a943a-73f7-4e98-b74c-dde1d0ff1c92"
Jul 06 14:23:24.494468 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:24.494386    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mbkvc" podUID="201f4c6e-b9d8-4a99-9f4e-b8f59e69ad1d"
Jul 06 14:23:25.191694 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:25.191646    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:23:25.288903 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:25.288863    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:23:25.789413 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:25.789375    2582 generic.go:356] "Generic (PLEG): container finished" podID="98121467-ea9e-4fdc-b195-85e95b837664" containerID="f07e67efd410dcc618283c995575f2aabdc64352e33e0183136b10591acbf2ee" exitCode=0
Jul 06 14:23:25.789842 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:25.789419    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p6g5d" event={"ID":"98121467-ea9e-4fdc-b195-85e95b837664","Type":"ContainerDied","Data":"f07e67efd410dcc618283c995575f2aabdc64352e33e0183136b10591acbf2ee"}
Jul 06 14:23:26.493831 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:26.493796    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mbkvc"
Jul 06 14:23:26.493974 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:26.493908    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mbkvc" podUID="201f4c6e-b9d8-4a99-9f4e-b8f59e69ad1d"
Jul 06 14:23:26.494023 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:26.494000    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gx87x"
Jul 06 14:23:26.494137 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:26.494112    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gx87x" podUID="b81991eb-ee77-4c04-b880-a34d9419ca14"
Jul 06 14:23:26.494188 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:26.494159    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mqgwp"
Jul 06 14:23:26.494292 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:26.494274    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mqgwp" podUID="537a943a-73f7-4e98-b74c-dde1d0ff1c92"
Jul 06 14:23:26.794280 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:26.794197    2582 generic.go:356] "Generic (PLEG): container finished" podID="98121467-ea9e-4fdc-b195-85e95b837664" containerID="ea85ed703c84a7d0c069e9ec0fd9cec9a09d667dd971c634606b349b8204faa5" exitCode=0
Jul 06 14:23:26.794280 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:26.794238    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p6g5d" event={"ID":"98121467-ea9e-4fdc-b195-85e95b837664","Type":"ContainerDied","Data":"ea85ed703c84a7d0c069e9ec0fd9cec9a09d667dd971c634606b349b8204faa5"}
Jul 06 14:23:27.135020 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:27.134942    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mn4nx\" (UniqueName: \"kubernetes.io/projected/b81991eb-ee77-4c04-b880-a34d9419ca14-kube-api-access-mn4nx\") pod \"network-check-target-gx87x\" (UID: \"b81991eb-ee77-4c04-b880-a34d9419ca14\") " pod="openshift-network-diagnostics/network-check-target-gx87x"
Jul 06 14:23:27.135020 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:27.135006    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/537a943a-73f7-4e98-b74c-dde1d0ff1c92-metrics-certs\") pod \"network-metrics-daemon-mqgwp\" (UID: \"537a943a-73f7-4e98-b74c-dde1d0ff1c92\") " pod="openshift-multus/network-metrics-daemon-mqgwp"
Jul 06 14:23:27.135175 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:27.135092    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 14:23:27.135175 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:27.135115    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 14:23:27.135175 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:27.135124    2582 projected.go:196] Error preparing data for projected volume kube-api-access-mn4nx for pod openshift-network-diagnostics/network-check-target-gx87x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 14:23:27.135175 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:27.135168    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b81991eb-ee77-4c04-b880-a34d9419ca14-kube-api-access-mn4nx podName:b81991eb-ee77-4c04-b880-a34d9419ca14 nodeName:}" failed. No retries permitted until 2026-07-06 14:23:59.135154436 +0000 UTC m=+66.055434844 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-mn4nx" (UniqueName: "kubernetes.io/projected/b81991eb-ee77-4c04-b880-a34d9419ca14-kube-api-access-mn4nx") pod "network-check-target-gx87x" (UID: "b81991eb-ee77-4c04-b880-a34d9419ca14") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 14:23:27.135335 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:27.135094    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 14:23:27.135335 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:27.135220    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/537a943a-73f7-4e98-b74c-dde1d0ff1c92-metrics-certs podName:537a943a-73f7-4e98-b74c-dde1d0ff1c92 nodeName:}" failed. No retries permitted until 2026-07-06 14:23:59.135208762 +0000 UTC m=+66.055489169 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/537a943a-73f7-4e98-b74c-dde1d0ff1c92-metrics-certs") pod "network-metrics-daemon-mqgwp" (UID: "537a943a-73f7-4e98-b74c-dde1d0ff1c92") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 14:23:27.235964 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:27.235926    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/201f4c6e-b9d8-4a99-9f4e-b8f59e69ad1d-original-pull-secret\") pod \"global-pull-secret-syncer-mbkvc\" (UID: \"201f4c6e-b9d8-4a99-9f4e-b8f59e69ad1d\") " pod="kube-system/global-pull-secret-syncer-mbkvc"
Jul 06 14:23:27.236125 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:27.236089    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 14:23:27.236200 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:27.236156    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/201f4c6e-b9d8-4a99-9f4e-b8f59e69ad1d-original-pull-secret podName:201f4c6e-b9d8-4a99-9f4e-b8f59e69ad1d nodeName:}" failed. No retries permitted until 2026-07-06 14:23:59.236139815 +0000 UTC m=+66.156420244 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/201f4c6e-b9d8-4a99-9f4e-b8f59e69ad1d-original-pull-secret") pod "global-pull-secret-syncer-mbkvc" (UID: "201f4c6e-b9d8-4a99-9f4e-b8f59e69ad1d") : object "kube-system"/"original-pull-secret" not registered
Jul 06 14:23:28.385221 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:28.385195    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-145.ec2.internal" event="NodeReady"
Jul 06 14:23:28.385606 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:28.385337    2582 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 06 14:23:28.433914 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:28.433874    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-2t99k"]
Jul 06 14:23:28.441177 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:28.441150    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-w7js7"]
Jul 06 14:23:28.441310 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:28.441271    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2t99k"
Jul 06 14:23:28.444064 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:28.444043    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-m58h6\""
Jul 06 14:23:28.444064 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:28.444057    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 06 14:23:28.444250 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:28.444165    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 06 14:23:28.444856 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:28.444837    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-w7js7"
Jul 06 14:23:28.449846 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:28.449486    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 06 14:23:28.449846 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:28.449553    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 06 14:23:28.449846 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:28.449705    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 06 14:23:28.450352 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:28.450315    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-zr548\""
Jul 06 14:23:28.451357 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:28.451333    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-2t99k"]
Jul 06 14:23:28.452012 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:28.451990    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-w7js7"]
Jul 06 14:23:28.493688 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:28.493646    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gx87x"
Jul 06 14:23:28.493891 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:28.493744    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mqgwp"
Jul 06 14:23:28.493959 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:28.493898    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mbkvc"
Jul 06 14:23:28.496319 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:28.496297    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 06 14:23:28.496442 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:28.496297    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 06 14:23:28.496442 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:28.496364    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 06 14:23:28.496559 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:28.496449    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5wq2g\""
Jul 06 14:23:28.496559 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:28.496367    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 06 14:23:28.496559 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:28.496504    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-fbtwb\""
Jul 06 14:23:28.545685 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:28.545637    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1de327c8-c76b-4f68-be9f-04fcdb31ed23-cert\") pod \"ingress-canary-w7js7\" (UID: \"1de327c8-c76b-4f68-be9f-04fcdb31ed23\") " pod="openshift-ingress-canary/ingress-canary-w7js7"
Jul 06 14:23:28.545889 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:28.545784    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0656cec5-7e50-4dfc-af2d-9a33adde49e3-metrics-tls\") pod \"dns-default-2t99k\" (UID: \"0656cec5-7e50-4dfc-af2d-9a33adde49e3\") " pod="openshift-dns/dns-default-2t99k"
Jul 06 14:23:28.545889 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:28.545823    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0656cec5-7e50-4dfc-af2d-9a33adde49e3-tmp-dir\") pod \"dns-default-2t99k\" (UID: \"0656cec5-7e50-4dfc-af2d-9a33adde49e3\") " pod="openshift-dns/dns-default-2t99k"
Jul 06 14:23:28.545889 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:28.545866    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vn8d9\" (UniqueName: \"kubernetes.io/projected/1de327c8-c76b-4f68-be9f-04fcdb31ed23-kube-api-access-vn8d9\") pod \"ingress-canary-w7js7\" (UID: \"1de327c8-c76b-4f68-be9f-04fcdb31ed23\") " pod="openshift-ingress-canary/ingress-canary-w7js7"
Jul 06 14:23:28.546076 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:28.546059    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0656cec5-7e50-4dfc-af2d-9a33adde49e3-config-volume\") pod \"dns-default-2t99k\" (UID: \"0656cec5-7e50-4dfc-af2d-9a33adde49e3\") " pod="openshift-dns/dns-default-2t99k"
Jul 06 14:23:28.546134 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:28.546113    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7zkfg\" (UniqueName: \"kubernetes.io/projected/0656cec5-7e50-4dfc-af2d-9a33adde49e3-kube-api-access-7zkfg\") pod \"dns-default-2t99k\" (UID: \"0656cec5-7e50-4dfc-af2d-9a33adde49e3\") " pod="openshift-dns/dns-default-2t99k"
Jul 06 14:23:28.647048 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:28.646960    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1de327c8-c76b-4f68-be9f-04fcdb31ed23-cert\") pod \"ingress-canary-w7js7\" (UID: \"1de327c8-c76b-4f68-be9f-04fcdb31ed23\") " pod="openshift-ingress-canary/ingress-canary-w7js7"
Jul 06 14:23:28.647210 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:28.647048    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0656cec5-7e50-4dfc-af2d-9a33adde49e3-metrics-tls\") pod \"dns-default-2t99k\" (UID: \"0656cec5-7e50-4dfc-af2d-9a33adde49e3\") " pod="openshift-dns/dns-default-2t99k"
Jul 06 14:23:28.647210 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:28.647080    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0656cec5-7e50-4dfc-af2d-9a33adde49e3-tmp-dir\") pod \"dns-default-2t99k\" (UID: \"0656cec5-7e50-4dfc-af2d-9a33adde49e3\") " pod="openshift-dns/dns-default-2t99k"
Jul 06 14:23:28.647210 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:28.647111    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vn8d9\" (UniqueName: \"kubernetes.io/projected/1de327c8-c76b-4f68-be9f-04fcdb31ed23-kube-api-access-vn8d9\") pod \"ingress-canary-w7js7\" (UID: \"1de327c8-c76b-4f68-be9f-04fcdb31ed23\") " pod="openshift-ingress-canary/ingress-canary-w7js7"
Jul 06 14:23:28.647210 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:28.647139    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0656cec5-7e50-4dfc-af2d-9a33adde49e3-config-volume\") pod \"dns-default-2t99k\" (UID: \"0656cec5-7e50-4dfc-af2d-9a33adde49e3\") " pod="openshift-dns/dns-default-2t99k"
Jul 06 14:23:28.647210 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:28.647194    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 14:23:28.647469 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:28.647272    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0656cec5-7e50-4dfc-af2d-9a33adde49e3-metrics-tls podName:0656cec5-7e50-4dfc-af2d-9a33adde49e3 nodeName:}" failed. No retries permitted until 2026-07-06 14:23:29.1472524 +0000 UTC m=+36.067532808 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0656cec5-7e50-4dfc-af2d-9a33adde49e3-metrics-tls") pod "dns-default-2t99k" (UID: "0656cec5-7e50-4dfc-af2d-9a33adde49e3") : secret "dns-default-metrics-tls" not found
Jul 06 14:23:28.647469 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:28.647199    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7zkfg\" (UniqueName: \"kubernetes.io/projected/0656cec5-7e50-4dfc-af2d-9a33adde49e3-kube-api-access-7zkfg\") pod \"dns-default-2t99k\" (UID: \"0656cec5-7e50-4dfc-af2d-9a33adde49e3\") " pod="openshift-dns/dns-default-2t99k"
Jul 06 14:23:28.647469 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:28.647455    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0656cec5-7e50-4dfc-af2d-9a33adde49e3-tmp-dir\") pod \"dns-default-2t99k\" (UID: \"0656cec5-7e50-4dfc-af2d-9a33adde49e3\") " pod="openshift-dns/dns-default-2t99k"
Jul 06 14:23:28.648044 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:28.648025    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0656cec5-7e50-4dfc-af2d-9a33adde49e3-config-volume\") pod \"dns-default-2t99k\" (UID: \"0656cec5-7e50-4dfc-af2d-9a33adde49e3\") " pod="openshift-dns/dns-default-2t99k"
Jul 06 14:23:28.651344 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:28.651224    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1de327c8-c76b-4f68-be9f-04fcdb31ed23-cert\") pod \"ingress-canary-w7js7\" (UID: \"1de327c8-c76b-4f68-be9f-04fcdb31ed23\") " pod="openshift-ingress-canary/ingress-canary-w7js7"
Jul 06 14:23:28.657158 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:28.657134    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vn8d9\" (UniqueName: \"kubernetes.io/projected/1de327c8-c76b-4f68-be9f-04fcdb31ed23-kube-api-access-vn8d9\") pod \"ingress-canary-w7js7\" (UID: \"1de327c8-c76b-4f68-be9f-04fcdb31ed23\") " pod="openshift-ingress-canary/ingress-canary-w7js7"
Jul 06 14:23:28.657251 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:28.657134    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7zkfg\" (UniqueName: \"kubernetes.io/projected/0656cec5-7e50-4dfc-af2d-9a33adde49e3-kube-api-access-7zkfg\") pod \"dns-default-2t99k\" (UID: \"0656cec5-7e50-4dfc-af2d-9a33adde49e3\") " pod="openshift-dns/dns-default-2t99k"
Jul 06 14:23:28.758395 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:28.758359    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-w7js7"
Jul 06 14:23:28.944226 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:28.944192    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-w7js7"]
Jul 06 14:23:28.948341 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:23:28.948314    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1de327c8_c76b_4f68_be9f_04fcdb31ed23.slice/crio-065a747b913aedb2337464772b20d8585457cfec0277f47b6f52aec52a7fe2c0 WatchSource:0}: Error finding container 065a747b913aedb2337464772b20d8585457cfec0277f47b6f52aec52a7fe2c0: Status 404 returned error can't find the container with id 065a747b913aedb2337464772b20d8585457cfec0277f47b6f52aec52a7fe2c0
Jul 06 14:23:29.151102 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:29.151071    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0656cec5-7e50-4dfc-af2d-9a33adde49e3-metrics-tls\") pod \"dns-default-2t99k\" (UID: \"0656cec5-7e50-4dfc-af2d-9a33adde49e3\") " pod="openshift-dns/dns-default-2t99k"
Jul 06 14:23:29.151286 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:29.151222    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 14:23:29.151345 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:29.151287    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0656cec5-7e50-4dfc-af2d-9a33adde49e3-metrics-tls podName:0656cec5-7e50-4dfc-af2d-9a33adde49e3 nodeName:}" failed. No retries permitted until 2026-07-06 14:23:30.15127 +0000 UTC m=+37.071550421 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0656cec5-7e50-4dfc-af2d-9a33adde49e3-metrics-tls") pod "dns-default-2t99k" (UID: "0656cec5-7e50-4dfc-af2d-9a33adde49e3") : secret "dns-default-metrics-tls" not found
Jul 06 14:23:29.804934 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:29.804890    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-w7js7" event={"ID":"1de327c8-c76b-4f68-be9f-04fcdb31ed23","Type":"ContainerStarted","Data":"065a747b913aedb2337464772b20d8585457cfec0277f47b6f52aec52a7fe2c0"}
Jul 06 14:23:30.160143 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:30.160117    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0656cec5-7e50-4dfc-af2d-9a33adde49e3-metrics-tls\") pod \"dns-default-2t99k\" (UID: \"0656cec5-7e50-4dfc-af2d-9a33adde49e3\") " pod="openshift-dns/dns-default-2t99k"
Jul 06 14:23:30.160323 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:30.160247    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 14:23:30.160323 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:30.160301    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0656cec5-7e50-4dfc-af2d-9a33adde49e3-metrics-tls podName:0656cec5-7e50-4dfc-af2d-9a33adde49e3 nodeName:}" failed. No retries permitted until 2026-07-06 14:23:32.160287919 +0000 UTC m=+39.080568331 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0656cec5-7e50-4dfc-af2d-9a33adde49e3-metrics-tls") pod "dns-default-2t99k" (UID: "0656cec5-7e50-4dfc-af2d-9a33adde49e3") : secret "dns-default-metrics-tls" not found
Jul 06 14:23:32.180719 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:32.180675    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0656cec5-7e50-4dfc-af2d-9a33adde49e3-metrics-tls\") pod \"dns-default-2t99k\" (UID: \"0656cec5-7e50-4dfc-af2d-9a33adde49e3\") " pod="openshift-dns/dns-default-2t99k"
Jul 06 14:23:32.181213 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:32.180813    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 14:23:32.181213 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:32.180868    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0656cec5-7e50-4dfc-af2d-9a33adde49e3-metrics-tls podName:0656cec5-7e50-4dfc-af2d-9a33adde49e3 nodeName:}" failed. No retries permitted until 2026-07-06 14:23:36.180854082 +0000 UTC m=+43.101134489 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0656cec5-7e50-4dfc-af2d-9a33adde49e3-metrics-tls") pod "dns-default-2t99k" (UID: "0656cec5-7e50-4dfc-af2d-9a33adde49e3") : secret "dns-default-metrics-tls" not found
Jul 06 14:23:33.412648 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:33.412607    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:23:33.513368 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:33.513335    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:23:33.697894 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:33.697864    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:23:33.812323 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:33.812290    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-fjz8x"]
Jul 06 14:23:33.816718 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:33.816689    2582 generic.go:356] "Generic (PLEG): container finished" podID="98121467-ea9e-4fdc-b195-85e95b837664" containerID="9979e276ec5fe6f6e53532f79782b8b956af091b2ba59aee4569b621b3d90b9b" exitCode=0
Jul 06 14:23:33.820065 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:33.819955    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:23:33.829445 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:33.829396    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p6g5d" event={"ID":"98121467-ea9e-4fdc-b195-85e95b837664","Type":"ContainerDied","Data":"9979e276ec5fe6f6e53532f79782b8b956af091b2ba59aee4569b621b3d90b9b"}
Jul 06 14:23:33.829561 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:33.829503    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-fjz8x"
Jul 06 14:23:33.829561 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:33.829536    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-w7js7" event={"ID":"1de327c8-c76b-4f68-be9f-04fcdb31ed23","Type":"ContainerStarted","Data":"f75dbb150ff0a94dc95ab4857d0aa17c18afd5102c74d7dcc9ecd5c22015f18b"}
Jul 06 14:23:33.834330 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:33.834273    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 06 14:23:33.834583 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:33.834555    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 06 14:23:33.835615 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:33.835197    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-fjz8x"]
Jul 06 14:23:33.835615 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:33.835441    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-n2l79\""
Jul 06 14:23:33.877846 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:33.877588    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-5kn2v"]
Jul 06 14:23:33.878059 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:33.877999    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-w7js7" podStartSLOduration=1.4593039669999999 podStartE2EDuration="5.877979851s" totalImagesPullingTime="4.418675884s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:23:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:23:33.874753581 +0000 UTC m=+40.795034011" watchObservedRunningTime="2026-07-06 14:23:33.877979851 +0000 UTC m=+40.798260281"
Jul 06 14:23:33.907211 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:33.907182    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-6c998bcc47-7mmnb"]
Jul 06 14:23:33.907357 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:33.907312    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-5kn2v"
Jul 06 14:23:33.910033 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:33.909975    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-9jm6r\""
Jul 06 14:23:33.910033 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:33.910032    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 06 14:23:33.910254 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:33.910109    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 06 14:23:33.910362 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:33.910305    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 06 14:23:33.911805 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:33.911788    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 06 14:23:33.926595 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:33.926565    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:23:33.927813 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:33.927794    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-xqwr8"]
Jul 06 14:23:33.927925 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:33.927909    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6c998bcc47-7mmnb"
Jul 06 14:23:33.930735 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:33.930714    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 06 14:23:33.930847 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:33.930760    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 06 14:23:33.930917 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:33.930874    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 06 14:23:33.931256 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:33.931234    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-w2cpr\""
Jul 06 14:23:33.931337 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:33.931274    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 06 14:23:33.931451 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:33.931361    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 06 14:23:33.931574 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:33.931560    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 06 14:23:33.948040 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:33.947975    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-5kn2v"]
Jul 06 14:23:33.948040 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:33.948020    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6c998bcc47-7mmnb"]
Jul 06 14:23:33.948187 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:33.948043    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-xqwr8"]
Jul 06 14:23:33.948187 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:33.948109    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-xqwr8"
Jul 06 14:23:33.951275 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:33.951231    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 06 14:23:33.951364 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:33.951304    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 06 14:23:33.951442 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:33.951391    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 06 14:23:33.951442 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:33.951405    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-mkf24\""
Jul 06 14:23:33.951627 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:33.951609    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 06 14:23:33.970620 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:33.970594    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-mhhcl"]
Jul 06 14:23:33.985419 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:33.985393    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-mhhcl"]
Jul 06 14:23:33.985536 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:33.985498    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-mhhcl"
Jul 06 14:23:33.988955 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:33.988934    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-m9xp7\""
Jul 06 14:23:33.989337 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:33.989314    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 06 14:23:33.989431 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:33.989324    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 06 14:23:33.989608 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:33.989593    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 06 14:23:33.989823 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:33.989808    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 06 14:23:33.994410 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:33.994379    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c9139faa-b66e-43d4-9a07-bd16a63ff0f8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-5kn2v\" (UID: \"c9139faa-b66e-43d4-9a07-bd16a63ff0f8\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-5kn2v"
Jul 06 14:23:33.994526 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:33.994450    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2f28s\" (UniqueName: \"kubernetes.io/projected/c9139faa-b66e-43d4-9a07-bd16a63ff0f8-kube-api-access-2f28s\") pod \"cluster-monitoring-operator-64786d9cbb-5kn2v\" (UID: \"c9139faa-b66e-43d4-9a07-bd16a63ff0f8\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-5kn2v"
Jul 06 14:23:33.994584 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:33.994570    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/c9139faa-b66e-43d4-9a07-bd16a63ff0f8-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-5kn2v\" (UID: \"c9139faa-b66e-43d4-9a07-bd16a63ff0f8\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-5kn2v"
Jul 06 14:23:33.994643 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:33.994630    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vp2q5\" (UniqueName: \"kubernetes.io/projected/dbf0b322-237d-4eb6-bbc2-f99f6c34fd20-kube-api-access-vp2q5\") pod \"volume-data-source-validator-5d456fdbcd-fjz8x\" (UID: \"dbf0b322-237d-4eb6-bbc2-f99f6c34fd20\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-fjz8x"
Jul 06 14:23:34.087829 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:34.087794    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:23:34.095974 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:34.095954    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/c9139faa-b66e-43d4-9a07-bd16a63ff0f8-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-5kn2v\" (UID: \"c9139faa-b66e-43d4-9a07-bd16a63ff0f8\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-5kn2v"
Jul 06 14:23:34.096080 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:34.095989    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7831bfca-c689-4707-918f-9b1b6fe52258-metrics-certs\") pod \"router-default-6c998bcc47-7mmnb\" (UID: \"7831bfca-c689-4707-918f-9b1b6fe52258\") " pod="openshift-ingress/router-default-6c998bcc47-7mmnb"
Jul 06 14:23:34.096080 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:34.096010    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7831bfca-c689-4707-918f-9b1b6fe52258-service-ca-bundle\") pod \"router-default-6c998bcc47-7mmnb\" (UID: \"7831bfca-c689-4707-918f-9b1b6fe52258\") " pod="openshift-ingress/router-default-6c998bcc47-7mmnb"
Jul 06 14:23:34.096160 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:34.096124    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d620f679-c4f6-4131-aebf-36b50b4433a9-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-xqwr8\" (UID: \"d620f679-c4f6-4131-aebf-36b50b4433a9\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-xqwr8"
Jul 06 14:23:34.096160 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:34.096155    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5hhn\" (UniqueName: \"kubernetes.io/projected/d620f679-c4f6-4131-aebf-36b50b4433a9-kube-api-access-w5hhn\") pod \"kube-storage-version-migrator-operator-846bf668f7-xqwr8\" (UID: \"d620f679-c4f6-4131-aebf-36b50b4433a9\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-xqwr8"
Jul 06 14:23:34.096249 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:34.096172    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/edffcb34-9976-419f-9a09-fe5a1cd6b2ec-config\") pod \"service-ca-operator-5d46d9ffd4-mhhcl\" (UID: \"edffcb34-9976-419f-9a09-fe5a1cd6b2ec\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-mhhcl"
Jul 06 14:23:34.096249 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:34.096200    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vp2q5\" (UniqueName: \"kubernetes.io/projected/dbf0b322-237d-4eb6-bbc2-f99f6c34fd20-kube-api-access-vp2q5\") pod \"volume-data-source-validator-5d456fdbcd-fjz8x\" (UID: \"dbf0b322-237d-4eb6-bbc2-f99f6c34fd20\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-fjz8x"
Jul 06 14:23:34.096249 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:34.096225    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/7831bfca-c689-4707-918f-9b1b6fe52258-stats-auth\") pod \"router-default-6c998bcc47-7mmnb\" (UID: \"7831bfca-c689-4707-918f-9b1b6fe52258\") " pod="openshift-ingress/router-default-6c998bcc47-7mmnb"
Jul 06 14:23:34.096347 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:34.096270    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/7831bfca-c689-4707-918f-9b1b6fe52258-default-certificate\") pod \"router-default-6c998bcc47-7mmnb\" (UID: \"7831bfca-c689-4707-918f-9b1b6fe52258\") " pod="openshift-ingress/router-default-6c998bcc47-7mmnb"
Jul 06 14:23:34.096347 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:34.096304    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/edffcb34-9976-419f-9a09-fe5a1cd6b2ec-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-mhhcl\" (UID: \"edffcb34-9976-419f-9a09-fe5a1cd6b2ec\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-mhhcl"
Jul 06 14:23:34.096347 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:34.096332    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c9139faa-b66e-43d4-9a07-bd16a63ff0f8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-5kn2v\" (UID: \"c9139faa-b66e-43d4-9a07-bd16a63ff0f8\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-5kn2v"
Jul 06 14:23:34.096452 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:34.096359    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qjhkv\" (UniqueName: \"kubernetes.io/projected/edffcb34-9976-419f-9a09-fe5a1cd6b2ec-kube-api-access-qjhkv\") pod \"service-ca-operator-5d46d9ffd4-mhhcl\" (UID: \"edffcb34-9976-419f-9a09-fe5a1cd6b2ec\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-mhhcl"
Jul 06 14:23:34.096452 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:34.096400    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2f28s\" (UniqueName: \"kubernetes.io/projected/c9139faa-b66e-43d4-9a07-bd16a63ff0f8-kube-api-access-2f28s\") pod \"cluster-monitoring-operator-64786d9cbb-5kn2v\" (UID: \"c9139faa-b66e-43d4-9a07-bd16a63ff0f8\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-5kn2v"
Jul 06 14:23:34.096452 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:34.096413    2582 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 06 14:23:34.096452 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:34.096429    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tccdg\" (UniqueName: \"kubernetes.io/projected/7831bfca-c689-4707-918f-9b1b6fe52258-kube-api-access-tccdg\") pod \"router-default-6c998bcc47-7mmnb\" (UID: \"7831bfca-c689-4707-918f-9b1b6fe52258\") " pod="openshift-ingress/router-default-6c998bcc47-7mmnb"
Jul 06 14:23:34.096629 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:34.096473    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d620f679-c4f6-4131-aebf-36b50b4433a9-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-xqwr8\" (UID: \"d620f679-c4f6-4131-aebf-36b50b4433a9\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-xqwr8"
Jul 06 14:23:34.096629 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:34.096485    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9139faa-b66e-43d4-9a07-bd16a63ff0f8-cluster-monitoring-operator-tls podName:c9139faa-b66e-43d4-9a07-bd16a63ff0f8 nodeName:}" failed. No retries permitted until 2026-07-06 14:23:34.596470467 +0000 UTC m=+41.516750880 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c9139faa-b66e-43d4-9a07-bd16a63ff0f8-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-5kn2v" (UID: "c9139faa-b66e-43d4-9a07-bd16a63ff0f8") : secret "cluster-monitoring-operator-tls" not found
Jul 06 14:23:34.096854 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:34.096835    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/c9139faa-b66e-43d4-9a07-bd16a63ff0f8-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-5kn2v\" (UID: \"c9139faa-b66e-43d4-9a07-bd16a63ff0f8\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-5kn2v"
Jul 06 14:23:34.106639 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:34.106613    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2f28s\" (UniqueName: \"kubernetes.io/projected/c9139faa-b66e-43d4-9a07-bd16a63ff0f8-kube-api-access-2f28s\") pod \"cluster-monitoring-operator-64786d9cbb-5kn2v\" (UID: \"c9139faa-b66e-43d4-9a07-bd16a63ff0f8\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-5kn2v"
Jul 06 14:23:34.110083 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:34.110068    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vp2q5\" (UniqueName: \"kubernetes.io/projected/dbf0b322-237d-4eb6-bbc2-f99f6c34fd20-kube-api-access-vp2q5\") pod \"volume-data-source-validator-5d456fdbcd-fjz8x\" (UID: \"dbf0b322-237d-4eb6-bbc2-f99f6c34fd20\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-fjz8x"
Jul 06 14:23:34.139636 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:34.139602    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-fjz8x"
Jul 06 14:23:34.191896 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:34.191796    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:23:34.201178 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:34.198838    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d620f679-c4f6-4131-aebf-36b50b4433a9-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-xqwr8\" (UID: \"d620f679-c4f6-4131-aebf-36b50b4433a9\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-xqwr8"
Jul 06 14:23:34.201178 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:34.198902    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7831bfca-c689-4707-918f-9b1b6fe52258-metrics-certs\") pod \"router-default-6c998bcc47-7mmnb\" (UID: \"7831bfca-c689-4707-918f-9b1b6fe52258\") " pod="openshift-ingress/router-default-6c998bcc47-7mmnb"
Jul 06 14:23:34.201178 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:34.198929    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7831bfca-c689-4707-918f-9b1b6fe52258-service-ca-bundle\") pod \"router-default-6c998bcc47-7mmnb\" (UID: \"7831bfca-c689-4707-918f-9b1b6fe52258\") " pod="openshift-ingress/router-default-6c998bcc47-7mmnb"
Jul 06 14:23:34.201178 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:34.198952    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d620f679-c4f6-4131-aebf-36b50b4433a9-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-xqwr8\" (UID: \"d620f679-c4f6-4131-aebf-36b50b4433a9\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-xqwr8"
Jul 06 14:23:34.201178 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:34.198978    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5hhn\" (UniqueName: \"kubernetes.io/projected/d620f679-c4f6-4131-aebf-36b50b4433a9-kube-api-access-w5hhn\") pod \"kube-storage-version-migrator-operator-846bf668f7-xqwr8\" (UID: \"d620f679-c4f6-4131-aebf-36b50b4433a9\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-xqwr8"
Jul 06 14:23:34.201178 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:34.199004    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/edffcb34-9976-419f-9a09-fe5a1cd6b2ec-config\") pod \"service-ca-operator-5d46d9ffd4-mhhcl\" (UID: \"edffcb34-9976-419f-9a09-fe5a1cd6b2ec\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-mhhcl"
Jul 06 14:23:34.201178 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:34.199039    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/7831bfca-c689-4707-918f-9b1b6fe52258-stats-auth\") pod \"router-default-6c998bcc47-7mmnb\" (UID: \"7831bfca-c689-4707-918f-9b1b6fe52258\") " pod="openshift-ingress/router-default-6c998bcc47-7mmnb"
Jul 06 14:23:34.201178 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:34.199076    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/7831bfca-c689-4707-918f-9b1b6fe52258-default-certificate\") pod \"router-default-6c998bcc47-7mmnb\" (UID: \"7831bfca-c689-4707-918f-9b1b6fe52258\") " pod="openshift-ingress/router-default-6c998bcc47-7mmnb"
Jul 06 14:23:34.201178 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:34.199125    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/edffcb34-9976-419f-9a09-fe5a1cd6b2ec-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-mhhcl\" (UID: \"edffcb34-9976-419f-9a09-fe5a1cd6b2ec\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-mhhcl"
Jul 06 14:23:34.201178 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:34.199161    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qjhkv\" (UniqueName: \"kubernetes.io/projected/edffcb34-9976-419f-9a09-fe5a1cd6b2ec-kube-api-access-qjhkv\") pod \"service-ca-operator-5d46d9ffd4-mhhcl\" (UID: \"edffcb34-9976-419f-9a09-fe5a1cd6b2ec\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-mhhcl"
Jul 06 14:23:34.201178 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:34.199210    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tccdg\" (UniqueName: \"kubernetes.io/projected/7831bfca-c689-4707-918f-9b1b6fe52258-kube-api-access-tccdg\") pod \"router-default-6c998bcc47-7mmnb\" (UID: \"7831bfca-c689-4707-918f-9b1b6fe52258\") " pod="openshift-ingress/router-default-6c998bcc47-7mmnb"
Jul 06 14:23:34.201178 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:34.200105    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d620f679-c4f6-4131-aebf-36b50b4433a9-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-xqwr8\" (UID: \"d620f679-c4f6-4131-aebf-36b50b4433a9\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-xqwr8"
Jul 06 14:23:34.201178 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:34.200204    2582 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 06 14:23:34.201178 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:34.200256    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7831bfca-c689-4707-918f-9b1b6fe52258-metrics-certs podName:7831bfca-c689-4707-918f-9b1b6fe52258 nodeName:}" failed. No retries permitted until 2026-07-06 14:23:34.700240163 +0000 UTC m=+41.620520576 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7831bfca-c689-4707-918f-9b1b6fe52258-metrics-certs") pod "router-default-6c998bcc47-7mmnb" (UID: "7831bfca-c689-4707-918f-9b1b6fe52258") : secret "router-metrics-certs-default" not found
Jul 06 14:23:34.201178 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:34.200503    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7831bfca-c689-4707-918f-9b1b6fe52258-service-ca-bundle podName:7831bfca-c689-4707-918f-9b1b6fe52258 nodeName:}" failed. No retries permitted until 2026-07-06 14:23:34.700486909 +0000 UTC m=+41.620767329 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7831bfca-c689-4707-918f-9b1b6fe52258-service-ca-bundle") pod "router-default-6c998bcc47-7mmnb" (UID: "7831bfca-c689-4707-918f-9b1b6fe52258") : configmap references non-existent config key: service-ca.crt
Jul 06 14:23:34.206328 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:34.205809    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/edffcb34-9976-419f-9a09-fe5a1cd6b2ec-config\") pod \"service-ca-operator-5d46d9ffd4-mhhcl\" (UID: \"edffcb34-9976-419f-9a09-fe5a1cd6b2ec\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-mhhcl"
Jul 06 14:23:34.212844 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:34.211625    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d620f679-c4f6-4131-aebf-36b50b4433a9-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-xqwr8\" (UID: \"d620f679-c4f6-4131-aebf-36b50b4433a9\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-xqwr8"
Jul 06 14:23:34.217836 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:34.217190    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qjhkv\" (UniqueName: \"kubernetes.io/projected/edffcb34-9976-419f-9a09-fe5a1cd6b2ec-kube-api-access-qjhkv\") pod \"service-ca-operator-5d46d9ffd4-mhhcl\" (UID: \"edffcb34-9976-419f-9a09-fe5a1cd6b2ec\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-mhhcl"
Jul 06 14:23:34.218397 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:34.218347    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/edffcb34-9976-419f-9a09-fe5a1cd6b2ec-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-mhhcl\" (UID: \"edffcb34-9976-419f-9a09-fe5a1cd6b2ec\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-mhhcl"
Jul 06 14:23:34.219123 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:34.219081    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/7831bfca-c689-4707-918f-9b1b6fe52258-default-certificate\") pod \"router-default-6c998bcc47-7mmnb\" (UID: \"7831bfca-c689-4707-918f-9b1b6fe52258\") " pod="openshift-ingress/router-default-6c998bcc47-7mmnb"
Jul 06 14:23:34.219888 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:34.219821    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/7831bfca-c689-4707-918f-9b1b6fe52258-stats-auth\") pod \"router-default-6c998bcc47-7mmnb\" (UID: \"7831bfca-c689-4707-918f-9b1b6fe52258\") " pod="openshift-ingress/router-default-6c998bcc47-7mmnb"
Jul 06 14:23:34.221425 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:34.221382    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5hhn\" (UniqueName: \"kubernetes.io/projected/d620f679-c4f6-4131-aebf-36b50b4433a9-kube-api-access-w5hhn\") pod \"kube-storage-version-migrator-operator-846bf668f7-xqwr8\" (UID: \"d620f679-c4f6-4131-aebf-36b50b4433a9\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-xqwr8"
Jul 06 14:23:34.222749 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:34.222709    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tccdg\" (UniqueName: \"kubernetes.io/projected/7831bfca-c689-4707-918f-9b1b6fe52258-kube-api-access-tccdg\") pod \"router-default-6c998bcc47-7mmnb\" (UID: \"7831bfca-c689-4707-918f-9b1b6fe52258\") " pod="openshift-ingress/router-default-6c998bcc47-7mmnb"
Jul 06 14:23:34.256567 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:34.256535    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-xqwr8"
Jul 06 14:23:34.283150 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:34.283122    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-fjz8x"]
Jul 06 14:23:34.287565 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:23:34.287540    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbf0b322_237d_4eb6_bbc2_f99f6c34fd20.slice/crio-f7b26ff2acc971d579a2bc570ff4aea3bb6974e08768ea630ee9bf151ea6a96f WatchSource:0}: Error finding container f7b26ff2acc971d579a2bc570ff4aea3bb6974e08768ea630ee9bf151ea6a96f: Status 404 returned error can't find the container with id f7b26ff2acc971d579a2bc570ff4aea3bb6974e08768ea630ee9bf151ea6a96f
Jul 06 14:23:34.331639 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:34.331537    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-mhhcl"
Jul 06 14:23:34.403707 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:34.403675    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-xqwr8"]
Jul 06 14:23:34.407490 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:23:34.407448    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd620f679_c4f6_4131_aebf_36b50b4433a9.slice/crio-66efe8173302a1a9fe050c3e8c60a54dd49d81a362349a695a757e469e174cfe WatchSource:0}: Error finding container 66efe8173302a1a9fe050c3e8c60a54dd49d81a362349a695a757e469e174cfe: Status 404 returned error can't find the container with id 66efe8173302a1a9fe050c3e8c60a54dd49d81a362349a695a757e469e174cfe
Jul 06 14:23:34.482511 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:34.482422    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-mhhcl"]
Jul 06 14:23:34.486153 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:23:34.486125    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedffcb34_9976_419f_9a09_fe5a1cd6b2ec.slice/crio-b5995c66788616e09e1618ba81e6fba75188e04f55de7ba3ca228c54df3ebc1a WatchSource:0}: Error finding container b5995c66788616e09e1618ba81e6fba75188e04f55de7ba3ca228c54df3ebc1a: Status 404 returned error can't find the container with id b5995c66788616e09e1618ba81e6fba75188e04f55de7ba3ca228c54df3ebc1a
Jul 06 14:23:34.601982 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:34.601951    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c9139faa-b66e-43d4-9a07-bd16a63ff0f8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-5kn2v\" (UID: \"c9139faa-b66e-43d4-9a07-bd16a63ff0f8\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-5kn2v"
Jul 06 14:23:34.602149 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:34.602112    2582 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 06 14:23:34.602186 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:34.602182    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9139faa-b66e-43d4-9a07-bd16a63ff0f8-cluster-monitoring-operator-tls podName:c9139faa-b66e-43d4-9a07-bd16a63ff0f8 nodeName:}" failed. No retries permitted until 2026-07-06 14:23:35.602164202 +0000 UTC m=+42.522444624 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c9139faa-b66e-43d4-9a07-bd16a63ff0f8-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-5kn2v" (UID: "c9139faa-b66e-43d4-9a07-bd16a63ff0f8") : secret "cluster-monitoring-operator-tls" not found
Jul 06 14:23:34.702802 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:34.702768    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7831bfca-c689-4707-918f-9b1b6fe52258-metrics-certs\") pod \"router-default-6c998bcc47-7mmnb\" (UID: \"7831bfca-c689-4707-918f-9b1b6fe52258\") " pod="openshift-ingress/router-default-6c998bcc47-7mmnb"
Jul 06 14:23:34.702802 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:34.702804    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7831bfca-c689-4707-918f-9b1b6fe52258-service-ca-bundle\") pod \"router-default-6c998bcc47-7mmnb\" (UID: \"7831bfca-c689-4707-918f-9b1b6fe52258\") " pod="openshift-ingress/router-default-6c998bcc47-7mmnb"
Jul 06 14:23:34.702995 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:34.702943    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7831bfca-c689-4707-918f-9b1b6fe52258-service-ca-bundle podName:7831bfca-c689-4707-918f-9b1b6fe52258 nodeName:}" failed. No retries permitted until 2026-07-06 14:23:35.702925436 +0000 UTC m=+42.623205856 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7831bfca-c689-4707-918f-9b1b6fe52258-service-ca-bundle") pod "router-default-6c998bcc47-7mmnb" (UID: "7831bfca-c689-4707-918f-9b1b6fe52258") : configmap references non-existent config key: service-ca.crt
Jul 06 14:23:34.702995 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:34.702944    2582 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 06 14:23:34.703070 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:34.703022    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7831bfca-c689-4707-918f-9b1b6fe52258-metrics-certs podName:7831bfca-c689-4707-918f-9b1b6fe52258 nodeName:}" failed. No retries permitted until 2026-07-06 14:23:35.702989909 +0000 UTC m=+42.623270325 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7831bfca-c689-4707-918f-9b1b6fe52258-metrics-certs") pod "router-default-6c998bcc47-7mmnb" (UID: "7831bfca-c689-4707-918f-9b1b6fe52258") : secret "router-metrics-certs-default" not found
Jul 06 14:23:34.803071 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:34.802987    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-788fcf5466-l2crl"]
Jul 06 14:23:34.820722 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:34.820692    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-788fcf5466-l2crl"]
Jul 06 14:23:34.820884 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:34.820783    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-788fcf5466-l2crl"
Jul 06 14:23:34.822484 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:34.822448    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-xqwr8" event={"ID":"d620f679-c4f6-4131-aebf-36b50b4433a9","Type":"ContainerStarted","Data":"66efe8173302a1a9fe050c3e8c60a54dd49d81a362349a695a757e469e174cfe"}
Jul 06 14:23:34.823438 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:34.823385    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 06 14:23:34.823571 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:34.823444    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 06 14:23:34.823571 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:34.823494    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 06 14:23:34.823571 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:34.823515    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-krbgm\""
Jul 06 14:23:34.826182 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:34.826147    2582 generic.go:356] "Generic (PLEG): container finished" podID="98121467-ea9e-4fdc-b195-85e95b837664" containerID="82f513187a664ac3ce8a8a9c920d97dac39261c2e09f76101774d67b18ec294a" exitCode=0
Jul 06 14:23:34.826286 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:34.826254    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p6g5d" event={"ID":"98121467-ea9e-4fdc-b195-85e95b837664","Type":"ContainerDied","Data":"82f513187a664ac3ce8a8a9c920d97dac39261c2e09f76101774d67b18ec294a"}
Jul 06 14:23:34.827601 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:34.827522    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-mhhcl" event={"ID":"edffcb34-9976-419f-9a09-fe5a1cd6b2ec","Type":"ContainerStarted","Data":"b5995c66788616e09e1618ba81e6fba75188e04f55de7ba3ca228c54df3ebc1a"}
Jul 06 14:23:34.830383 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:34.830353    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-fjz8x" event={"ID":"dbf0b322-237d-4eb6-bbc2-f99f6c34fd20","Type":"ContainerStarted","Data":"f7b26ff2acc971d579a2bc570ff4aea3bb6974e08768ea630ee9bf151ea6a96f"}
Jul 06 14:23:34.830827 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:34.830800    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 06 14:23:34.835623 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:34.835602    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:23:35.006987 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:35.006953    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6chdg\" (UniqueName: \"kubernetes.io/projected/c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3-kube-api-access-6chdg\") pod \"image-registry-788fcf5466-l2crl\" (UID: \"c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3\") " pod="openshift-image-registry/image-registry-788fcf5466-l2crl"
Jul 06 14:23:35.007156 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:35.007049    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3-registry-tls\") pod \"image-registry-788fcf5466-l2crl\" (UID: \"c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3\") " pod="openshift-image-registry/image-registry-788fcf5466-l2crl"
Jul 06 14:23:35.007156 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:35.007145    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3-registry-certificates\") pod \"image-registry-788fcf5466-l2crl\" (UID: \"c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3\") " pod="openshift-image-registry/image-registry-788fcf5466-l2crl"
Jul 06 14:23:35.007272 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:35.007164    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3-image-registry-private-configuration\") pod \"image-registry-788fcf5466-l2crl\" (UID: \"c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3\") " pod="openshift-image-registry/image-registry-788fcf5466-l2crl"
Jul 06 14:23:35.007272 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:35.007192    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3-ca-trust-extracted\") pod \"image-registry-788fcf5466-l2crl\" (UID: \"c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3\") " pod="openshift-image-registry/image-registry-788fcf5466-l2crl"
Jul 06 14:23:35.007332 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:35.007298    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3-trusted-ca\") pod \"image-registry-788fcf5466-l2crl\" (UID: \"c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3\") " pod="openshift-image-registry/image-registry-788fcf5466-l2crl"
Jul 06 14:23:35.007368 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:35.007349    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3-installation-pull-secrets\") pod \"image-registry-788fcf5466-l2crl\" (UID: \"c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3\") " pod="openshift-image-registry/image-registry-788fcf5466-l2crl"
Jul 06 14:23:35.007423 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:35.007407    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3-bound-sa-token\") pod \"image-registry-788fcf5466-l2crl\" (UID: \"c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3\") " pod="openshift-image-registry/image-registry-788fcf5466-l2crl"
Jul 06 14:23:35.108275 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:35.108194    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3-trusted-ca\") pod \"image-registry-788fcf5466-l2crl\" (UID: \"c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3\") " pod="openshift-image-registry/image-registry-788fcf5466-l2crl"
Jul 06 14:23:35.108410 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:35.108304    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3-installation-pull-secrets\") pod \"image-registry-788fcf5466-l2crl\" (UID: \"c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3\") " pod="openshift-image-registry/image-registry-788fcf5466-l2crl"
Jul 06 14:23:35.108410 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:35.108349    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3-bound-sa-token\") pod \"image-registry-788fcf5466-l2crl\" (UID: \"c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3\") " pod="openshift-image-registry/image-registry-788fcf5466-l2crl"
Jul 06 14:23:35.108514 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:35.108417    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6chdg\" (UniqueName: \"kubernetes.io/projected/c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3-kube-api-access-6chdg\") pod \"image-registry-788fcf5466-l2crl\" (UID: \"c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3\") " pod="openshift-image-registry/image-registry-788fcf5466-l2crl"
Jul 06 14:23:35.108514 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:35.108453    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3-registry-tls\") pod \"image-registry-788fcf5466-l2crl\" (UID: \"c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3\") " pod="openshift-image-registry/image-registry-788fcf5466-l2crl"
Jul 06 14:23:35.108607 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:35.108557    2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 14:23:35.108607 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:35.108574    2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-788fcf5466-l2crl: secret "image-registry-tls" not found
Jul 06 14:23:35.108726 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:35.108634    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3-registry-tls podName:c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3 nodeName:}" failed. No retries permitted until 2026-07-06 14:23:35.60861521 +0000 UTC m=+42.528895690 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3-registry-tls") pod "image-registry-788fcf5466-l2crl" (UID: "c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3") : secret "image-registry-tls" not found
Jul 06 14:23:35.108726 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:35.108675    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3-registry-certificates\") pod \"image-registry-788fcf5466-l2crl\" (UID: \"c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3\") " pod="openshift-image-registry/image-registry-788fcf5466-l2crl"
Jul 06 14:23:35.108726 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:35.108714    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3-image-registry-private-configuration\") pod \"image-registry-788fcf5466-l2crl\" (UID: \"c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3\") " pod="openshift-image-registry/image-registry-788fcf5466-l2crl"
Jul 06 14:23:35.108892 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:35.108745    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3-ca-trust-extracted\") pod \"image-registry-788fcf5466-l2crl\" (UID: \"c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3\") " pod="openshift-image-registry/image-registry-788fcf5466-l2crl"
Jul 06 14:23:35.109189 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:35.109137    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3-ca-trust-extracted\") pod \"image-registry-788fcf5466-l2crl\" (UID: \"c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3\") " pod="openshift-image-registry/image-registry-788fcf5466-l2crl"
Jul 06 14:23:35.109309 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:35.109284    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3-registry-certificates\") pod \"image-registry-788fcf5466-l2crl\" (UID: \"c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3\") " pod="openshift-image-registry/image-registry-788fcf5466-l2crl"
Jul 06 14:23:35.109616 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:35.109583    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3-trusted-ca\") pod \"image-registry-788fcf5466-l2crl\" (UID: \"c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3\") " pod="openshift-image-registry/image-registry-788fcf5466-l2crl"
Jul 06 14:23:35.111133 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:35.111054    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3-installation-pull-secrets\") pod \"image-registry-788fcf5466-l2crl\" (UID: \"c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3\") " pod="openshift-image-registry/image-registry-788fcf5466-l2crl"
Jul 06 14:23:35.111622 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:35.111597    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3-image-registry-private-configuration\") pod \"image-registry-788fcf5466-l2crl\" (UID: \"c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3\") " pod="openshift-image-registry/image-registry-788fcf5466-l2crl"
Jul 06 14:23:35.117958 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:35.117914    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6chdg\" (UniqueName: \"kubernetes.io/projected/c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3-kube-api-access-6chdg\") pod \"image-registry-788fcf5466-l2crl\" (UID: \"c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3\") " pod="openshift-image-registry/image-registry-788fcf5466-l2crl"
Jul 06 14:23:35.118318 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:35.118273    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3-bound-sa-token\") pod \"image-registry-788fcf5466-l2crl\" (UID: \"c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3\") " pod="openshift-image-registry/image-registry-788fcf5466-l2crl"
Jul 06 14:23:35.613763 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:35.613729    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3-registry-tls\") pod \"image-registry-788fcf5466-l2crl\" (UID: \"c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3\") " pod="openshift-image-registry/image-registry-788fcf5466-l2crl"
Jul 06 14:23:35.614216 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:35.613838    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c9139faa-b66e-43d4-9a07-bd16a63ff0f8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-5kn2v\" (UID: \"c9139faa-b66e-43d4-9a07-bd16a63ff0f8\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-5kn2v"
Jul 06 14:23:35.614216 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:35.613889    2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 14:23:35.614216 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:35.613906    2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-788fcf5466-l2crl: secret "image-registry-tls" not found
Jul 06 14:23:35.614216 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:35.613942    2582 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 06 14:23:35.614216 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:35.613970    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3-registry-tls podName:c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3 nodeName:}" failed. No retries permitted until 2026-07-06 14:23:36.613951962 +0000 UTC m=+43.534232393 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3-registry-tls") pod "image-registry-788fcf5466-l2crl" (UID: "c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3") : secret "image-registry-tls" not found
Jul 06 14:23:35.614216 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:35.613988    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9139faa-b66e-43d4-9a07-bd16a63ff0f8-cluster-monitoring-operator-tls podName:c9139faa-b66e-43d4-9a07-bd16a63ff0f8 nodeName:}" failed. No retries permitted until 2026-07-06 14:23:37.613979146 +0000 UTC m=+44.534259552 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c9139faa-b66e-43d4-9a07-bd16a63ff0f8-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-5kn2v" (UID: "c9139faa-b66e-43d4-9a07-bd16a63ff0f8") : secret "cluster-monitoring-operator-tls" not found
Jul 06 14:23:35.714486 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:35.714452    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7831bfca-c689-4707-918f-9b1b6fe52258-metrics-certs\") pod \"router-default-6c998bcc47-7mmnb\" (UID: \"7831bfca-c689-4707-918f-9b1b6fe52258\") " pod="openshift-ingress/router-default-6c998bcc47-7mmnb"
Jul 06 14:23:35.714486 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:35.714498    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7831bfca-c689-4707-918f-9b1b6fe52258-service-ca-bundle\") pod \"router-default-6c998bcc47-7mmnb\" (UID: \"7831bfca-c689-4707-918f-9b1b6fe52258\") " pod="openshift-ingress/router-default-6c998bcc47-7mmnb"
Jul 06 14:23:35.714699 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:35.714618    2582 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 06 14:23:35.714699 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:35.714644    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7831bfca-c689-4707-918f-9b1b6fe52258-service-ca-bundle podName:7831bfca-c689-4707-918f-9b1b6fe52258 nodeName:}" failed. No retries permitted until 2026-07-06 14:23:37.714630681 +0000 UTC m=+44.634911089 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7831bfca-c689-4707-918f-9b1b6fe52258-service-ca-bundle") pod "router-default-6c998bcc47-7mmnb" (UID: "7831bfca-c689-4707-918f-9b1b6fe52258") : configmap references non-existent config key: service-ca.crt
Jul 06 14:23:35.714699 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:35.714691    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7831bfca-c689-4707-918f-9b1b6fe52258-metrics-certs podName:7831bfca-c689-4707-918f-9b1b6fe52258 nodeName:}" failed. No retries permitted until 2026-07-06 14:23:37.714678509 +0000 UTC m=+44.634958917 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7831bfca-c689-4707-918f-9b1b6fe52258-metrics-certs") pod "router-default-6c998bcc47-7mmnb" (UID: "7831bfca-c689-4707-918f-9b1b6fe52258") : secret "router-metrics-certs-default" not found
Jul 06 14:23:35.835415 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:35.835379    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p6g5d" event={"ID":"98121467-ea9e-4fdc-b195-85e95b837664","Type":"ContainerStarted","Data":"10baf1f278fcd590506238c3548c55976ccb7849616ac4e3b5545e4f37fd8de2"}
Jul 06 14:23:35.860069 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:35.859988    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-p6g5d" podStartSLOduration=8.753376579 podStartE2EDuration="42.859966244s" totalImagesPullingTime="34.106589665s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 14:22:53 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:23:35.857914524 +0000 UTC m=+42.778194956" watchObservedRunningTime="2026-07-06 14:23:35.859966244 +0000 UTC m=+42.780246676"
Jul 06 14:23:36.029604 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:36.029576    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:23:36.130093 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:36.130040    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:23:36.219669 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:36.219619    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0656cec5-7e50-4dfc-af2d-9a33adde49e3-metrics-tls\") pod \"dns-default-2t99k\" (UID: \"0656cec5-7e50-4dfc-af2d-9a33adde49e3\") " pod="openshift-dns/dns-default-2t99k"
Jul 06 14:23:36.219813 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:36.219783    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 14:23:36.219883 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:36.219850    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0656cec5-7e50-4dfc-af2d-9a33adde49e3-metrics-tls podName:0656cec5-7e50-4dfc-af2d-9a33adde49e3 nodeName:}" failed. No retries permitted until 2026-07-06 14:23:44.219832558 +0000 UTC m=+51.140113003 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0656cec5-7e50-4dfc-af2d-9a33adde49e3-metrics-tls") pod "dns-default-2t99k" (UID: "0656cec5-7e50-4dfc-af2d-9a33adde49e3") : secret "dns-default-metrics-tls" not found
Jul 06 14:23:36.622602 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:36.622560    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3-registry-tls\") pod \"image-registry-788fcf5466-l2crl\" (UID: \"c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3\") " pod="openshift-image-registry/image-registry-788fcf5466-l2crl"
Jul 06 14:23:36.623019 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:36.622771    2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 14:23:36.623019 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:36.622796    2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-788fcf5466-l2crl: secret "image-registry-tls" not found
Jul 06 14:23:36.623019 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:36.622876    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3-registry-tls podName:c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3 nodeName:}" failed. No retries permitted until 2026-07-06 14:23:38.62285522 +0000 UTC m=+45.543135647 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3-registry-tls") pod "image-registry-788fcf5466-l2crl" (UID: "c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3") : secret "image-registry-tls" not found
Jul 06 14:23:36.838962 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:36.838921    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-fjz8x" event={"ID":"dbf0b322-237d-4eb6-bbc2-f99f6c34fd20","Type":"ContainerStarted","Data":"9d8435597121ee62b9767502775eec5588b96dfd2979de645ae60649b920bcda"}
Jul 06 14:23:36.855641 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:36.855575    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-fjz8x" podStartSLOduration=2.141792396 podStartE2EDuration="3.855559654s" totalImagesPullingTime="1.713767258s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:23:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:23:36.855032414 +0000 UTC m=+43.775312843" watchObservedRunningTime="2026-07-06 14:23:36.855559654 +0000 UTC m=+43.775840084"
Jul 06 14:23:36.968521 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:36.968476    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:23:37.069648 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:37.069599    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:23:37.631104 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:37.631062    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c9139faa-b66e-43d4-9a07-bd16a63ff0f8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-5kn2v\" (UID: \"c9139faa-b66e-43d4-9a07-bd16a63ff0f8\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-5kn2v"
Jul 06 14:23:37.631479 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:37.631186    2582 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 06 14:23:37.631479 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:37.631273    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9139faa-b66e-43d4-9a07-bd16a63ff0f8-cluster-monitoring-operator-tls podName:c9139faa-b66e-43d4-9a07-bd16a63ff0f8 nodeName:}" failed. No retries permitted until 2026-07-06 14:23:41.631257383 +0000 UTC m=+48.551537809 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c9139faa-b66e-43d4-9a07-bd16a63ff0f8-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-5kn2v" (UID: "c9139faa-b66e-43d4-9a07-bd16a63ff0f8") : secret "cluster-monitoring-operator-tls" not found
Jul 06 14:23:37.731806 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:37.731768    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7831bfca-c689-4707-918f-9b1b6fe52258-metrics-certs\") pod \"router-default-6c998bcc47-7mmnb\" (UID: \"7831bfca-c689-4707-918f-9b1b6fe52258\") " pod="openshift-ingress/router-default-6c998bcc47-7mmnb"
Jul 06 14:23:37.731806 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:37.731806    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7831bfca-c689-4707-918f-9b1b6fe52258-service-ca-bundle\") pod \"router-default-6c998bcc47-7mmnb\" (UID: \"7831bfca-c689-4707-918f-9b1b6fe52258\") " pod="openshift-ingress/router-default-6c998bcc47-7mmnb"
Jul 06 14:23:37.731992 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:37.731912    2582 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 06 14:23:37.731992 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:37.731953    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7831bfca-c689-4707-918f-9b1b6fe52258-service-ca-bundle podName:7831bfca-c689-4707-918f-9b1b6fe52258 nodeName:}" failed. No retries permitted until 2026-07-06 14:23:41.731939995 +0000 UTC m=+48.652220402 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7831bfca-c689-4707-918f-9b1b6fe52258-service-ca-bundle") pod "router-default-6c998bcc47-7mmnb" (UID: "7831bfca-c689-4707-918f-9b1b6fe52258") : configmap references non-existent config key: service-ca.crt
Jul 06 14:23:37.731992 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:37.731968    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7831bfca-c689-4707-918f-9b1b6fe52258-metrics-certs podName:7831bfca-c689-4707-918f-9b1b6fe52258 nodeName:}" failed. No retries permitted until 2026-07-06 14:23:41.731961577 +0000 UTC m=+48.652241984 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7831bfca-c689-4707-918f-9b1b6fe52258-metrics-certs") pod "router-default-6c998bcc47-7mmnb" (UID: "7831bfca-c689-4707-918f-9b1b6fe52258") : secret "router-metrics-certs-default" not found
Jul 06 14:23:38.640933 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:38.640892    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3-registry-tls\") pod \"image-registry-788fcf5466-l2crl\" (UID: \"c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3\") " pod="openshift-image-registry/image-registry-788fcf5466-l2crl"
Jul 06 14:23:38.641355 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:38.641040    2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 14:23:38.641355 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:38.641060    2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-788fcf5466-l2crl: secret "image-registry-tls" not found
Jul 06 14:23:38.641355 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:38.641116    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3-registry-tls podName:c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3 nodeName:}" failed. No retries permitted until 2026-07-06 14:23:42.641099409 +0000 UTC m=+49.561379817 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3-registry-tls") pod "image-registry-788fcf5466-l2crl" (UID: "c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3") : secret "image-registry-tls" not found
Jul 06 14:23:38.845046 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:38.845012    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-mhhcl" event={"ID":"edffcb34-9976-419f-9a09-fe5a1cd6b2ec","Type":"ContainerStarted","Data":"c91957f90474d17ce418d77dd6a5802df820d1b81fd08aaf902f09c54ad9e827"}
Jul 06 14:23:38.846533 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:38.846505    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-xqwr8" event={"ID":"d620f679-c4f6-4131-aebf-36b50b4433a9","Type":"ContainerStarted","Data":"07ab961048ca3a76c3b6400ab1b11e32b06900a560ae51c0f1ecd304d8c9ae22"}
Jul 06 14:23:38.862108 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:38.862053    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-mhhcl" podStartSLOduration=2.515967697 podStartE2EDuration="5.862037668s" totalImagesPullingTime="3.346069971s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:23:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:23:38.861584299 +0000 UTC m=+45.781864729" watchObservedRunningTime="2026-07-06 14:23:38.862037668 +0000 UTC m=+45.782318087"
Jul 06 14:23:38.882670 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:38.882601    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-xqwr8" podStartSLOduration=2.463700953 podStartE2EDuration="5.882583222s" totalImagesPullingTime="3.418882269s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:23:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:23:38.882459237 +0000 UTC m=+45.802739670" watchObservedRunningTime="2026-07-06 14:23:38.882583222 +0000 UTC m=+45.802863651"
Jul 06 14:23:39.256743 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:39.256711    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:23:39.390686 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:39.390638    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:23:39.487922 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:39.487886    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:23:39.584428 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:39.584355    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:23:39.783211 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:39.783180    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:23:39.850092 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:39.850008    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:23:40.065991 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:40.065956    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:23:40.124861 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:40.124780    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:23:40.303551 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:40.303519    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:23:40.341750 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:40.341721    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-pfg9l"]
Jul 06 14:23:40.390107 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:40.390026    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-pfg9l"]
Jul 06 14:23:40.390247 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:40.390114    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-pfg9l"
Jul 06 14:23:40.396261 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:40.396102    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 06 14:23:40.396718 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:40.396694    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-r6zhh\""
Jul 06 14:23:40.396718 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:40.396712    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 06 14:23:40.396878 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:40.396735    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 06 14:23:40.396878 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:40.396717    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 06 14:23:40.403070 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:40.403044    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:23:40.455097 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:40.455059    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/105734b3-e5f3-4bf2-8f66-df587a4caec2-data-volume\") pod \"insights-runtime-extractor-pfg9l\" (UID: \"105734b3-e5f3-4bf2-8f66-df587a4caec2\") " pod="openshift-insights/insights-runtime-extractor-pfg9l"
Jul 06 14:23:40.455298 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:40.455129    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/105734b3-e5f3-4bf2-8f66-df587a4caec2-crio-socket\") pod \"insights-runtime-extractor-pfg9l\" (UID: \"105734b3-e5f3-4bf2-8f66-df587a4caec2\") " pod="openshift-insights/insights-runtime-extractor-pfg9l"
Jul 06 14:23:40.455298 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:40.455150    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/105734b3-e5f3-4bf2-8f66-df587a4caec2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pfg9l\" (UID: \"105734b3-e5f3-4bf2-8f66-df587a4caec2\") " pod="openshift-insights/insights-runtime-extractor-pfg9l"
Jul 06 14:23:40.455298 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:40.455204    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/105734b3-e5f3-4bf2-8f66-df587a4caec2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pfg9l\" (UID: \"105734b3-e5f3-4bf2-8f66-df587a4caec2\") " pod="openshift-insights/insights-runtime-extractor-pfg9l"
Jul 06 14:23:40.455413 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:40.455304    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldqk2\" (UniqueName: \"kubernetes.io/projected/105734b3-e5f3-4bf2-8f66-df587a4caec2-kube-api-access-ldqk2\") pod \"insights-runtime-extractor-pfg9l\" (UID: \"105734b3-e5f3-4bf2-8f66-df587a4caec2\") " pod="openshift-insights/insights-runtime-extractor-pfg9l"
Jul 06 14:23:40.495703 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:40.495671    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:23:40.556587 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:40.556549    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldqk2\" (UniqueName: \"kubernetes.io/projected/105734b3-e5f3-4bf2-8f66-df587a4caec2-kube-api-access-ldqk2\") pod \"insights-runtime-extractor-pfg9l\" (UID: \"105734b3-e5f3-4bf2-8f66-df587a4caec2\") " pod="openshift-insights/insights-runtime-extractor-pfg9l"
Jul 06 14:23:40.556746 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:40.556623    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/105734b3-e5f3-4bf2-8f66-df587a4caec2-data-volume\") pod \"insights-runtime-extractor-pfg9l\" (UID: \"105734b3-e5f3-4bf2-8f66-df587a4caec2\") " pod="openshift-insights/insights-runtime-extractor-pfg9l"
Jul 06 14:23:40.556833 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:40.556809    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/105734b3-e5f3-4bf2-8f66-df587a4caec2-crio-socket\") pod \"insights-runtime-extractor-pfg9l\" (UID: \"105734b3-e5f3-4bf2-8f66-df587a4caec2\") " pod="openshift-insights/insights-runtime-extractor-pfg9l"
Jul 06 14:23:40.556905 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:40.556841    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/105734b3-e5f3-4bf2-8f66-df587a4caec2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pfg9l\" (UID: \"105734b3-e5f3-4bf2-8f66-df587a4caec2\") " pod="openshift-insights/insights-runtime-extractor-pfg9l"
Jul 06 14:23:40.556905 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:40.556864    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/105734b3-e5f3-4bf2-8f66-df587a4caec2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pfg9l\" (UID: \"105734b3-e5f3-4bf2-8f66-df587a4caec2\") " pod="openshift-insights/insights-runtime-extractor-pfg9l"
Jul 06 14:23:40.557001 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:40.556963    2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 14:23:40.557001 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:40.556984    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 14:23:40.557100 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:40.557026    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/105734b3-e5f3-4bf2-8f66-df587a4caec2-kube-rbac-proxy-cm podName:105734b3-e5f3-4bf2-8f66-df587a4caec2 nodeName:}" failed. No retries permitted until 2026-07-06 14:23:41.057011146 +0000 UTC m=+47.977291553 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/105734b3-e5f3-4bf2-8f66-df587a4caec2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pfg9l" (UID: "105734b3-e5f3-4bf2-8f66-df587a4caec2") : configmap "kube-rbac-proxy" not found
Jul 06 14:23:40.557100 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:40.557041    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/105734b3-e5f3-4bf2-8f66-df587a4caec2-insights-runtime-extractor-tls podName:105734b3-e5f3-4bf2-8f66-df587a4caec2 nodeName:}" failed. No retries permitted until 2026-07-06 14:23:41.057035123 +0000 UTC m=+47.977315530 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/105734b3-e5f3-4bf2-8f66-df587a4caec2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pfg9l" (UID: "105734b3-e5f3-4bf2-8f66-df587a4caec2") : secret "insights-runtime-extractor-tls" not found
Jul 06 14:23:40.557100 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:40.557047    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/105734b3-e5f3-4bf2-8f66-df587a4caec2-crio-socket\") pod \"insights-runtime-extractor-pfg9l\" (UID: \"105734b3-e5f3-4bf2-8f66-df587a4caec2\") " pod="openshift-insights/insights-runtime-extractor-pfg9l"
Jul 06 14:23:40.557100 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:40.557063    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/105734b3-e5f3-4bf2-8f66-df587a4caec2-data-volume\") pod \"insights-runtime-extractor-pfg9l\" (UID: \"105734b3-e5f3-4bf2-8f66-df587a4caec2\") " pod="openshift-insights/insights-runtime-extractor-pfg9l"
Jul 06 14:23:40.565808 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:40.565788    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldqk2\" (UniqueName: \"kubernetes.io/projected/105734b3-e5f3-4bf2-8f66-df587a4caec2-kube-api-access-ldqk2\") pod \"insights-runtime-extractor-pfg9l\" (UID: \"105734b3-e5f3-4bf2-8f66-df587a4caec2\") " pod="openshift-insights/insights-runtime-extractor-pfg9l"
Jul 06 14:23:41.061799 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:41.061759    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/105734b3-e5f3-4bf2-8f66-df587a4caec2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pfg9l\" (UID: \"105734b3-e5f3-4bf2-8f66-df587a4caec2\") " pod="openshift-insights/insights-runtime-extractor-pfg9l"
Jul 06 14:23:41.062227 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:41.061806    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/105734b3-e5f3-4bf2-8f66-df587a4caec2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pfg9l\" (UID: \"105734b3-e5f3-4bf2-8f66-df587a4caec2\") " pod="openshift-insights/insights-runtime-extractor-pfg9l"
Jul 06 14:23:41.062227 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:41.061878    2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 14:23:41.062227 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:41.061945    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/105734b3-e5f3-4bf2-8f66-df587a4caec2-kube-rbac-proxy-cm podName:105734b3-e5f3-4bf2-8f66-df587a4caec2 nodeName:}" failed. No retries permitted until 2026-07-06 14:23:42.061929733 +0000 UTC m=+48.982210140 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/105734b3-e5f3-4bf2-8f66-df587a4caec2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pfg9l" (UID: "105734b3-e5f3-4bf2-8f66-df587a4caec2") : configmap "kube-rbac-proxy" not found
Jul 06 14:23:41.062227 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:41.061984    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 14:23:41.062227 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:41.062044    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/105734b3-e5f3-4bf2-8f66-df587a4caec2-insights-runtime-extractor-tls podName:105734b3-e5f3-4bf2-8f66-df587a4caec2 nodeName:}" failed. No retries permitted until 2026-07-06 14:23:42.062029688 +0000 UTC m=+48.982310094 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/105734b3-e5f3-4bf2-8f66-df587a4caec2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pfg9l" (UID: "105734b3-e5f3-4bf2-8f66-df587a4caec2") : secret "insights-runtime-extractor-tls" not found
Jul 06 14:23:41.643900 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:41.643859    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-758f599c5-thzss"]
Jul 06 14:23:41.665256 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:41.665233    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-thzss"]
Jul 06 14:23:41.665407 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:41.665321    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-thzss"
Jul 06 14:23:41.667665 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:41.667632    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c9139faa-b66e-43d4-9a07-bd16a63ff0f8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-5kn2v\" (UID: \"c9139faa-b66e-43d4-9a07-bd16a63ff0f8\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-5kn2v"
Jul 06 14:23:41.667795 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:41.667753    2582 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 06 14:23:41.667870 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:41.667820    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9139faa-b66e-43d4-9a07-bd16a63ff0f8-cluster-monitoring-operator-tls podName:c9139faa-b66e-43d4-9a07-bd16a63ff0f8 nodeName:}" failed. No retries permitted until 2026-07-06 14:23:49.667804249 +0000 UTC m=+56.588084678 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c9139faa-b66e-43d4-9a07-bd16a63ff0f8-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-5kn2v" (UID: "c9139faa-b66e-43d4-9a07-bd16a63ff0f8") : secret "cluster-monitoring-operator-tls" not found
Jul 06 14:23:41.668112 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:41.668086    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 06 14:23:41.668208 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:41.668094    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 06 14:23:41.668208 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:41.668116    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 06 14:23:41.669093 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:41.669077    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 06 14:23:41.669282 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:41.669267    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-6l89q\""
Jul 06 14:23:41.677250 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:41.677232    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:23:41.768914 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:41.768883    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/7204e120-3bf2-49dc-815c-40cc581b07d4-signing-key\") pod \"service-ca-758f599c5-thzss\" (UID: \"7204e120-3bf2-49dc-815c-40cc581b07d4\") " pod="openshift-service-ca/service-ca-758f599c5-thzss"
Jul 06 14:23:41.769117 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:41.768945    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/7204e120-3bf2-49dc-815c-40cc581b07d4-signing-cabundle\") pod \"service-ca-758f599c5-thzss\" (UID: \"7204e120-3bf2-49dc-815c-40cc581b07d4\") " pod="openshift-service-ca/service-ca-758f599c5-thzss"
Jul 06 14:23:41.769117 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:41.769060    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rzs8\" (UniqueName: \"kubernetes.io/projected/7204e120-3bf2-49dc-815c-40cc581b07d4-kube-api-access-7rzs8\") pod \"service-ca-758f599c5-thzss\" (UID: \"7204e120-3bf2-49dc-815c-40cc581b07d4\") " pod="openshift-service-ca/service-ca-758f599c5-thzss"
Jul 06 14:23:41.769117 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:41.769100    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7831bfca-c689-4707-918f-9b1b6fe52258-metrics-certs\") pod \"router-default-6c998bcc47-7mmnb\" (UID: \"7831bfca-c689-4707-918f-9b1b6fe52258\") " pod="openshift-ingress/router-default-6c998bcc47-7mmnb"
Jul 06 14:23:41.769336 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:41.769127    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7831bfca-c689-4707-918f-9b1b6fe52258-service-ca-bundle\") pod \"router-default-6c998bcc47-7mmnb\" (UID: \"7831bfca-c689-4707-918f-9b1b6fe52258\") " pod="openshift-ingress/router-default-6c998bcc47-7mmnb"
Jul 06 14:23:41.769336 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:41.769216    2582 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 06 14:23:41.769336 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:41.769275    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7831bfca-c689-4707-918f-9b1b6fe52258-service-ca-bundle podName:7831bfca-c689-4707-918f-9b1b6fe52258 nodeName:}" failed. No retries permitted until 2026-07-06 14:23:49.769256433 +0000 UTC m=+56.689536843 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7831bfca-c689-4707-918f-9b1b6fe52258-service-ca-bundle") pod "router-default-6c998bcc47-7mmnb" (UID: "7831bfca-c689-4707-918f-9b1b6fe52258") : configmap references non-existent config key: service-ca.crt
Jul 06 14:23:41.769336 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:41.769302    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7831bfca-c689-4707-918f-9b1b6fe52258-metrics-certs podName:7831bfca-c689-4707-918f-9b1b6fe52258 nodeName:}" failed. No retries permitted until 2026-07-06 14:23:49.769291195 +0000 UTC m=+56.689571609 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7831bfca-c689-4707-918f-9b1b6fe52258-metrics-certs") pod "router-default-6c998bcc47-7mmnb" (UID: "7831bfca-c689-4707-918f-9b1b6fe52258") : secret "router-metrics-certs-default" not found
Jul 06 14:23:41.869995 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:41.869959    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7rzs8\" (UniqueName: \"kubernetes.io/projected/7204e120-3bf2-49dc-815c-40cc581b07d4-kube-api-access-7rzs8\") pod \"service-ca-758f599c5-thzss\" (UID: \"7204e120-3bf2-49dc-815c-40cc581b07d4\") " pod="openshift-service-ca/service-ca-758f599c5-thzss"
Jul 06 14:23:41.870166 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:41.870066    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/7204e120-3bf2-49dc-815c-40cc581b07d4-signing-key\") pod \"service-ca-758f599c5-thzss\" (UID: \"7204e120-3bf2-49dc-815c-40cc581b07d4\") " pod="openshift-service-ca/service-ca-758f599c5-thzss"
Jul 06 14:23:41.870166 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:41.870115    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/7204e120-3bf2-49dc-815c-40cc581b07d4-signing-cabundle\") pod \"service-ca-758f599c5-thzss\" (UID: \"7204e120-3bf2-49dc-815c-40cc581b07d4\") " pod="openshift-service-ca/service-ca-758f599c5-thzss"
Jul 06 14:23:41.870803 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:41.870779    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/7204e120-3bf2-49dc-815c-40cc581b07d4-signing-cabundle\") pod \"service-ca-758f599c5-thzss\" (UID: \"7204e120-3bf2-49dc-815c-40cc581b07d4\") " pod="openshift-service-ca/service-ca-758f599c5-thzss"
Jul 06 14:23:41.872446 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:41.872429    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/7204e120-3bf2-49dc-815c-40cc581b07d4-signing-key\") pod \"service-ca-758f599c5-thzss\" (UID: \"7204e120-3bf2-49dc-815c-40cc581b07d4\") " pod="openshift-service-ca/service-ca-758f599c5-thzss"
Jul 06 14:23:41.878911 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:41.878890    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rzs8\" (UniqueName: \"kubernetes.io/projected/7204e120-3bf2-49dc-815c-40cc581b07d4-kube-api-access-7rzs8\") pod \"service-ca-758f599c5-thzss\" (UID: \"7204e120-3bf2-49dc-815c-40cc581b07d4\") " pod="openshift-service-ca/service-ca-758f599c5-thzss"
Jul 06 14:23:41.974631 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:41.974596    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-thzss"
Jul 06 14:23:42.071271 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:42.071201    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/105734b3-e5f3-4bf2-8f66-df587a4caec2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pfg9l\" (UID: \"105734b3-e5f3-4bf2-8f66-df587a4caec2\") " pod="openshift-insights/insights-runtime-extractor-pfg9l"
Jul 06 14:23:42.071271 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:42.071235    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/105734b3-e5f3-4bf2-8f66-df587a4caec2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pfg9l\" (UID: \"105734b3-e5f3-4bf2-8f66-df587a4caec2\") " pod="openshift-insights/insights-runtime-extractor-pfg9l"
Jul 06 14:23:42.071742 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:42.071313    2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 14:23:42.071742 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:42.071354    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 14:23:42.071742 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:42.071379    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/105734b3-e5f3-4bf2-8f66-df587a4caec2-kube-rbac-proxy-cm podName:105734b3-e5f3-4bf2-8f66-df587a4caec2 nodeName:}" failed. No retries permitted until 2026-07-06 14:23:44.071359347 +0000 UTC m=+50.991639775 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/105734b3-e5f3-4bf2-8f66-df587a4caec2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pfg9l" (UID: "105734b3-e5f3-4bf2-8f66-df587a4caec2") : configmap "kube-rbac-proxy" not found
Jul 06 14:23:42.071742 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:42.071396    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/105734b3-e5f3-4bf2-8f66-df587a4caec2-insights-runtime-extractor-tls podName:105734b3-e5f3-4bf2-8f66-df587a4caec2 nodeName:}" failed. No retries permitted until 2026-07-06 14:23:44.071387176 +0000 UTC m=+50.991667583 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/105734b3-e5f3-4bf2-8f66-df587a4caec2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pfg9l" (UID: "105734b3-e5f3-4bf2-8f66-df587a4caec2") : secret "insights-runtime-extractor-tls" not found
Jul 06 14:23:42.113346 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:42.113310    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-thzss"]
Jul 06 14:23:42.117360 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:23:42.117329    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7204e120_3bf2_49dc_815c_40cc581b07d4.slice/crio-763745ecab02bbe533e8c957052fab04ba74dbe95e415de4fc9f0cdce22d393f WatchSource:0}: Error finding container 763745ecab02bbe533e8c957052fab04ba74dbe95e415de4fc9f0cdce22d393f: Status 404 returned error can't find the container with id 763745ecab02bbe533e8c957052fab04ba74dbe95e415de4fc9f0cdce22d393f
Jul 06 14:23:42.219099 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:42.219076    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:23:42.332772 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:42.332735    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:23:42.674028 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:42.674000    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:23:42.676023 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:42.676003    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3-registry-tls\") pod \"image-registry-788fcf5466-l2crl\" (UID: \"c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3\") " pod="openshift-image-registry/image-registry-788fcf5466-l2crl"
Jul 06 14:23:42.676161 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:42.676144    2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 14:23:42.676217 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:42.676162    2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-788fcf5466-l2crl: secret "image-registry-tls" not found
Jul 06 14:23:42.676217 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:42.676211    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3-registry-tls podName:c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3 nodeName:}" failed. No retries permitted until 2026-07-06 14:23:50.676196219 +0000 UTC m=+57.596476626 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3-registry-tls") pod "image-registry-788fcf5466-l2crl" (UID: "c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3") : secret "image-registry-tls" not found
Jul 06 14:23:42.746337 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:42.746307    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-95qwv_5554b54b-fec2-4059-9f42-845d87fc9961/dns-node-resolver/0.log"
Jul 06 14:23:42.857736 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:42.857701    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-thzss" event={"ID":"7204e120-3bf2-49dc-815c-40cc581b07d4","Type":"ContainerStarted","Data":"239ca8f92c62d9d68e1256541ef8f67e2b2ecdd0f51639ce6a1bd1e3a23d062c"}
Jul 06 14:23:42.857898 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:42.857751    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-thzss" event={"ID":"7204e120-3bf2-49dc-815c-40cc581b07d4","Type":"ContainerStarted","Data":"763745ecab02bbe533e8c957052fab04ba74dbe95e415de4fc9f0cdce22d393f"}
Jul 06 14:23:42.882941 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:42.882890    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-758f599c5-thzss" podStartSLOduration=1.882874135 podStartE2EDuration="1.882874135s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:23:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:23:42.882554825 +0000 UTC m=+49.802835254" watchObservedRunningTime="2026-07-06 14:23:42.882874135 +0000 UTC m=+49.803154564"
Jul 06 14:23:43.228156 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:43.228121    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:23:43.420085 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:43.420026    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:23:43.496065 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:43.495946    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:23:43.572111 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:43.572078    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:23:43.672391 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:43.672348    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:23:43.772665 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:43.772557    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:23:43.936926 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:43.936895    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:23:43.945392 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:43.945369    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-k72tt_19ce583c-bcbe-4393-ae34-afd29df988b7/node-ca/0.log"
Jul 06 14:23:44.090979 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:44.090089    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/105734b3-e5f3-4bf2-8f66-df587a4caec2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pfg9l\" (UID: \"105734b3-e5f3-4bf2-8f66-df587a4caec2\") " pod="openshift-insights/insights-runtime-extractor-pfg9l"
Jul 06 14:23:44.090979 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:44.090143    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/105734b3-e5f3-4bf2-8f66-df587a4caec2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pfg9l\" (UID: \"105734b3-e5f3-4bf2-8f66-df587a4caec2\") " pod="openshift-insights/insights-runtime-extractor-pfg9l"
Jul 06 14:23:44.090979 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:44.090380    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 14:23:44.090979 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:44.090442    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/105734b3-e5f3-4bf2-8f66-df587a4caec2-insights-runtime-extractor-tls podName:105734b3-e5f3-4bf2-8f66-df587a4caec2 nodeName:}" failed. No retries permitted until 2026-07-06 14:23:48.090424071 +0000 UTC m=+55.010704486 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/105734b3-e5f3-4bf2-8f66-df587a4caec2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pfg9l" (UID: "105734b3-e5f3-4bf2-8f66-df587a4caec2") : secret "insights-runtime-extractor-tls" not found
Jul 06 14:23:44.090979 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:44.090845    2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 14:23:44.090979 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:44.090898    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/105734b3-e5f3-4bf2-8f66-df587a4caec2-kube-rbac-proxy-cm podName:105734b3-e5f3-4bf2-8f66-df587a4caec2 nodeName:}" failed. No retries permitted until 2026-07-06 14:23:48.09088235 +0000 UTC m=+55.011162780 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/105734b3-e5f3-4bf2-8f66-df587a4caec2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pfg9l" (UID: "105734b3-e5f3-4bf2-8f66-df587a4caec2") : configmap "kube-rbac-proxy" not found
Jul 06 14:23:44.292000 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:44.291967    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0656cec5-7e50-4dfc-af2d-9a33adde49e3-metrics-tls\") pod \"dns-default-2t99k\" (UID: \"0656cec5-7e50-4dfc-af2d-9a33adde49e3\") " pod="openshift-dns/dns-default-2t99k"
Jul 06 14:23:44.292364 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:44.292125    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 14:23:44.292364 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:44.292190    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0656cec5-7e50-4dfc-af2d-9a33adde49e3-metrics-tls podName:0656cec5-7e50-4dfc-af2d-9a33adde49e3 nodeName:}" failed. No retries permitted until 2026-07-06 14:24:00.292174499 +0000 UTC m=+67.212454907 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0656cec5-7e50-4dfc-af2d-9a33adde49e3-metrics-tls") pod "dns-default-2t99k" (UID: "0656cec5-7e50-4dfc-af2d-9a33adde49e3") : secret "dns-default-metrics-tls" not found
Jul 06 14:23:44.546995 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:44.546966    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-w7js7_1de327c8-c76b-4f68-be9f-04fcdb31ed23/serve-healthcheck-canary/0.log"
Jul 06 14:23:44.550602 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:44.550574    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:23:45.148715 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:45.148677    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-xqwr8_d620f679-c4f6-4131-aebf-36b50b4433a9/kube-storage-version-migrator-operator/0.log"
Jul 06 14:23:45.332252 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:45.332208    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:23:45.570505 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:45.570466    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:23:45.836911 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:45.836834    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:23:45.937161 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:45.937126    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:23:46.038128 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:46.038085    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:23:46.138402 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:46.138309    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:23:46.733687 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:46.733626    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:23:46.927761 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:46.927713    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:23:47.071521 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:47.071394    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:23:47.330891 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:47.330773    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:23:47.545891 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:47.545839    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:23:47.797477 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:47.797425    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:23:47.857668 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:47.857627    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:23:47.930343 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:47.930314    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:23:48.127644 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:48.127559    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/105734b3-e5f3-4bf2-8f66-df587a4caec2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pfg9l\" (UID: \"105734b3-e5f3-4bf2-8f66-df587a4caec2\") " pod="openshift-insights/insights-runtime-extractor-pfg9l"
Jul 06 14:23:48.127644 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:48.127601    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/105734b3-e5f3-4bf2-8f66-df587a4caec2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pfg9l\" (UID: \"105734b3-e5f3-4bf2-8f66-df587a4caec2\") " pod="openshift-insights/insights-runtime-extractor-pfg9l"
Jul 06 14:23:48.127861 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:48.127716    2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 14:23:48.127861 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:48.127786    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/105734b3-e5f3-4bf2-8f66-df587a4caec2-kube-rbac-proxy-cm podName:105734b3-e5f3-4bf2-8f66-df587a4caec2 nodeName:}" failed. No retries permitted until 2026-07-06 14:23:56.127765618 +0000 UTC m=+63.048046043 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/105734b3-e5f3-4bf2-8f66-df587a4caec2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pfg9l" (UID: "105734b3-e5f3-4bf2-8f66-df587a4caec2") : configmap "kube-rbac-proxy" not found
Jul 06 14:23:48.127861 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:48.127787    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 14:23:48.127981 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:48.127886    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/105734b3-e5f3-4bf2-8f66-df587a4caec2-insights-runtime-extractor-tls podName:105734b3-e5f3-4bf2-8f66-df587a4caec2 nodeName:}" failed. No retries permitted until 2026-07-06 14:23:56.127865443 +0000 UTC m=+63.048145864 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/105734b3-e5f3-4bf2-8f66-df587a4caec2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pfg9l" (UID: "105734b3-e5f3-4bf2-8f66-df587a4caec2") : secret "insights-runtime-extractor-tls" not found
Jul 06 14:23:48.930081 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:48.930049    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:23:49.322330 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:49.322194    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:23:49.528164 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:49.528131    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:23:49.582154 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:49.582063    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:23:49.726903 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:49.726872    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:23:49.739914 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:49.739865    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c9139faa-b66e-43d4-9a07-bd16a63ff0f8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-5kn2v\" (UID: \"c9139faa-b66e-43d4-9a07-bd16a63ff0f8\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-5kn2v"
Jul 06 14:23:49.740097 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:49.740051    2582 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 06 14:23:49.740150 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:23:49.740129    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9139faa-b66e-43d4-9a07-bd16a63ff0f8-cluster-monitoring-operator-tls podName:c9139faa-b66e-43d4-9a07-bd16a63ff0f8 nodeName:}" failed. No retries permitted until 2026-07-06 14:24:05.740109325 +0000 UTC m=+72.660389735 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c9139faa-b66e-43d4-9a07-bd16a63ff0f8-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-5kn2v" (UID: "c9139faa-b66e-43d4-9a07-bd16a63ff0f8") : secret "cluster-monitoring-operator-tls" not found
Jul 06 14:23:49.841061 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:49.840973    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7831bfca-c689-4707-918f-9b1b6fe52258-metrics-certs\") pod \"router-default-6c998bcc47-7mmnb\" (UID: \"7831bfca-c689-4707-918f-9b1b6fe52258\") " pod="openshift-ingress/router-default-6c998bcc47-7mmnb"
Jul 06 14:23:49.841061 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:49.841025    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7831bfca-c689-4707-918f-9b1b6fe52258-service-ca-bundle\") pod \"router-default-6c998bcc47-7mmnb\" (UID: \"7831bfca-c689-4707-918f-9b1b6fe52258\") " pod="openshift-ingress/router-default-6c998bcc47-7mmnb"
Jul 06 14:23:49.841757 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:49.841734    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7831bfca-c689-4707-918f-9b1b6fe52258-service-ca-bundle\") pod \"router-default-6c998bcc47-7mmnb\" (UID: \"7831bfca-c689-4707-918f-9b1b6fe52258\") " pod="openshift-ingress/router-default-6c998bcc47-7mmnb"
Jul 06 14:23:49.843450 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:49.843425    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7831bfca-c689-4707-918f-9b1b6fe52258-metrics-certs\") pod \"router-default-6c998bcc47-7mmnb\" (UID: \"7831bfca-c689-4707-918f-9b1b6fe52258\") " pod="openshift-ingress/router-default-6c998bcc47-7mmnb"
Jul 06 14:23:49.925017 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:49.924985    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:23:50.136719 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:50.136619    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6c998bcc47-7mmnb"
Jul 06 14:23:50.261528 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:50.261497    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6c998bcc47-7mmnb"]
Jul 06 14:23:50.264222 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:23:50.264202    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7831bfca_c689_4707_918f_9b1b6fe52258.slice/crio-397df0eda2f0a0523754696002ad5660853ea4d685dc68c01025a4d506abe504 WatchSource:0}: Error finding container 397df0eda2f0a0523754696002ad5660853ea4d685dc68c01025a4d506abe504: Status 404 returned error can't find the container with id 397df0eda2f0a0523754696002ad5660853ea4d685dc68c01025a4d506abe504
Jul 06 14:23:50.748236 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:50.748185    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3-registry-tls\") pod \"image-registry-788fcf5466-l2crl\" (UID: \"c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3\") " pod="openshift-image-registry/image-registry-788fcf5466-l2crl"
Jul 06 14:23:50.750628 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:50.750596    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3-registry-tls\") pod \"image-registry-788fcf5466-l2crl\" (UID: \"c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3\") " pod="openshift-image-registry/image-registry-788fcf5466-l2crl"
Jul 06 14:23:50.880489 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:50.880457    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6c998bcc47-7mmnb" event={"ID":"7831bfca-c689-4707-918f-9b1b6fe52258","Type":"ContainerStarted","Data":"0b37a4a7bb4b93df7888931c0d85fb2f405cc3879de3aba7a46bdc5f7413a62c"}
Jul 06 14:23:50.880675 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:50.880507    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6c998bcc47-7mmnb" event={"ID":"7831bfca-c689-4707-918f-9b1b6fe52258","Type":"ContainerStarted","Data":"397df0eda2f0a0523754696002ad5660853ea4d685dc68c01025a4d506abe504"}
Jul 06 14:23:50.903543 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:50.903489    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-6c998bcc47-7mmnb" podStartSLOduration=17.903472817 podStartE2EDuration="17.903472817s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:23:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:23:50.902250145 +0000 UTC m=+57.822530575" watchObservedRunningTime="2026-07-06 14:23:50.903472817 +0000 UTC m=+57.823753245"
Jul 06 14:23:51.033270 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:51.033185    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-788fcf5466-l2crl"
Jul 06 14:23:51.137131 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:51.137103    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-6c998bcc47-7mmnb"
Jul 06 14:23:51.139735 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:51.139709    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-6c998bcc47-7mmnb"
Jul 06 14:23:51.144627 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:51.144596    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:23:51.161899 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:51.161865    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-788fcf5466-l2crl"]
Jul 06 14:23:51.165384 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:23:51.165356    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0502bfb_26bd_453e_ad2b_fb78a9ce6dc3.slice/crio-d1edf21668cc754051d98554dea95e039212e1eb29f2e173d56bba5ae6a32e26 WatchSource:0}: Error finding container d1edf21668cc754051d98554dea95e039212e1eb29f2e173d56bba5ae6a32e26: Status 404 returned error can't find the container with id d1edf21668cc754051d98554dea95e039212e1eb29f2e173d56bba5ae6a32e26
Jul 06 14:23:51.332468 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:51.332380    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:23:51.530242 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:51.530208    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:23:51.735062 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:51.735027    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:23:51.885362 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:51.885322    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-788fcf5466-l2crl" event={"ID":"c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3","Type":"ContainerStarted","Data":"a8a201cbdc6e072741a65780070205d0adfe51e617c53f67fe00b73b2885a9ca"}
Jul 06 14:23:51.885673 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:51.885624    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-6c998bcc47-7mmnb"
Jul 06 14:23:51.885798 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:51.885701    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-788fcf5466-l2crl" event={"ID":"c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3","Type":"ContainerStarted","Data":"d1edf21668cc754051d98554dea95e039212e1eb29f2e173d56bba5ae6a32e26"}
Jul 06 14:23:51.885798 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:51.885730    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-788fcf5466-l2crl"
Jul 06 14:23:51.886681 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:51.886647    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-6c998bcc47-7mmnb"
Jul 06 14:23:51.924732 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:51.924674    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-788fcf5466-l2crl" podStartSLOduration=17.924636408 podStartE2EDuration="17.924636408s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:23:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:23:51.923053322 +0000 UTC m=+58.843333751" watchObservedRunningTime="2026-07-06 14:23:51.924636408 +0000 UTC m=+58.844916839"
Jul 06 14:23:51.954007 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:51.953965    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:23:52.561132 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:52.561081    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:23:52.927280 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:52.927245    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:23:53.129828 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:53.129798    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:23:53.328983 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:53.328876    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:23:53.572796 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:53.572765    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:23:53.736796 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:53.736758    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:23:53.799800 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:53.799774    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-54jfj"
Jul 06 14:23:53.940907 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:53.940876    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:23:56.197236 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:56.197198    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/105734b3-e5f3-4bf2-8f66-df587a4caec2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pfg9l\" (UID: \"105734b3-e5f3-4bf2-8f66-df587a4caec2\") " pod="openshift-insights/insights-runtime-extractor-pfg9l"
Jul 06 14:23:56.197236 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:56.197238    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/105734b3-e5f3-4bf2-8f66-df587a4caec2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pfg9l\" (UID: \"105734b3-e5f3-4bf2-8f66-df587a4caec2\") " pod="openshift-insights/insights-runtime-extractor-pfg9l"
Jul 06 14:23:56.197785 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:56.197750    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/105734b3-e5f3-4bf2-8f66-df587a4caec2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pfg9l\" (UID: \"105734b3-e5f3-4bf2-8f66-df587a4caec2\") " pod="openshift-insights/insights-runtime-extractor-pfg9l"
Jul 06 14:23:56.199489 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:56.199472    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/105734b3-e5f3-4bf2-8f66-df587a4caec2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pfg9l\" (UID: \"105734b3-e5f3-4bf2-8f66-df587a4caec2\") " pod="openshift-insights/insights-runtime-extractor-pfg9l"
Jul 06 14:23:56.303963 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:56.303935    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-r6zhh\""
Jul 06 14:23:56.311607 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:56.311581    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-pfg9l"
Jul 06 14:23:56.435024 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:56.434990    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-pfg9l"]
Jul 06 14:23:56.437969 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:23:56.437942    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod105734b3_e5f3_4bf2_8f66_df587a4caec2.slice/crio-688b0cae6b91553cc525b207840a6001c2b4d387446db2fbd60238987c95bae9 WatchSource:0}: Error finding container 688b0cae6b91553cc525b207840a6001c2b4d387446db2fbd60238987c95bae9: Status 404 returned error can't find the container with id 688b0cae6b91553cc525b207840a6001c2b4d387446db2fbd60238987c95bae9
Jul 06 14:23:56.904606 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:56.904571    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pfg9l" event={"ID":"105734b3-e5f3-4bf2-8f66-df587a4caec2","Type":"ContainerStarted","Data":"688b0cae6b91553cc525b207840a6001c2b4d387446db2fbd60238987c95bae9"}
Jul 06 14:23:58.171527 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:58.171498    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:23:58.243169 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:58.243129    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:23:59.224991 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:59.224951    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/537a943a-73f7-4e98-b74c-dde1d0ff1c92-metrics-certs\") pod \"network-metrics-daemon-mqgwp\" (UID: \"537a943a-73f7-4e98-b74c-dde1d0ff1c92\") " pod="openshift-multus/network-metrics-daemon-mqgwp"
Jul 06 14:23:59.225360 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:59.225025    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mn4nx\" (UniqueName: \"kubernetes.io/projected/b81991eb-ee77-4c04-b880-a34d9419ca14-kube-api-access-mn4nx\") pod \"network-check-target-gx87x\" (UID: \"b81991eb-ee77-4c04-b880-a34d9419ca14\") " pod="openshift-network-diagnostics/network-check-target-gx87x"
Jul 06 14:23:59.227853 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:59.227834    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 06 14:23:59.227948 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:59.227862    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 06 14:23:59.237584 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:59.237562    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/537a943a-73f7-4e98-b74c-dde1d0ff1c92-metrics-certs\") pod \"network-metrics-daemon-mqgwp\" (UID: \"537a943a-73f7-4e98-b74c-dde1d0ff1c92\") " pod="openshift-multus/network-metrics-daemon-mqgwp"
Jul 06 14:23:59.237854 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:59.237837    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 06 14:23:59.248604 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:59.248566    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mn4nx\" (UniqueName: \"kubernetes.io/projected/b81991eb-ee77-4c04-b880-a34d9419ca14-kube-api-access-mn4nx\") pod \"network-check-target-gx87x\" (UID: \"b81991eb-ee77-4c04-b880-a34d9419ca14\") " pod="openshift-network-diagnostics/network-check-target-gx87x"
Jul 06 14:23:59.325926 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:59.325892    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/201f4c6e-b9d8-4a99-9f4e-b8f59e69ad1d-original-pull-secret\") pod \"global-pull-secret-syncer-mbkvc\" (UID: \"201f4c6e-b9d8-4a99-9f4e-b8f59e69ad1d\") " pod="kube-system/global-pull-secret-syncer-mbkvc"
Jul 06 14:23:59.328725 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:59.328705    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 06 14:23:59.339324 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:59.339303    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/201f4c6e-b9d8-4a99-9f4e-b8f59e69ad1d-original-pull-secret\") pod \"global-pull-secret-syncer-mbkvc\" (UID: \"201f4c6e-b9d8-4a99-9f4e-b8f59e69ad1d\") " pod="kube-system/global-pull-secret-syncer-mbkvc"
Jul 06 14:23:59.407210 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:59.407172    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-fbtwb\""
Jul 06 14:23:59.413267 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:59.413245    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5wq2g\""
Jul 06 14:23:59.415078 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:59.415059    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gx87x"
Jul 06 14:23:59.418382 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:59.418357    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mbkvc"
Jul 06 14:23:59.421477 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:23:59.421459    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mqgwp"
Jul 06 14:24:00.231596 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:00.231444    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-mqgwp"]
Jul 06 14:24:00.235264 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:24:00.235239    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod537a943a_73f7_4e98_b74c_dde1d0ff1c92.slice/crio-48661f86cce735a51a40d3f46ce34380381dd9e76755629aa627be050ce74f2f WatchSource:0}: Error finding container 48661f86cce735a51a40d3f46ce34380381dd9e76755629aa627be050ce74f2f: Status 404 returned error can't find the container with id 48661f86cce735a51a40d3f46ce34380381dd9e76755629aa627be050ce74f2f
Jul 06 14:24:00.250778 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:00.250752    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-mbkvc"]
Jul 06 14:24:00.254326 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:24:00.254302    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod201f4c6e_b9d8_4a99_9f4e_b8f59e69ad1d.slice/crio-fc782350bf04c9c2e070d0e9f00938ac6f22f95c4d238261c8fbee39c6e15124 WatchSource:0}: Error finding container fc782350bf04c9c2e070d0e9f00938ac6f22f95c4d238261c8fbee39c6e15124: Status 404 returned error can't find the container with id fc782350bf04c9c2e070d0e9f00938ac6f22f95c4d238261c8fbee39c6e15124
Jul 06 14:24:00.334732 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:00.334701    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0656cec5-7e50-4dfc-af2d-9a33adde49e3-metrics-tls\") pod \"dns-default-2t99k\" (UID: \"0656cec5-7e50-4dfc-af2d-9a33adde49e3\") " pod="openshift-dns/dns-default-2t99k"
Jul 06 14:24:00.336923 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:00.336902    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0656cec5-7e50-4dfc-af2d-9a33adde49e3-metrics-tls\") pod \"dns-default-2t99k\" (UID: \"0656cec5-7e50-4dfc-af2d-9a33adde49e3\") " pod="openshift-dns/dns-default-2t99k"
Jul 06 14:24:00.453937 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:00.453902    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-gx87x"]
Jul 06 14:24:00.457035 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:24:00.457005    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb81991eb_ee77_4c04_b880_a34d9419ca14.slice/crio-ab756d5bf8d45cbdfa5cdaf7c576e51654710b522f95b18b5d9287cf32d2ff82 WatchSource:0}: Error finding container ab756d5bf8d45cbdfa5cdaf7c576e51654710b522f95b18b5d9287cf32d2ff82: Status 404 returned error can't find the container with id ab756d5bf8d45cbdfa5cdaf7c576e51654710b522f95b18b5d9287cf32d2ff82
Jul 06 14:24:00.555141 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:00.555107    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-m58h6\""
Jul 06 14:24:00.563125 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:00.563099    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2t99k"
Jul 06 14:24:00.684972 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:00.684939    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-2t99k"]
Jul 06 14:24:00.687517 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:24:00.687492    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0656cec5_7e50_4dfc_af2d_9a33adde49e3.slice/crio-604a8543e56d071810d3631479587e09ceaa44b736479fdecfb85a944f313317 WatchSource:0}: Error finding container 604a8543e56d071810d3631479587e09ceaa44b736479fdecfb85a944f313317: Status 404 returned error can't find the container with id 604a8543e56d071810d3631479587e09ceaa44b736479fdecfb85a944f313317
Jul 06 14:24:00.920488 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:00.920462    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-gx87x" event={"ID":"b81991eb-ee77-4c04-b880-a34d9419ca14","Type":"ContainerStarted","Data":"ab756d5bf8d45cbdfa5cdaf7c576e51654710b522f95b18b5d9287cf32d2ff82"}
Jul 06 14:24:00.921887 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:00.921851    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pfg9l" event={"ID":"105734b3-e5f3-4bf2-8f66-df587a4caec2","Type":"ContainerStarted","Data":"2b52a8dcce39fcf3af1630072128e253268dd606579c9206d225aba966574dd3"}
Jul 06 14:24:00.923005 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:00.922982    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2t99k" event={"ID":"0656cec5-7e50-4dfc-af2d-9a33adde49e3","Type":"ContainerStarted","Data":"604a8543e56d071810d3631479587e09ceaa44b736479fdecfb85a944f313317"}
Jul 06 14:24:00.924052 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:00.924023    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-mbkvc" event={"ID":"201f4c6e-b9d8-4a99-9f4e-b8f59e69ad1d","Type":"ContainerStarted","Data":"fc782350bf04c9c2e070d0e9f00938ac6f22f95c4d238261c8fbee39c6e15124"}
Jul 06 14:24:00.925003 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:00.924983    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mqgwp" event={"ID":"537a943a-73f7-4e98-b74c-dde1d0ff1c92","Type":"ContainerStarted","Data":"48661f86cce735a51a40d3f46ce34380381dd9e76755629aa627be050ce74f2f"}
Jul 06 14:24:01.121487 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:01.121448    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5459d6b8cb-v8ghl"]
Jul 06 14:24:01.125068 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:01.124841    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5459d6b8cb-v8ghl"
Jul 06 14:24:01.128398 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:01.128119    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 06 14:24:01.128398 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:01.128146    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 06 14:24:01.128398 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:01.128190    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 06 14:24:01.128398 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:01.128129    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 06 14:24:01.129390 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:01.129189    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 06 14:24:01.129552 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:01.129462    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 06 14:24:01.130033 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:01.130011    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 06 14:24:01.139889 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:01.138706    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-788fcf5466-l2crl"]
Jul 06 14:24:01.139889 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:01.139842    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5459d6b8cb-v8ghl"]
Jul 06 14:24:01.220754 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:01.220716    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6556f6b698-2qxrh"]
Jul 06 14:24:01.224467 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:01.223996    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6556f6b698-2qxrh"
Jul 06 14:24:01.237517 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:01.237490    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6556f6b698-2qxrh"]
Jul 06 14:24:01.241948 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:01.241923    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/edd8288b-e268-45ac-be98-17524d200d25-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5459d6b8cb-v8ghl\" (UID: \"edd8288b-e268-45ac-be98-17524d200d25\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5459d6b8cb-v8ghl"
Jul 06 14:24:01.242069 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:01.241966    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/edd8288b-e268-45ac-be98-17524d200d25-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5459d6b8cb-v8ghl\" (UID: \"edd8288b-e268-45ac-be98-17524d200d25\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5459d6b8cb-v8ghl"
Jul 06 14:24:01.242069 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:01.241998    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/edd8288b-e268-45ac-be98-17524d200d25-hub\") pod \"cluster-proxy-proxy-agent-5459d6b8cb-v8ghl\" (UID: \"edd8288b-e268-45ac-be98-17524d200d25\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5459d6b8cb-v8ghl"
Jul 06 14:24:01.242069 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:01.242024    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/edd8288b-e268-45ac-be98-17524d200d25-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5459d6b8cb-v8ghl\" (UID: \"edd8288b-e268-45ac-be98-17524d200d25\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5459d6b8cb-v8ghl"
Jul 06 14:24:01.242069 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:01.242058    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/edd8288b-e268-45ac-be98-17524d200d25-ca\") pod \"cluster-proxy-proxy-agent-5459d6b8cb-v8ghl\" (UID: \"edd8288b-e268-45ac-be98-17524d200d25\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5459d6b8cb-v8ghl"
Jul 06 14:24:01.242313 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:01.242094    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sbj2c\" (UniqueName: \"kubernetes.io/projected/edd8288b-e268-45ac-be98-17524d200d25-kube-api-access-sbj2c\") pod \"cluster-proxy-proxy-agent-5459d6b8cb-v8ghl\" (UID: \"edd8288b-e268-45ac-be98-17524d200d25\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5459d6b8cb-v8ghl"
Jul 06 14:24:01.243344 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:01.243323    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:24:01.343289 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:01.343254    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/edd8288b-e268-45ac-be98-17524d200d25-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5459d6b8cb-v8ghl\" (UID: \"edd8288b-e268-45ac-be98-17524d200d25\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5459d6b8cb-v8ghl"
Jul 06 14:24:01.343463 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:01.343308    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/edd8288b-e268-45ac-be98-17524d200d25-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5459d6b8cb-v8ghl\" (UID: \"edd8288b-e268-45ac-be98-17524d200d25\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5459d6b8cb-v8ghl"
Jul 06 14:24:01.343463 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:01.343342    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3de1c042-065e-4441-be64-4b75163f94b0-image-registry-private-configuration\") pod \"image-registry-6556f6b698-2qxrh\" (UID: \"3de1c042-065e-4441-be64-4b75163f94b0\") " pod="openshift-image-registry/image-registry-6556f6b698-2qxrh"
Jul 06 14:24:01.343463 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:01.343368    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-242wn\" (UniqueName: \"kubernetes.io/projected/3de1c042-065e-4441-be64-4b75163f94b0-kube-api-access-242wn\") pod \"image-registry-6556f6b698-2qxrh\" (UID: \"3de1c042-065e-4441-be64-4b75163f94b0\") " pod="openshift-image-registry/image-registry-6556f6b698-2qxrh"
Jul 06 14:24:01.343463 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:01.343401    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/edd8288b-e268-45ac-be98-17524d200d25-hub\") pod \"cluster-proxy-proxy-agent-5459d6b8cb-v8ghl\" (UID: \"edd8288b-e268-45ac-be98-17524d200d25\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5459d6b8cb-v8ghl"
Jul 06 14:24:01.343463 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:01.343429    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3de1c042-065e-4441-be64-4b75163f94b0-registry-certificates\") pod \"image-registry-6556f6b698-2qxrh\" (UID: \"3de1c042-065e-4441-be64-4b75163f94b0\") " pod="openshift-image-registry/image-registry-6556f6b698-2qxrh"
Jul 06 14:24:01.343463 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:01.343456    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/edd8288b-e268-45ac-be98-17524d200d25-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5459d6b8cb-v8ghl\" (UID: \"edd8288b-e268-45ac-be98-17524d200d25\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5459d6b8cb-v8ghl"
Jul 06 14:24:01.343800 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:01.343481    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3de1c042-065e-4441-be64-4b75163f94b0-ca-trust-extracted\") pod \"image-registry-6556f6b698-2qxrh\" (UID: \"3de1c042-065e-4441-be64-4b75163f94b0\") " pod="openshift-image-registry/image-registry-6556f6b698-2qxrh"
Jul 06 14:24:01.343800 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:01.343516    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3de1c042-065e-4441-be64-4b75163f94b0-installation-pull-secrets\") pod \"image-registry-6556f6b698-2qxrh\" (UID: \"3de1c042-065e-4441-be64-4b75163f94b0\") " pod="openshift-image-registry/image-registry-6556f6b698-2qxrh"
Jul 06 14:24:01.343800 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:01.343545    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/edd8288b-e268-45ac-be98-17524d200d25-ca\") pod \"cluster-proxy-proxy-agent-5459d6b8cb-v8ghl\" (UID: \"edd8288b-e268-45ac-be98-17524d200d25\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5459d6b8cb-v8ghl"
Jul 06 14:24:01.343800 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:01.343586    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sbj2c\" (UniqueName: \"kubernetes.io/projected/edd8288b-e268-45ac-be98-17524d200d25-kube-api-access-sbj2c\") pod \"cluster-proxy-proxy-agent-5459d6b8cb-v8ghl\" (UID: \"edd8288b-e268-45ac-be98-17524d200d25\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5459d6b8cb-v8ghl"
Jul 06 14:24:01.343800 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:01.343609    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3de1c042-065e-4441-be64-4b75163f94b0-trusted-ca\") pod \"image-registry-6556f6b698-2qxrh\" (UID: \"3de1c042-065e-4441-be64-4b75163f94b0\") " pod="openshift-image-registry/image-registry-6556f6b698-2qxrh"
Jul 06 14:24:01.343800 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:01.343665    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3de1c042-065e-4441-be64-4b75163f94b0-registry-tls\") pod \"image-registry-6556f6b698-2qxrh\" (UID: \"3de1c042-065e-4441-be64-4b75163f94b0\") " pod="openshift-image-registry/image-registry-6556f6b698-2qxrh"
Jul 06 14:24:01.343800 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:01.343725    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3de1c042-065e-4441-be64-4b75163f94b0-bound-sa-token\") pod \"image-registry-6556f6b698-2qxrh\" (UID: \"3de1c042-065e-4441-be64-4b75163f94b0\") " pod="openshift-image-registry/image-registry-6556f6b698-2qxrh"
Jul 06 14:24:01.345486 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:01.345415    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/edd8288b-e268-45ac-be98-17524d200d25-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5459d6b8cb-v8ghl\" (UID: \"edd8288b-e268-45ac-be98-17524d200d25\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5459d6b8cb-v8ghl"
Jul 06 14:24:01.356967 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:01.354518    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sbj2c\" (UniqueName: \"kubernetes.io/projected/edd8288b-e268-45ac-be98-17524d200d25-kube-api-access-sbj2c\") pod \"cluster-proxy-proxy-agent-5459d6b8cb-v8ghl\" (UID: \"edd8288b-e268-45ac-be98-17524d200d25\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5459d6b8cb-v8ghl"
Jul 06 14:24:01.356967 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:01.354934    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/edd8288b-e268-45ac-be98-17524d200d25-hub\") pod \"cluster-proxy-proxy-agent-5459d6b8cb-v8ghl\" (UID: \"edd8288b-e268-45ac-be98-17524d200d25\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5459d6b8cb-v8ghl"
Jul 06 14:24:01.356967 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:01.355185    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/edd8288b-e268-45ac-be98-17524d200d25-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5459d6b8cb-v8ghl\" (UID: \"edd8288b-e268-45ac-be98-17524d200d25\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5459d6b8cb-v8ghl"
Jul 06 14:24:01.356967 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:01.355449    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/edd8288b-e268-45ac-be98-17524d200d25-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5459d6b8cb-v8ghl\" (UID: \"edd8288b-e268-45ac-be98-17524d200d25\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5459d6b8cb-v8ghl"
Jul 06 14:24:01.373074 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:01.370931    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/edd8288b-e268-45ac-be98-17524d200d25-ca\") pod \"cluster-proxy-proxy-agent-5459d6b8cb-v8ghl\" (UID: \"edd8288b-e268-45ac-be98-17524d200d25\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5459d6b8cb-v8ghl"
Jul 06 14:24:01.373074 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:01.372450    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:24:01.445697 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:01.444893    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3de1c042-065e-4441-be64-4b75163f94b0-image-registry-private-configuration\") pod \"image-registry-6556f6b698-2qxrh\" (UID: \"3de1c042-065e-4441-be64-4b75163f94b0\") " pod="openshift-image-registry/image-registry-6556f6b698-2qxrh"
Jul 06 14:24:01.445697 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:01.444938    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-242wn\" (UniqueName: \"kubernetes.io/projected/3de1c042-065e-4441-be64-4b75163f94b0-kube-api-access-242wn\") pod \"image-registry-6556f6b698-2qxrh\" (UID: \"3de1c042-065e-4441-be64-4b75163f94b0\") " pod="openshift-image-registry/image-registry-6556f6b698-2qxrh"
Jul 06 14:24:01.445697 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:01.444974    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3de1c042-065e-4441-be64-4b75163f94b0-registry-certificates\") pod \"image-registry-6556f6b698-2qxrh\" (UID: \"3de1c042-065e-4441-be64-4b75163f94b0\") " pod="openshift-image-registry/image-registry-6556f6b698-2qxrh"
Jul 06 14:24:01.445697 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:01.445004    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3de1c042-065e-4441-be64-4b75163f94b0-ca-trust-extracted\") pod \"image-registry-6556f6b698-2qxrh\" (UID: \"3de1c042-065e-4441-be64-4b75163f94b0\") " pod="openshift-image-registry/image-registry-6556f6b698-2qxrh"
Jul 06 14:24:01.445697 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:01.445334    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3de1c042-065e-4441-be64-4b75163f94b0-installation-pull-secrets\") pod \"image-registry-6556f6b698-2qxrh\" (UID: \"3de1c042-065e-4441-be64-4b75163f94b0\") " pod="openshift-image-registry/image-registry-6556f6b698-2qxrh"
Jul 06 14:24:01.445697 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:01.445398    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3de1c042-065e-4441-be64-4b75163f94b0-trusted-ca\") pod \"image-registry-6556f6b698-2qxrh\" (UID: \"3de1c042-065e-4441-be64-4b75163f94b0\") " pod="openshift-image-registry/image-registry-6556f6b698-2qxrh"
Jul 06 14:24:01.445697 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:01.445440    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3de1c042-065e-4441-be64-4b75163f94b0-registry-tls\") pod \"image-registry-6556f6b698-2qxrh\" (UID: \"3de1c042-065e-4441-be64-4b75163f94b0\") " pod="openshift-image-registry/image-registry-6556f6b698-2qxrh"
Jul 06 14:24:01.445697 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:01.445499    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3de1c042-065e-4441-be64-4b75163f94b0-bound-sa-token\") pod \"image-registry-6556f6b698-2qxrh\" (UID: \"3de1c042-065e-4441-be64-4b75163f94b0\") " pod="openshift-image-registry/image-registry-6556f6b698-2qxrh"
Jul 06 14:24:01.445697 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:01.445508    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3de1c042-065e-4441-be64-4b75163f94b0-ca-trust-extracted\") pod \"image-registry-6556f6b698-2qxrh\" (UID: \"3de1c042-065e-4441-be64-4b75163f94b0\") " pod="openshift-image-registry/image-registry-6556f6b698-2qxrh"
Jul 06 14:24:01.446283 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:01.446154    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3de1c042-065e-4441-be64-4b75163f94b0-registry-certificates\") pod \"image-registry-6556f6b698-2qxrh\" (UID: \"3de1c042-065e-4441-be64-4b75163f94b0\") " pod="openshift-image-registry/image-registry-6556f6b698-2qxrh"
Jul 06 14:24:01.447178 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:01.447135    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3de1c042-065e-4441-be64-4b75163f94b0-trusted-ca\") pod \"image-registry-6556f6b698-2qxrh\" (UID: \"3de1c042-065e-4441-be64-4b75163f94b0\") " pod="openshift-image-registry/image-registry-6556f6b698-2qxrh"
Jul 06 14:24:01.448619 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:01.448599    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5459d6b8cb-v8ghl"
Jul 06 14:24:01.449318 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:01.449290    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3de1c042-065e-4441-be64-4b75163f94b0-image-registry-private-configuration\") pod \"image-registry-6556f6b698-2qxrh\" (UID: \"3de1c042-065e-4441-be64-4b75163f94b0\") " pod="openshift-image-registry/image-registry-6556f6b698-2qxrh"
Jul 06 14:24:01.451120 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:01.451098    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3de1c042-065e-4441-be64-4b75163f94b0-registry-tls\") pod \"image-registry-6556f6b698-2qxrh\" (UID: \"3de1c042-065e-4441-be64-4b75163f94b0\") " pod="openshift-image-registry/image-registry-6556f6b698-2qxrh"
Jul 06 14:24:01.452928 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:01.452901    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3de1c042-065e-4441-be64-4b75163f94b0-installation-pull-secrets\") pod \"image-registry-6556f6b698-2qxrh\" (UID: \"3de1c042-065e-4441-be64-4b75163f94b0\") " pod="openshift-image-registry/image-registry-6556f6b698-2qxrh"
Jul 06 14:24:01.461077 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:01.461037    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3de1c042-065e-4441-be64-4b75163f94b0-bound-sa-token\") pod \"image-registry-6556f6b698-2qxrh\" (UID: \"3de1c042-065e-4441-be64-4b75163f94b0\") " pod="openshift-image-registry/image-registry-6556f6b698-2qxrh"
Jul 06 14:24:01.463256 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:01.463232    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-242wn\" (UniqueName: \"kubernetes.io/projected/3de1c042-065e-4441-be64-4b75163f94b0-kube-api-access-242wn\") pod \"image-registry-6556f6b698-2qxrh\" (UID: \"3de1c042-065e-4441-be64-4b75163f94b0\") " pod="openshift-image-registry/image-registry-6556f6b698-2qxrh"
Jul 06 14:24:01.468669 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:01.468535    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:24:01.539677 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:01.539353    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6556f6b698-2qxrh"
Jul 06 14:24:01.639079 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:01.639009    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5459d6b8cb-v8ghl"]
Jul 06 14:24:01.640485 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:24:01.640452    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podedd8288b_e268_45ac_be98_17524d200d25.slice/crio-778131e845dcc6591a709c396f5fa385f3361a42fc300400383129250ce2e0c1 WatchSource:0}: Error finding container 778131e845dcc6591a709c396f5fa385f3361a42fc300400383129250ce2e0c1: Status 404 returned error can't find the container with id 778131e845dcc6591a709c396f5fa385f3361a42fc300400383129250ce2e0c1
Jul 06 14:24:01.719842 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:01.719764    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6556f6b698-2qxrh"]
Jul 06 14:24:01.725696 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:24:01.725667    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3de1c042_065e_4441_be64_4b75163f94b0.slice/crio-b3a0cc423ca6bc507c5bc00e0c21b2d4bb01e24b87fcfe5c4943ef5c71387279 WatchSource:0}: Error finding container b3a0cc423ca6bc507c5bc00e0c21b2d4bb01e24b87fcfe5c4943ef5c71387279: Status 404 returned error can't find the container with id b3a0cc423ca6bc507c5bc00e0c21b2d4bb01e24b87fcfe5c4943ef5c71387279
Jul 06 14:24:01.936675 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:01.933957    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5459d6b8cb-v8ghl" event={"ID":"edd8288b-e268-45ac-be98-17524d200d25","Type":"ContainerStarted","Data":"778131e845dcc6591a709c396f5fa385f3361a42fc300400383129250ce2e0c1"}
Jul 06 14:24:01.938305 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:01.937427    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6556f6b698-2qxrh" event={"ID":"3de1c042-065e-4441-be64-4b75163f94b0","Type":"ContainerStarted","Data":"aa29eef0517d16e4005253de676eb543bbc8294e6aeca0c7043dd3d51fb70d7a"}
Jul 06 14:24:01.938305 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:01.937481    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6556f6b698-2qxrh" event={"ID":"3de1c042-065e-4441-be64-4b75163f94b0","Type":"ContainerStarted","Data":"b3a0cc423ca6bc507c5bc00e0c21b2d4bb01e24b87fcfe5c4943ef5c71387279"}
Jul 06 14:24:01.938305 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:01.938238    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6556f6b698-2qxrh"
Jul 06 14:24:01.945030 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:01.944933    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pfg9l" event={"ID":"105734b3-e5f3-4bf2-8f66-df587a4caec2","Type":"ContainerStarted","Data":"ef3ecc453594142ae9931dace3653eec5690adf7fd88ecc41f375c8993276304"}
Jul 06 14:24:01.960412 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:01.960340    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6556f6b698-2qxrh" podStartSLOduration=0.960295703 podStartE2EDuration="960.295703ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:24:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:24:01.958021256 +0000 UTC m=+68.878301689" watchObservedRunningTime="2026-07-06 14:24:01.960295703 +0000 UTC m=+68.880576133"
Jul 06 14:24:03.765022 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:03.764936    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:24:03.889473 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:03.889440    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:24:04.042344 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:04.042246    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:24:04.170156 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:04.170117    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:24:04.245041 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:04.245010    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:24:04.375305 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:04.375230    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:24:04.474296 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:04.474262    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:24:04.576176 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:04.576144    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:24:04.710899 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:04.710856    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:24:04.766841 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:04.766808    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:24:04.903211 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:04.903181    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:24:04.961622 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:04.961534    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:24:05.107515 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:05.107480    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:24:05.164547 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:05.164516    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:24:05.499573 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:05.499541    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:24:05.552778 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:05.552745    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:24:05.727024 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:05.726991    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:24:05.786160 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:05.786036    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c9139faa-b66e-43d4-9a07-bd16a63ff0f8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-5kn2v\" (UID: \"c9139faa-b66e-43d4-9a07-bd16a63ff0f8\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-5kn2v"
Jul 06 14:24:05.789532 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:05.789478    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c9139faa-b66e-43d4-9a07-bd16a63ff0f8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-5kn2v\" (UID: \"c9139faa-b66e-43d4-9a07-bd16a63ff0f8\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-5kn2v"
Jul 06 14:24:05.924375 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:05.924343    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:24:06.020876 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:06.020639    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-9jm6r\""
Jul 06 14:24:06.024368 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:06.023422    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:24:06.028945 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:06.028708    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-5kn2v"
Jul 06 14:24:06.814644 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:06.814615    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:24:06.878116 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:06.878079    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:24:06.937303 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:06.937267    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:24:09.772122 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:09.772055    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-5kn2v"]
Jul 06 14:24:09.776634 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:24:09.776612    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9139faa_b66e_43d4_9a07_bd16a63ff0f8.slice/crio-b7bb54422bbe2a121e81da51ac01aafc5e617886573dfffd95602ff93bd86e65 WatchSource:0}: Error finding container b7bb54422bbe2a121e81da51ac01aafc5e617886573dfffd95602ff93bd86e65: Status 404 returned error can't find the container with id b7bb54422bbe2a121e81da51ac01aafc5e617886573dfffd95602ff93bd86e65
Jul 06 14:24:09.968161 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:09.968130    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:24:09.981777 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:09.981742    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pfg9l" event={"ID":"105734b3-e5f3-4bf2-8f66-df587a4caec2","Type":"ContainerStarted","Data":"8cd05aecdfe222ab5bc0531bda34a60c4c2275255373ddda9d563aecf3b9e1e5"}
Jul 06 14:24:09.983218 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:09.983192    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2t99k" event={"ID":"0656cec5-7e50-4dfc-af2d-9a33adde49e3","Type":"ContainerStarted","Data":"27da0bffab48d7758301aea111a507bd0bd890d8f61a70a98253d0e7ee3ebe70"}
Jul 06 14:24:09.984618 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:09.984597    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-mbkvc" event={"ID":"201f4c6e-b9d8-4a99-9f4e-b8f59e69ad1d","Type":"ContainerStarted","Data":"f72ec7d68d988f3c7c13f3d688950a6b1b5c303170d1188c13b29d48f1544aa9"}
Jul 06 14:24:09.986286 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:09.986257    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mqgwp" event={"ID":"537a943a-73f7-4e98-b74c-dde1d0ff1c92","Type":"ContainerStarted","Data":"4e4e2b9d0962421431d9dced12a2e568f2c25cb5736fe18395a063d26ef6c115"}
Jul 06 14:24:09.987399 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:09.987372    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-5kn2v" event={"ID":"c9139faa-b66e-43d4-9a07-bd16a63ff0f8","Type":"ContainerStarted","Data":"b7bb54422bbe2a121e81da51ac01aafc5e617886573dfffd95602ff93bd86e65"}
Jul 06 14:24:09.988868 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:09.988837    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-gx87x" event={"ID":"b81991eb-ee77-4c04-b880-a34d9419ca14","Type":"ContainerStarted","Data":"918526daad5bcfe7e0ee85488084e9711e6f8755bb4b84d688169b41f75408cc"}
Jul 06 14:24:09.988967 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:09.988945    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-gx87x"
Jul 06 14:24:10.002619 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:10.002570    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-pfg9l" podStartSLOduration=16.96639421 podStartE2EDuration="30.002555904s" totalImagesPullingTime="13.036161694s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 14:23:40 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:24:10.001904986 +0000 UTC m=+76.922185417" watchObservedRunningTime="2026-07-06 14:24:10.002555904 +0000 UTC m=+76.922836333"
Jul 06 14:24:10.017035 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:10.016982    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-gx87x" podStartSLOduration=67.842809642 podStartE2EDuration="1m17.016969948s" totalImagesPullingTime="9.174160306s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:22:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:24:10.016348874 +0000 UTC m=+76.936629306" watchObservedRunningTime="2026-07-06 14:24:10.016969948 +0000 UTC m=+76.937250376"
Jul 06 14:24:10.031333 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:10.031292    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-mbkvc" podStartSLOduration=67.644563587 podStartE2EDuration="1m17.031278157s" totalImagesPullingTime="9.38671457s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 14:22:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:24:10.030693638 +0000 UTC m=+76.950974067" watchObservedRunningTime="2026-07-06 14:24:10.031278157 +0000 UTC m=+76.951558586"
Jul 06 14:24:10.036831 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:10.036810    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:24:10.996279 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:10.996242    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2t99k" event={"ID":"0656cec5-7e50-4dfc-af2d-9a33adde49e3","Type":"ContainerStarted","Data":"b8ac4a2599b76c12ae31923b9f132e7d9b6d6579cf8d2da8d2e7aae27d25963b"}
Jul 06 14:24:10.996717 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:10.996346    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-2t99k"
Jul 06 14:24:10.998397 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:10.998336    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mqgwp" event={"ID":"537a943a-73f7-4e98-b74c-dde1d0ff1c92","Type":"ContainerStarted","Data":"752df819fce11ea0ca3cd228d94b5be4883e95fdcb12fbc28693d985a22f926d"}
Jul 06 14:24:11.000631 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:11.000603    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5459d6b8cb-v8ghl" event={"ID":"edd8288b-e268-45ac-be98-17524d200d25","Type":"ContainerStarted","Data":"0b33e0663c0ea2c181d216c2fb61093938ae467c7f3ce1b0cb37288869bda7cf"}
Jul 06 14:24:11.000757 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:11.000641    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5459d6b8cb-v8ghl" event={"ID":"edd8288b-e268-45ac-be98-17524d200d25","Type":"ContainerStarted","Data":"414aca9042ea3f10c4067c0125ef09fda52c39acec05d3ed7a802b018a6611fc"}
Jul 06 14:24:11.000757 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:11.000679    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5459d6b8cb-v8ghl" event={"ID":"edd8288b-e268-45ac-be98-17524d200d25","Type":"ContainerStarted","Data":"0dffac76164515fde98a35817f0c0603d5dacbfe1fae27b007870bace6d4e8ea"}
Jul 06 14:24:11.015885 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:11.015837    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-2t99k" podStartSLOduration=34.10601837 podStartE2EDuration="43.015818391s" totalImagesPullingTime="8.909800021s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:23:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:24:11.014382573 +0000 UTC m=+77.934663002" watchObservedRunningTime="2026-07-06 14:24:11.015818391 +0000 UTC m=+77.936098823"
Jul 06 14:24:11.034612 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:11.034564    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5459d6b8cb-v8ghl" podStartSLOduration=1.587690625 podStartE2EDuration="10.034548373s" totalImagesPullingTime="8.446857748s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:24:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:24:11.033785297 +0000 UTC m=+77.954065727" watchObservedRunningTime="2026-07-06 14:24:11.034548373 +0000 UTC m=+77.954828802"
Jul 06 14:24:11.052636 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:11.052573    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-mqgwp" podStartSLOduration=71.023683277 podStartE2EDuration="1m18.052554894s" totalImagesPullingTime="7.028871617s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:22:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:24:11.052037389 +0000 UTC m=+77.972317822" watchObservedRunningTime="2026-07-06 14:24:11.052554894 +0000 UTC m=+77.972835325"
Jul 06 14:24:11.144249 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:11.144205    2582 patch_prober.go:28] interesting pod/image-registry-788fcf5466-l2crl container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 06 14:24:11.144410 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:11.144260    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-788fcf5466-l2crl" podUID="c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 06 14:24:11.173093 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:11.173061    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:24:11.274095 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:11.274021    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:24:11.790619 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:11.790582    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:24:12.005478 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:12.005439    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-5kn2v" event={"ID":"c9139faa-b66e-43d4-9a07-bd16a63ff0f8","Type":"ContainerStarted","Data":"4003af5ab8a61c4cd27710fb09a32e3aab2df93a543c4940dc36b326f540be71"}
Jul 06 14:24:12.022852 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:12.022645    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-5kn2v" podStartSLOduration=36.904798992 podStartE2EDuration="39.022624921s" totalImagesPullingTime="2.117825929s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:23:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:24:12.020845672 +0000 UTC m=+78.941126102" watchObservedRunningTime="2026-07-06 14:24:12.022624921 +0000 UTC m=+78.942905354"
Jul 06 14:24:12.194441 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:12.194403    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:24:12.283336 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:12.283306    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:24:12.450362 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:12.450269    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:24:12.740729 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:12.740623    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:24:15.687819 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:15.687706    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:24:15.821141 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:15.821103    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:24:16.433685 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:16.433623    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:24:16.513225 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:16.513192    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:24:16.698450 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:16.698364    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:24:17.313437 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:17.313409    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:24:17.527619 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:17.527588    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:24:17.627908 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:17.627814    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:24:18.778860 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:18.778829    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:24:19.538361 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:19.538334    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:24:20.436224 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:20.436192    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:24:20.538338 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:20.538312    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:24:21.008351 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:21.008325    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-2t99k"
Jul 06 14:24:21.143938 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:21.143899    2582 patch_prober.go:28] interesting pod/image-registry-788fcf5466-l2crl container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 06 14:24:21.144098 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:21.143968    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-788fcf5466-l2crl" podUID="c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 06 14:24:21.153701 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:21.153645    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:24:21.252003 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:21.251972    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:24:21.566777 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:21.566748    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:24:21.815239 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:21.815204    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:24:21.846083 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:21.846003    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-rnr84"]
Jul 06 14:24:21.850889 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:21.850868    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-rnr84"
Jul 06 14:24:21.854196 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:21.854175    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 06 14:24:21.854645 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:21.854511    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-k77mc\""
Jul 06 14:24:21.854645 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:21.854540    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 06 14:24:21.855336 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:21.855316    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 06 14:24:21.855458 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:21.855324    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 06 14:24:21.900844 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:21.900810    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:24:21.916291 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:21.916259    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3ab8d9b2-b7ce-49c8-9ab9-f8bf02453276-metrics-client-ca\") pod \"node-exporter-rnr84\" (UID: \"3ab8d9b2-b7ce-49c8-9ab9-f8bf02453276\") " pod="openshift-monitoring/node-exporter-rnr84"
Jul 06 14:24:21.916453 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:21.916302    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3ab8d9b2-b7ce-49c8-9ab9-f8bf02453276-node-exporter-wtmp\") pod \"node-exporter-rnr84\" (UID: \"3ab8d9b2-b7ce-49c8-9ab9-f8bf02453276\") " pod="openshift-monitoring/node-exporter-rnr84"
Jul 06 14:24:21.916453 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:21.916344    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3ab8d9b2-b7ce-49c8-9ab9-f8bf02453276-sys\") pod \"node-exporter-rnr84\" (UID: \"3ab8d9b2-b7ce-49c8-9ab9-f8bf02453276\") " pod="openshift-monitoring/node-exporter-rnr84"
Jul 06 14:24:21.916453 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:21.916383    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5xdn2\" (UniqueName: \"kubernetes.io/projected/3ab8d9b2-b7ce-49c8-9ab9-f8bf02453276-kube-api-access-5xdn2\") pod \"node-exporter-rnr84\" (UID: \"3ab8d9b2-b7ce-49c8-9ab9-f8bf02453276\") " pod="openshift-monitoring/node-exporter-rnr84"
Jul 06 14:24:21.916453 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:21.916407    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3ab8d9b2-b7ce-49c8-9ab9-f8bf02453276-node-exporter-tls\") pod \"node-exporter-rnr84\" (UID: \"3ab8d9b2-b7ce-49c8-9ab9-f8bf02453276\") " pod="openshift-monitoring/node-exporter-rnr84"
Jul 06 14:24:21.916453 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:21.916442    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3ab8d9b2-b7ce-49c8-9ab9-f8bf02453276-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rnr84\" (UID: \"3ab8d9b2-b7ce-49c8-9ab9-f8bf02453276\") " pod="openshift-monitoring/node-exporter-rnr84"
Jul 06 14:24:21.916719 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:21.916465    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3ab8d9b2-b7ce-49c8-9ab9-f8bf02453276-node-exporter-accelerators-collector-config\") pod \"node-exporter-rnr84\" (UID: \"3ab8d9b2-b7ce-49c8-9ab9-f8bf02453276\") " pod="openshift-monitoring/node-exporter-rnr84"
Jul 06 14:24:21.916719 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:21.916494    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3ab8d9b2-b7ce-49c8-9ab9-f8bf02453276-root\") pod \"node-exporter-rnr84\" (UID: \"3ab8d9b2-b7ce-49c8-9ab9-f8bf02453276\") " pod="openshift-monitoring/node-exporter-rnr84"
Jul 06 14:24:21.916719 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:21.916541    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3ab8d9b2-b7ce-49c8-9ab9-f8bf02453276-node-exporter-textfile\") pod \"node-exporter-rnr84\" (UID: \"3ab8d9b2-b7ce-49c8-9ab9-f8bf02453276\") " pod="openshift-monitoring/node-exporter-rnr84"
Jul 06 14:24:22.017001 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:22.016968    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3ab8d9b2-b7ce-49c8-9ab9-f8bf02453276-node-exporter-textfile\") pod \"node-exporter-rnr84\" (UID: \"3ab8d9b2-b7ce-49c8-9ab9-f8bf02453276\") " pod="openshift-monitoring/node-exporter-rnr84"
Jul 06 14:24:22.017241 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:22.017224    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3ab8d9b2-b7ce-49c8-9ab9-f8bf02453276-metrics-client-ca\") pod \"node-exporter-rnr84\" (UID: \"3ab8d9b2-b7ce-49c8-9ab9-f8bf02453276\") " pod="openshift-monitoring/node-exporter-rnr84"
Jul 06 14:24:22.017348 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:22.017336    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3ab8d9b2-b7ce-49c8-9ab9-f8bf02453276-node-exporter-wtmp\") pod \"node-exporter-rnr84\" (UID: \"3ab8d9b2-b7ce-49c8-9ab9-f8bf02453276\") " pod="openshift-monitoring/node-exporter-rnr84"
Jul 06 14:24:22.017451 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:22.017393    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3ab8d9b2-b7ce-49c8-9ab9-f8bf02453276-node-exporter-textfile\") pod \"node-exporter-rnr84\" (UID: \"3ab8d9b2-b7ce-49c8-9ab9-f8bf02453276\") " pod="openshift-monitoring/node-exporter-rnr84"
Jul 06 14:24:22.018048 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:22.017515    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3ab8d9b2-b7ce-49c8-9ab9-f8bf02453276-sys\") pod \"node-exporter-rnr84\" (UID: \"3ab8d9b2-b7ce-49c8-9ab9-f8bf02453276\") " pod="openshift-monitoring/node-exporter-rnr84"
Jul 06 14:24:22.018048 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:22.017478    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3ab8d9b2-b7ce-49c8-9ab9-f8bf02453276-node-exporter-wtmp\") pod \"node-exporter-rnr84\" (UID: \"3ab8d9b2-b7ce-49c8-9ab9-f8bf02453276\") " pod="openshift-monitoring/node-exporter-rnr84"
Jul 06 14:24:22.018048 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:22.017594    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xdn2\" (UniqueName: \"kubernetes.io/projected/3ab8d9b2-b7ce-49c8-9ab9-f8bf02453276-kube-api-access-5xdn2\") pod \"node-exporter-rnr84\" (UID: \"3ab8d9b2-b7ce-49c8-9ab9-f8bf02453276\") " pod="openshift-monitoring/node-exporter-rnr84"
Jul 06 14:24:22.018048 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:22.017628    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3ab8d9b2-b7ce-49c8-9ab9-f8bf02453276-node-exporter-tls\") pod \"node-exporter-rnr84\" (UID: \"3ab8d9b2-b7ce-49c8-9ab9-f8bf02453276\") " pod="openshift-monitoring/node-exporter-rnr84"
Jul 06 14:24:22.018048 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:22.017682    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3ab8d9b2-b7ce-49c8-9ab9-f8bf02453276-sys\") pod \"node-exporter-rnr84\" (UID: \"3ab8d9b2-b7ce-49c8-9ab9-f8bf02453276\") " pod="openshift-monitoring/node-exporter-rnr84"
Jul 06 14:24:22.018048 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:22.017687    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3ab8d9b2-b7ce-49c8-9ab9-f8bf02453276-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rnr84\" (UID: \"3ab8d9b2-b7ce-49c8-9ab9-f8bf02453276\") " pod="openshift-monitoring/node-exporter-rnr84"
Jul 06 14:24:22.018048 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:22.017727    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3ab8d9b2-b7ce-49c8-9ab9-f8bf02453276-node-exporter-accelerators-collector-config\") pod \"node-exporter-rnr84\" (UID: \"3ab8d9b2-b7ce-49c8-9ab9-f8bf02453276\") " pod="openshift-monitoring/node-exporter-rnr84"
Jul 06 14:24:22.018048 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:22.017760    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3ab8d9b2-b7ce-49c8-9ab9-f8bf02453276-root\") pod \"node-exporter-rnr84\" (UID: \"3ab8d9b2-b7ce-49c8-9ab9-f8bf02453276\") " pod="openshift-monitoring/node-exporter-rnr84"
Jul 06 14:24:22.018048 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:22.017830    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3ab8d9b2-b7ce-49c8-9ab9-f8bf02453276-root\") pod \"node-exporter-rnr84\" (UID: \"3ab8d9b2-b7ce-49c8-9ab9-f8bf02453276\") " pod="openshift-monitoring/node-exporter-rnr84"
Jul 06 14:24:22.018048 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:22.017940    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3ab8d9b2-b7ce-49c8-9ab9-f8bf02453276-metrics-client-ca\") pod \"node-exporter-rnr84\" (UID: \"3ab8d9b2-b7ce-49c8-9ab9-f8bf02453276\") " pod="openshift-monitoring/node-exporter-rnr84"
Jul 06 14:24:22.018588 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:24:22.018311    2582 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 06 14:24:22.018588 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:22.018343    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3ab8d9b2-b7ce-49c8-9ab9-f8bf02453276-node-exporter-accelerators-collector-config\") pod \"node-exporter-rnr84\" (UID: \"3ab8d9b2-b7ce-49c8-9ab9-f8bf02453276\") " pod="openshift-monitoring/node-exporter-rnr84"
Jul 06 14:24:22.018588 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:24:22.018369    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ab8d9b2-b7ce-49c8-9ab9-f8bf02453276-node-exporter-tls podName:3ab8d9b2-b7ce-49c8-9ab9-f8bf02453276 nodeName:}" failed. No retries permitted until 2026-07-06 14:24:22.518350257 +0000 UTC m=+89.438630667 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/3ab8d9b2-b7ce-49c8-9ab9-f8bf02453276-node-exporter-tls") pod "node-exporter-rnr84" (UID: "3ab8d9b2-b7ce-49c8-9ab9-f8bf02453276") : secret "node-exporter-tls" not found
Jul 06 14:24:22.020768 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:22.020726    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3ab8d9b2-b7ce-49c8-9ab9-f8bf02453276-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rnr84\" (UID: \"3ab8d9b2-b7ce-49c8-9ab9-f8bf02453276\") " pod="openshift-monitoring/node-exporter-rnr84"
Jul 06 14:24:22.028143 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:22.028122    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xdn2\" (UniqueName: \"kubernetes.io/projected/3ab8d9b2-b7ce-49c8-9ab9-f8bf02453276-kube-api-access-5xdn2\") pod \"node-exporter-rnr84\" (UID: \"3ab8d9b2-b7ce-49c8-9ab9-f8bf02453276\") " pod="openshift-monitoring/node-exporter-rnr84"
Jul 06 14:24:22.080986 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:22.080956    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:24:22.186001 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:22.185963    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:24:22.280911 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:22.280876    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:24:22.378380 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:22.378343    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:24:22.521905 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:22.521826    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3ab8d9b2-b7ce-49c8-9ab9-f8bf02453276-node-exporter-tls\") pod \"node-exporter-rnr84\" (UID: \"3ab8d9b2-b7ce-49c8-9ab9-f8bf02453276\") " pod="openshift-monitoring/node-exporter-rnr84"
Jul 06 14:24:22.524175 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:22.524152    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3ab8d9b2-b7ce-49c8-9ab9-f8bf02453276-node-exporter-tls\") pod \"node-exporter-rnr84\" (UID: \"3ab8d9b2-b7ce-49c8-9ab9-f8bf02453276\") " pod="openshift-monitoring/node-exporter-rnr84"
Jul 06 14:24:22.630031 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:22.630002    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:24:22.719528 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:22.719498    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:24:22.762843 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:22.762811    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-rnr84"
Jul 06 14:24:22.819879 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:22.819853    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:24:22.909480 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:22.909452    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:24:23.031294 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:23.031203    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:24:23.045267 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:23.045237    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rnr84" event={"ID":"3ab8d9b2-b7ce-49c8-9ab9-f8bf02453276","Type":"ContainerStarted","Data":"fac19a87dd94dfaf12599f21ecb977905fc9775ccb82067e19e69d6f9aceae03"}
Jul 06 14:24:23.960824 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:23.960793    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6556f6b698-2qxrh"
Jul 06 14:24:24.050126 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:24.050095    2582 generic.go:356] "Generic (PLEG): container finished" podID="3ab8d9b2-b7ce-49c8-9ab9-f8bf02453276" containerID="942be820dffc23a661ca0db024d04969ec029f825d58a458790d677951544f69" exitCode=0
Jul 06 14:24:24.050304 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:24.050178    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rnr84" event={"ID":"3ab8d9b2-b7ce-49c8-9ab9-f8bf02453276","Type":"ContainerDied","Data":"942be820dffc23a661ca0db024d04969ec029f825d58a458790d677951544f69"}
Jul 06 14:24:24.095235 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:24.095197    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:24:24.851049 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:24.851014    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:24:24.946662 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:24.946636    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:24:25.005668 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:25.005622    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:24:25.056021 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:25.055991    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rnr84" event={"ID":"3ab8d9b2-b7ce-49c8-9ab9-f8bf02453276","Type":"ContainerStarted","Data":"7b41be697d2511567bd2d5dc2ddc26bf7733a09f6bbbded2918573b23ae85a27"}
Jul 06 14:24:25.056185 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:25.056043    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rnr84" event={"ID":"3ab8d9b2-b7ce-49c8-9ab9-f8bf02453276","Type":"ContainerStarted","Data":"ac8faaeb91a5fe4931622eecbbe19bd6542df69f2db4b680ef41f7c41e1159e1"}
Jul 06 14:24:25.071215 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:25.071182    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:24:25.079140 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:25.079098    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-rnr84" podStartSLOduration=2.928428585 podStartE2EDuration="4.079083874s" totalImagesPullingTime="1.085648438s" totalInitContainerRuntime="65.006851ms" isStatefulPod=true podCreationTimestamp="2026-07-06 14:24:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:24:25.077963975 +0000 UTC m=+91.998244403" watchObservedRunningTime="2026-07-06 14:24:25.079083874 +0000 UTC m=+91.999364302"
Jul 06 14:24:26.172324 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:26.172289    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-788fcf5466-l2crl" podUID="c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3" containerName="registry" containerID="cri-o://a8a201cbdc6e072741a65780070205d0adfe51e617c53f67fe00b73b2885a9ca" gracePeriod=30
Jul 06 14:24:26.414613 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:26.414589    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-788fcf5466-l2crl"
Jul 06 14:24:26.453664 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:26.453568    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3-trusted-ca\") pod \"c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3\" (UID: \"c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3\") "
Jul 06 14:24:26.453664 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:26.453620    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3-registry-certificates\") pod \"c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3\" (UID: \"c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3\") "
Jul 06 14:24:26.453664 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:26.453643    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3-bound-sa-token\") pod \"c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3\" (UID: \"c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3\") "
Jul 06 14:24:26.453918 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:26.453685    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3-registry-tls\") pod \"c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3\" (UID: \"c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3\") "
Jul 06 14:24:26.453918 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:26.453746    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3-ca-trust-extracted\") pod \"c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3\" (UID: \"c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3\") "
Jul 06 14:24:26.453918 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:26.453791    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3-image-registry-private-configuration\") pod \"c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3\" (UID: \"c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3\") "
Jul 06 14:24:26.453918 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:26.453817    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6chdg\" (UniqueName: \"kubernetes.io/projected/c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3-kube-api-access-6chdg\") pod \"c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3\" (UID: \"c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3\") "
Jul 06 14:24:26.453918 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:26.453873    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3-installation-pull-secrets\") pod \"c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3\" (UID: \"c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3\") "
Jul 06 14:24:26.454138 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:26.454036    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3" (UID: "c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:24:26.454195 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:26.454127    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3" (UID: "c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:24:26.456617 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:26.456590    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3" (UID: "c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:24:26.457034 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:26.457000    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3" (UID: "c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:24:26.457148 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:26.457110    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3" (UID: "c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:24:26.457211 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:26.457146    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3" (UID: "c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:24:26.457211 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:26.457191    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3-kube-api-access-6chdg" (OuterVolumeSpecName: "kube-api-access-6chdg") pod "c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3" (UID: "c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3"). InnerVolumeSpecName "kube-api-access-6chdg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:24:26.462760 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:26.462731    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3" (UID: "c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:24:26.473294 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:26.473272    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:24:26.555134 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:26.555099    2582 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3-installation-pull-secrets\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Jul 06 14:24:26.555134 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:26.555131    2582 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3-trusted-ca\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Jul 06 14:24:26.555134 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:26.555141    2582 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3-registry-certificates\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Jul 06 14:24:26.555415 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:26.555151    2582 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3-bound-sa-token\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Jul 06 14:24:26.555415 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:26.555164    2582 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3-registry-tls\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Jul 06 14:24:26.555415 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:26.555172    2582 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3-ca-trust-extracted\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Jul 06 14:24:26.555415 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:26.555182    2582 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3-image-registry-private-configuration\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Jul 06 14:24:26.555415 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:26.555190    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6chdg\" (UniqueName: \"kubernetes.io/projected/c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3-kube-api-access-6chdg\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Jul 06 14:24:26.574931 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:26.574897    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:24:26.649266 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:26.649233    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:24:26.915997 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:26.915966    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:24:27.065894 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:27.065862    2582 generic.go:356] "Generic (PLEG): container finished" podID="c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3" containerID="a8a201cbdc6e072741a65780070205d0adfe51e617c53f67fe00b73b2885a9ca" exitCode=0
Jul 06 14:24:27.066032 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:27.065909    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-788fcf5466-l2crl"
Jul 06 14:24:27.066032 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:27.065930    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-788fcf5466-l2crl" event={"ID":"c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3","Type":"ContainerDied","Data":"a8a201cbdc6e072741a65780070205d0adfe51e617c53f67fe00b73b2885a9ca"}
Jul 06 14:24:27.066032 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:27.065979    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-788fcf5466-l2crl" event={"ID":"c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3","Type":"ContainerDied","Data":"d1edf21668cc754051d98554dea95e039212e1eb29f2e173d56bba5ae6a32e26"}
Jul 06 14:24:27.066032 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:27.066007    2582 scope.go:117] "RemoveContainer" containerID="a8a201cbdc6e072741a65780070205d0adfe51e617c53f67fe00b73b2885a9ca"
Jul 06 14:24:27.074211 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:27.074195    2582 scope.go:117] "RemoveContainer" containerID="a8a201cbdc6e072741a65780070205d0adfe51e617c53f67fe00b73b2885a9ca"
Jul 06 14:24:27.074443 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:24:27.074422    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a8a201cbdc6e072741a65780070205d0adfe51e617c53f67fe00b73b2885a9ca\": container with ID starting with a8a201cbdc6e072741a65780070205d0adfe51e617c53f67fe00b73b2885a9ca not found: ID does not exist" containerID="a8a201cbdc6e072741a65780070205d0adfe51e617c53f67fe00b73b2885a9ca"
Jul 06 14:24:27.074551 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:27.074456    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8a201cbdc6e072741a65780070205d0adfe51e617c53f67fe00b73b2885a9ca"} err="failed to get container status \"a8a201cbdc6e072741a65780070205d0adfe51e617c53f67fe00b73b2885a9ca\": rpc error: code = NotFound desc = could not find container \"a8a201cbdc6e072741a65780070205d0adfe51e617c53f67fe00b73b2885a9ca\": container with ID starting with a8a201cbdc6e072741a65780070205d0adfe51e617c53f67fe00b73b2885a9ca not found: ID does not exist"
Jul 06 14:24:27.086580 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:27.086552    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-788fcf5466-l2crl"]
Jul 06 14:24:27.092508 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:27.092488    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-788fcf5466-l2crl"]
Jul 06 14:24:27.498157 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:27.498118    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3" path="/var/lib/kubelet/pods/c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3/volumes"
Jul 06 14:24:28.102942 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:28.102912    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:24:28.948980 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:28.948949    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:24:29.000157 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:29.000124    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:24:30.144448 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:30.144423    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:24:30.203490 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:30.203464    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:24:30.354052 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:30.354026    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:24:33.763244 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:33.763194    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:24:33.823891 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:33.823859    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:24:38.631830 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:38.631794    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:24:38.690280 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:38.690246    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:24:38.749738 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:38.749709    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:24:39.402778 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:39.402735    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:24:39.502171 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:39.502142    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:24:39.997389 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:39.997358    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:24:40.096328 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:40.096298    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:24:40.199765 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:40.199732    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:24:41.004013 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:41.003980    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-gx87x"
Jul 06 14:24:44.128552 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:44.128516    2582 generic.go:356] "Generic (PLEG): container finished" podID="edffcb34-9976-419f-9a09-fe5a1cd6b2ec" containerID="c91957f90474d17ce418d77dd6a5802df820d1b81fd08aaf902f09c54ad9e827" exitCode=0
Jul 06 14:24:44.128934 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:44.128561    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-mhhcl" event={"ID":"edffcb34-9976-419f-9a09-fe5a1cd6b2ec","Type":"ContainerDied","Data":"c91957f90474d17ce418d77dd6a5802df820d1b81fd08aaf902f09c54ad9e827"}
Jul 06 14:24:44.128934 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:44.128880    2582 scope.go:117] "RemoveContainer" containerID="c91957f90474d17ce418d77dd6a5802df820d1b81fd08aaf902f09c54ad9e827"
Jul 06 14:24:45.133684 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:45.133632    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-mhhcl" event={"ID":"edffcb34-9976-419f-9a09-fe5a1cd6b2ec","Type":"ContainerStarted","Data":"ddf78773cc0945cfdae7f7c5898c03c01c77917253b629e2cf064422ed575fef"}
Jul 06 14:24:48.761080 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:48.761042    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:24:48.859523 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:48.859475    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:24:50.133141 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:24:50.133089    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:25:09.213673 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:25:09.213621    2582 generic.go:356] "Generic (PLEG): container finished" podID="d620f679-c4f6-4131-aebf-36b50b4433a9" containerID="07ab961048ca3a76c3b6400ab1b11e32b06900a560ae51c0f1ecd304d8c9ae22" exitCode=0
Jul 06 14:25:09.214112 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:25:09.213694    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-xqwr8" event={"ID":"d620f679-c4f6-4131-aebf-36b50b4433a9","Type":"ContainerDied","Data":"07ab961048ca3a76c3b6400ab1b11e32b06900a560ae51c0f1ecd304d8c9ae22"}
Jul 06 14:25:09.214112 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:25:09.214073    2582 scope.go:117] "RemoveContainer" containerID="07ab961048ca3a76c3b6400ab1b11e32b06900a560ae51c0f1ecd304d8c9ae22"
Jul 06 14:25:10.218755 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:25:10.218723    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-xqwr8" event={"ID":"d620f679-c4f6-4131-aebf-36b50b4433a9","Type":"ContainerStarted","Data":"13c3a7dd571e73d768130826aed17bb765a9339e6cc40b18979033314c1a3f85"}
Jul 06 14:25:41.078417 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:25:41.078353    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:25:41.378179 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:25:41.378083    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:25:50.579258 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:25:50.579185    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:25:50.632000 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:25:50.631971    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:26:01.997935 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:26:01.997897    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:26:02.097664 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:26:02.097631    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:26:02.156704 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:26:02.156678    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:26:07.408493 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:26:07.408461    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:26:41.472099 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:26:41.472059    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:26:56.328967 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:26:56.328937    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:26:56.390414 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:26:56.390378    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:27:03.328041 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:27:03.328007    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:27:03.440781 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:27:03.440742    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:27:03.495991 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:27:03.495954    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:27:04.076783 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:27:04.076751    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:27:08.434421 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:27:08.434390    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:27:08.535461 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:27:08.535429    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:27:14.283507 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:27:14.283473    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:27:14.381162 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:27:14.381129    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:27:14.548917 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:27:14.548839    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:27:18.768237 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:27:18.768143    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:27:18.981035 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:27:18.981000    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:27:31.698013 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:27:31.697980    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:27:45.461404 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:27:45.461372    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:27:45.559816 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:27:45.559787    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:27:50.856293 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:27:50.856252    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:27:53.393270 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:27:53.393247    2582 kubelet.go:1648] "Image garbage collection succeeded"
Jul 06 14:28:12.501119 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:28:12.501084    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:28:13.892744 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:28:13.892711    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:28:16.111245 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:28:16.111189    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:28:16.212011 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:28:16.211982    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:28:17.573729 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:28:17.573688    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:28:17.678302 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:28:17.678262    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:28:18.356147 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:28:18.356103    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:28:18.459955 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:28:18.459923    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:28:20.520872 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:28:20.520846    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:28:20.902182 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:28:20.902106    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:28:23.101144 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:28:23.101110    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:28:23.201415 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:28:23.201382    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:28:25.515081 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:28:25.515051    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:28:25.572350 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:28:25.572322    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:28:28.744752 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:28:28.744719    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:28:30.829795 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:28:30.829757    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:28:30.927614 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:28:30.927583    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:28:37.256833 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:28:37.256803    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:28:37.350016 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:28:37.349989    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:28:39.516668 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:28:39.516632    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:28:51.152375 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:28:51.152294    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:28:51.247797 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:28:51.247764    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:28:51.797458 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:28:51.797429    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:28:52.033000 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:28:52.032968    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:28:52.141996 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:28:52.141923    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:28:52.165641 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:28:52.165605    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-557ddcc9b5-n6rcd"]
Jul 06 14:28:52.165992 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:28:52.165869    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3" containerName="registry"
Jul 06 14:28:52.165992 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:28:52.165880    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3" containerName="registry"
Jul 06 14:28:52.165992 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:28:52.165923    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="c0502bfb-26bd-453e-ad2b-fb78a9ce6dc3" containerName="registry"
Jul 06 14:28:52.168784 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:28:52.168768    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-557ddcc9b5-n6rcd"
Jul 06 14:28:52.176859 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:28:52.176832    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 06 14:28:52.176976 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:28:52.176845    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 06 14:28:52.176976 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:28:52.176880    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 06 14:28:52.177097 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:28:52.177007    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-l564n\""
Jul 06 14:28:52.177097 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:28:52.177054    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 06 14:28:52.188467 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:28:52.188446    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-557ddcc9b5-n6rcd"]
Jul 06 14:28:52.302394 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:28:52.302361    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4d365742-5bd2-4dd7-84da-209a1bee7142-manifests\") pod \"opendatahub-operator-controller-manager-557ddcc9b5-n6rcd\" (UID: \"4d365742-5bd2-4dd7-84da-209a1bee7142\") " pod="opendatahub/opendatahub-operator-controller-manager-557ddcc9b5-n6rcd"
Jul 06 14:28:52.302394 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:28:52.302392    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4d365742-5bd2-4dd7-84da-209a1bee7142-tmp\") pod \"opendatahub-operator-controller-manager-557ddcc9b5-n6rcd\" (UID: \"4d365742-5bd2-4dd7-84da-209a1bee7142\") " pod="opendatahub/opendatahub-operator-controller-manager-557ddcc9b5-n6rcd"
Jul 06 14:28:52.302612 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:28:52.302430    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4d365742-5bd2-4dd7-84da-209a1bee7142-apiservice-cert\") pod \"opendatahub-operator-controller-manager-557ddcc9b5-n6rcd\" (UID: \"4d365742-5bd2-4dd7-84da-209a1bee7142\") " pod="opendatahub/opendatahub-operator-controller-manager-557ddcc9b5-n6rcd"
Jul 06 14:28:52.302612 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:28:52.302448    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4d365742-5bd2-4dd7-84da-209a1bee7142-webhook-cert\") pod \"opendatahub-operator-controller-manager-557ddcc9b5-n6rcd\" (UID: \"4d365742-5bd2-4dd7-84da-209a1bee7142\") " pod="opendatahub/opendatahub-operator-controller-manager-557ddcc9b5-n6rcd"
Jul 06 14:28:52.302612 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:28:52.302527    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwwg7\" (UniqueName: \"kubernetes.io/projected/4d365742-5bd2-4dd7-84da-209a1bee7142-kube-api-access-gwwg7\") pod \"opendatahub-operator-controller-manager-557ddcc9b5-n6rcd\" (UID: \"4d365742-5bd2-4dd7-84da-209a1bee7142\") " pod="opendatahub/opendatahub-operator-controller-manager-557ddcc9b5-n6rcd"
Jul 06 14:28:52.327676 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:28:52.327625    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:28:52.403563 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:28:52.403483    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4d365742-5bd2-4dd7-84da-209a1bee7142-apiservice-cert\") pod \"opendatahub-operator-controller-manager-557ddcc9b5-n6rcd\" (UID: \"4d365742-5bd2-4dd7-84da-209a1bee7142\") " pod="opendatahub/opendatahub-operator-controller-manager-557ddcc9b5-n6rcd"
Jul 06 14:28:52.403563 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:28:52.403519    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4d365742-5bd2-4dd7-84da-209a1bee7142-webhook-cert\") pod \"opendatahub-operator-controller-manager-557ddcc9b5-n6rcd\" (UID: \"4d365742-5bd2-4dd7-84da-209a1bee7142\") " pod="opendatahub/opendatahub-operator-controller-manager-557ddcc9b5-n6rcd"
Jul 06 14:28:52.403563 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:28:52.403549    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwwg7\" (UniqueName: \"kubernetes.io/projected/4d365742-5bd2-4dd7-84da-209a1bee7142-kube-api-access-gwwg7\") pod \"opendatahub-operator-controller-manager-557ddcc9b5-n6rcd\" (UID: \"4d365742-5bd2-4dd7-84da-209a1bee7142\") " pod="opendatahub/opendatahub-operator-controller-manager-557ddcc9b5-n6rcd"
Jul 06 14:28:52.403822 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:28:52.403595    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4d365742-5bd2-4dd7-84da-209a1bee7142-manifests\") pod \"opendatahub-operator-controller-manager-557ddcc9b5-n6rcd\" (UID: \"4d365742-5bd2-4dd7-84da-209a1bee7142\") " pod="opendatahub/opendatahub-operator-controller-manager-557ddcc9b5-n6rcd"
Jul 06 14:28:52.403822 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:28:52.403613    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4d365742-5bd2-4dd7-84da-209a1bee7142-tmp\") pod \"opendatahub-operator-controller-manager-557ddcc9b5-n6rcd\" (UID: \"4d365742-5bd2-4dd7-84da-209a1bee7142\") " pod="opendatahub/opendatahub-operator-controller-manager-557ddcc9b5-n6rcd"
Jul 06 14:28:52.404116 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:28:52.404093    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4d365742-5bd2-4dd7-84da-209a1bee7142-manifests\") pod \"opendatahub-operator-controller-manager-557ddcc9b5-n6rcd\" (UID: \"4d365742-5bd2-4dd7-84da-209a1bee7142\") " pod="opendatahub/opendatahub-operator-controller-manager-557ddcc9b5-n6rcd"
Jul 06 14:28:52.405932 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:28:52.405907    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4d365742-5bd2-4dd7-84da-209a1bee7142-tmp\") pod \"opendatahub-operator-controller-manager-557ddcc9b5-n6rcd\" (UID: \"4d365742-5bd2-4dd7-84da-209a1bee7142\") " pod="opendatahub/opendatahub-operator-controller-manager-557ddcc9b5-n6rcd"
Jul 06 14:28:52.406065 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:28:52.406049    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4d365742-5bd2-4dd7-84da-209a1bee7142-apiservice-cert\") pod \"opendatahub-operator-controller-manager-557ddcc9b5-n6rcd\" (UID: \"4d365742-5bd2-4dd7-84da-209a1bee7142\") " pod="opendatahub/opendatahub-operator-controller-manager-557ddcc9b5-n6rcd"
Jul 06 14:28:52.406137 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:28:52.406110    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4d365742-5bd2-4dd7-84da-209a1bee7142-webhook-cert\") pod \"opendatahub-operator-controller-manager-557ddcc9b5-n6rcd\" (UID: \"4d365742-5bd2-4dd7-84da-209a1bee7142\") " pod="opendatahub/opendatahub-operator-controller-manager-557ddcc9b5-n6rcd"
Jul 06 14:28:52.415704 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:28:52.415648    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwwg7\" (UniqueName: \"kubernetes.io/projected/4d365742-5bd2-4dd7-84da-209a1bee7142-kube-api-access-gwwg7\") pod \"opendatahub-operator-controller-manager-557ddcc9b5-n6rcd\" (UID: \"4d365742-5bd2-4dd7-84da-209a1bee7142\") " pod="opendatahub/opendatahub-operator-controller-manager-557ddcc9b5-n6rcd"
Jul 06 14:28:52.478434 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:28:52.478400    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-557ddcc9b5-n6rcd"
Jul 06 14:28:52.479046 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:28:52.479019    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:28:52.582614 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:28:52.582578    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:28:52.622384 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:28:52.622331    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-557ddcc9b5-n6rcd"]
Jul 06 14:28:52.625318 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:28:52.625278    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d365742_5bd2_4dd7_84da_209a1bee7142.slice/crio-e855c331564c4048b469091a36fbdc9f326b89f307202fede936aadd376b2e3d WatchSource:0}: Error finding container e855c331564c4048b469091a36fbdc9f326b89f307202fede936aadd376b2e3d: Status 404 returned error can't find the container with id e855c331564c4048b469091a36fbdc9f326b89f307202fede936aadd376b2e3d
Jul 06 14:28:52.627035 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:28:52.627019    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 14:28:52.689687 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:28:52.689647    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:28:52.794211 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:28:52.794180    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:28:52.983156 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:28:52.983076    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-557ddcc9b5-n6rcd" event={"ID":"4d365742-5bd2-4dd7-84da-209a1bee7142","Type":"ContainerStarted","Data":"e855c331564c4048b469091a36fbdc9f326b89f307202fede936aadd376b2e3d"}
Jul 06 14:28:55.996936 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:28:55.996900    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-557ddcc9b5-n6rcd" event={"ID":"4d365742-5bd2-4dd7-84da-209a1bee7142","Type":"ContainerStarted","Data":"f7c52b951c9ab522020d8038d31abe67236570cd33e76b65888018057adb5c44"}
Jul 06 14:28:57.001701 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:28:57.001597    2582 generic.go:356] "Generic (PLEG): container finished" podID="4d365742-5bd2-4dd7-84da-209a1bee7142" containerID="f7c52b951c9ab522020d8038d31abe67236570cd33e76b65888018057adb5c44" exitCode=0
Jul 06 14:28:57.001701 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:28:57.001687    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-557ddcc9b5-n6rcd" event={"ID":"4d365742-5bd2-4dd7-84da-209a1bee7142","Type":"ContainerDied","Data":"f7c52b951c9ab522020d8038d31abe67236570cd33e76b65888018057adb5c44"}
Jul 06 14:28:58.007302 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:28:58.007266    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-557ddcc9b5-n6rcd" event={"ID":"4d365742-5bd2-4dd7-84da-209a1bee7142","Type":"ContainerStarted","Data":"bce2f73ba0b3d11ee19c20e58e13af9407b09706bc08bc81ed6c2db6ebe2e8fc"}
Jul 06 14:28:58.007734 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:28:58.007385    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-557ddcc9b5-n6rcd"
Jul 06 14:28:58.036484 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:28:58.036425    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-557ddcc9b5-n6rcd" podStartSLOduration=1.489869704 podStartE2EDuration="6.036405737s" totalImagesPullingTime="3.443693102s" totalInitContainerRuntime="1.102842931s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:28:52 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:28:58.034069281 +0000 UTC m=+364.954349711" watchObservedRunningTime="2026-07-06 14:28:58.036405737 +0000 UTC m=+364.956686165"
Jul 06 14:29:05.155496 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:29:05.155460    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:29:05.256154 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:29:05.256123    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:29:05.573427 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:29:05.573392    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:29:05.673908 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:29:05.673879    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:29:07.024268 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:29:07.024225    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:29:07.135884 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:29:07.135850    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:29:09.012452 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:29:09.012424    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-557ddcc9b5-n6rcd"
Jul 06 14:29:11.144818 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:29:11.144783    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:29:11.280915 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:29:11.280883    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:29:11.846549 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:29:11.846513    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:29:11.930241 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:29:11.930206    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:29:12.025268 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:29:12.025228    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:29:12.509717 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:29:12.509688    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:29:12.613426 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:29:12.613393    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:29:13.240733 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:29:13.240647    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:29:14.409148 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:29:14.409112    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:29:14.467048 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:29:14.467007    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7b5f845fbc-4cq42"]
Jul 06 14:29:14.478117 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:29:14.478083    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7b5f845fbc-4cq42"
Jul 06 14:29:14.480440 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:29:14.480408    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-knrgv\""
Jul 06 14:29:14.480597 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:29:14.480462    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7b5f845fbc-4cq42"]
Jul 06 14:29:14.480710 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:29:14.480692    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 06 14:29:14.480783 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:29:14.480698    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 06 14:29:14.573145 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:29:14.573103    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrjzw\" (UniqueName: \"kubernetes.io/projected/4683bcda-8e38-4d5a-a8d5-283e7f0985f1-kube-api-access-wrjzw\") pod \"kube-auth-proxy-7b5f845fbc-4cq42\" (UID: \"4683bcda-8e38-4d5a-a8d5-283e7f0985f1\") " pod="openshift-ingress/kube-auth-proxy-7b5f845fbc-4cq42"
Jul 06 14:29:14.573414 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:29:14.573390    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4683bcda-8e38-4d5a-a8d5-283e7f0985f1-tmp\") pod \"kube-auth-proxy-7b5f845fbc-4cq42\" (UID: \"4683bcda-8e38-4d5a-a8d5-283e7f0985f1\") " pod="openshift-ingress/kube-auth-proxy-7b5f845fbc-4cq42"
Jul 06 14:29:14.573537 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:29:14.573431    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4683bcda-8e38-4d5a-a8d5-283e7f0985f1-tls-certs\") pod \"kube-auth-proxy-7b5f845fbc-4cq42\" (UID: \"4683bcda-8e38-4d5a-a8d5-283e7f0985f1\") " pod="openshift-ingress/kube-auth-proxy-7b5f845fbc-4cq42"
Jul 06 14:29:14.673938 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:29:14.673853    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:29:14.674081 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:29:14.674019    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrjzw\" (UniqueName: \"kubernetes.io/projected/4683bcda-8e38-4d5a-a8d5-283e7f0985f1-kube-api-access-wrjzw\") pod \"kube-auth-proxy-7b5f845fbc-4cq42\" (UID: \"4683bcda-8e38-4d5a-a8d5-283e7f0985f1\") " pod="openshift-ingress/kube-auth-proxy-7b5f845fbc-4cq42"
Jul 06 14:29:14.674081 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:29:14.674053    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4683bcda-8e38-4d5a-a8d5-283e7f0985f1-tmp\") pod \"kube-auth-proxy-7b5f845fbc-4cq42\" (UID: \"4683bcda-8e38-4d5a-a8d5-283e7f0985f1\") " pod="openshift-ingress/kube-auth-proxy-7b5f845fbc-4cq42"
Jul 06 14:29:14.674081 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:29:14.674073    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4683bcda-8e38-4d5a-a8d5-283e7f0985f1-tls-certs\") pod \"kube-auth-proxy-7b5f845fbc-4cq42\" (UID: \"4683bcda-8e38-4d5a-a8d5-283e7f0985f1\") " pod="openshift-ingress/kube-auth-proxy-7b5f845fbc-4cq42"
Jul 06 14:29:14.676458 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:29:14.676428    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4683bcda-8e38-4d5a-a8d5-283e7f0985f1-tmp\") pod \"kube-auth-proxy-7b5f845fbc-4cq42\" (UID: \"4683bcda-8e38-4d5a-a8d5-283e7f0985f1\") " pod="openshift-ingress/kube-auth-proxy-7b5f845fbc-4cq42"
Jul 06 14:29:14.676703 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:29:14.676683    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4683bcda-8e38-4d5a-a8d5-283e7f0985f1-tls-certs\") pod \"kube-auth-proxy-7b5f845fbc-4cq42\" (UID: \"4683bcda-8e38-4d5a-a8d5-283e7f0985f1\") " pod="openshift-ingress/kube-auth-proxy-7b5f845fbc-4cq42"
Jul 06 14:29:14.696268 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:29:14.696226    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrjzw\" (UniqueName: \"kubernetes.io/projected/4683bcda-8e38-4d5a-a8d5-283e7f0985f1-kube-api-access-wrjzw\") pod \"kube-auth-proxy-7b5f845fbc-4cq42\" (UID: \"4683bcda-8e38-4d5a-a8d5-283e7f0985f1\") " pod="openshift-ingress/kube-auth-proxy-7b5f845fbc-4cq42"
Jul 06 14:29:14.789761 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:29:14.789723    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7b5f845fbc-4cq42"
Jul 06 14:29:14.931299 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:29:14.931274    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7b5f845fbc-4cq42"]
Jul 06 14:29:14.933232 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:29:14.933203    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4683bcda_8e38_4d5a_a8d5_283e7f0985f1.slice/crio-7e5916eb8b2ae2ac06381b55a0b1cb08cf8b06a61e85f126c97e15a03362eee7 WatchSource:0}: Error finding container 7e5916eb8b2ae2ac06381b55a0b1cb08cf8b06a61e85f126c97e15a03362eee7: Status 404 returned error can't find the container with id 7e5916eb8b2ae2ac06381b55a0b1cb08cf8b06a61e85f126c97e15a03362eee7
Jul 06 14:29:15.083952 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:29:15.083906    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7b5f845fbc-4cq42" event={"ID":"4683bcda-8e38-4d5a-a8d5-283e7f0985f1","Type":"ContainerStarted","Data":"7e5916eb8b2ae2ac06381b55a0b1cb08cf8b06a61e85f126c97e15a03362eee7"}
Jul 06 14:29:15.767981 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:29:15.767946    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:29:15.836838 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:29:15.836799    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:29:16.878573 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:29:16.878530    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:29:19.099613 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:29:19.099575    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7b5f845fbc-4cq42" event={"ID":"4683bcda-8e38-4d5a-a8d5-283e7f0985f1","Type":"ContainerStarted","Data":"d71feb699b8273a5ace5e41a243a711af211655a0d0143edd7e4984f39b33f77"}
Jul 06 14:29:19.123506 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:29:19.123454    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7b5f845fbc-4cq42" podStartSLOduration=1.9451446620000001 podStartE2EDuration="5.12343934s" totalImagesPullingTime="3.178294678s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:29:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:29:19.122137063 +0000 UTC m=+386.042417492" watchObservedRunningTime="2026-07-06 14:29:19.12343934 +0000 UTC m=+386.043719769"
Jul 06 14:29:19.137446 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:29:19.137399    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:29:19.748265 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:29:19.748229    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-szk4j"]
Jul 06 14:29:19.750435 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:29:19.750418    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-szk4j"
Jul 06 14:29:19.757613 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:29:19.757582    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 06 14:29:19.757742 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:29:19.757675    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 06 14:29:19.757742 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:29:19.757691    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-qbkzq\""
Jul 06 14:29:19.757849 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:29:19.757681    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 06 14:29:19.758053 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:29:19.758040    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 06 14:29:19.786027 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:29:19.785988    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-szk4j"]
Jul 06 14:29:19.817555 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:29:19.817519    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/68c3e410-778f-417e-a018-bb0f57344a26-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-szk4j\" (UID: \"68c3e410-778f-417e-a018-bb0f57344a26\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-szk4j"
Jul 06 14:29:19.817555 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:29:19.817555    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/68c3e410-778f-417e-a018-bb0f57344a26-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-szk4j\" (UID: \"68c3e410-778f-417e-a018-bb0f57344a26\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-szk4j"
Jul 06 14:29:19.817802 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:29:19.817575    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/68c3e410-778f-417e-a018-bb0f57344a26-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-szk4j\" (UID: \"68c3e410-778f-417e-a018-bb0f57344a26\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-szk4j"
Jul 06 14:29:19.817802 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:29:19.817594    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/68c3e410-778f-417e-a018-bb0f57344a26-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-szk4j\" (UID: \"68c3e410-778f-417e-a018-bb0f57344a26\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-szk4j"
Jul 06 14:29:19.817802 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:29:19.817612    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28vl9\" (UniqueName: \"kubernetes.io/projected/68c3e410-778f-417e-a018-bb0f57344a26-kube-api-access-28vl9\") pod \"istiod-openshift-gateway-94bb8fbfd-szk4j\" (UID: \"68c3e410-778f-417e-a018-bb0f57344a26\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-szk4j"
Jul 06 14:29:19.817802 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:29:19.817709    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/68c3e410-778f-417e-a018-bb0f57344a26-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-szk4j\" (UID: \"68c3e410-778f-417e-a018-bb0f57344a26\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-szk4j"
Jul 06 14:29:19.817802 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:29:19.817749    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/68c3e410-778f-417e-a018-bb0f57344a26-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-szk4j\" (UID: \"68c3e410-778f-417e-a018-bb0f57344a26\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-szk4j"
Jul 06 14:29:19.918129 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:29:19.918078    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/68c3e410-778f-417e-a018-bb0f57344a26-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-szk4j\" (UID: \"68c3e410-778f-417e-a018-bb0f57344a26\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-szk4j"
Jul 06 14:29:19.918129 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:29:19.918136    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/68c3e410-778f-417e-a018-bb0f57344a26-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-szk4j\" (UID: \"68c3e410-778f-417e-a018-bb0f57344a26\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-szk4j"
Jul 06 14:29:19.918379 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:29:19.918164    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-28vl9\" (UniqueName: \"kubernetes.io/projected/68c3e410-778f-417e-a018-bb0f57344a26-kube-api-access-28vl9\") pod \"istiod-openshift-gateway-94bb8fbfd-szk4j\" (UID: \"68c3e410-778f-417e-a018-bb0f57344a26\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-szk4j"
Jul 06 14:29:19.918379 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:29:19.918204    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/68c3e410-778f-417e-a018-bb0f57344a26-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-szk4j\" (UID: \"68c3e410-778f-417e-a018-bb0f57344a26\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-szk4j"
Jul 06 14:29:19.918379 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:29:19.918252    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/68c3e410-778f-417e-a018-bb0f57344a26-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-szk4j\" (UID: \"68c3e410-778f-417e-a018-bb0f57344a26\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-szk4j"
Jul 06 14:29:19.918379 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:29:19.918311    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/68c3e410-778f-417e-a018-bb0f57344a26-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-szk4j\" (UID: \"68c3e410-778f-417e-a018-bb0f57344a26\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-szk4j"
Jul 06 14:29:19.918379 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:29:19.918336    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/68c3e410-778f-417e-a018-bb0f57344a26-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-szk4j\" (UID: \"68c3e410-778f-417e-a018-bb0f57344a26\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-szk4j"
Jul 06 14:29:19.918948 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:29:19.918919    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/68c3e410-778f-417e-a018-bb0f57344a26-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-szk4j\" (UID: \"68c3e410-778f-417e-a018-bb0f57344a26\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-szk4j"
Jul 06 14:29:19.920606 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:29:19.920578    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/68c3e410-778f-417e-a018-bb0f57344a26-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-szk4j\" (UID: \"68c3e410-778f-417e-a018-bb0f57344a26\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-szk4j"
Jul 06 14:29:19.920735 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:29:19.920610    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/68c3e410-778f-417e-a018-bb0f57344a26-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-szk4j\" (UID: \"68c3e410-778f-417e-a018-bb0f57344a26\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-szk4j"
Jul 06 14:29:19.920735 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:29:19.920699    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/68c3e410-778f-417e-a018-bb0f57344a26-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-szk4j\" (UID: \"68c3e410-778f-417e-a018-bb0f57344a26\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-szk4j"
Jul 06 14:29:19.920849 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:29:19.920733    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/68c3e410-778f-417e-a018-bb0f57344a26-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-szk4j\" (UID: \"68c3e410-778f-417e-a018-bb0f57344a26\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-szk4j"
Jul 06 14:29:19.930873 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:29:19.930852    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/68c3e410-778f-417e-a018-bb0f57344a26-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-szk4j\" (UID: \"68c3e410-778f-417e-a018-bb0f57344a26\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-szk4j"
Jul 06 14:29:19.931082 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:29:19.931062    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-28vl9\" (UniqueName: \"kubernetes.io/projected/68c3e410-778f-417e-a018-bb0f57344a26-kube-api-access-28vl9\") pod \"istiod-openshift-gateway-94bb8fbfd-szk4j\" (UID: \"68c3e410-778f-417e-a018-bb0f57344a26\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-szk4j"
Jul 06 14:29:20.059345 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:29:20.059258    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-szk4j"
Jul 06 14:29:20.199273 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:29:20.199220    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-szk4j"]
Jul 06 14:29:20.202162 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:29:20.202123    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68c3e410_778f_417e_a018_bb0f57344a26.slice/crio-99b16dc7480b4c5bd6bf480bfb017e9f2fe27d3de02b8a222e38a7e256e76c6e WatchSource:0}: Error finding container 99b16dc7480b4c5bd6bf480bfb017e9f2fe27d3de02b8a222e38a7e256e76c6e: Status 404 returned error can't find the container with id 99b16dc7480b4c5bd6bf480bfb017e9f2fe27d3de02b8a222e38a7e256e76c6e
Jul 06 14:29:20.407420 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:29:20.407392    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:29:20.628982 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:29:20.628950    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:29:21.110249 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:29:21.110190    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-szk4j" event={"ID":"68c3e410-778f-417e-a018-bb0f57344a26","Type":"ContainerStarted","Data":"99b16dc7480b4c5bd6bf480bfb017e9f2fe27d3de02b8a222e38a7e256e76c6e"}
Jul 06 14:29:21.900777 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:29:21.900740    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:29:22.131258 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:29:22.131190    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:29:22.399114 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:29:22.399083    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:29:22.506833 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:29:22.506799    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:29:22.506911 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:29:22.506870    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:29:23.126893 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:29:23.126852    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-szk4j" event={"ID":"68c3e410-778f-417e-a018-bb0f57344a26","Type":"ContainerStarted","Data":"77d0104e47feb34951b4737800fd0e3552cb0162b150a08557ac47550f5575b2"}
Jul 06 14:29:23.127339 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:29:23.127029    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-szk4j"
Jul 06 14:29:23.128972 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:29:23.128949    2582 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-szk4j container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 06 14:29:23.129071 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:29:23.128993    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-szk4j" podUID="68c3e410-778f-417e-a018-bb0f57344a26" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 06 14:29:23.170753 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:29:23.170688    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-szk4j" podStartSLOduration=1.8683295370000002 podStartE2EDuration="4.170664383s" totalImagesPullingTime="2.302334846s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:29:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:29:23.167991548 +0000 UTC m=+390.088271973" watchObservedRunningTime="2026-07-06 14:29:23.170664383 +0000 UTC m=+390.090944805"
Jul 06 14:29:23.259956 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:29:23.259925    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:29:23.361965 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:29:23.361929    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-pqfl8"]
Jul 06 14:29:23.365425 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:29:23.365406    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-pqfl8"
Jul 06 14:29:23.369684 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:29:23.369646    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 06 14:29:23.369815 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:29:23.369770    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-gvqtk\""
Jul 06 14:29:23.392832 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:29:23.392753    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:29:23.457718 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:29:23.457686    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4w225\" (UniqueName: \"kubernetes.io/projected/c98e166b-42be-4564-b226-bff9639867d2-kube-api-access-4w225\") pod \"kserve-controller-manager-d6f4b65b8-pqfl8\" (UID: \"c98e166b-42be-4564-b226-bff9639867d2\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-pqfl8"
Jul 06 14:29:23.457876 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:29:23.457741    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c98e166b-42be-4564-b226-bff9639867d2-cert\") pod \"kserve-controller-manager-d6f4b65b8-pqfl8\" (UID: \"c98e166b-42be-4564-b226-bff9639867d2\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-pqfl8"
Jul 06 14:29:23.501460 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:29:23.501419    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-pqfl8"]
Jul 06 14:29:23.558583 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:29:23.558554    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4w225\" (UniqueName: \"kubernetes.io/projected/c98e166b-42be-4564-b226-bff9639867d2-kube-api-access-4w225\") pod \"kserve-controller-manager-d6f4b65b8-pqfl8\" (UID: \"c98e166b-42be-4564-b226-bff9639867d2\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-pqfl8"
Jul 06 14:29:23.558775 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:29:23.558598    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c98e166b-42be-4564-b226-bff9639867d2-cert\") pod \"kserve-controller-manager-d6f4b65b8-pqfl8\" (UID: \"c98e166b-42be-4564-b226-bff9639867d2\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-pqfl8"
Jul 06 14:29:23.561022 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:29:23.560994    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c98e166b-42be-4564-b226-bff9639867d2-cert\") pod \"kserve-controller-manager-d6f4b65b8-pqfl8\" (UID: \"c98e166b-42be-4564-b226-bff9639867d2\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-pqfl8"
Jul 06 14:29:23.574728 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:29:23.574704    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:29:23.611614 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:29:23.611582    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4w225\" (UniqueName: \"kubernetes.io/projected/c98e166b-42be-4564-b226-bff9639867d2-kube-api-access-4w225\") pod \"kserve-controller-manager-d6f4b65b8-pqfl8\" (UID: \"c98e166b-42be-4564-b226-bff9639867d2\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-pqfl8"
Jul 06 14:29:23.676051 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:29:23.676013    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-pqfl8"
Jul 06 14:29:23.701000 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:29:23.700973    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:29:23.854780 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:29:23.854742    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:29:23.862979 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:29:23.862947    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-pqfl8"]
Jul 06 14:29:23.869029 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:29:23.869003    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc98e166b_42be_4564_b226_bff9639867d2.slice/crio-a87f8322ebe7ca145df5dbcb040f32b7007891bf378b0a70c46472ea2c49f404 WatchSource:0}: Error finding container a87f8322ebe7ca145df5dbcb040f32b7007891bf378b0a70c46472ea2c49f404: Status 404 returned error can't find the container with id a87f8322ebe7ca145df5dbcb040f32b7007891bf378b0a70c46472ea2c49f404
Jul 06 14:29:24.032457 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:29:24.032346    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:29:24.132666 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:29:24.132614    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-pqfl8" event={"ID":"c98e166b-42be-4564-b226-bff9639867d2","Type":"ContainerStarted","Data":"a87f8322ebe7ca145df5dbcb040f32b7007891bf378b0a70c46472ea2c49f404"}
Jul 06 14:29:24.133511 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:29:24.133492    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-szk4j"
Jul 06 14:29:27.147378 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:29:27.147290    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-pqfl8" event={"ID":"c98e166b-42be-4564-b226-bff9639867d2","Type":"ContainerStarted","Data":"e42d1fdaaa9cdf2f8beec6e3c7e305c85d02c97e894255c5a3f710b3b73069ba"}
Jul 06 14:29:27.147378 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:29:27.147374    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-pqfl8"
Jul 06 14:29:27.222080 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:29:27.222020    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-pqfl8" podStartSLOduration=1.386426967 podStartE2EDuration="4.222001081s" totalImagesPullingTime="2.835574114s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:29:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:29:27.220999175 +0000 UTC m=+394.141279620" watchObservedRunningTime="2026-07-06 14:29:27.222001081 +0000 UTC m=+394.142281509"
Jul 06 14:29:28.169800 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:29:28.169768    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:29:28.276716 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:29:28.276681    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:29:48.169924 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:29:48.169887    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:29:58.157507 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:29:58.157475    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-pqfl8"
Jul 06 14:30:03.229424 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:30:03.229388    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:30:03.330021 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:30:03.329982    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:30:12.705086 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:30:12.705056    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:30:12.804022 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:30:12.803992    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:30:12.941014 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:30:12.940977    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:30:34.205961 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:30:34.205913    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:30:36.784815 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:30:36.784785    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:30:40.782377 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:30:40.782343    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:30:42.673284 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:30:42.673243    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4ld9t"]
Jul 06 14:30:42.678291 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:30:42.678264    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4ld9t"
Jul 06 14:30:42.682582 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:30:42.682556    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 06 14:30:42.682819 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:30:42.682800    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 06 14:30:42.683176 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:30:42.683155    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4ld9t"]
Jul 06 14:30:42.683796 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:30:42.683780    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-7dr4n\""
Jul 06 14:30:42.820845 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:30:42.820813    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7bm7\" (UniqueName: \"kubernetes.io/projected/c15b5441-7a5b-4f97-8486-0e2c21f88c72-kube-api-access-t7bm7\") pod \"limitador-operator-controller-manager-859d7b78bd-4ld9t\" (UID: \"c15b5441-7a5b-4f97-8486-0e2c21f88c72\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4ld9t"
Jul 06 14:30:42.921403 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:30:42.921367    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7bm7\" (UniqueName: \"kubernetes.io/projected/c15b5441-7a5b-4f97-8486-0e2c21f88c72-kube-api-access-t7bm7\") pod \"limitador-operator-controller-manager-859d7b78bd-4ld9t\" (UID: \"c15b5441-7a5b-4f97-8486-0e2c21f88c72\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4ld9t"
Jul 06 14:30:42.935251 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:30:42.935179    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7bm7\" (UniqueName: \"kubernetes.io/projected/c15b5441-7a5b-4f97-8486-0e2c21f88c72-kube-api-access-t7bm7\") pod \"limitador-operator-controller-manager-859d7b78bd-4ld9t\" (UID: \"c15b5441-7a5b-4f97-8486-0e2c21f88c72\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4ld9t"
Jul 06 14:30:42.991757 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:30:42.991715    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4ld9t"
Jul 06 14:30:43.125183 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:30:43.125159    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4ld9t"]
Jul 06 14:30:43.127796 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:30:43.127764    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc15b5441_7a5b_4f97_8486_0e2c21f88c72.slice/crio-be776a3479924b46d4e71e6d5e09da3a19d1d5c1f58502867cbb81305cdd9229 WatchSource:0}: Error finding container be776a3479924b46d4e71e6d5e09da3a19d1d5c1f58502867cbb81305cdd9229: Status 404 returned error can't find the container with id be776a3479924b46d4e71e6d5e09da3a19d1d5c1f58502867cbb81305cdd9229
Jul 06 14:30:43.400131 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:30:43.400044    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:30:43.453293 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:30:43.453257    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4ld9t" event={"ID":"c15b5441-7a5b-4f97-8486-0e2c21f88c72","Type":"ContainerStarted","Data":"be776a3479924b46d4e71e6d5e09da3a19d1d5c1f58502867cbb81305cdd9229"}
Jul 06 14:30:45.464997 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:30:45.464953    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4ld9t" event={"ID":"c15b5441-7a5b-4f97-8486-0e2c21f88c72","Type":"ContainerStarted","Data":"85cec6838b4467b9777ec5dad7efa5c763c520458a2b9fbd3eeeff47d0994ed8"}
Jul 06 14:30:45.465394 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:30:45.465076    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4ld9t"
Jul 06 14:30:45.483581 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:30:45.483533    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4ld9t" podStartSLOduration=1.258958821 podStartE2EDuration="3.483517621s" totalImagesPullingTime="2.2245588s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:30:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:30:45.482283992 +0000 UTC m=+472.402564422" watchObservedRunningTime="2026-07-06 14:30:45.483517621 +0000 UTC m=+472.403798129"
Jul 06 14:30:46.817109 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:30:46.817078    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:30:48.043043 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:30:48.043003    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:30:48.191992 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:30:48.191956    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:30:48.876138 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:30:48.876107    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:30:49.827994 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:30:49.827960    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:30:52.423868 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:30:52.423835    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:30:53.810896 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:30:53.810861    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:30:53.913700 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:30:53.913650    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:30:55.747465 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:30:55.747430    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:30:55.818532 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:30:55.818496    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:30:56.472365 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:30:56.472334    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4ld9t"
Jul 06 14:30:57.977850 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:30:57.977814    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:30:58.078454 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:30:58.078418    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:31:01.013607 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:01.013581    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:31:01.098697 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:01.098644    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:31:04.090578 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:04.090544    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:31:05.267937 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:05.267903    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6s8p7"]
Jul 06 14:31:05.271086 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:05.271065    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6s8p7"
Jul 06 14:31:05.273872 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:05.273853    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-l6jr9\""
Jul 06 14:31:05.286262 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:05.286235    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6s8p7"]
Jul 06 14:31:05.308721 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:05.308684    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9h29\" (UniqueName: \"kubernetes.io/projected/0bd04eed-68b4-4740-99d3-4cb565e0343c-kube-api-access-k9h29\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-6s8p7\" (UID: \"0bd04eed-68b4-4740-99d3-4cb565e0343c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6s8p7"
Jul 06 14:31:05.308920 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:05.308748    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0bd04eed-68b4-4740-99d3-4cb565e0343c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-6s8p7\" (UID: \"0bd04eed-68b4-4740-99d3-4cb565e0343c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6s8p7"
Jul 06 14:31:05.409213 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:05.409170    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k9h29\" (UniqueName: \"kubernetes.io/projected/0bd04eed-68b4-4740-99d3-4cb565e0343c-kube-api-access-k9h29\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-6s8p7\" (UID: \"0bd04eed-68b4-4740-99d3-4cb565e0343c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6s8p7"
Jul 06 14:31:05.409389 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:05.409227    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0bd04eed-68b4-4740-99d3-4cb565e0343c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-6s8p7\" (UID: \"0bd04eed-68b4-4740-99d3-4cb565e0343c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6s8p7"
Jul 06 14:31:05.409694 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:05.409642    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0bd04eed-68b4-4740-99d3-4cb565e0343c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-6s8p7\" (UID: \"0bd04eed-68b4-4740-99d3-4cb565e0343c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6s8p7"
Jul 06 14:31:05.418559 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:05.418534    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9h29\" (UniqueName: \"kubernetes.io/projected/0bd04eed-68b4-4740-99d3-4cb565e0343c-kube-api-access-k9h29\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-6s8p7\" (UID: \"0bd04eed-68b4-4740-99d3-4cb565e0343c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6s8p7"
Jul 06 14:31:05.580946 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:05.580850    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6s8p7"
Jul 06 14:31:05.714368 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:05.714344    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6s8p7"]
Jul 06 14:31:05.716879 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:31:05.716851    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0bd04eed_68b4_4740_99d3_4cb565e0343c.slice/crio-007e5264dcd7093cc426035a79ab5cca1a86cee962ac42a852a1fcbcee7919c7 WatchSource:0}: Error finding container 007e5264dcd7093cc426035a79ab5cca1a86cee962ac42a852a1fcbcee7919c7: Status 404 returned error can't find the container with id 007e5264dcd7093cc426035a79ab5cca1a86cee962ac42a852a1fcbcee7919c7
Jul 06 14:31:05.959832 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:05.959791    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6s8p7"]
Jul 06 14:31:05.967077 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:05.967046    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6s8p7"]
Jul 06 14:31:05.995686 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:05.995621    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-758vt"]
Jul 06 14:31:06.000447 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:06.000412    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-758vt"
Jul 06 14:31:06.014421 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:06.014391    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/20924e66-3b00-4883-ba91-07f3f1d6bc01-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-758vt\" (UID: \"20924e66-3b00-4883-ba91-07f3f1d6bc01\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-758vt"
Jul 06 14:31:06.014566 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:06.014491    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfkhv\" (UniqueName: \"kubernetes.io/projected/20924e66-3b00-4883-ba91-07f3f1d6bc01-kube-api-access-vfkhv\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-758vt\" (UID: \"20924e66-3b00-4883-ba91-07f3f1d6bc01\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-758vt"
Jul 06 14:31:06.020885 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:06.020856    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-758vt"]
Jul 06 14:31:06.023019 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:06.022993    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4ld9t"]
Jul 06 14:31:06.023246 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:06.023205    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4ld9t" podUID="c15b5441-7a5b-4f97-8486-0e2c21f88c72" containerName="manager" containerID="cri-o://85cec6838b4467b9777ec5dad7efa5c763c520458a2b9fbd3eeeff47d0994ed8" gracePeriod=2
Jul 06 14:31:06.044712 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:06.044683    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4ld9t"]
Jul 06 14:31:06.061688 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:31:06.061616    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-4ld9t\" is forbidden: User \"system:node:ip-10-0-137-145.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-145.ec2.internal' and this object" podUID="c15b5441-7a5b-4f97-8486-0e2c21f88c72" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4ld9t"
Jul 06 14:31:06.115476 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:06.115447    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vfkhv\" (UniqueName: \"kubernetes.io/projected/20924e66-3b00-4883-ba91-07f3f1d6bc01-kube-api-access-vfkhv\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-758vt\" (UID: \"20924e66-3b00-4883-ba91-07f3f1d6bc01\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-758vt"
Jul 06 14:31:06.115650 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:06.115498    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/20924e66-3b00-4883-ba91-07f3f1d6bc01-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-758vt\" (UID: \"20924e66-3b00-4883-ba91-07f3f1d6bc01\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-758vt"
Jul 06 14:31:06.115874 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:06.115856    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/20924e66-3b00-4883-ba91-07f3f1d6bc01-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-758vt\" (UID: \"20924e66-3b00-4883-ba91-07f3f1d6bc01\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-758vt"
Jul 06 14:31:06.130952 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:06.130924    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfkhv\" (UniqueName: \"kubernetes.io/projected/20924e66-3b00-4883-ba91-07f3f1d6bc01-kube-api-access-vfkhv\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-758vt\" (UID: \"20924e66-3b00-4883-ba91-07f3f1d6bc01\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-758vt"
Jul 06 14:31:06.305248 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:06.305223    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4ld9t"
Jul 06 14:31:06.307680 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:31:06.307641    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-4ld9t\" is forbidden: User \"system:node:ip-10-0-137-145.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-145.ec2.internal' and this object" podUID="c15b5441-7a5b-4f97-8486-0e2c21f88c72" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4ld9t"
Jul 06 14:31:06.310802 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:06.310779    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-758vt"
Jul 06 14:31:06.316748 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:06.316711    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t7bm7\" (UniqueName: \"kubernetes.io/projected/c15b5441-7a5b-4f97-8486-0e2c21f88c72-kube-api-access-t7bm7\") pod \"c15b5441-7a5b-4f97-8486-0e2c21f88c72\" (UID: \"c15b5441-7a5b-4f97-8486-0e2c21f88c72\") "
Jul 06 14:31:06.319324 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:06.319293    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c15b5441-7a5b-4f97-8486-0e2c21f88c72-kube-api-access-t7bm7" (OuterVolumeSpecName: "kube-api-access-t7bm7") pod "c15b5441-7a5b-4f97-8486-0e2c21f88c72" (UID: "c15b5441-7a5b-4f97-8486-0e2c21f88c72"). InnerVolumeSpecName "kube-api-access-t7bm7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:31:06.417425 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:06.417394    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t7bm7\" (UniqueName: \"kubernetes.io/projected/c15b5441-7a5b-4f97-8486-0e2c21f88c72-kube-api-access-t7bm7\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Jul 06 14:31:06.556452 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:06.556369    2582 generic.go:356] "Generic (PLEG): container finished" podID="c15b5441-7a5b-4f97-8486-0e2c21f88c72" containerID="85cec6838b4467b9777ec5dad7efa5c763c520458a2b9fbd3eeeff47d0994ed8" exitCode=0
Jul 06 14:31:06.556594 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:06.556557    2582 scope.go:117] "RemoveContainer" containerID="85cec6838b4467b9777ec5dad7efa5c763c520458a2b9fbd3eeeff47d0994ed8"
Jul 06 14:31:06.556594 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:06.556579    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4ld9t"
Jul 06 14:31:06.559752 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:31:06.559627    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-4ld9t\" is forbidden: User \"system:node:ip-10-0-137-145.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-145.ec2.internal' and this object" podUID="c15b5441-7a5b-4f97-8486-0e2c21f88c72" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4ld9t"
Jul 06 14:31:06.570313 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:31:06.570275    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-4ld9t\" is forbidden: User \"system:node:ip-10-0-137-145.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-145.ec2.internal' and this object" podUID="c15b5441-7a5b-4f97-8486-0e2c21f88c72" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4ld9t"
Jul 06 14:31:06.613478 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:06.613309    2582 scope.go:117] "RemoveContainer" containerID="85cec6838b4467b9777ec5dad7efa5c763c520458a2b9fbd3eeeff47d0994ed8"
Jul 06 14:31:06.613779 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:31:06.613751    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"85cec6838b4467b9777ec5dad7efa5c763c520458a2b9fbd3eeeff47d0994ed8\": container with ID starting with 85cec6838b4467b9777ec5dad7efa5c763c520458a2b9fbd3eeeff47d0994ed8 not found: ID does not exist" containerID="85cec6838b4467b9777ec5dad7efa5c763c520458a2b9fbd3eeeff47d0994ed8"
Jul 06 14:31:06.613879 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:06.613793    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"85cec6838b4467b9777ec5dad7efa5c763c520458a2b9fbd3eeeff47d0994ed8"} err="failed to get container status \"85cec6838b4467b9777ec5dad7efa5c763c520458a2b9fbd3eeeff47d0994ed8\": rpc error: code = NotFound desc = could not find container \"85cec6838b4467b9777ec5dad7efa5c763c520458a2b9fbd3eeeff47d0994ed8\": container with ID starting with 85cec6838b4467b9777ec5dad7efa5c763c520458a2b9fbd3eeeff47d0994ed8 not found: ID does not exist"
Jul 06 14:31:06.648983 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:06.648950    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-758vt"]
Jul 06 14:31:06.670051 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:31:06.670014    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20924e66_3b00_4883_ba91_07f3f1d6bc01.slice/crio-98ebdf3311b95a1c3f45b30e94059940cc467d91520c3cd233ed335be9069196 WatchSource:0}: Error finding container 98ebdf3311b95a1c3f45b30e94059940cc467d91520c3cd233ed335be9069196: Status 404 returned error can't find the container with id 98ebdf3311b95a1c3f45b30e94059940cc467d91520c3cd233ed335be9069196
Jul 06 14:31:07.503378 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:07.503332    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c15b5441-7a5b-4f97-8486-0e2c21f88c72" path="/var/lib/kubelet/pods/c15b5441-7a5b-4f97-8486-0e2c21f88c72/volumes"
Jul 06 14:31:07.568329 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:07.568289    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-758vt" event={"ID":"20924e66-3b00-4883-ba91-07f3f1d6bc01","Type":"ContainerStarted","Data":"98ebdf3311b95a1c3f45b30e94059940cc467d91520c3cd233ed335be9069196"}
Jul 06 14:31:09.011631 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:09.011600    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:31:09.113426 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:09.113388    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:31:11.589397 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:11.589336    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6s8p7" podUID="0bd04eed-68b4-4740-99d3-4cb565e0343c" containerName="manager" containerID="cri-o://460e457acb9ccd6758fc6788fc80a9ac1d9a5e84074afa990d12ebc42f54a55a" gracePeriod=2
Jul 06 14:31:11.591058 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:11.591032    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-758vt" event={"ID":"20924e66-3b00-4883-ba91-07f3f1d6bc01","Type":"ContainerStarted","Data":"d6e69fcaf366d7204b149acc654dfddd59c82b2a5ab2643a2e5678276df33e84"}
Jul 06 14:31:11.591188 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:11.591165    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-758vt"
Jul 06 14:31:11.622838 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:11.622785    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-758vt" podStartSLOduration=2.747772306 podStartE2EDuration="6.622768695s" totalImagesPullingTime="3.874996389s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:31:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:31:11.622281665 +0000 UTC m=+498.542562097" watchObservedRunningTime="2026-07-06 14:31:11.622768695 +0000 UTC m=+498.543049123"
Jul 06 14:31:11.667513 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:11.667461    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:31:11.765829 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:11.765802    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:31:11.831474 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:11.831442    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6s8p7"
Jul 06 14:31:11.833951 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:31:11.833924    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-6s8p7\" is forbidden: User \"system:node:ip-10-0-137-145.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-145.ec2.internal' and this object" podUID="0bd04eed-68b4-4740-99d3-4cb565e0343c" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6s8p7"
Jul 06 14:31:11.859222 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:11.859127    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k9h29\" (UniqueName: \"kubernetes.io/projected/0bd04eed-68b4-4740-99d3-4cb565e0343c-kube-api-access-k9h29\") pod \"0bd04eed-68b4-4740-99d3-4cb565e0343c\" (UID: \"0bd04eed-68b4-4740-99d3-4cb565e0343c\") "
Jul 06 14:31:11.859222 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:11.859173    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0bd04eed-68b4-4740-99d3-4cb565e0343c-extensions-socket-volume\") pod \"0bd04eed-68b4-4740-99d3-4cb565e0343c\" (UID: \"0bd04eed-68b4-4740-99d3-4cb565e0343c\") "
Jul 06 14:31:11.859480 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:11.859454    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0bd04eed-68b4-4740-99d3-4cb565e0343c-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "0bd04eed-68b4-4740-99d3-4cb565e0343c" (UID: "0bd04eed-68b4-4740-99d3-4cb565e0343c"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:31:11.861299 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:11.861273    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0bd04eed-68b4-4740-99d3-4cb565e0343c-kube-api-access-k9h29" (OuterVolumeSpecName: "kube-api-access-k9h29") pod "0bd04eed-68b4-4740-99d3-4cb565e0343c" (UID: "0bd04eed-68b4-4740-99d3-4cb565e0343c"). InnerVolumeSpecName "kube-api-access-k9h29". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:31:11.959994 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:11.959950    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k9h29\" (UniqueName: \"kubernetes.io/projected/0bd04eed-68b4-4740-99d3-4cb565e0343c-kube-api-access-k9h29\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Jul 06 14:31:11.959994 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:11.959985    2582 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0bd04eed-68b4-4740-99d3-4cb565e0343c-extensions-socket-volume\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Jul 06 14:31:12.596478 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:12.596440    2582 generic.go:356] "Generic (PLEG): container finished" podID="0bd04eed-68b4-4740-99d3-4cb565e0343c" containerID="460e457acb9ccd6758fc6788fc80a9ac1d9a5e84074afa990d12ebc42f54a55a" exitCode=2
Jul 06 14:31:12.596970 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:12.596487    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6s8p7"
Jul 06 14:31:12.596970 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:12.596542    2582 scope.go:117] "RemoveContainer" containerID="460e457acb9ccd6758fc6788fc80a9ac1d9a5e84074afa990d12ebc42f54a55a"
Jul 06 14:31:12.598898 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:31:12.598867    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-6s8p7\" is forbidden: User \"system:node:ip-10-0-137-145.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-145.ec2.internal' and this object" podUID="0bd04eed-68b4-4740-99d3-4cb565e0343c" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6s8p7"
Jul 06 14:31:12.605119 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:12.605098    2582 scope.go:117] "RemoveContainer" containerID="460e457acb9ccd6758fc6788fc80a9ac1d9a5e84074afa990d12ebc42f54a55a"
Jul 06 14:31:12.605369 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:31:12.605351    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"460e457acb9ccd6758fc6788fc80a9ac1d9a5e84074afa990d12ebc42f54a55a\": container with ID starting with 460e457acb9ccd6758fc6788fc80a9ac1d9a5e84074afa990d12ebc42f54a55a not found: ID does not exist" containerID="460e457acb9ccd6758fc6788fc80a9ac1d9a5e84074afa990d12ebc42f54a55a"
Jul 06 14:31:12.605443 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:12.605378    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"460e457acb9ccd6758fc6788fc80a9ac1d9a5e84074afa990d12ebc42f54a55a"} err="failed to get container status \"460e457acb9ccd6758fc6788fc80a9ac1d9a5e84074afa990d12ebc42f54a55a\": rpc error: code = NotFound desc = could not find container \"460e457acb9ccd6758fc6788fc80a9ac1d9a5e84074afa990d12ebc42f54a55a\": container with ID starting with 460e457acb9ccd6758fc6788fc80a9ac1d9a5e84074afa990d12ebc42f54a55a not found: ID does not exist"
Jul 06 14:31:12.607805 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:31:12.607784    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-6s8p7\" is forbidden: User \"system:node:ip-10-0-137-145.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-145.ec2.internal' and this object" podUID="0bd04eed-68b4-4740-99d3-4cb565e0343c" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6s8p7"
Jul 06 14:31:13.497265 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:31:13.497221    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-6s8p7\" is forbidden: User \"system:node:ip-10-0-137-145.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-145.ec2.internal' and this object" podUID="0bd04eed-68b4-4740-99d3-4cb565e0343c" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6s8p7"
Jul 06 14:31:13.498603 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:13.498579    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0bd04eed-68b4-4740-99d3-4cb565e0343c" path="/var/lib/kubelet/pods/0bd04eed-68b4-4740-99d3-4cb565e0343c/volumes"
Jul 06 14:31:14.477855 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:14.477821    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:31:14.578770 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:14.578738    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:31:18.054271 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:18.054234    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:31:18.145885 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:18.145854    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:31:22.599966 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:22.599935    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-758vt"
Jul 06 14:31:26.878149 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:26.878116    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:31:26.977994 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:26.977958    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:31:29.502339 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:29.502309    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:31:29.603044 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:29.603009    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:31:32.708969 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:32.708937    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:31:32.809005 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:32.808975    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:31:35.372420 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:35.372384    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-758vt"]
Jul 06 14:31:35.373024 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:35.372623    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-758vt" podUID="20924e66-3b00-4883-ba91-07f3f1d6bc01" containerName="manager" containerID="cri-o://d6e69fcaf366d7204b149acc654dfddd59c82b2a5ab2643a2e5678276df33e84" gracePeriod=10
Jul 06 14:31:35.618251 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:35.618217    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-758vt"
Jul 06 14:31:35.699774 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:35.699738    2582 generic.go:356] "Generic (PLEG): container finished" podID="20924e66-3b00-4883-ba91-07f3f1d6bc01" containerID="d6e69fcaf366d7204b149acc654dfddd59c82b2a5ab2643a2e5678276df33e84" exitCode=0
Jul 06 14:31:35.699961 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:35.699784    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-758vt"
Jul 06 14:31:35.699961 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:35.699841    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-758vt" event={"ID":"20924e66-3b00-4883-ba91-07f3f1d6bc01","Type":"ContainerDied","Data":"d6e69fcaf366d7204b149acc654dfddd59c82b2a5ab2643a2e5678276df33e84"}
Jul 06 14:31:35.699961 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:35.699893    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-758vt" event={"ID":"20924e66-3b00-4883-ba91-07f3f1d6bc01","Type":"ContainerDied","Data":"98ebdf3311b95a1c3f45b30e94059940cc467d91520c3cd233ed335be9069196"}
Jul 06 14:31:35.699961 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:35.699919    2582 scope.go:117] "RemoveContainer" containerID="d6e69fcaf366d7204b149acc654dfddd59c82b2a5ab2643a2e5678276df33e84"
Jul 06 14:31:35.708029 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:35.708008    2582 scope.go:117] "RemoveContainer" containerID="d6e69fcaf366d7204b149acc654dfddd59c82b2a5ab2643a2e5678276df33e84"
Jul 06 14:31:35.708305 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:31:35.708285    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d6e69fcaf366d7204b149acc654dfddd59c82b2a5ab2643a2e5678276df33e84\": container with ID starting with d6e69fcaf366d7204b149acc654dfddd59c82b2a5ab2643a2e5678276df33e84 not found: ID does not exist" containerID="d6e69fcaf366d7204b149acc654dfddd59c82b2a5ab2643a2e5678276df33e84"
Jul 06 14:31:35.708372 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:35.708315    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6e69fcaf366d7204b149acc654dfddd59c82b2a5ab2643a2e5678276df33e84"} err="failed to get container status \"d6e69fcaf366d7204b149acc654dfddd59c82b2a5ab2643a2e5678276df33e84\": rpc error: code = NotFound desc = could not find container \"d6e69fcaf366d7204b149acc654dfddd59c82b2a5ab2643a2e5678276df33e84\": container with ID starting with d6e69fcaf366d7204b149acc654dfddd59c82b2a5ab2643a2e5678276df33e84 not found: ID does not exist"
Jul 06 14:31:35.750874 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:35.750838    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/20924e66-3b00-4883-ba91-07f3f1d6bc01-extensions-socket-volume\") pod \"20924e66-3b00-4883-ba91-07f3f1d6bc01\" (UID: \"20924e66-3b00-4883-ba91-07f3f1d6bc01\") "
Jul 06 14:31:35.751039 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:35.750893    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vfkhv\" (UniqueName: \"kubernetes.io/projected/20924e66-3b00-4883-ba91-07f3f1d6bc01-kube-api-access-vfkhv\") pod \"20924e66-3b00-4883-ba91-07f3f1d6bc01\" (UID: \"20924e66-3b00-4883-ba91-07f3f1d6bc01\") "
Jul 06 14:31:35.751313 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:35.751291    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20924e66-3b00-4883-ba91-07f3f1d6bc01-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "20924e66-3b00-4883-ba91-07f3f1d6bc01" (UID: "20924e66-3b00-4883-ba91-07f3f1d6bc01"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:31:35.753029 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:35.753009    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20924e66-3b00-4883-ba91-07f3f1d6bc01-kube-api-access-vfkhv" (OuterVolumeSpecName: "kube-api-access-vfkhv") pod "20924e66-3b00-4883-ba91-07f3f1d6bc01" (UID: "20924e66-3b00-4883-ba91-07f3f1d6bc01"). InnerVolumeSpecName "kube-api-access-vfkhv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:31:35.857879 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:35.857843    2582 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/20924e66-3b00-4883-ba91-07f3f1d6bc01-extensions-socket-volume\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Jul 06 14:31:35.857879 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:35.857872    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vfkhv\" (UniqueName: \"kubernetes.io/projected/20924e66-3b00-4883-ba91-07f3f1d6bc01-kube-api-access-vfkhv\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Jul 06 14:31:36.039885 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:36.039852    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-758vt"]
Jul 06 14:31:36.047322 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:36.047290    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-758vt"]
Jul 06 14:31:36.319752 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:36.319665    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:31:36.419598 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:36.419562    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:31:37.498415 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:37.498382    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="20924e66-3b00-4883-ba91-07f3f1d6bc01" path="/var/lib/kubelet/pods/20924e66-3b00-4883-ba91-07f3f1d6bc01/volumes"
Jul 06 14:31:39.083543 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:39.083513    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lkxb4"]
Jul 06 14:31:39.083951 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:39.083808    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20924e66-3b00-4883-ba91-07f3f1d6bc01" containerName="manager"
Jul 06 14:31:39.083951 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:39.083820    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="20924e66-3b00-4883-ba91-07f3f1d6bc01" containerName="manager"
Jul 06 14:31:39.083951 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:39.083843    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c15b5441-7a5b-4f97-8486-0e2c21f88c72" containerName="manager"
Jul 06 14:31:39.083951 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:39.083848    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="c15b5441-7a5b-4f97-8486-0e2c21f88c72" containerName="manager"
Jul 06 14:31:39.083951 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:39.083865    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0bd04eed-68b4-4740-99d3-4cb565e0343c" containerName="manager"
Jul 06 14:31:39.083951 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:39.083871    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="0bd04eed-68b4-4740-99d3-4cb565e0343c" containerName="manager"
Jul 06 14:31:39.083951 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:39.083913    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="20924e66-3b00-4883-ba91-07f3f1d6bc01" containerName="manager"
Jul 06 14:31:39.083951 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:39.083920    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="c15b5441-7a5b-4f97-8486-0e2c21f88c72" containerName="manager"
Jul 06 14:31:39.083951 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:39.083926    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="0bd04eed-68b4-4740-99d3-4cb565e0343c" containerName="manager"
Jul 06 14:31:39.088267 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:39.088246    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lkxb4"
Jul 06 14:31:39.090803 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:39.090781    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-ctc9f\""
Jul 06 14:31:39.099344 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:39.099311    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lkxb4"]
Jul 06 14:31:39.111363 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:39.111338    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:31:39.185893 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:39.185857    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eefcbb73-dab6-4344-abbd-c972ef1e5a9a-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-lkxb4\" (UID: \"eefcbb73-dab6-4344-abbd-c972ef1e5a9a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lkxb4"
Jul 06 14:31:39.185893 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:39.185895    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eefcbb73-dab6-4344-abbd-c972ef1e5a9a-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-lkxb4\" (UID: \"eefcbb73-dab6-4344-abbd-c972ef1e5a9a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lkxb4"
Jul 06 14:31:39.186151 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:39.185938    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eefcbb73-dab6-4344-abbd-c972ef1e5a9a-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-lkxb4\" (UID: \"eefcbb73-dab6-4344-abbd-c972ef1e5a9a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lkxb4"
Jul 06 14:31:39.186151 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:39.185981    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eefcbb73-dab6-4344-abbd-c972ef1e5a9a-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-lkxb4\" (UID: \"eefcbb73-dab6-4344-abbd-c972ef1e5a9a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lkxb4"
Jul 06 14:31:39.186151 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:39.186003    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eefcbb73-dab6-4344-abbd-c972ef1e5a9a-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-lkxb4\" (UID: \"eefcbb73-dab6-4344-abbd-c972ef1e5a9a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lkxb4"
Jul 06 14:31:39.186151 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:39.186067    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eefcbb73-dab6-4344-abbd-c972ef1e5a9a-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-lkxb4\" (UID: \"eefcbb73-dab6-4344-abbd-c972ef1e5a9a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lkxb4"
Jul 06 14:31:39.186151 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:39.186125    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eefcbb73-dab6-4344-abbd-c972ef1e5a9a-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-lkxb4\" (UID: \"eefcbb73-dab6-4344-abbd-c972ef1e5a9a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lkxb4"
Jul 06 14:31:39.186359 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:39.186189    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8prq\" (UniqueName: \"kubernetes.io/projected/eefcbb73-dab6-4344-abbd-c972ef1e5a9a-kube-api-access-c8prq\") pod \"maas-default-gateway-openshift-default-56654dcf7-lkxb4\" (UID: \"eefcbb73-dab6-4344-abbd-c972ef1e5a9a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lkxb4"
Jul 06 14:31:39.186359 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:39.186234    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eefcbb73-dab6-4344-abbd-c972ef1e5a9a-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-lkxb4\" (UID: \"eefcbb73-dab6-4344-abbd-c972ef1e5a9a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lkxb4"
Jul 06 14:31:39.248212 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:39.248179    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:31:39.286944 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:39.286905    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eefcbb73-dab6-4344-abbd-c972ef1e5a9a-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-lkxb4\" (UID: \"eefcbb73-dab6-4344-abbd-c972ef1e5a9a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lkxb4"
Jul 06 14:31:39.287125 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:39.286961    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eefcbb73-dab6-4344-abbd-c972ef1e5a9a-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-lkxb4\" (UID: \"eefcbb73-dab6-4344-abbd-c972ef1e5a9a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lkxb4"
Jul 06 14:31:39.287125 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:39.286985    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eefcbb73-dab6-4344-abbd-c972ef1e5a9a-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-lkxb4\" (UID: \"eefcbb73-dab6-4344-abbd-c972ef1e5a9a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lkxb4"
Jul 06 14:31:39.287125 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:39.287003    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eefcbb73-dab6-4344-abbd-c972ef1e5a9a-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-lkxb4\" (UID: \"eefcbb73-dab6-4344-abbd-c972ef1e5a9a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lkxb4"
Jul 06 14:31:39.287125 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:39.287021    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eefcbb73-dab6-4344-abbd-c972ef1e5a9a-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-lkxb4\" (UID: \"eefcbb73-dab6-4344-abbd-c972ef1e5a9a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lkxb4"
Jul 06 14:31:39.287344 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:39.287135    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8prq\" (UniqueName: \"kubernetes.io/projected/eefcbb73-dab6-4344-abbd-c972ef1e5a9a-kube-api-access-c8prq\") pod \"maas-default-gateway-openshift-default-56654dcf7-lkxb4\" (UID: \"eefcbb73-dab6-4344-abbd-c972ef1e5a9a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lkxb4"
Jul 06 14:31:39.287344 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:39.287184    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eefcbb73-dab6-4344-abbd-c972ef1e5a9a-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-lkxb4\" (UID: \"eefcbb73-dab6-4344-abbd-c972ef1e5a9a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lkxb4"
Jul 06 14:31:39.287344 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:39.287214    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eefcbb73-dab6-4344-abbd-c972ef1e5a9a-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-lkxb4\" (UID: \"eefcbb73-dab6-4344-abbd-c972ef1e5a9a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lkxb4"
Jul 06 14:31:39.287344 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:39.287242    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eefcbb73-dab6-4344-abbd-c972ef1e5a9a-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-lkxb4\" (UID: \"eefcbb73-dab6-4344-abbd-c972ef1e5a9a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lkxb4"
Jul 06 14:31:39.287552 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:39.287419    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eefcbb73-dab6-4344-abbd-c972ef1e5a9a-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-lkxb4\" (UID: \"eefcbb73-dab6-4344-abbd-c972ef1e5a9a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lkxb4"
Jul 06 14:31:39.287552 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:39.287491    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eefcbb73-dab6-4344-abbd-c972ef1e5a9a-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-lkxb4\" (UID: \"eefcbb73-dab6-4344-abbd-c972ef1e5a9a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lkxb4"
Jul 06 14:31:39.287552 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:39.287528    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eefcbb73-dab6-4344-abbd-c972ef1e5a9a-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-lkxb4\" (UID: \"eefcbb73-dab6-4344-abbd-c972ef1e5a9a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lkxb4"
Jul 06 14:31:39.287791 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:39.287576    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eefcbb73-dab6-4344-abbd-c972ef1e5a9a-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-lkxb4\" (UID: \"eefcbb73-dab6-4344-abbd-c972ef1e5a9a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lkxb4"
Jul 06 14:31:39.287861 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:39.287841    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eefcbb73-dab6-4344-abbd-c972ef1e5a9a-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-lkxb4\" (UID: \"eefcbb73-dab6-4344-abbd-c972ef1e5a9a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lkxb4"
Jul 06 14:31:39.289475 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:39.289456    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eefcbb73-dab6-4344-abbd-c972ef1e5a9a-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-lkxb4\" (UID: \"eefcbb73-dab6-4344-abbd-c972ef1e5a9a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lkxb4"
Jul 06 14:31:39.289769 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:39.289751    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eefcbb73-dab6-4344-abbd-c972ef1e5a9a-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-lkxb4\" (UID: \"eefcbb73-dab6-4344-abbd-c972ef1e5a9a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lkxb4"
Jul 06 14:31:39.295134 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:39.295107    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eefcbb73-dab6-4344-abbd-c972ef1e5a9a-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-lkxb4\" (UID: \"eefcbb73-dab6-4344-abbd-c972ef1e5a9a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lkxb4"
Jul 06 14:31:39.295870 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:39.295851    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8prq\" (UniqueName: \"kubernetes.io/projected/eefcbb73-dab6-4344-abbd-c972ef1e5a9a-kube-api-access-c8prq\") pod \"maas-default-gateway-openshift-default-56654dcf7-lkxb4\" (UID: \"eefcbb73-dab6-4344-abbd-c972ef1e5a9a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lkxb4"
Jul 06 14:31:39.401505 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:39.401406    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lkxb4"
Jul 06 14:31:39.538468 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:39.538435    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lkxb4"]
Jul 06 14:31:39.541558 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:31:39.541522    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeefcbb73_dab6_4344_abbd_c972ef1e5a9a.slice/crio-b2cd75b98732c70544f1222fb69edc082483db2b35d470aaa1d212b4960b62ee WatchSource:0}: Error finding container b2cd75b98732c70544f1222fb69edc082483db2b35d470aaa1d212b4960b62ee: Status 404 returned error can't find the container with id b2cd75b98732c70544f1222fb69edc082483db2b35d470aaa1d212b4960b62ee
Jul 06 14:31:39.719858 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:39.719813    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lkxb4" event={"ID":"eefcbb73-dab6-4344-abbd-c972ef1e5a9a","Type":"ContainerStarted","Data":"b2cd75b98732c70544f1222fb69edc082483db2b35d470aaa1d212b4960b62ee"}
Jul 06 14:31:42.117592 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:42.117552    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:31:42.117972 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:42.117636    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:31:42.117972 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:42.117700    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:31:42.738457 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:42.738423    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lkxb4" event={"ID":"eefcbb73-dab6-4344-abbd-c972ef1e5a9a","Type":"ContainerStarted","Data":"449bdaf6bbaa12bb9c08bfbcee5dd87c193c1727e2278564c4ac42b6342faf12"}
Jul 06 14:31:42.759938 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:42.759888    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lkxb4" podStartSLOduration=1.186116279 podStartE2EDuration="3.759872563s" totalImagesPullingTime="2.573756284s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:31:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:31:42.758589858 +0000 UTC m=+529.678870283" watchObservedRunningTime="2026-07-06 14:31:42.759872563 +0000 UTC m=+529.680152992"
Jul 06 14:31:43.402412 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:43.402368    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lkxb4"
Jul 06 14:31:43.408525 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:43.408494    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lkxb4"
Jul 06 14:31:43.743066 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:43.743026    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lkxb4"
Jul 06 14:31:43.743958 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:43.743940    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lkxb4"
Jul 06 14:31:43.817936 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:43.817893    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-2r49j"]
Jul 06 14:31:43.820719 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:43.820700    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-2r49j"
Jul 06 14:31:43.823729 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:43.823702    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-lkvjk\""
Jul 06 14:31:43.823729 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:43.823727    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 06 14:31:43.823901 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:43.823704    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 06 14:31:43.824426 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:43.824411    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 06 14:31:43.829753 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:43.829732    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-2r49j"]
Jul 06 14:31:43.833495 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:43.833477    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:31:43.917780 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:43.917749    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-2r49j"]
Jul 06 14:31:43.923857 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:43.923830    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:31:43.934756 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:43.934731    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/57dfb91c-8bfa-43df-8749-7fd46f453e17-config-file\") pod \"limitador-limitador-64c94fd64f-2r49j\" (UID: \"57dfb91c-8bfa-43df-8749-7fd46f453e17\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-2r49j"
Jul 06 14:31:43.934881 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:43.934849    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swpvt\" (UniqueName: \"kubernetes.io/projected/57dfb91c-8bfa-43df-8749-7fd46f453e17-kube-api-access-swpvt\") pod \"limitador-limitador-64c94fd64f-2r49j\" (UID: \"57dfb91c-8bfa-43df-8749-7fd46f453e17\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-2r49j"
Jul 06 14:31:43.987834 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:43.987793    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:31:44.036155 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:44.036060    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-swpvt\" (UniqueName: \"kubernetes.io/projected/57dfb91c-8bfa-43df-8749-7fd46f453e17-kube-api-access-swpvt\") pod \"limitador-limitador-64c94fd64f-2r49j\" (UID: \"57dfb91c-8bfa-43df-8749-7fd46f453e17\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-2r49j"
Jul 06 14:31:44.036155 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:44.036114    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/57dfb91c-8bfa-43df-8749-7fd46f453e17-config-file\") pod \"limitador-limitador-64c94fd64f-2r49j\" (UID: \"57dfb91c-8bfa-43df-8749-7fd46f453e17\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-2r49j"
Jul 06 14:31:44.036811 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:44.036790    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/57dfb91c-8bfa-43df-8749-7fd46f453e17-config-file\") pod \"limitador-limitador-64c94fd64f-2r49j\" (UID: \"57dfb91c-8bfa-43df-8749-7fd46f453e17\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-2r49j"
Jul 06 14:31:44.049345 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:44.049321    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-swpvt\" (UniqueName: \"kubernetes.io/projected/57dfb91c-8bfa-43df-8749-7fd46f453e17-kube-api-access-swpvt\") pod \"limitador-limitador-64c94fd64f-2r49j\" (UID: \"57dfb91c-8bfa-43df-8749-7fd46f453e17\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-2r49j"
Jul 06 14:31:44.132343 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:44.132304    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-2r49j"
Jul 06 14:31:44.281030 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:44.280990    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nkcvz"]
Jul 06 14:31:44.283590 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:44.283568    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-nkcvz"
Jul 06 14:31:44.293826 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:44.293792    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-2r49j"]
Jul 06 14:31:44.295583 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:44.295562    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nkcvz"]
Jul 06 14:31:44.296955 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:31:44.296931    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57dfb91c_8bfa_43df_8749_7fd46f453e17.slice/crio-292d1e4a8315565390e7188b61bb1407856315b0f557ce13d3b9a0e24454578f WatchSource:0}: Error finding container 292d1e4a8315565390e7188b61bb1407856315b0f557ce13d3b9a0e24454578f: Status 404 returned error can't find the container with id 292d1e4a8315565390e7188b61bb1407856315b0f557ce13d3b9a0e24454578f
Jul 06 14:31:44.329155 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:44.329123    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nkcvz"]
Jul 06 14:31:44.439489 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:44.439449    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/aaae66ed-43be-4fc9-8b35-77d7330476a6-config-file\") pod \"limitador-limitador-54d6d988d5-nkcvz\" (UID: \"aaae66ed-43be-4fc9-8b35-77d7330476a6\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-nkcvz"
Jul 06 14:31:44.439894 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:44.439514    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nwx74\" (UniqueName: \"kubernetes.io/projected/aaae66ed-43be-4fc9-8b35-77d7330476a6-kube-api-access-nwx74\") pod \"limitador-limitador-54d6d988d5-nkcvz\" (UID: \"aaae66ed-43be-4fc9-8b35-77d7330476a6\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-nkcvz"
Jul 06 14:31:44.540995 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:44.540907    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/aaae66ed-43be-4fc9-8b35-77d7330476a6-config-file\") pod \"limitador-limitador-54d6d988d5-nkcvz\" (UID: \"aaae66ed-43be-4fc9-8b35-77d7330476a6\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-nkcvz"
Jul 06 14:31:44.540995 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:44.540952    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nwx74\" (UniqueName: \"kubernetes.io/projected/aaae66ed-43be-4fc9-8b35-77d7330476a6-kube-api-access-nwx74\") pod \"limitador-limitador-54d6d988d5-nkcvz\" (UID: \"aaae66ed-43be-4fc9-8b35-77d7330476a6\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-nkcvz"
Jul 06 14:31:44.541540 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:44.541518    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/aaae66ed-43be-4fc9-8b35-77d7330476a6-config-file\") pod \"limitador-limitador-54d6d988d5-nkcvz\" (UID: \"aaae66ed-43be-4fc9-8b35-77d7330476a6\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-nkcvz"
Jul 06 14:31:44.554721 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:44.554685    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nwx74\" (UniqueName: \"kubernetes.io/projected/aaae66ed-43be-4fc9-8b35-77d7330476a6-kube-api-access-nwx74\") pod \"limitador-limitador-54d6d988d5-nkcvz\" (UID: \"aaae66ed-43be-4fc9-8b35-77d7330476a6\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-nkcvz"
Jul 06 14:31:44.594826 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:44.594781    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-nkcvz"
Jul 06 14:31:44.727165 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:44.727037    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nkcvz"]
Jul 06 14:31:44.731765 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:31:44.731536    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaaae66ed_43be_4fc9_8b35_77d7330476a6.slice/crio-bde45f091439a8b1120f9dd849b0db5a856f984d4fd9314f93ddf59d15ecb5e7 WatchSource:0}: Error finding container bde45f091439a8b1120f9dd849b0db5a856f984d4fd9314f93ddf59d15ecb5e7: Status 404 returned error can't find the container with id bde45f091439a8b1120f9dd849b0db5a856f984d4fd9314f93ddf59d15ecb5e7
Jul 06 14:31:44.748328 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:44.748297    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-nkcvz" event={"ID":"aaae66ed-43be-4fc9-8b35-77d7330476a6","Type":"ContainerStarted","Data":"bde45f091439a8b1120f9dd849b0db5a856f984d4fd9314f93ddf59d15ecb5e7"}
Jul 06 14:31:44.749572 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:44.749546    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-2r49j" event={"ID":"57dfb91c-8bfa-43df-8749-7fd46f453e17","Type":"ContainerStarted","Data":"292d1e4a8315565390e7188b61bb1407856315b0f557ce13d3b9a0e24454578f"}
Jul 06 14:31:44.776760 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:44.776730    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:31:44.910922 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:44.910895    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:31:47.767851 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:47.767803    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-nkcvz" event={"ID":"aaae66ed-43be-4fc9-8b35-77d7330476a6","Type":"ContainerStarted","Data":"256c2662466ffee9cfaf619dfabb7c46aef6a008a1fee8ad1977e606bfcb4403"}
Jul 06 14:31:47.768276 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:47.767886    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-nkcvz"
Jul 06 14:31:47.769325 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:47.769300    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-2r49j" event={"ID":"57dfb91c-8bfa-43df-8749-7fd46f453e17","Type":"ContainerStarted","Data":"6cf4bac3426575dfad9a3abf49b96d7e1e8d410dc347c6c4f1015feaec8289a4"}
Jul 06 14:31:47.769433 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:47.769422    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-2r49j"
Jul 06 14:31:47.787109 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:47.786768    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-nkcvz" podStartSLOduration=1.292334697 podStartE2EDuration="3.786751872s" totalImagesPullingTime="2.494417175s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:31:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:31:47.786375146 +0000 UTC m=+534.706655576" watchObservedRunningTime="2026-07-06 14:31:47.786751872 +0000 UTC m=+534.707032302"
Jul 06 14:31:47.804962 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:47.804908    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-2r49j" podStartSLOduration=1.879891073 podStartE2EDuration="4.804892009s" totalImagesPullingTime="2.925000936s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:31:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:31:47.802908181 +0000 UTC m=+534.723188611" watchObservedRunningTime="2026-07-06 14:31:47.804892009 +0000 UTC m=+534.725172439"
Jul 06 14:31:58.775520 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:58.775486    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-2r49j"
Jul 06 14:31:58.775967 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:58.775556    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-nkcvz"
Jul 06 14:31:58.838123 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:58.838088    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-2r49j"]
Jul 06 14:31:58.838312 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:58.838267    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-2r49j" podUID="57dfb91c-8bfa-43df-8749-7fd46f453e17" containerName="limitador" containerID="cri-o://6cf4bac3426575dfad9a3abf49b96d7e1e8d410dc347c6c4f1015feaec8289a4" gracePeriod=30
Jul 06 14:31:59.375070 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:59.375037    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-2r49j"
Jul 06 14:31:59.468207 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:59.468169    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/57dfb91c-8bfa-43df-8749-7fd46f453e17-config-file\") pod \"57dfb91c-8bfa-43df-8749-7fd46f453e17\" (UID: \"57dfb91c-8bfa-43df-8749-7fd46f453e17\") "
Jul 06 14:31:59.468602 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:59.468227    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-swpvt\" (UniqueName: \"kubernetes.io/projected/57dfb91c-8bfa-43df-8749-7fd46f453e17-kube-api-access-swpvt\") pod \"57dfb91c-8bfa-43df-8749-7fd46f453e17\" (UID: \"57dfb91c-8bfa-43df-8749-7fd46f453e17\") "
Jul 06 14:31:59.468602 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:59.468538    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/57dfb91c-8bfa-43df-8749-7fd46f453e17-config-file" (OuterVolumeSpecName: "config-file") pod "57dfb91c-8bfa-43df-8749-7fd46f453e17" (UID: "57dfb91c-8bfa-43df-8749-7fd46f453e17"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:31:59.470263 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:59.470238    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57dfb91c-8bfa-43df-8749-7fd46f453e17-kube-api-access-swpvt" (OuterVolumeSpecName: "kube-api-access-swpvt") pod "57dfb91c-8bfa-43df-8749-7fd46f453e17" (UID: "57dfb91c-8bfa-43df-8749-7fd46f453e17"). InnerVolumeSpecName "kube-api-access-swpvt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:31:59.568800 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:59.568766    2582 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/57dfb91c-8bfa-43df-8749-7fd46f453e17-config-file\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Jul 06 14:31:59.568800 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:59.568794    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-swpvt\" (UniqueName: \"kubernetes.io/projected/57dfb91c-8bfa-43df-8749-7fd46f453e17-kube-api-access-swpvt\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Jul 06 14:31:59.822746 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:59.822637    2582 generic.go:356] "Generic (PLEG): container finished" podID="57dfb91c-8bfa-43df-8749-7fd46f453e17" containerID="6cf4bac3426575dfad9a3abf49b96d7e1e8d410dc347c6c4f1015feaec8289a4" exitCode=0
Jul 06 14:31:59.822746 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:59.822695    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-2r49j"
Jul 06 14:31:59.822746 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:59.822728    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-2r49j" event={"ID":"57dfb91c-8bfa-43df-8749-7fd46f453e17","Type":"ContainerDied","Data":"6cf4bac3426575dfad9a3abf49b96d7e1e8d410dc347c6c4f1015feaec8289a4"}
Jul 06 14:31:59.823201 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:59.822778    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-2r49j" event={"ID":"57dfb91c-8bfa-43df-8749-7fd46f453e17","Type":"ContainerDied","Data":"292d1e4a8315565390e7188b61bb1407856315b0f557ce13d3b9a0e24454578f"}
Jul 06 14:31:59.823201 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:59.822800    2582 scope.go:117] "RemoveContainer" containerID="6cf4bac3426575dfad9a3abf49b96d7e1e8d410dc347c6c4f1015feaec8289a4"
Jul 06 14:31:59.830766 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:59.830733    2582 scope.go:117] "RemoveContainer" containerID="6cf4bac3426575dfad9a3abf49b96d7e1e8d410dc347c6c4f1015feaec8289a4"
Jul 06 14:31:59.831012 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:31:59.830994    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6cf4bac3426575dfad9a3abf49b96d7e1e8d410dc347c6c4f1015feaec8289a4\": container with ID starting with 6cf4bac3426575dfad9a3abf49b96d7e1e8d410dc347c6c4f1015feaec8289a4 not found: ID does not exist" containerID="6cf4bac3426575dfad9a3abf49b96d7e1e8d410dc347c6c4f1015feaec8289a4"
Jul 06 14:31:59.831056 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:59.831024    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6cf4bac3426575dfad9a3abf49b96d7e1e8d410dc347c6c4f1015feaec8289a4"} err="failed to get container status \"6cf4bac3426575dfad9a3abf49b96d7e1e8d410dc347c6c4f1015feaec8289a4\": rpc error: code = NotFound desc = could not find container \"6cf4bac3426575dfad9a3abf49b96d7e1e8d410dc347c6c4f1015feaec8289a4\": container with ID starting with 6cf4bac3426575dfad9a3abf49b96d7e1e8d410dc347c6c4f1015feaec8289a4 not found: ID does not exist"
Jul 06 14:31:59.842337 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:59.842307    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-2r49j"]
Jul 06 14:31:59.846669 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:31:59.846637    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-2r49j"]
Jul 06 14:32:01.498459 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:32:01.498415    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="57dfb91c-8bfa-43df-8749-7fd46f453e17" path="/var/lib/kubelet/pods/57dfb91c-8bfa-43df-8749-7fd46f453e17/volumes"
Jul 06 14:32:05.355800 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:32:05.355769    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-w88fb"]
Jul 06 14:32:05.356200 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:32:05.356069    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57dfb91c-8bfa-43df-8749-7fd46f453e17" containerName="limitador"
Jul 06 14:32:05.356200 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:32:05.356082    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="57dfb91c-8bfa-43df-8749-7fd46f453e17" containerName="limitador"
Jul 06 14:32:05.356200 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:32:05.356137    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="57dfb91c-8bfa-43df-8749-7fd46f453e17" containerName="limitador"
Jul 06 14:32:05.358519 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:32:05.358500    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-w88fb"
Jul 06 14:32:05.361235 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:32:05.361210    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\""
Jul 06 14:32:05.366475 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:32:05.366453    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-l22ww\""
Jul 06 14:32:05.367353 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:32:05.367333    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-w88fb"]
Jul 06 14:32:05.404111 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:32:05.404068    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:32:05.412056 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:32:05.412031    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/157b4d97-1f8b-41a9-a1e8-e463e08aed0a-data\") pod \"postgres-69fb4594cf-w88fb\" (UID: \"157b4d97-1f8b-41a9-a1e8-e463e08aed0a\") " pod="opendatahub/postgres-69fb4594cf-w88fb"
Jul 06 14:32:05.412180 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:32:05.412077    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7nc8\" (UniqueName: \"kubernetes.io/projected/157b4d97-1f8b-41a9-a1e8-e463e08aed0a-kube-api-access-x7nc8\") pod \"postgres-69fb4594cf-w88fb\" (UID: \"157b4d97-1f8b-41a9-a1e8-e463e08aed0a\") " pod="opendatahub/postgres-69fb4594cf-w88fb"
Jul 06 14:32:05.512884 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:32:05.512846    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/157b4d97-1f8b-41a9-a1e8-e463e08aed0a-data\") pod \"postgres-69fb4594cf-w88fb\" (UID: \"157b4d97-1f8b-41a9-a1e8-e463e08aed0a\") " pod="opendatahub/postgres-69fb4594cf-w88fb"
Jul 06 14:32:05.513029 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:32:05.512897    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7nc8\" (UniqueName: \"kubernetes.io/projected/157b4d97-1f8b-41a9-a1e8-e463e08aed0a-kube-api-access-x7nc8\") pod \"postgres-69fb4594cf-w88fb\" (UID: \"157b4d97-1f8b-41a9-a1e8-e463e08aed0a\") " pod="opendatahub/postgres-69fb4594cf-w88fb"
Jul 06 14:32:05.513219 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:32:05.513202    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/157b4d97-1f8b-41a9-a1e8-e463e08aed0a-data\") pod \"postgres-69fb4594cf-w88fb\" (UID: \"157b4d97-1f8b-41a9-a1e8-e463e08aed0a\") " pod="opendatahub/postgres-69fb4594cf-w88fb"
Jul 06 14:32:05.523233 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:32:05.523206    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7nc8\" (UniqueName: \"kubernetes.io/projected/157b4d97-1f8b-41a9-a1e8-e463e08aed0a-kube-api-access-x7nc8\") pod \"postgres-69fb4594cf-w88fb\" (UID: \"157b4d97-1f8b-41a9-a1e8-e463e08aed0a\") " pod="opendatahub/postgres-69fb4594cf-w88fb"
Jul 06 14:32:05.670401 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:32:05.670358    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-w88fb"
Jul 06 14:32:05.818130 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:32:05.818098    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-w88fb"]
Jul 06 14:32:05.821820 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:32:05.821792    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod157b4d97_1f8b_41a9_a1e8_e463e08aed0a.slice/crio-2d2a961cfb578b05c0de6975eee5f1c62236637479367a5007c4af73692ab276 WatchSource:0}: Error finding container 2d2a961cfb578b05c0de6975eee5f1c62236637479367a5007c4af73692ab276: Status 404 returned error can't find the container with id 2d2a961cfb578b05c0de6975eee5f1c62236637479367a5007c4af73692ab276
Jul 06 14:32:05.848899 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:32:05.848862    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-w88fb" event={"ID":"157b4d97-1f8b-41a9-a1e8-e463e08aed0a","Type":"ContainerStarted","Data":"2d2a961cfb578b05c0de6975eee5f1c62236637479367a5007c4af73692ab276"}
Jul 06 14:32:10.878593 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:32:10.878499    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-w88fb" event={"ID":"157b4d97-1f8b-41a9-a1e8-e463e08aed0a","Type":"ContainerStarted","Data":"02289b919d93f8fd7101ef17fb67b929353bb1fa763d82ec049385eecc35f69c"}
Jul 06 14:32:10.879029 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:32:10.878594    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-w88fb"
Jul 06 14:32:10.895780 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:32:10.895723    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-w88fb" podStartSLOduration=1.165598771 podStartE2EDuration="5.895707045s" totalImagesPullingTime="4.730108274s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:32:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:32:10.894545165 +0000 UTC m=+557.814825595" watchObservedRunningTime="2026-07-06 14:32:10.895707045 +0000 UTC m=+557.815987474"
Jul 06 14:32:16.911608 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:32:16.911575    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-w88fb"
Jul 06 14:32:17.217064 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:32:17.216976    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:32:17.458066 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:32:17.458029    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:32:17.869393 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:32:17.869361    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5856d58fcb-5lgwf"]
Jul 06 14:32:17.873834 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:32:17.873814    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5856d58fcb-5lgwf"
Jul 06 14:32:17.879415 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:32:17.879389    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-sfc8j\""
Jul 06 14:32:17.879571 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:32:17.879494    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 06 14:32:17.881744 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:32:17.881710    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5856d58fcb-5lgwf"]
Jul 06 14:32:17.921812 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:32:17.921778    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xwxz\" (UniqueName: \"kubernetes.io/projected/1b31891a-25cf-4412-a77b-f2719106afe4-kube-api-access-6xwxz\") pod \"authorino-5856d58fcb-5lgwf\" (UID: \"1b31891a-25cf-4412-a77b-f2719106afe4\") " pod="kuadrant-system/authorino-5856d58fcb-5lgwf"
Jul 06 14:32:17.921812 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:32:17.921817    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1b31891a-25cf-4412-a77b-f2719106afe4-tls-cert\") pod \"authorino-5856d58fcb-5lgwf\" (UID: \"1b31891a-25cf-4412-a77b-f2719106afe4\") " pod="kuadrant-system/authorino-5856d58fcb-5lgwf"
Jul 06 14:32:18.022715 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:32:18.022649    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6xwxz\" (UniqueName: \"kubernetes.io/projected/1b31891a-25cf-4412-a77b-f2719106afe4-kube-api-access-6xwxz\") pod \"authorino-5856d58fcb-5lgwf\" (UID: \"1b31891a-25cf-4412-a77b-f2719106afe4\") " pod="kuadrant-system/authorino-5856d58fcb-5lgwf"
Jul 06 14:32:18.022900 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:32:18.022730    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1b31891a-25cf-4412-a77b-f2719106afe4-tls-cert\") pod \"authorino-5856d58fcb-5lgwf\" (UID: \"1b31891a-25cf-4412-a77b-f2719106afe4\") " pod="kuadrant-system/authorino-5856d58fcb-5lgwf"
Jul 06 14:32:18.025177 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:32:18.025159    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1b31891a-25cf-4412-a77b-f2719106afe4-tls-cert\") pod \"authorino-5856d58fcb-5lgwf\" (UID: \"1b31891a-25cf-4412-a77b-f2719106afe4\") " pod="kuadrant-system/authorino-5856d58fcb-5lgwf"
Jul 06 14:32:18.034945 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:32:18.034919    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xwxz\" (UniqueName: \"kubernetes.io/projected/1b31891a-25cf-4412-a77b-f2719106afe4-kube-api-access-6xwxz\") pod \"authorino-5856d58fcb-5lgwf\" (UID: \"1b31891a-25cf-4412-a77b-f2719106afe4\") " pod="kuadrant-system/authorino-5856d58fcb-5lgwf"
Jul 06 14:32:18.183609 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:32:18.183579    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5856d58fcb-5lgwf"
Jul 06 14:32:18.314552 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:32:18.314528    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5856d58fcb-5lgwf"]
Jul 06 14:32:18.316098 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:32:18.316072    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1b31891a_25cf_4412_a77b_f2719106afe4.slice/crio-b7cda16a8fe1fc5158ed3db03b015a0d1be19b43350e7380cb72801cb1fb9466 WatchSource:0}: Error finding container b7cda16a8fe1fc5158ed3db03b015a0d1be19b43350e7380cb72801cb1fb9466: Status 404 returned error can't find the container with id b7cda16a8fe1fc5158ed3db03b015a0d1be19b43350e7380cb72801cb1fb9466
Jul 06 14:32:18.915350 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:32:18.915310    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5856d58fcb-5lgwf" event={"ID":"1b31891a-25cf-4412-a77b-f2719106afe4","Type":"ContainerStarted","Data":"b7cda16a8fe1fc5158ed3db03b015a0d1be19b43350e7380cb72801cb1fb9466"}
Jul 06 14:32:21.929799 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:32:21.929768    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5856d58fcb-5lgwf" event={"ID":"1b31891a-25cf-4412-a77b-f2719106afe4","Type":"ContainerStarted","Data":"1b48257df05ca0cdc7b2d90e9ebae429014a323932bfdb17fe7a806f2f565848"}
Jul 06 14:32:21.946189 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:32:21.946140    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5856d58fcb-5lgwf" podStartSLOduration=1.9462370789999999 podStartE2EDuration="4.946124442s" totalImagesPullingTime="2.999887363s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:32:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:32:21.943934442 +0000 UTC m=+568.864214872" watchObservedRunningTime="2026-07-06 14:32:21.946124442 +0000 UTC m=+568.866404870"
Jul 06 14:32:26.160031 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:32:26.159999    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:32:26.258578 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:32:26.258541    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:32:26.336496 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:32:26.336456    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:32:26.545239 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:32:26.545143    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:32:29.241946 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:32:29.241901    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:32:29.334791 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:32:29.334761    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:33:02.344931 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:33:02.344900    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:33:02.855811 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:33:02.855781    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:33:03.003265 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:33:03.003229    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:33:03.335973 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:33:03.335930    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:33:03.427517 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:33:03.427487    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:33:03.448312 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:33:03.448282    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-k7dkq"]
Jul 06 14:33:03.452815 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:33:03.452795    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-k7dkq"
Jul 06 14:33:03.455995 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:33:03.455975    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-84c4w\""
Jul 06 14:33:03.456074 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:33:03.455977    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 06 14:33:03.463121 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:33:03.463095    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-k7dkq"]
Jul 06 14:33:03.510043 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:33:03.510002    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fadfc4ff-b375-4673-a9eb-431bcb0b8fb3-plugins-config-volume\") pod \"payload-processing-58f86c7798-k7dkq\" (UID: \"fadfc4ff-b375-4673-a9eb-431bcb0b8fb3\") " pod="openshift-ingress/payload-processing-58f86c7798-k7dkq"
Jul 06 14:33:03.510284 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:33:03.510250    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hczqh\" (UniqueName: \"kubernetes.io/projected/fadfc4ff-b375-4673-a9eb-431bcb0b8fb3-kube-api-access-hczqh\") pod \"payload-processing-58f86c7798-k7dkq\" (UID: \"fadfc4ff-b375-4673-a9eb-431bcb0b8fb3\") " pod="openshift-ingress/payload-processing-58f86c7798-k7dkq"
Jul 06 14:33:03.535600 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:33:03.535562    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nkcvz"]
Jul 06 14:33:03.610920 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:33:03.610831    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fadfc4ff-b375-4673-a9eb-431bcb0b8fb3-plugins-config-volume\") pod \"payload-processing-58f86c7798-k7dkq\" (UID: \"fadfc4ff-b375-4673-a9eb-431bcb0b8fb3\") " pod="openshift-ingress/payload-processing-58f86c7798-k7dkq"
Jul 06 14:33:03.610920 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:33:03.610906    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hczqh\" (UniqueName: \"kubernetes.io/projected/fadfc4ff-b375-4673-a9eb-431bcb0b8fb3-kube-api-access-hczqh\") pod \"payload-processing-58f86c7798-k7dkq\" (UID: \"fadfc4ff-b375-4673-a9eb-431bcb0b8fb3\") " pod="openshift-ingress/payload-processing-58f86c7798-k7dkq"
Jul 06 14:33:03.611735 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:33:03.611704    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fadfc4ff-b375-4673-a9eb-431bcb0b8fb3-plugins-config-volume\") pod \"payload-processing-58f86c7798-k7dkq\" (UID: \"fadfc4ff-b375-4673-a9eb-431bcb0b8fb3\") " pod="openshift-ingress/payload-processing-58f86c7798-k7dkq"
Jul 06 14:33:03.622417 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:33:03.622382    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hczqh\" (UniqueName: \"kubernetes.io/projected/fadfc4ff-b375-4673-a9eb-431bcb0b8fb3-kube-api-access-hczqh\") pod \"payload-processing-58f86c7798-k7dkq\" (UID: \"fadfc4ff-b375-4673-a9eb-431bcb0b8fb3\") " pod="openshift-ingress/payload-processing-58f86c7798-k7dkq"
Jul 06 14:33:03.764522 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:33:03.764488    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-k7dkq"
Jul 06 14:33:03.896399 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:33:03.896348    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-k7dkq"]
Jul 06 14:33:03.899142 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:33:03.899110    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfadfc4ff_b375_4673_a9eb_431bcb0b8fb3.slice/crio-4ed864d6b0e83f53be8e81173a19fd35001684578704b3973b182925acca2051 WatchSource:0}: Error finding container 4ed864d6b0e83f53be8e81173a19fd35001684578704b3973b182925acca2051: Status 404 returned error can't find the container with id 4ed864d6b0e83f53be8e81173a19fd35001684578704b3973b182925acca2051
Jul 06 14:33:04.108757 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:33:04.108716    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-k7dkq" event={"ID":"fadfc4ff-b375-4673-a9eb-431bcb0b8fb3","Type":"ContainerStarted","Data":"4ed864d6b0e83f53be8e81173a19fd35001684578704b3973b182925acca2051"}
Jul 06 14:33:06.118530 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:33:06.118494    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-k7dkq" event={"ID":"fadfc4ff-b375-4673-a9eb-431bcb0b8fb3","Type":"ContainerStarted","Data":"2fac1f29d3b50af070392dd83ae1c7853a60f636e0f5c12122f179a2a8bc6f8f"}
Jul 06 14:33:06.119008 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:33:06.118617    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58f86c7798-k7dkq"
Jul 06 14:33:10.637187 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:33:10.637151    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:33:10.714542 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:33:10.714487    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:33:11.153590 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:33:11.153501    2582 generic.go:356] "Generic (PLEG): container finished" podID="eefcbb73-dab6-4344-abbd-c972ef1e5a9a" containerID="449bdaf6bbaa12bb9c08bfbcee5dd87c193c1727e2278564c4ac42b6342faf12" exitCode=0
Jul 06 14:33:11.153590 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:33:11.153565    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lkxb4" event={"ID":"eefcbb73-dab6-4344-abbd-c972ef1e5a9a","Type":"ContainerDied","Data":"449bdaf6bbaa12bb9c08bfbcee5dd87c193c1727e2278564c4ac42b6342faf12"}
Jul 06 14:33:11.153993 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:33:11.153980    2582 scope.go:117] "RemoveContainer" containerID="449bdaf6bbaa12bb9c08bfbcee5dd87c193c1727e2278564c4ac42b6342faf12"
Jul 06 14:33:11.155099 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:33:11.155070    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:33:11.155167 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:33:11.155154    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:33:11.155207 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:33:11.155185    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:33:11.177386 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:33:11.177333    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58f86c7798-k7dkq" podStartSLOduration=6.666537789 podStartE2EDuration="8.177315972s" totalImagesPullingTime="1.510778183s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:33:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:33:06.136892544 +0000 UTC m=+613.057172976" watchObservedRunningTime="2026-07-06 14:33:11.177315972 +0000 UTC m=+618.097596401"
Jul 06 14:33:12.159341 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:33:12.159306    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lkxb4" event={"ID":"eefcbb73-dab6-4344-abbd-c972ef1e5a9a","Type":"ContainerStarted","Data":"29681e9955dd080808d9b34c307dba034f7b2e00ea9b0bf9b9727118ee450378"}
Jul 06 14:33:12.402331 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:33:12.402297    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lkxb4"
Jul 06 14:33:12.403332 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:33:12.403305    2582 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-lkxb4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.25:15021/healthz/ready\": dial tcp 10.133.0.25:15021: connect: connection refused" start-of-body=
Jul 06 14:33:12.403455 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:33:12.403355    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lkxb4" podUID="eefcbb73-dab6-4344-abbd-c972ef1e5a9a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.25:15021/healthz/ready\": dial tcp 10.133.0.25:15021: connect: connection refused"
Jul 06 14:33:12.629243 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:33:12.629147    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:33:12.731556 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:33:12.731514    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:33:13.402541 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:33:13.402502    2582 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-lkxb4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.25:15021/healthz/ready\": dial tcp 10.133.0.25:15021: connect: connection refused" start-of-body=
Jul 06 14:33:13.402998 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:33:13.402555    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lkxb4" podUID="eefcbb73-dab6-4344-abbd-c972ef1e5a9a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.25:15021/healthz/ready\": dial tcp 10.133.0.25:15021: connect: connection refused"
Jul 06 14:33:13.743525 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:33:13.743475    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lkxb4"
Jul 06 14:33:14.402426 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:33:14.402384    2582 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-lkxb4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.25:15021/healthz/ready\": dial tcp 10.133.0.25:15021: connect: connection refused" start-of-body=
Jul 06 14:33:14.402602 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:33:14.402442    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lkxb4" podUID="eefcbb73-dab6-4344-abbd-c972ef1e5a9a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.25:15021/healthz/ready\": dial tcp 10.133.0.25:15021: connect: connection refused"
Jul 06 14:33:15.402632 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:33:15.402554    2582 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-lkxb4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.25:15021/healthz/ready\": dial tcp 10.133.0.25:15021: connect: connection refused" start-of-body=
Jul 06 14:33:15.402632 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:33:15.402608    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lkxb4" podUID="eefcbb73-dab6-4344-abbd-c972ef1e5a9a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.25:15021/healthz/ready\": dial tcp 10.133.0.25:15021: connect: connection refused"
Jul 06 14:33:16.405777 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:33:16.405747    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lkxb4"
Jul 06 14:33:16.406884 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:33:16.406862    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lkxb4"
Jul 06 14:33:17.125243 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:33:17.125215    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58f86c7798-k7dkq"
Jul 06 14:33:27.384762 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:33:27.384727    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:33:27.820255 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:33:27.820218    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nkcvz"]
Jul 06 14:33:35.466177 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:33:35.466139    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:33:36.240923 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:33:36.240887    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nkcvz"]
Jul 06 14:33:38.538801 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:33:38.538760    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-ptfrh"]
Jul 06 14:33:38.544846 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:33:38.544814    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ptfrh"
Jul 06 14:33:38.545321 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:33:38.545292    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/39f2a134-38e0-4d12-a2e0-9e40af629763-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ptfrh\" (UID: \"39f2a134-38e0-4d12-a2e0-9e40af629763\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ptfrh"
Jul 06 14:33:38.545451 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:33:38.545345    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/39f2a134-38e0-4d12-a2e0-9e40af629763-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ptfrh\" (UID: \"39f2a134-38e0-4d12-a2e0-9e40af629763\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ptfrh"
Jul 06 14:33:38.545451 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:33:38.545387    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/39f2a134-38e0-4d12-a2e0-9e40af629763-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ptfrh\" (UID: \"39f2a134-38e0-4d12-a2e0-9e40af629763\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ptfrh"
Jul 06 14:33:38.545451 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:33:38.545416    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/39f2a134-38e0-4d12-a2e0-9e40af629763-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ptfrh\" (UID: \"39f2a134-38e0-4d12-a2e0-9e40af629763\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ptfrh"
Jul 06 14:33:38.545569 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:33:38.545467    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9vf5n\" (UniqueName: \"kubernetes.io/projected/39f2a134-38e0-4d12-a2e0-9e40af629763-kube-api-access-9vf5n\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ptfrh\" (UID: \"39f2a134-38e0-4d12-a2e0-9e40af629763\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ptfrh"
Jul 06 14:33:38.545569 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:33:38.545503    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/39f2a134-38e0-4d12-a2e0-9e40af629763-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ptfrh\" (UID: \"39f2a134-38e0-4d12-a2e0-9e40af629763\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ptfrh"
Jul 06 14:33:38.548250 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:33:38.548216    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 06 14:33:38.548250 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:33:38.548238    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-d45hj\""
Jul 06 14:33:38.548419 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:33:38.548252    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 06 14:33:38.548419 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:33:38.548242    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 06 14:33:38.552748 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:33:38.552717    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-ptfrh"]
Jul 06 14:33:38.632837 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:33:38.632797    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:33:38.646687 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:33:38.646644    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/39f2a134-38e0-4d12-a2e0-9e40af629763-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ptfrh\" (UID: \"39f2a134-38e0-4d12-a2e0-9e40af629763\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ptfrh"
Jul 06 14:33:38.646687 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:33:38.646690    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/39f2a134-38e0-4d12-a2e0-9e40af629763-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ptfrh\" (UID: \"39f2a134-38e0-4d12-a2e0-9e40af629763\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ptfrh"
Jul 06 14:33:38.646933 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:33:38.646718    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9vf5n\" (UniqueName: \"kubernetes.io/projected/39f2a134-38e0-4d12-a2e0-9e40af629763-kube-api-access-9vf5n\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ptfrh\" (UID: \"39f2a134-38e0-4d12-a2e0-9e40af629763\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ptfrh"
Jul 06 14:33:38.646933 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:33:38.646739    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/39f2a134-38e0-4d12-a2e0-9e40af629763-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ptfrh\" (UID: \"39f2a134-38e0-4d12-a2e0-9e40af629763\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ptfrh"
Jul 06 14:33:38.646933 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:33:38.646766    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/39f2a134-38e0-4d12-a2e0-9e40af629763-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ptfrh\" (UID: \"39f2a134-38e0-4d12-a2e0-9e40af629763\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ptfrh"
Jul 06 14:33:38.646933 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:33:38.646792    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/39f2a134-38e0-4d12-a2e0-9e40af629763-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ptfrh\" (UID: \"39f2a134-38e0-4d12-a2e0-9e40af629763\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ptfrh"
Jul 06 14:33:38.647140 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:33:38.647034    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/39f2a134-38e0-4d12-a2e0-9e40af629763-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ptfrh\" (UID: \"39f2a134-38e0-4d12-a2e0-9e40af629763\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ptfrh"
Jul 06 14:33:38.647140 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:33:38.647090    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/39f2a134-38e0-4d12-a2e0-9e40af629763-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ptfrh\" (UID: \"39f2a134-38e0-4d12-a2e0-9e40af629763\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ptfrh"
Jul 06 14:33:38.647233 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:33:38.647153    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/39f2a134-38e0-4d12-a2e0-9e40af629763-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ptfrh\" (UID: \"39f2a134-38e0-4d12-a2e0-9e40af629763\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ptfrh"
Jul 06 14:33:38.648967 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:33:38.648946    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/39f2a134-38e0-4d12-a2e0-9e40af629763-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ptfrh\" (UID: \"39f2a134-38e0-4d12-a2e0-9e40af629763\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ptfrh"
Jul 06 14:33:38.649210 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:33:38.649195    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/39f2a134-38e0-4d12-a2e0-9e40af629763-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ptfrh\" (UID: \"39f2a134-38e0-4d12-a2e0-9e40af629763\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ptfrh"
Jul 06 14:33:38.655339 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:33:38.655320    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9vf5n\" (UniqueName: \"kubernetes.io/projected/39f2a134-38e0-4d12-a2e0-9e40af629763-kube-api-access-9vf5n\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ptfrh\" (UID: \"39f2a134-38e0-4d12-a2e0-9e40af629763\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ptfrh"
Jul 06 14:33:38.856871 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:33:38.856782    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ptfrh"
Jul 06 14:33:38.991006 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:33:38.990884    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-ptfrh"]
Jul 06 14:33:38.993571 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:33:38.993547    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39f2a134_38e0_4d12_a2e0_9e40af629763.slice/crio-ded44a94a4b15444fa00cf913f4f89fd01023478280eb22d102a5da9cc186c4b WatchSource:0}: Error finding container ded44a94a4b15444fa00cf913f4f89fd01023478280eb22d102a5da9cc186c4b: Status 404 returned error can't find the container with id ded44a94a4b15444fa00cf913f4f89fd01023478280eb22d102a5da9cc186c4b
Jul 06 14:33:39.275469 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:33:39.275424    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ptfrh" event={"ID":"39f2a134-38e0-4d12-a2e0-9e40af629763","Type":"ContainerStarted","Data":"ded44a94a4b15444fa00cf913f4f89fd01023478280eb22d102a5da9cc186c4b"}
Jul 06 14:33:39.451619 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:33:39.451573    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nkcvz"]
Jul 06 14:33:40.282267 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:33:40.282232    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ptfrh" event={"ID":"39f2a134-38e0-4d12-a2e0-9e40af629763","Type":"ContainerStarted","Data":"808886e490a44c5573abef61efb7dc59e05c37c5d11cb7ca75af63637073096b"}
Jul 06 14:33:40.300380 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:33:40.300330    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ptfrh" podStartSLOduration=1.157127614 podStartE2EDuration="2.300314389s" totalImagesPullingTime="1.143186775s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:33:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:33:40.299633541 +0000 UTC m=+647.219913971" watchObservedRunningTime="2026-07-06 14:33:40.300314389 +0000 UTC m=+647.220594818"
Jul 06 14:33:44.471317 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:33:44.471282    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:33:45.943238 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:33:45.943203    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nkcvz"]
Jul 06 14:33:48.857372 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:33:48.857339    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ptfrh"
Jul 06 14:33:48.857783 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:33:48.857421    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ptfrh"
Jul 06 14:33:48.870033 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:33:48.870005    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ptfrh"
Jul 06 14:33:49.335599 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:33:49.335571    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ptfrh"
Jul 06 14:34:02.237193 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:34:02.237155    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-hvwvr"]
Jul 06 14:34:02.240820 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:34:02.240789    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hvwvr"
Jul 06 14:34:02.243365 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:34:02.243346    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 06 14:34:02.248523 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:34:02.248502    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-hvwvr"]
Jul 06 14:34:02.268869 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:34:02.268829    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:34:02.362523 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:34:02.362482    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9177faec-dfee-428d-99b0-4a4c531eaaa7-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hvwvr\" (UID: \"9177faec-dfee-428d-99b0-4a4c531eaaa7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hvwvr"
Jul 06 14:34:02.362523 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:34:02.362525    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9177faec-dfee-428d-99b0-4a4c531eaaa7-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hvwvr\" (UID: \"9177faec-dfee-428d-99b0-4a4c531eaaa7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hvwvr"
Jul 06 14:34:02.362810 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:34:02.362562    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9177faec-dfee-428d-99b0-4a4c531eaaa7-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hvwvr\" (UID: \"9177faec-dfee-428d-99b0-4a4c531eaaa7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hvwvr"
Jul 06 14:34:02.362810 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:34:02.362591    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9177faec-dfee-428d-99b0-4a4c531eaaa7-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hvwvr\" (UID: \"9177faec-dfee-428d-99b0-4a4c531eaaa7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hvwvr"
Jul 06 14:34:02.362810 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:34:02.362728    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwhpg\" (UniqueName: \"kubernetes.io/projected/9177faec-dfee-428d-99b0-4a4c531eaaa7-kube-api-access-gwhpg\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hvwvr\" (UID: \"9177faec-dfee-428d-99b0-4a4c531eaaa7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hvwvr"
Jul 06 14:34:02.362810 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:34:02.362777    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9177faec-dfee-428d-99b0-4a4c531eaaa7-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hvwvr\" (UID: \"9177faec-dfee-428d-99b0-4a4c531eaaa7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hvwvr"
Jul 06 14:34:02.463784 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:34:02.463739    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9177faec-dfee-428d-99b0-4a4c531eaaa7-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hvwvr\" (UID: \"9177faec-dfee-428d-99b0-4a4c531eaaa7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hvwvr"
Jul 06 14:34:02.463784 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:34:02.463786    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9177faec-dfee-428d-99b0-4a4c531eaaa7-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hvwvr\" (UID: \"9177faec-dfee-428d-99b0-4a4c531eaaa7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hvwvr"
Jul 06 14:34:02.464053 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:34:02.463824    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9177faec-dfee-428d-99b0-4a4c531eaaa7-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hvwvr\" (UID: \"9177faec-dfee-428d-99b0-4a4c531eaaa7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hvwvr"
Jul 06 14:34:02.464053 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:34:02.463860    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9177faec-dfee-428d-99b0-4a4c531eaaa7-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hvwvr\" (UID: \"9177faec-dfee-428d-99b0-4a4c531eaaa7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hvwvr"
Jul 06 14:34:02.464053 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:34:02.463930    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwhpg\" (UniqueName: \"kubernetes.io/projected/9177faec-dfee-428d-99b0-4a4c531eaaa7-kube-api-access-gwhpg\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hvwvr\" (UID: \"9177faec-dfee-428d-99b0-4a4c531eaaa7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hvwvr"
Jul 06 14:34:02.464053 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:34:02.463968    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9177faec-dfee-428d-99b0-4a4c531eaaa7-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hvwvr\" (UID: \"9177faec-dfee-428d-99b0-4a4c531eaaa7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hvwvr"
Jul 06 14:34:02.464267 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:34:02.464226    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9177faec-dfee-428d-99b0-4a4c531eaaa7-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hvwvr\" (UID: \"9177faec-dfee-428d-99b0-4a4c531eaaa7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hvwvr"
Jul 06 14:34:02.464325 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:34:02.464263    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9177faec-dfee-428d-99b0-4a4c531eaaa7-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hvwvr\" (UID: \"9177faec-dfee-428d-99b0-4a4c531eaaa7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hvwvr"
Jul 06 14:34:02.464325 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:34:02.464276    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9177faec-dfee-428d-99b0-4a4c531eaaa7-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hvwvr\" (UID: \"9177faec-dfee-428d-99b0-4a4c531eaaa7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hvwvr"
Jul 06 14:34:02.466215 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:34:02.466191    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9177faec-dfee-428d-99b0-4a4c531eaaa7-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hvwvr\" (UID: \"9177faec-dfee-428d-99b0-4a4c531eaaa7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hvwvr"
Jul 06 14:34:02.466406 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:34:02.466388    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9177faec-dfee-428d-99b0-4a4c531eaaa7-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hvwvr\" (UID: \"9177faec-dfee-428d-99b0-4a4c531eaaa7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hvwvr"
Jul 06 14:34:02.473418 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:34:02.473400    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwhpg\" (UniqueName: \"kubernetes.io/projected/9177faec-dfee-428d-99b0-4a4c531eaaa7-kube-api-access-gwhpg\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hvwvr\" (UID: \"9177faec-dfee-428d-99b0-4a4c531eaaa7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hvwvr"
Jul 06 14:34:02.554341 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:34:02.554223    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hvwvr"
Jul 06 14:34:02.693913 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:34:02.693890    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-hvwvr"]
Jul 06 14:34:02.696165 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:34:02.696133    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9177faec_dfee_428d_99b0_4a4c531eaaa7.slice/crio-62b6128a6bde7b977ba87d0f804331fd496ec200ea7920271765e7a50be5a9c2 WatchSource:0}: Error finding container 62b6128a6bde7b977ba87d0f804331fd496ec200ea7920271765e7a50be5a9c2: Status 404 returned error can't find the container with id 62b6128a6bde7b977ba87d0f804331fd496ec200ea7920271765e7a50be5a9c2
Jul 06 14:34:02.697594 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:34:02.697576    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 14:34:03.380178 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:34:03.380141    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hvwvr" event={"ID":"9177faec-dfee-428d-99b0-4a4c531eaaa7","Type":"ContainerStarted","Data":"cbc27c6dd8d585d0da23be86096ba4e73a9a818164954465c535d56c0cf48070"}
Jul 06 14:34:03.380569 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:34:03.380193    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hvwvr" event={"ID":"9177faec-dfee-428d-99b0-4a4c531eaaa7","Type":"ContainerStarted","Data":"62b6128a6bde7b977ba87d0f804331fd496ec200ea7920271765e7a50be5a9c2"}
Jul 06 14:34:03.401718 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:34:03.401649    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hvwvr" podStartSLOduration=1.207397683 podStartE2EDuration="1.401633186s" totalImagesPullingTime="194.235503ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:34:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:34:03.399960994 +0000 UTC m=+670.320241424" watchObservedRunningTime="2026-07-06 14:34:03.401633186 +0000 UTC m=+670.321913615"
Jul 06 14:34:04.149368 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:34:04.149330    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nkcvz"]
Jul 06 14:34:10.806809 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:34:10.806774    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:34:12.554889 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:34:12.554851    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hvwvr"
Jul 06 14:34:12.555333 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:34:12.554939    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hvwvr"
Jul 06 14:34:12.567311 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:34:12.567288    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hvwvr"
Jul 06 14:34:13.434879 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:34:13.434842    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hvwvr"
Jul 06 14:34:14.163672 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:34:14.163623    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nkcvz"]
Jul 06 14:34:23.961299 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:34:23.961267    2582 patch_prober.go:28] interesting pod/image-registry-6556f6b698-2qxrh container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 06 14:34:23.961697 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:34:23.961324    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6556f6b698-2qxrh" podUID="3de1c042-065e-4441-be64-4b75163f94b0" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 06 14:34:31.544117 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:34:31.544078    2582 patch_prober.go:28] interesting pod/image-registry-6556f6b698-2qxrh container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 06 14:34:31.544492 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:34:31.544158    2582 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6556f6b698-2qxrh" podUID="3de1c042-065e-4441-be64-4b75163f94b0" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 06 14:35:05.740146 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:35:05.740116    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:35:05.826526 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:35:05.826499    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:35:06.356309 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:35:06.356269    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5856d58fcb-5lgwf"]
Jul 06 14:35:06.356510 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:35:06.356453    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5856d58fcb-5lgwf" podUID="1b31891a-25cf-4412-a77b-f2719106afe4" containerName="authorino" containerID="cri-o://1b48257df05ca0cdc7b2d90e9ebae429014a323932bfdb17fe7a806f2f565848" gracePeriod=30
Jul 06 14:35:06.605339 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:35:06.605314    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5856d58fcb-5lgwf"
Jul 06 14:35:06.656862 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:35:06.656828    2582 generic.go:356] "Generic (PLEG): container finished" podID="1b31891a-25cf-4412-a77b-f2719106afe4" containerID="1b48257df05ca0cdc7b2d90e9ebae429014a323932bfdb17fe7a806f2f565848" exitCode=0
Jul 06 14:35:06.657024 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:35:06.656882    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5856d58fcb-5lgwf"
Jul 06 14:35:06.657024 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:35:06.656916    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5856d58fcb-5lgwf" event={"ID":"1b31891a-25cf-4412-a77b-f2719106afe4","Type":"ContainerDied","Data":"1b48257df05ca0cdc7b2d90e9ebae429014a323932bfdb17fe7a806f2f565848"}
Jul 06 14:35:06.657024 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:35:06.656956    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5856d58fcb-5lgwf" event={"ID":"1b31891a-25cf-4412-a77b-f2719106afe4","Type":"ContainerDied","Data":"b7cda16a8fe1fc5158ed3db03b015a0d1be19b43350e7380cb72801cb1fb9466"}
Jul 06 14:35:06.657024 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:35:06.656973    2582 scope.go:117] "RemoveContainer" containerID="1b48257df05ca0cdc7b2d90e9ebae429014a323932bfdb17fe7a806f2f565848"
Jul 06 14:35:06.665283 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:35:06.665261    2582 scope.go:117] "RemoveContainer" containerID="1b48257df05ca0cdc7b2d90e9ebae429014a323932bfdb17fe7a806f2f565848"
Jul 06 14:35:06.665523 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:35:06.665507    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1b48257df05ca0cdc7b2d90e9ebae429014a323932bfdb17fe7a806f2f565848\": container with ID starting with 1b48257df05ca0cdc7b2d90e9ebae429014a323932bfdb17fe7a806f2f565848 not found: ID does not exist" containerID="1b48257df05ca0cdc7b2d90e9ebae429014a323932bfdb17fe7a806f2f565848"
Jul 06 14:35:06.665586 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:35:06.665531    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b48257df05ca0cdc7b2d90e9ebae429014a323932bfdb17fe7a806f2f565848"} err="failed to get container status \"1b48257df05ca0cdc7b2d90e9ebae429014a323932bfdb17fe7a806f2f565848\": rpc error: code = NotFound desc = could not find container \"1b48257df05ca0cdc7b2d90e9ebae429014a323932bfdb17fe7a806f2f565848\": container with ID starting with 1b48257df05ca0cdc7b2d90e9ebae429014a323932bfdb17fe7a806f2f565848 not found: ID does not exist"
Jul 06 14:35:06.733507 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:35:06.733470    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6xwxz\" (UniqueName: \"kubernetes.io/projected/1b31891a-25cf-4412-a77b-f2719106afe4-kube-api-access-6xwxz\") pod \"1b31891a-25cf-4412-a77b-f2719106afe4\" (UID: \"1b31891a-25cf-4412-a77b-f2719106afe4\") "
Jul 06 14:35:06.733690 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:35:06.733528    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1b31891a-25cf-4412-a77b-f2719106afe4-tls-cert\") pod \"1b31891a-25cf-4412-a77b-f2719106afe4\" (UID: \"1b31891a-25cf-4412-a77b-f2719106afe4\") "
Jul 06 14:35:06.735637 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:35:06.735605    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b31891a-25cf-4412-a77b-f2719106afe4-kube-api-access-6xwxz" (OuterVolumeSpecName: "kube-api-access-6xwxz") pod "1b31891a-25cf-4412-a77b-f2719106afe4" (UID: "1b31891a-25cf-4412-a77b-f2719106afe4"). InnerVolumeSpecName "kube-api-access-6xwxz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:35:06.743555 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:35:06.743528    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1b31891a-25cf-4412-a77b-f2719106afe4-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "1b31891a-25cf-4412-a77b-f2719106afe4" (UID: "1b31891a-25cf-4412-a77b-f2719106afe4"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:35:06.834141 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:35:06.834104    2582 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1b31891a-25cf-4412-a77b-f2719106afe4-tls-cert\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Jul 06 14:35:06.834141 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:35:06.834135    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6xwxz\" (UniqueName: \"kubernetes.io/projected/1b31891a-25cf-4412-a77b-f2719106afe4-kube-api-access-6xwxz\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Jul 06 14:35:06.840051 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:35:06.840025    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:35:06.939850 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:35:06.939731    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:35:06.985205 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:35:06.985174    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5856d58fcb-5lgwf"]
Jul 06 14:35:06.992211 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:35:06.992182    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5856d58fcb-5lgwf"]
Jul 06 14:35:07.499565 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:35:07.499529    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1b31891a-25cf-4412-a77b-f2719106afe4" path="/var/lib/kubelet/pods/1b31891a-25cf-4412-a77b-f2719106afe4/volumes"
Jul 06 14:35:19.904193 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:35:19.904163    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:35:19.964373 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:35:19.964333    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:35:27.852699 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:35:27.852645    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:35:27.951309 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:35:27.951261    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:35:29.656201 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:35:29.656149    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:35:34.896284 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:35:34.896249    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nkcvz"]
Jul 06 14:35:43.982495 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:35:43.982459    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nkcvz"]
Jul 06 14:35:55.070351 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:35:55.070315    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nkcvz"]
Jul 06 14:36:04.999676 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:36:04.999625    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nkcvz"]
Jul 06 14:36:05.605726 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:36:05.605694    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:36:05.791490 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:36:05.791450    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:36:09.884209 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:36:09.884174    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:36:15.281637 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:36:15.281600    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nkcvz"]
Jul 06 14:36:17.159232 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:36:17.159196    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:36:17.313631 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:36:17.313595    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:36:17.583040 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:36:17.582957    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:36:17.888170 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:36:17.888083    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:36:19.480349 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:36:19.480316    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:36:43.866476 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:36:43.866437    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nkcvz"]
Jul 06 14:36:56.362432 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:36:56.362392    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nkcvz"]
Jul 06 14:37:02.241646 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:37:02.241614    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:37:02.333851 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:37:02.333816    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:37:02.426739 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:37:02.426708    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:37:09.538808 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:37:09.538774    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:37:09.641527 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:37:09.641492    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:37:09.761216 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:37:09.761187    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:37:09.916449 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:37:09.916417    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:37:12.225643 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:37:12.225611    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:37:16.614869 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:37:16.614826    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:37:16.726588 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:37:16.726554    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:37:25.135631 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:37:25.135592    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:37:25.237891 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:37:25.237859    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:37:34.468180 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:37:34.468140    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nkcvz"]
Jul 06 14:37:43.397842 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:37:43.397796    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nkcvz"]
Jul 06 14:37:52.263946 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:37:52.263859    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nkcvz"]
Jul 06 14:38:03.253837 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:38:03.253798    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nkcvz"]
Jul 06 14:38:14.479390 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:38:14.479346    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nkcvz"]
Jul 06 14:38:23.878951 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:38:23.878912    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nkcvz"]
Jul 06 14:38:35.068435 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:38:35.068403    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nkcvz"]
Jul 06 14:38:44.507214 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:38:44.507176    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nkcvz"]
Jul 06 14:39:07.366933 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:39:07.366896    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nkcvz"]
Jul 06 14:39:19.049677 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:39:19.049576    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nkcvz"]
Jul 06 14:39:25.874624 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:39:25.874590    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:39:43.152001 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:39:43.151969    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nkcvz"]
Jul 06 14:39:52.544611 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:39:52.544570    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nkcvz"]
Jul 06 14:40:09.866896 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:40:09.866860    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nkcvz"]
Jul 06 14:40:19.860621 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:40:19.860587    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nkcvz"]
Jul 06 14:40:31.455412 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:40:31.455373    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nkcvz"]
Jul 06 14:40:40.452887 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:40:40.452846    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nkcvz"]
Jul 06 14:40:49.053011 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:40:49.052926    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nkcvz"]
Jul 06 14:41:49.933630 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:41:49.933599    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:42:37.349916 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:42:37.349878    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nkcvz"]
Jul 06 14:42:46.259338 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:42:46.259299    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nkcvz"]
Jul 06 14:42:58.078581 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:42:58.078542    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nkcvz"]
Jul 06 14:42:59.812694 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:42:59.812632    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:43:06.549052 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:43:06.549009    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nkcvz"]
Jul 06 14:43:15.647394 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:43:15.647355    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nkcvz"]
Jul 06 14:43:25.986799 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:43:25.986762    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nkcvz"]
Jul 06 14:43:36.254734 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:43:36.254687    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nkcvz"]
Jul 06 14:43:47.171897 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:43:47.171809    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nkcvz"]
Jul 06 14:43:55.750944 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:43:55.750904    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nkcvz"]
Jul 06 14:44:06.859760 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:44:06.859727    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nkcvz"]
Jul 06 14:44:18.158037 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:44:18.158006    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nkcvz"]
Jul 06 14:44:25.648835 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:44:25.648786    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nkcvz"]
Jul 06 14:44:43.662107 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:44:43.662071    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nkcvz"]
Jul 06 14:44:52.648707 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:44:52.648669    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nkcvz"]
Jul 06 14:44:54.252771 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:44:54.252737    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:45:00.162746 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:45:00.162712    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29722485-j42nc"]
Jul 06 14:45:00.163115 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:45:00.163026    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b31891a-25cf-4412-a77b-f2719106afe4" containerName="authorino"
Jul 06 14:45:00.163115 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:45:00.163037    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b31891a-25cf-4412-a77b-f2719106afe4" containerName="authorino"
Jul 06 14:45:00.163115 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:45:00.163090    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="1b31891a-25cf-4412-a77b-f2719106afe4" containerName="authorino"
Jul 06 14:45:00.165554 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:45:00.165537    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722485-j42nc"
Jul 06 14:45:00.168434 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:45:00.168417    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-zd4qd\""
Jul 06 14:45:00.188877 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:45:00.188846    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29722485-j42nc"]
Jul 06 14:45:00.259286 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:45:00.259243    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-knghs\" (UniqueName: \"kubernetes.io/projected/6eb8e6a1-164b-4e46-bc3d-74d79973ec6b-kube-api-access-knghs\") pod \"maas-api-key-cleanup-29722485-j42nc\" (UID: \"6eb8e6a1-164b-4e46-bc3d-74d79973ec6b\") " pod="opendatahub/maas-api-key-cleanup-29722485-j42nc"
Jul 06 14:45:00.359910 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:45:00.359855    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-knghs\" (UniqueName: \"kubernetes.io/projected/6eb8e6a1-164b-4e46-bc3d-74d79973ec6b-kube-api-access-knghs\") pod \"maas-api-key-cleanup-29722485-j42nc\" (UID: \"6eb8e6a1-164b-4e46-bc3d-74d79973ec6b\") " pod="opendatahub/maas-api-key-cleanup-29722485-j42nc"
Jul 06 14:45:00.372749 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:45:00.372718    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-knghs\" (UniqueName: \"kubernetes.io/projected/6eb8e6a1-164b-4e46-bc3d-74d79973ec6b-kube-api-access-knghs\") pod \"maas-api-key-cleanup-29722485-j42nc\" (UID: \"6eb8e6a1-164b-4e46-bc3d-74d79973ec6b\") " pod="opendatahub/maas-api-key-cleanup-29722485-j42nc"
Jul 06 14:45:00.476042 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:45:00.475952    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722485-j42nc"
Jul 06 14:45:00.607674 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:45:00.607618    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29722485-j42nc"]
Jul 06 14:45:00.610486 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:45:00.610459    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6eb8e6a1_164b_4e46_bc3d_74d79973ec6b.slice/crio-5e69bb6a970d649f77dd287cc9684c734ba1d4503c2a72c68474139b754fa3c6 WatchSource:0}: Error finding container 5e69bb6a970d649f77dd287cc9684c734ba1d4503c2a72c68474139b754fa3c6: Status 404 returned error can't find the container with id 5e69bb6a970d649f77dd287cc9684c734ba1d4503c2a72c68474139b754fa3c6
Jul 06 14:45:00.612290 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:45:00.612271    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 14:45:01.204022 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:45:01.203985    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722485-j42nc" event={"ID":"6eb8e6a1-164b-4e46-bc3d-74d79973ec6b","Type":"ContainerStarted","Data":"5e69bb6a970d649f77dd287cc9684c734ba1d4503c2a72c68474139b754fa3c6"}
Jul 06 14:45:03.354282 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:45:03.354248    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nkcvz"]
Jul 06 14:45:04.218490 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:45:04.218451    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722485-j42nc" event={"ID":"6eb8e6a1-164b-4e46-bc3d-74d79973ec6b","Type":"ContainerStarted","Data":"27fad186a93a048e98550395ff960e2e6c37090c0194047451dfbbf1d84e4d8d"}
Jul 06 14:45:04.243693 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:45:04.243621    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29722485-j42nc" podStartSLOduration=1.131106757 podStartE2EDuration="4.243604994s" totalImagesPullingTime="3.112498237s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:45:04.242875717 +0000 UTC m=+1331.163156146" watchObservedRunningTime="2026-07-06 14:45:04.243604994 +0000 UTC m=+1331.163885422"
Jul 06 14:45:05.223696 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:45:05.223640    2582 generic.go:356] "Generic (PLEG): container finished" podID="6eb8e6a1-164b-4e46-bc3d-74d79973ec6b" containerID="27fad186a93a048e98550395ff960e2e6c37090c0194047451dfbbf1d84e4d8d" exitCode=0
Jul 06 14:45:05.224086 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:45:05.223761    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722485-j42nc" event={"ID":"6eb8e6a1-164b-4e46-bc3d-74d79973ec6b","Type":"ContainerDied","Data":"27fad186a93a048e98550395ff960e2e6c37090c0194047451dfbbf1d84e4d8d"}
Jul 06 14:45:06.356500 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:45:06.356475    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722485-j42nc"
Jul 06 14:45:06.513604 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:45:06.513512    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-knghs\" (UniqueName: \"kubernetes.io/projected/6eb8e6a1-164b-4e46-bc3d-74d79973ec6b-kube-api-access-knghs\") pod \"6eb8e6a1-164b-4e46-bc3d-74d79973ec6b\" (UID: \"6eb8e6a1-164b-4e46-bc3d-74d79973ec6b\") "
Jul 06 14:45:06.515731 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:45:06.515701    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6eb8e6a1-164b-4e46-bc3d-74d79973ec6b-kube-api-access-knghs" (OuterVolumeSpecName: "kube-api-access-knghs") pod "6eb8e6a1-164b-4e46-bc3d-74d79973ec6b" (UID: "6eb8e6a1-164b-4e46-bc3d-74d79973ec6b"). InnerVolumeSpecName "kube-api-access-knghs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:45:06.614214 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:45:06.614168    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-knghs\" (UniqueName: \"kubernetes.io/projected/6eb8e6a1-164b-4e46-bc3d-74d79973ec6b-kube-api-access-knghs\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Jul 06 14:45:07.235804 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:45:07.235779    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722485-j42nc"
Jul 06 14:45:07.235991 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:45:07.235773    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722485-j42nc" event={"ID":"6eb8e6a1-164b-4e46-bc3d-74d79973ec6b","Type":"ContainerDied","Data":"5e69bb6a970d649f77dd287cc9684c734ba1d4503c2a72c68474139b754fa3c6"}
Jul 06 14:45:07.235991 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:45:07.235921    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5e69bb6a970d649f77dd287cc9684c734ba1d4503c2a72c68474139b754fa3c6"
Jul 06 14:45:14.146194 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:45:14.146155    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nkcvz"]
Jul 06 14:45:29.862548 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:45:29.862465    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nkcvz"]
Jul 06 14:45:38.942035 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:45:38.941999    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nkcvz"]
Jul 06 14:45:48.353814 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:45:48.353777    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nkcvz"]
Jul 06 14:45:53.141848 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:45:53.141814    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:45:57.845152 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:45:57.845116    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nkcvz"]
Jul 06 14:46:06.953857 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:46:06.953820    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nkcvz"]
Jul 06 14:46:15.951571 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:46:15.951535    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nkcvz"]
Jul 06 14:46:28.753929 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:46:28.753895    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nkcvz"]
Jul 06 14:46:38.058950 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:46:38.058917    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nkcvz"]
Jul 06 14:46:47.861551 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:46:47.861477    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nkcvz"]
Jul 06 14:47:00.253964 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:47:00.253921    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nkcvz"]
Jul 06 14:47:10.747609 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:47:10.747574    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nkcvz"]
Jul 06 14:47:20.347079 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:47:20.347033    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nkcvz"]
Jul 06 14:47:29.744156 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:47:29.744113    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nkcvz"]
Jul 06 14:47:44.942424 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:47:44.942389    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nkcvz"]
Jul 06 14:47:56.947208 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:47:56.947174    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nkcvz"]
Jul 06 14:47:59.817065 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:47:59.817030    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:48:07.340785 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:48:07.340741    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:48:10.251178 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:48:10.251146    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nkcvz"]
Jul 06 14:48:15.595496 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:48:15.595397    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:48:20.937404 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:48:20.937366    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nkcvz"]
Jul 06 14:48:28.037506 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:48:28.037471    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nkcvz"]
Jul 06 14:48:30.694735 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:48:30.694699    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:48:37.246743 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:48:37.246705    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nkcvz"]
Jul 06 14:48:40.629104 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:48:40.629051    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:48:40.701234 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:48:40.701195    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:48:41.060764 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:48:41.060727    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:48:47.043965 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:48:47.043923    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:48:47.146983 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:48:47.146950    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:48:47.268470 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:48:47.268442    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-7ebf541d-openshift-default-74847d7947-4rg2t"]
Jul 06 14:48:47.268785 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:48:47.268772    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6eb8e6a1-164b-4e46-bc3d-74d79973ec6b" containerName="cleanup"
Jul 06 14:48:47.268839 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:48:47.268786    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="6eb8e6a1-164b-4e46-bc3d-74d79973ec6b" containerName="cleanup"
Jul 06 14:48:47.268881 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:48:47.268847    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="6eb8e6a1-164b-4e46-bc3d-74d79973ec6b" containerName="cleanup"
Jul 06 14:48:47.270470 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:48:47.270439    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-7ebf541d-openshift-default-74847d7947-4rg2t"
Jul 06 14:48:47.274064 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:48:47.274045    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-7ebf541d-openshift-default-dockercfg-kgvh7\""
Jul 06 14:48:47.302509 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:48:47.302432    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-7ebf541d-openshift-default-74847d7947-4rg2t"]
Jul 06 14:48:47.306537 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:48:47.306516    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:48:47.374265 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:48:47.374229    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d2c6105-282b-477e-8a04-7147625efa69-workload-socket\") pod \"e2e-ait-7ebf541d-openshift-default-74847d7947-4rg2t\" (UID: \"9d2c6105-282b-477e-8a04-7147625efa69\") " pod="openshift-ingress/e2e-ait-7ebf541d-openshift-default-74847d7947-4rg2t"
Jul 06 14:48:47.374453 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:48:47.374277    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9d2c6105-282b-477e-8a04-7147625efa69-istio-podinfo\") pod \"e2e-ait-7ebf541d-openshift-default-74847d7947-4rg2t\" (UID: \"9d2c6105-282b-477e-8a04-7147625efa69\") " pod="openshift-ingress/e2e-ait-7ebf541d-openshift-default-74847d7947-4rg2t"
Jul 06 14:48:47.374453 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:48:47.374293    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9d2c6105-282b-477e-8a04-7147625efa69-istiod-ca-cert\") pod \"e2e-ait-7ebf541d-openshift-default-74847d7947-4rg2t\" (UID: \"9d2c6105-282b-477e-8a04-7147625efa69\") " pod="openshift-ingress/e2e-ait-7ebf541d-openshift-default-74847d7947-4rg2t"
Jul 06 14:48:47.374453 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:48:47.374314    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9d2c6105-282b-477e-8a04-7147625efa69-istio-token\") pod \"e2e-ait-7ebf541d-openshift-default-74847d7947-4rg2t\" (UID: \"9d2c6105-282b-477e-8a04-7147625efa69\") " pod="openshift-ingress/e2e-ait-7ebf541d-openshift-default-74847d7947-4rg2t"
Jul 06 14:48:47.374453 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:48:47.374361    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kgckb\" (UniqueName: \"kubernetes.io/projected/9d2c6105-282b-477e-8a04-7147625efa69-kube-api-access-kgckb\") pod \"e2e-ait-7ebf541d-openshift-default-74847d7947-4rg2t\" (UID: \"9d2c6105-282b-477e-8a04-7147625efa69\") " pod="openshift-ingress/e2e-ait-7ebf541d-openshift-default-74847d7947-4rg2t"
Jul 06 14:48:47.374453 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:48:47.374379    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d2c6105-282b-477e-8a04-7147625efa69-workload-certs\") pod \"e2e-ait-7ebf541d-openshift-default-74847d7947-4rg2t\" (UID: \"9d2c6105-282b-477e-8a04-7147625efa69\") " pod="openshift-ingress/e2e-ait-7ebf541d-openshift-default-74847d7947-4rg2t"
Jul 06 14:48:47.374453 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:48:47.374406    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9d2c6105-282b-477e-8a04-7147625efa69-istio-envoy\") pod \"e2e-ait-7ebf541d-openshift-default-74847d7947-4rg2t\" (UID: \"9d2c6105-282b-477e-8a04-7147625efa69\") " pod="openshift-ingress/e2e-ait-7ebf541d-openshift-default-74847d7947-4rg2t"
Jul 06 14:48:47.374453 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:48:47.374435    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9d2c6105-282b-477e-8a04-7147625efa69-istio-data\") pod \"e2e-ait-7ebf541d-openshift-default-74847d7947-4rg2t\" (UID: \"9d2c6105-282b-477e-8a04-7147625efa69\") " pod="openshift-ingress/e2e-ait-7ebf541d-openshift-default-74847d7947-4rg2t"
Jul 06 14:48:47.374750 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:48:47.374464    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d2c6105-282b-477e-8a04-7147625efa69-credential-socket\") pod \"e2e-ait-7ebf541d-openshift-default-74847d7947-4rg2t\" (UID: \"9d2c6105-282b-477e-8a04-7147625efa69\") " pod="openshift-ingress/e2e-ait-7ebf541d-openshift-default-74847d7947-4rg2t"
Jul 06 14:48:47.409131 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:48:47.409092    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:48:47.475211 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:48:47.475170    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d2c6105-282b-477e-8a04-7147625efa69-workload-socket\") pod \"e2e-ait-7ebf541d-openshift-default-74847d7947-4rg2t\" (UID: \"9d2c6105-282b-477e-8a04-7147625efa69\") " pod="openshift-ingress/e2e-ait-7ebf541d-openshift-default-74847d7947-4rg2t"
Jul 06 14:48:47.475387 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:48:47.475224    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9d2c6105-282b-477e-8a04-7147625efa69-istio-podinfo\") pod \"e2e-ait-7ebf541d-openshift-default-74847d7947-4rg2t\" (UID: \"9d2c6105-282b-477e-8a04-7147625efa69\") " pod="openshift-ingress/e2e-ait-7ebf541d-openshift-default-74847d7947-4rg2t"
Jul 06 14:48:47.475387 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:48:47.475328    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9d2c6105-282b-477e-8a04-7147625efa69-istiod-ca-cert\") pod \"e2e-ait-7ebf541d-openshift-default-74847d7947-4rg2t\" (UID: \"9d2c6105-282b-477e-8a04-7147625efa69\") " pod="openshift-ingress/e2e-ait-7ebf541d-openshift-default-74847d7947-4rg2t"
Jul 06 14:48:47.475387 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:48:47.475358    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9d2c6105-282b-477e-8a04-7147625efa69-istio-token\") pod \"e2e-ait-7ebf541d-openshift-default-74847d7947-4rg2t\" (UID: \"9d2c6105-282b-477e-8a04-7147625efa69\") " pod="openshift-ingress/e2e-ait-7ebf541d-openshift-default-74847d7947-4rg2t"
Jul 06 14:48:47.475555 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:48:47.475403    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgckb\" (UniqueName: \"kubernetes.io/projected/9d2c6105-282b-477e-8a04-7147625efa69-kube-api-access-kgckb\") pod \"e2e-ait-7ebf541d-openshift-default-74847d7947-4rg2t\" (UID: \"9d2c6105-282b-477e-8a04-7147625efa69\") " pod="openshift-ingress/e2e-ait-7ebf541d-openshift-default-74847d7947-4rg2t"
Jul 06 14:48:47.475555 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:48:47.475431    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d2c6105-282b-477e-8a04-7147625efa69-workload-certs\") pod \"e2e-ait-7ebf541d-openshift-default-74847d7947-4rg2t\" (UID: \"9d2c6105-282b-477e-8a04-7147625efa69\") " pod="openshift-ingress/e2e-ait-7ebf541d-openshift-default-74847d7947-4rg2t"
Jul 06 14:48:47.475555 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:48:47.475465    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9d2c6105-282b-477e-8a04-7147625efa69-istio-envoy\") pod \"e2e-ait-7ebf541d-openshift-default-74847d7947-4rg2t\" (UID: \"9d2c6105-282b-477e-8a04-7147625efa69\") " pod="openshift-ingress/e2e-ait-7ebf541d-openshift-default-74847d7947-4rg2t"
Jul 06 14:48:47.475555 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:48:47.475511    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9d2c6105-282b-477e-8a04-7147625efa69-istio-data\") pod \"e2e-ait-7ebf541d-openshift-default-74847d7947-4rg2t\" (UID: \"9d2c6105-282b-477e-8a04-7147625efa69\") " pod="openshift-ingress/e2e-ait-7ebf541d-openshift-default-74847d7947-4rg2t"
Jul 06 14:48:47.475753 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:48:47.475567    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d2c6105-282b-477e-8a04-7147625efa69-workload-socket\") pod \"e2e-ait-7ebf541d-openshift-default-74847d7947-4rg2t\" (UID: \"9d2c6105-282b-477e-8a04-7147625efa69\") " pod="openshift-ingress/e2e-ait-7ebf541d-openshift-default-74847d7947-4rg2t"
Jul 06 14:48:47.476185 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:48:47.476152    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9d2c6105-282b-477e-8a04-7147625efa69-istio-data\") pod \"e2e-ait-7ebf541d-openshift-default-74847d7947-4rg2t\" (UID: \"9d2c6105-282b-477e-8a04-7147625efa69\") " pod="openshift-ingress/e2e-ait-7ebf541d-openshift-default-74847d7947-4rg2t"
Jul 06 14:48:47.476304 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:48:47.476159    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d2c6105-282b-477e-8a04-7147625efa69-credential-socket\") pod \"e2e-ait-7ebf541d-openshift-default-74847d7947-4rg2t\" (UID: \"9d2c6105-282b-477e-8a04-7147625efa69\") " pod="openshift-ingress/e2e-ait-7ebf541d-openshift-default-74847d7947-4rg2t"
Jul 06 14:48:47.476304 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:48:47.476245    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d2c6105-282b-477e-8a04-7147625efa69-workload-certs\") pod \"e2e-ait-7ebf541d-openshift-default-74847d7947-4rg2t\" (UID: \"9d2c6105-282b-477e-8a04-7147625efa69\") " pod="openshift-ingress/e2e-ait-7ebf541d-openshift-default-74847d7947-4rg2t"
Jul 06 14:48:47.476499 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:48:47.476470    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d2c6105-282b-477e-8a04-7147625efa69-credential-socket\") pod \"e2e-ait-7ebf541d-openshift-default-74847d7947-4rg2t\" (UID: \"9d2c6105-282b-477e-8a04-7147625efa69\") " pod="openshift-ingress/e2e-ait-7ebf541d-openshift-default-74847d7947-4rg2t"
Jul 06 14:48:47.476582 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:48:47.476547    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9d2c6105-282b-477e-8a04-7147625efa69-istiod-ca-cert\") pod \"e2e-ait-7ebf541d-openshift-default-74847d7947-4rg2t\" (UID: \"9d2c6105-282b-477e-8a04-7147625efa69\") " pod="openshift-ingress/e2e-ait-7ebf541d-openshift-default-74847d7947-4rg2t"
Jul 06 14:48:47.478818 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:48:47.478793    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9d2c6105-282b-477e-8a04-7147625efa69-istio-envoy\") pod \"e2e-ait-7ebf541d-openshift-default-74847d7947-4rg2t\" (UID: \"9d2c6105-282b-477e-8a04-7147625efa69\") " pod="openshift-ingress/e2e-ait-7ebf541d-openshift-default-74847d7947-4rg2t"
Jul 06 14:48:47.478931 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:48:47.478865    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9d2c6105-282b-477e-8a04-7147625efa69-istio-podinfo\") pod \"e2e-ait-7ebf541d-openshift-default-74847d7947-4rg2t\" (UID: \"9d2c6105-282b-477e-8a04-7147625efa69\") " pod="openshift-ingress/e2e-ait-7ebf541d-openshift-default-74847d7947-4rg2t"
Jul 06 14:48:47.490670 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:48:47.490628    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9d2c6105-282b-477e-8a04-7147625efa69-istio-token\") pod \"e2e-ait-7ebf541d-openshift-default-74847d7947-4rg2t\" (UID: \"9d2c6105-282b-477e-8a04-7147625efa69\") " pod="openshift-ingress/e2e-ait-7ebf541d-openshift-default-74847d7947-4rg2t"
Jul 06 14:48:47.490982 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:48:47.490960    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kgckb\" (UniqueName: \"kubernetes.io/projected/9d2c6105-282b-477e-8a04-7147625efa69-kube-api-access-kgckb\") pod \"e2e-ait-7ebf541d-openshift-default-74847d7947-4rg2t\" (UID: \"9d2c6105-282b-477e-8a04-7147625efa69\") " pod="openshift-ingress/e2e-ait-7ebf541d-openshift-default-74847d7947-4rg2t"
Jul 06 14:48:47.581557 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:48:47.581469    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-7ebf541d-openshift-default-74847d7947-4rg2t"
Jul 06 14:48:47.720074 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:48:47.720049    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-7ebf541d-openshift-default-74847d7947-4rg2t"]
Jul 06 14:48:47.722713 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:48:47.722685    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d2c6105_282b_477e_8a04_7147625efa69.slice/crio-66cba88c2196ec98277147f2f12b3f816f319c13c8900670d455b7706188e120 WatchSource:0}: Error finding container 66cba88c2196ec98277147f2f12b3f816f319c13c8900670d455b7706188e120: Status 404 returned error can't find the container with id 66cba88c2196ec98277147f2f12b3f816f319c13c8900670d455b7706188e120
Jul 06 14:48:47.724770 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:48:47.724739    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:48:47.724826 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:48:47.724803    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:48:47.724862 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:48:47.724833    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:48:48.198504 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:48:48.198468    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7ebf541d-openshift-default-74847d7947-4rg2t" event={"ID":"9d2c6105-282b-477e-8a04-7147625efa69","Type":"ContainerStarted","Data":"5cab2d169583dee8a47ed04a7ff520fd070735f77b7d95b9559a0a785ecee82a"}
Jul 06 14:48:48.198877 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:48:48.198525    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7ebf541d-openshift-default-74847d7947-4rg2t" event={"ID":"9d2c6105-282b-477e-8a04-7147625efa69","Type":"ContainerStarted","Data":"66cba88c2196ec98277147f2f12b3f816f319c13c8900670d455b7706188e120"}
Jul 06 14:48:48.220734 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:48:48.220690    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-7ebf541d-openshift-default-74847d7947-4rg2t" podStartSLOduration=1.220675329 podStartE2EDuration="1.220675329s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:48:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:48:48.218646568 +0000 UTC m=+1555.138926997" watchObservedRunningTime="2026-07-06 14:48:48.220675329 +0000 UTC m=+1555.140955810"
Jul 06 14:48:48.450522 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:48:48.450426    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:48:48.533468 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:48:48.533437    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:48:48.582205 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:48:48.582171    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-7ebf541d-openshift-default-74847d7947-4rg2t"
Jul 06 14:48:48.583647 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:48:48.583624    2582 patch_prober.go:28] interesting pod/e2e-ait-7ebf541d-openshift-default-74847d7947-4rg2t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body=
Jul 06 14:48:48.583738 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:48:48.583695    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-7ebf541d-openshift-default-74847d7947-4rg2t" podUID="9d2c6105-282b-477e-8a04-7147625efa69" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused"
Jul 06 14:48:48.627210 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:48:48.627168    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:48:48.725573 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:48:48.725483    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:48:49.022290 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:48:49.022208    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:48:49.126087 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:48:49.126055    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:48:49.585501 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:48:49.585472    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-7ebf541d-openshift-default-74847d7947-4rg2t"
Jul 06 14:48:50.207495 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:48:50.207465    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-7ebf541d-openshift-default-74847d7947-4rg2t"
Jul 06 14:48:50.208473 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:48:50.208456    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-7ebf541d-openshift-default-74847d7947-4rg2t"
Jul 06 14:48:51.240464 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:48:51.240432    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nkcvz"]
Jul 06 14:48:51.274579 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:48:51.274546    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:48:53.688067 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:48:53.688033    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:48:53.824258 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:48:53.824213    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-7ebf541d-openshift-default-74847d7947-4rg2t"]
Jul 06 14:48:53.824873 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:48:53.824466    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-7ebf541d-openshift-default-74847d7947-4rg2t" podUID="9d2c6105-282b-477e-8a04-7147625efa69" containerName="istio-proxy" containerID="cri-o://5cab2d169583dee8a47ed04a7ff520fd070735f77b7d95b9559a0a785ecee82a" gracePeriod=30
Jul 06 14:48:53.850108 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:48:53.850059    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:48:53.950608 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:48:53.950515    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:48:54.058245 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:48:54.058216    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:48:55.851010 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:48:55.850975    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:48:59.002060 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:48:59.002034    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-7ebf541d-openshift-default-74847d7947-4rg2t"
Jul 06 14:48:59.093969 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:48:59.093867    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d2c6105-282b-477e-8a04-7147625efa69-workload-certs\") pod \"9d2c6105-282b-477e-8a04-7147625efa69\" (UID: \"9d2c6105-282b-477e-8a04-7147625efa69\") "
Jul 06 14:48:59.093969 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:48:59.093932    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kgckb\" (UniqueName: \"kubernetes.io/projected/9d2c6105-282b-477e-8a04-7147625efa69-kube-api-access-kgckb\") pod \"9d2c6105-282b-477e-8a04-7147625efa69\" (UID: \"9d2c6105-282b-477e-8a04-7147625efa69\") "
Jul 06 14:48:59.094192 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:48:59.093979    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9d2c6105-282b-477e-8a04-7147625efa69-istiod-ca-cert\") pod \"9d2c6105-282b-477e-8a04-7147625efa69\" (UID: \"9d2c6105-282b-477e-8a04-7147625efa69\") "
Jul 06 14:48:59.094192 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:48:59.094018    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9d2c6105-282b-477e-8a04-7147625efa69-istio-podinfo\") pod \"9d2c6105-282b-477e-8a04-7147625efa69\" (UID: \"9d2c6105-282b-477e-8a04-7147625efa69\") "
Jul 06 14:48:59.094192 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:48:59.094041    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9d2c6105-282b-477e-8a04-7147625efa69-istio-token\") pod \"9d2c6105-282b-477e-8a04-7147625efa69\" (UID: \"9d2c6105-282b-477e-8a04-7147625efa69\") "
Jul 06 14:48:59.094192 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:48:59.094062    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9d2c6105-282b-477e-8a04-7147625efa69-istio-envoy\") pod \"9d2c6105-282b-477e-8a04-7147625efa69\" (UID: \"9d2c6105-282b-477e-8a04-7147625efa69\") "
Jul 06 14:48:59.094192 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:48:59.094084    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9d2c6105-282b-477e-8a04-7147625efa69-istio-data\") pod \"9d2c6105-282b-477e-8a04-7147625efa69\" (UID: \"9d2c6105-282b-477e-8a04-7147625efa69\") "
Jul 06 14:48:59.094192 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:48:59.094156    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d2c6105-282b-477e-8a04-7147625efa69-credential-socket\") pod \"9d2c6105-282b-477e-8a04-7147625efa69\" (UID: \"9d2c6105-282b-477e-8a04-7147625efa69\") "
Jul 06 14:48:59.094473 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:48:59.094220    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d2c6105-282b-477e-8a04-7147625efa69-workload-socket\") pod \"9d2c6105-282b-477e-8a04-7147625efa69\" (UID: \"9d2c6105-282b-477e-8a04-7147625efa69\") "
Jul 06 14:48:59.094473 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:48:59.094223    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d2c6105-282b-477e-8a04-7147625efa69-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9d2c6105-282b-477e-8a04-7147625efa69" (UID: "9d2c6105-282b-477e-8a04-7147625efa69"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:48:59.094576 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:48:59.094467    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d2c6105-282b-477e-8a04-7147625efa69-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9d2c6105-282b-477e-8a04-7147625efa69" (UID: "9d2c6105-282b-477e-8a04-7147625efa69"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:48:59.094576 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:48:59.094480    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d2c6105-282b-477e-8a04-7147625efa69-workload-certs\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Jul 06 14:48:59.094750 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:48:59.094727    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d2c6105-282b-477e-8a04-7147625efa69-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9d2c6105-282b-477e-8a04-7147625efa69" (UID: "9d2c6105-282b-477e-8a04-7147625efa69"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:48:59.094750 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:48:59.094739    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9d2c6105-282b-477e-8a04-7147625efa69-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9d2c6105-282b-477e-8a04-7147625efa69" (UID: "9d2c6105-282b-477e-8a04-7147625efa69"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:48:59.095011 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:48:59.094989    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d2c6105-282b-477e-8a04-7147625efa69-istio-data" (OuterVolumeSpecName: "istio-data") pod "9d2c6105-282b-477e-8a04-7147625efa69" (UID: "9d2c6105-282b-477e-8a04-7147625efa69"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:48:59.096833 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:48:59.096793    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d2c6105-282b-477e-8a04-7147625efa69-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9d2c6105-282b-477e-8a04-7147625efa69" (UID: "9d2c6105-282b-477e-8a04-7147625efa69"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:48:59.096925 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:48:59.096839    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d2c6105-282b-477e-8a04-7147625efa69-kube-api-access-kgckb" (OuterVolumeSpecName: "kube-api-access-kgckb") pod "9d2c6105-282b-477e-8a04-7147625efa69" (UID: "9d2c6105-282b-477e-8a04-7147625efa69"). InnerVolumeSpecName "kube-api-access-kgckb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:48:59.096925 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:48:59.096814    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d2c6105-282b-477e-8a04-7147625efa69-istio-token" (OuterVolumeSpecName: "istio-token") pod "9d2c6105-282b-477e-8a04-7147625efa69" (UID: "9d2c6105-282b-477e-8a04-7147625efa69"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:48:59.096925 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:48:59.096838    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9d2c6105-282b-477e-8a04-7147625efa69-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9d2c6105-282b-477e-8a04-7147625efa69" (UID: "9d2c6105-282b-477e-8a04-7147625efa69"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 14:48:59.195739 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:48:59.195703    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kgckb\" (UniqueName: \"kubernetes.io/projected/9d2c6105-282b-477e-8a04-7147625efa69-kube-api-access-kgckb\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Jul 06 14:48:59.195739 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:48:59.195733    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9d2c6105-282b-477e-8a04-7147625efa69-istiod-ca-cert\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Jul 06 14:48:59.195739 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:48:59.195742    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9d2c6105-282b-477e-8a04-7147625efa69-istio-podinfo\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Jul 06 14:48:59.195971 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:48:59.195750    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9d2c6105-282b-477e-8a04-7147625efa69-istio-token\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Jul 06 14:48:59.195971 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:48:59.195759    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9d2c6105-282b-477e-8a04-7147625efa69-istio-envoy\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Jul 06 14:48:59.195971 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:48:59.195766    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9d2c6105-282b-477e-8a04-7147625efa69-istio-data\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Jul 06 14:48:59.195971 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:48:59.195774    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d2c6105-282b-477e-8a04-7147625efa69-credential-socket\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Jul 06 14:48:59.195971 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:48:59.195784    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d2c6105-282b-477e-8a04-7147625efa69-workload-socket\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Jul 06 14:48:59.240917 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:48:59.240881    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nkcvz"]
Jul 06 14:48:59.257705 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:48:59.257673    2582 generic.go:356] "Generic (PLEG): container finished" podID="9d2c6105-282b-477e-8a04-7147625efa69" containerID="5cab2d169583dee8a47ed04a7ff520fd070735f77b7d95b9559a0a785ecee82a" exitCode=0
Jul 06 14:48:59.257705 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:48:59.257717    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-7ebf541d-openshift-default-74847d7947-4rg2t"
Jul 06 14:48:59.257943 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:48:59.257774    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7ebf541d-openshift-default-74847d7947-4rg2t" event={"ID":"9d2c6105-282b-477e-8a04-7147625efa69","Type":"ContainerDied","Data":"5cab2d169583dee8a47ed04a7ff520fd070735f77b7d95b9559a0a785ecee82a"}
Jul 06 14:48:59.257943 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:48:59.257815    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7ebf541d-openshift-default-74847d7947-4rg2t" event={"ID":"9d2c6105-282b-477e-8a04-7147625efa69","Type":"ContainerDied","Data":"66cba88c2196ec98277147f2f12b3f816f319c13c8900670d455b7706188e120"}
Jul 06 14:48:59.257943 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:48:59.257835    2582 scope.go:117] "RemoveContainer" containerID="5cab2d169583dee8a47ed04a7ff520fd070735f77b7d95b9559a0a785ecee82a"
Jul 06 14:48:59.266627 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:48:59.266609    2582 scope.go:117] "RemoveContainer" containerID="5cab2d169583dee8a47ed04a7ff520fd070735f77b7d95b9559a0a785ecee82a"
Jul 06 14:48:59.266945 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:48:59.266923    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5cab2d169583dee8a47ed04a7ff520fd070735f77b7d95b9559a0a785ecee82a\": container with ID starting with 5cab2d169583dee8a47ed04a7ff520fd070735f77b7d95b9559a0a785ecee82a not found: ID does not exist" containerID="5cab2d169583dee8a47ed04a7ff520fd070735f77b7d95b9559a0a785ecee82a"
Jul 06 14:48:59.267051 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:48:59.266956    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5cab2d169583dee8a47ed04a7ff520fd070735f77b7d95b9559a0a785ecee82a"} err="failed to get container status \"5cab2d169583dee8a47ed04a7ff520fd070735f77b7d95b9559a0a785ecee82a\": rpc error: code = NotFound desc = could not find container \"5cab2d169583dee8a47ed04a7ff520fd070735f77b7d95b9559a0a785ecee82a\": container with ID starting with 5cab2d169583dee8a47ed04a7ff520fd070735f77b7d95b9559a0a785ecee82a not found: ID does not exist"
Jul 06 14:48:59.279605 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:48:59.279581    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-7ebf541d-openshift-default-74847d7947-4rg2t"]
Jul 06 14:48:59.283541 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:48:59.283519    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-7ebf541d-openshift-default-74847d7947-4rg2t"]
Jul 06 14:48:59.499988 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:48:59.499952    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9d2c6105-282b-477e-8a04-7147625efa69" path="/var/lib/kubelet/pods/9d2c6105-282b-477e-8a04-7147625efa69/volumes"
Jul 06 14:48:59.972635 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:48:59.972602    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:49:00.073705 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:49:00.073674    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:49:00.212908 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:49:00.212875    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:49:00.308434 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:49:00.308343    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:49:01.374930 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:49:01.374896    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:49:01.502811 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:49:01.502774    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:49:01.602560 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:49:01.602521    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:49:01.811051 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:49:01.811019    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:49:02.057637 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:49:02.057600    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:49:02.158751 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:49:02.158714    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:49:03.332056 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:49:03.332022    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:49:06.516122 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:49:06.516089    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:49:06.986501 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:49:06.986469    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:49:12.796475 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:49:12.796438    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:49:12.896924 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:49:12.896886    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:49:18.909600 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:49:18.909558    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:49:19.115154 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:49:19.115114    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:49:19.285617 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:49:19.285575    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:49:20.258786 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:49:20.258741    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:49:20.350997 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:49:20.350963    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:49:20.511704 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:49:20.511606    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:49:20.630751 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:49:20.630701    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:49:20.730266 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:49:20.730227    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:49:21.199498 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:49:21.199461    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:49:21.389281 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:49:21.389252    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:49:21.606292 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:49:21.606185    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:49:23.147497 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:49:23.147460    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nkcvz"]
Jul 06 14:49:23.988418 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:49:23.988385    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:49:24.783994 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:49:24.783956    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:49:24.966015 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:49:24.965986    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:49:25.065039 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:49:25.064960    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:49:25.164491 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:49:25.164460    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:49:26.843960 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:49:26.843929    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:49:31.421572 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:49:31.421534    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:49:31.485302 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:49:31.485265    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:49:31.891179 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:49:31.891080    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:49:31.987707 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:49:31.987676    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:49:32.088721 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:49:32.088688    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:49:33.551096 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:49:33.551065    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:49:35.263015 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:49:35.262980    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nkcvz"]
Jul 06 14:49:41.127851 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:49:41.127807    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:49:41.309697 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:49:41.309631    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:49:41.420429 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:49:41.420390    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:49:42.053232 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:49:42.053202    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:50:07.996102 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:50:07.996064    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:50:14.795134 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:50:14.795095    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:50:14.913414 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:50:14.913372    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:50:15.017381 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:50:15.017351    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:50:30.908633 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:50:30.908580    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:50:35.139794 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:50:35.139757    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:50:35.201245 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:50:35.201206    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:50:37.478321 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:50:37.478278    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:50:37.614975 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:50:37.614922    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:50:37.746154 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:50:37.746062    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:50:38.103514 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:50:38.103409    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:50:48.201587 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:50:48.201544    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:50:49.011273 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:50:49.011229    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:50:55.814253 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:50:55.814216    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:50:55.921852 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:50:55.921818    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:50:56.023342 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:50:56.023305    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:50:56.118917 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:50:56.118826    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:50:56.358140 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:50:56.358091    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:50:56.932328 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:50:56.932301    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:50:57.047519 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:50:57.047485    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:50:58.821331 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:50:58.821295    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:50:59.353769 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:50:59.353732    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nkcvz"]
Jul 06 14:51:05.516874 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:05.516836    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:51:05.617389 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:05.617356    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:51:06.269467 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:06.269435    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:51:08.154786 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:08.154751    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nkcvz"]
Jul 06 14:51:12.651965 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:12.651931    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:51:12.738959 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:12.738929    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:51:12.900247 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:12.900209    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:51:13.221973 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:13.221938    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-234d4ebd-openshift-default-846b94c4cf-zbvlm"]
Jul 06 14:51:13.222279 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:13.222266    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d2c6105-282b-477e-8a04-7147625efa69" containerName="istio-proxy"
Jul 06 14:51:13.222279 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:13.222280    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d2c6105-282b-477e-8a04-7147625efa69" containerName="istio-proxy"
Jul 06 14:51:13.222408 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:13.222330    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d2c6105-282b-477e-8a04-7147625efa69" containerName="istio-proxy"
Jul 06 14:51:13.225331 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:13.225290    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-234d4ebd-openshift-default-846b94c4cf-zbvlm"
Jul 06 14:51:13.235584 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:13.235549    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/34f558d9-2168-40d9-aada-917369f45b12-workload-socket\") pod \"e2e-mt-234d4ebd-openshift-default-846b94c4cf-zbvlm\" (UID: \"34f558d9-2168-40d9-aada-917369f45b12\") " pod="openshift-ingress/e2e-mt-234d4ebd-openshift-default-846b94c4cf-zbvlm"
Jul 06 14:51:13.235584 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:13.235580    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/34f558d9-2168-40d9-aada-917369f45b12-istiod-ca-cert\") pod \"e2e-mt-234d4ebd-openshift-default-846b94c4cf-zbvlm\" (UID: \"34f558d9-2168-40d9-aada-917369f45b12\") " pod="openshift-ingress/e2e-mt-234d4ebd-openshift-default-846b94c4cf-zbvlm"
Jul 06 14:51:13.235817 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:13.235797    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/34f558d9-2168-40d9-aada-917369f45b12-istio-data\") pod \"e2e-mt-234d4ebd-openshift-default-846b94c4cf-zbvlm\" (UID: \"34f558d9-2168-40d9-aada-917369f45b12\") " pod="openshift-ingress/e2e-mt-234d4ebd-openshift-default-846b94c4cf-zbvlm"
Jul 06 14:51:13.235888 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:13.235857    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zplzs\" (UniqueName: \"kubernetes.io/projected/34f558d9-2168-40d9-aada-917369f45b12-kube-api-access-zplzs\") pod \"e2e-mt-234d4ebd-openshift-default-846b94c4cf-zbvlm\" (UID: \"34f558d9-2168-40d9-aada-917369f45b12\") " pod="openshift-ingress/e2e-mt-234d4ebd-openshift-default-846b94c4cf-zbvlm"
Jul 06 14:51:13.235888 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:13.235869    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-234d4ebd-openshift-default-dockercfg-tvkhb\""
Jul 06 14:51:13.235995 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:13.235887    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/34f558d9-2168-40d9-aada-917369f45b12-credential-socket\") pod \"e2e-mt-234d4ebd-openshift-default-846b94c4cf-zbvlm\" (UID: \"34f558d9-2168-40d9-aada-917369f45b12\") " pod="openshift-ingress/e2e-mt-234d4ebd-openshift-default-846b94c4cf-zbvlm"
Jul 06 14:51:13.235995 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:13.235914    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/34f558d9-2168-40d9-aada-917369f45b12-istio-podinfo\") pod \"e2e-mt-234d4ebd-openshift-default-846b94c4cf-zbvlm\" (UID: \"34f558d9-2168-40d9-aada-917369f45b12\") " pod="openshift-ingress/e2e-mt-234d4ebd-openshift-default-846b94c4cf-zbvlm"
Jul 06 14:51:13.235995 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:13.235937    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/34f558d9-2168-40d9-aada-917369f45b12-istio-token\") pod \"e2e-mt-234d4ebd-openshift-default-846b94c4cf-zbvlm\" (UID: \"34f558d9-2168-40d9-aada-917369f45b12\") " pod="openshift-ingress/e2e-mt-234d4ebd-openshift-default-846b94c4cf-zbvlm"
Jul 06 14:51:13.236136 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:13.236015    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/34f558d9-2168-40d9-aada-917369f45b12-istio-envoy\") pod \"e2e-mt-234d4ebd-openshift-default-846b94c4cf-zbvlm\" (UID: \"34f558d9-2168-40d9-aada-917369f45b12\") " pod="openshift-ingress/e2e-mt-234d4ebd-openshift-default-846b94c4cf-zbvlm"
Jul 06 14:51:13.236136 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:13.236072    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/34f558d9-2168-40d9-aada-917369f45b12-workload-certs\") pod \"e2e-mt-234d4ebd-openshift-default-846b94c4cf-zbvlm\" (UID: \"34f558d9-2168-40d9-aada-917369f45b12\") " pod="openshift-ingress/e2e-mt-234d4ebd-openshift-default-846b94c4cf-zbvlm"
Jul 06 14:51:13.261620 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:13.261589    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-234d4ebd-openshift-default-846b94c4cf-zbvlm"]
Jul 06 14:51:13.265577 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:13.265548    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:51:13.337337 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:13.337293    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/34f558d9-2168-40d9-aada-917369f45b12-istio-data\") pod \"e2e-mt-234d4ebd-openshift-default-846b94c4cf-zbvlm\" (UID: \"34f558d9-2168-40d9-aada-917369f45b12\") " pod="openshift-ingress/e2e-mt-234d4ebd-openshift-default-846b94c4cf-zbvlm"
Jul 06 14:51:13.337542 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:13.337358    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zplzs\" (UniqueName: \"kubernetes.io/projected/34f558d9-2168-40d9-aada-917369f45b12-kube-api-access-zplzs\") pod \"e2e-mt-234d4ebd-openshift-default-846b94c4cf-zbvlm\" (UID: \"34f558d9-2168-40d9-aada-917369f45b12\") " pod="openshift-ingress/e2e-mt-234d4ebd-openshift-default-846b94c4cf-zbvlm"
Jul 06 14:51:13.337542 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:13.337386    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/34f558d9-2168-40d9-aada-917369f45b12-credential-socket\") pod \"e2e-mt-234d4ebd-openshift-default-846b94c4cf-zbvlm\" (UID: \"34f558d9-2168-40d9-aada-917369f45b12\") " pod="openshift-ingress/e2e-mt-234d4ebd-openshift-default-846b94c4cf-zbvlm"
Jul 06 14:51:13.337542 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:13.337410    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/34f558d9-2168-40d9-aada-917369f45b12-istio-podinfo\") pod \"e2e-mt-234d4ebd-openshift-default-846b94c4cf-zbvlm\" (UID: \"34f558d9-2168-40d9-aada-917369f45b12\") " pod="openshift-ingress/e2e-mt-234d4ebd-openshift-default-846b94c4cf-zbvlm"
Jul 06 14:51:13.337542 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:13.337434    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/34f558d9-2168-40d9-aada-917369f45b12-istio-token\") pod \"e2e-mt-234d4ebd-openshift-default-846b94c4cf-zbvlm\" (UID: \"34f558d9-2168-40d9-aada-917369f45b12\") " pod="openshift-ingress/e2e-mt-234d4ebd-openshift-default-846b94c4cf-zbvlm"
Jul 06 14:51:13.337542 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:13.337479    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/34f558d9-2168-40d9-aada-917369f45b12-istio-envoy\") pod \"e2e-mt-234d4ebd-openshift-default-846b94c4cf-zbvlm\" (UID: \"34f558d9-2168-40d9-aada-917369f45b12\") " pod="openshift-ingress/e2e-mt-234d4ebd-openshift-default-846b94c4cf-zbvlm"
Jul 06 14:51:13.337542 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:13.337526    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/34f558d9-2168-40d9-aada-917369f45b12-workload-certs\") pod \"e2e-mt-234d4ebd-openshift-default-846b94c4cf-zbvlm\" (UID: \"34f558d9-2168-40d9-aada-917369f45b12\") " pod="openshift-ingress/e2e-mt-234d4ebd-openshift-default-846b94c4cf-zbvlm"
Jul 06 14:51:13.337871 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:13.337578    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/34f558d9-2168-40d9-aada-917369f45b12-workload-socket\") pod \"e2e-mt-234d4ebd-openshift-default-846b94c4cf-zbvlm\" (UID: \"34f558d9-2168-40d9-aada-917369f45b12\") " pod="openshift-ingress/e2e-mt-234d4ebd-openshift-default-846b94c4cf-zbvlm"
Jul 06 14:51:13.337871 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:13.337599    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/34f558d9-2168-40d9-aada-917369f45b12-istiod-ca-cert\") pod \"e2e-mt-234d4ebd-openshift-default-846b94c4cf-zbvlm\" (UID: \"34f558d9-2168-40d9-aada-917369f45b12\") " pod="openshift-ingress/e2e-mt-234d4ebd-openshift-default-846b94c4cf-zbvlm"
Jul 06 14:51:13.337871 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:13.337789    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/34f558d9-2168-40d9-aada-917369f45b12-istio-data\") pod \"e2e-mt-234d4ebd-openshift-default-846b94c4cf-zbvlm\" (UID: \"34f558d9-2168-40d9-aada-917369f45b12\") " pod="openshift-ingress/e2e-mt-234d4ebd-openshift-default-846b94c4cf-zbvlm"
Jul 06 14:51:13.338147 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:13.338125    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/34f558d9-2168-40d9-aada-917369f45b12-credential-socket\") pod \"e2e-mt-234d4ebd-openshift-default-846b94c4cf-zbvlm\" (UID: \"34f558d9-2168-40d9-aada-917369f45b12\") " pod="openshift-ingress/e2e-mt-234d4ebd-openshift-default-846b94c4cf-zbvlm"
Jul 06 14:51:13.338253 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:13.338219    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/34f558d9-2168-40d9-aada-917369f45b12-workload-certs\") pod \"e2e-mt-234d4ebd-openshift-default-846b94c4cf-zbvlm\" (UID: \"34f558d9-2168-40d9-aada-917369f45b12\") " pod="openshift-ingress/e2e-mt-234d4ebd-openshift-default-846b94c4cf-zbvlm"
Jul 06 14:51:13.338346 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:13.338320    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/34f558d9-2168-40d9-aada-917369f45b12-workload-socket\") pod \"e2e-mt-234d4ebd-openshift-default-846b94c4cf-zbvlm\" (UID: \"34f558d9-2168-40d9-aada-917369f45b12\") " pod="openshift-ingress/e2e-mt-234d4ebd-openshift-default-846b94c4cf-zbvlm"
Jul 06 14:51:13.338432 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:13.338412    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/34f558d9-2168-40d9-aada-917369f45b12-istiod-ca-cert\") pod \"e2e-mt-234d4ebd-openshift-default-846b94c4cf-zbvlm\" (UID: \"34f558d9-2168-40d9-aada-917369f45b12\") " pod="openshift-ingress/e2e-mt-234d4ebd-openshift-default-846b94c4cf-zbvlm"
Jul 06 14:51:13.340015 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:13.339990    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/34f558d9-2168-40d9-aada-917369f45b12-istio-envoy\") pod \"e2e-mt-234d4ebd-openshift-default-846b94c4cf-zbvlm\" (UID: \"34f558d9-2168-40d9-aada-917369f45b12\") " pod="openshift-ingress/e2e-mt-234d4ebd-openshift-default-846b94c4cf-zbvlm"
Jul 06 14:51:13.340109 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:13.340091    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/34f558d9-2168-40d9-aada-917369f45b12-istio-podinfo\") pod \"e2e-mt-234d4ebd-openshift-default-846b94c4cf-zbvlm\" (UID: \"34f558d9-2168-40d9-aada-917369f45b12\") " pod="openshift-ingress/e2e-mt-234d4ebd-openshift-default-846b94c4cf-zbvlm"
Jul 06 14:51:13.346606 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:13.346575    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zplzs\" (UniqueName: \"kubernetes.io/projected/34f558d9-2168-40d9-aada-917369f45b12-kube-api-access-zplzs\") pod \"e2e-mt-234d4ebd-openshift-default-846b94c4cf-zbvlm\" (UID: \"34f558d9-2168-40d9-aada-917369f45b12\") " pod="openshift-ingress/e2e-mt-234d4ebd-openshift-default-846b94c4cf-zbvlm"
Jul 06 14:51:13.346801 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:13.346780    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/34f558d9-2168-40d9-aada-917369f45b12-istio-token\") pod \"e2e-mt-234d4ebd-openshift-default-846b94c4cf-zbvlm\" (UID: \"34f558d9-2168-40d9-aada-917369f45b12\") " pod="openshift-ingress/e2e-mt-234d4ebd-openshift-default-846b94c4cf-zbvlm"
Jul 06 14:51:13.541797 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:13.541700    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-234d4ebd-openshift-default-846b94c4cf-zbvlm"
Jul 06 14:51:13.697491 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:13.697462    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-234d4ebd-openshift-default-846b94c4cf-zbvlm"]
Jul 06 14:51:13.701089 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:51:13.701061    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34f558d9_2168_40d9_aada_917369f45b12.slice/crio-90f40b4ba1d87f7cdf85859c91315cc952cb406197b3a5f22a91ef1a6544bd4a WatchSource:0}: Error finding container 90f40b4ba1d87f7cdf85859c91315cc952cb406197b3a5f22a91ef1a6544bd4a: Status 404 returned error can't find the container with id 90f40b4ba1d87f7cdf85859c91315cc952cb406197b3a5f22a91ef1a6544bd4a
Jul 06 14:51:13.703292 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:13.703259    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:51:13.703383 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:13.703325    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:51:13.703383 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:13.703355    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:51:13.850985 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:13.850893    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-234d4ebd-openshift-default-846b94c4cf-zbvlm" event={"ID":"34f558d9-2168-40d9-aada-917369f45b12","Type":"ContainerStarted","Data":"aefde7d06aa4fdffbc225e9a58a0aa2512f85674e97d5b1527a93c0f61e48f58"}
Jul 06 14:51:13.850985 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:13.850944    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-234d4ebd-openshift-default-846b94c4cf-zbvlm" event={"ID":"34f558d9-2168-40d9-aada-917369f45b12","Type":"ContainerStarted","Data":"90f40b4ba1d87f7cdf85859c91315cc952cb406197b3a5f22a91ef1a6544bd4a"}
Jul 06 14:51:13.913561 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:13.913498    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-234d4ebd-openshift-default-846b94c4cf-zbvlm" podStartSLOduration=0.913477793 podStartE2EDuration="913.477793ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:51:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:51:13.912150792 +0000 UTC m=+1700.832431222" watchObservedRunningTime="2026-07-06 14:51:13.913477793 +0000 UTC m=+1700.833758221"
Jul 06 14:51:13.957062 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:13.957027    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:51:14.542033 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:14.541994    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-234d4ebd-openshift-default-846b94c4cf-zbvlm"
Jul 06 14:51:14.546760 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:14.546735    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-234d4ebd-openshift-default-846b94c4cf-zbvlm"
Jul 06 14:51:14.854925 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:14.854844    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-234d4ebd-openshift-default-846b94c4cf-zbvlm"
Jul 06 14:51:14.855842 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:14.855823    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-234d4ebd-openshift-default-846b94c4cf-zbvlm"
Jul 06 14:51:16.230987 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:16.230899    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:51:16.331550 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:16.331511    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:51:16.537222 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:16.537133    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:51:16.984896 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:16.984868    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:51:17.480542 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:17.480510    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:51:17.775014 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:17.774919    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:51:20.689358 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:20.689324    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:51:21.185922 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:21.185888    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nkcvz"]
Jul 06 14:51:21.378064 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:21.378035    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:51:21.491710 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:21.491600    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:51:21.871868 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:21.871778    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:51:28.140222 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:28.140178    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:51:28.250626 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:28.250585    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:51:28.792532 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:28.792499    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:51:29.158933 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:29.158902    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:51:29.371987 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:29.371947    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:51:29.856459 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:29.856418    2582 patch_prober.go:28] interesting pod/e2e-mt-234d4ebd-openshift-default-846b94c4cf-zbvlm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body=
Jul 06 14:51:29.856677 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:29.856482    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-234d4ebd-openshift-default-846b94c4cf-zbvlm" podUID="34f558d9-2168-40d9-aada-917369f45b12" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused"
Jul 06 14:51:29.920466 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:29.920432    2582 generic.go:356] "Generic (PLEG): container finished" podID="34f558d9-2168-40d9-aada-917369f45b12" containerID="aefde7d06aa4fdffbc225e9a58a0aa2512f85674e97d5b1527a93c0f61e48f58" exitCode=0
Jul 06 14:51:29.920635 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:29.920506    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-234d4ebd-openshift-default-846b94c4cf-zbvlm" event={"ID":"34f558d9-2168-40d9-aada-917369f45b12","Type":"ContainerDied","Data":"aefde7d06aa4fdffbc225e9a58a0aa2512f85674e97d5b1527a93c0f61e48f58"}
Jul 06 14:51:29.920927 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:29.920904    2582 scope.go:117] "RemoveContainer" containerID="aefde7d06aa4fdffbc225e9a58a0aa2512f85674e97d5b1527a93c0f61e48f58"
Jul 06 14:51:29.921913 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:29.921881    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:51:29.922030 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:29.921972    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:51:29.922030 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:29.922018    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:51:30.928031 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:30.927992    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-234d4ebd-openshift-default-846b94c4cf-zbvlm" event={"ID":"34f558d9-2168-40d9-aada-917369f45b12","Type":"ContainerStarted","Data":"3e3324ddc2107a657737338b0d9aeee47ee0968cc43dfe19a4de4201afee222f"}
Jul 06 14:51:31.542970 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:31.542928    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-234d4ebd-openshift-default-846b94c4cf-zbvlm"
Jul 06 14:51:31.543189 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:31.543055    2582 patch_prober.go:28] interesting pod/e2e-mt-234d4ebd-openshift-default-846b94c4cf-zbvlm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body=
Jul 06 14:51:31.543189 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:31.543107    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-234d4ebd-openshift-default-846b94c4cf-zbvlm" podUID="34f558d9-2168-40d9-aada-917369f45b12" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused"
Jul 06 14:51:32.354445 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:32.354400    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nkcvz"]
Jul 06 14:51:32.542457 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:32.542415    2582 patch_prober.go:28] interesting pod/e2e-mt-234d4ebd-openshift-default-846b94c4cf-zbvlm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body=
Jul 06 14:51:32.542774 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:32.542743    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-234d4ebd-openshift-default-846b94c4cf-zbvlm" podUID="34f558d9-2168-40d9-aada-917369f45b12" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused"
Jul 06 14:51:33.542292 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:33.542253    2582 patch_prober.go:28] interesting pod/e2e-mt-234d4ebd-openshift-default-846b94c4cf-zbvlm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body=
Jul 06 14:51:33.542814 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:33.542316    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-234d4ebd-openshift-default-846b94c4cf-zbvlm" podUID="34f558d9-2168-40d9-aada-917369f45b12" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused"
Jul 06 14:51:34.542797 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:34.542758    2582 patch_prober.go:28] interesting pod/e2e-mt-234d4ebd-openshift-default-846b94c4cf-zbvlm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body=
Jul 06 14:51:34.543393 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:34.543359    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-234d4ebd-openshift-default-846b94c4cf-zbvlm" podUID="34f558d9-2168-40d9-aada-917369f45b12" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused"
Jul 06 14:51:35.546936 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:35.546907    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-234d4ebd-openshift-default-846b94c4cf-zbvlm"
Jul 06 14:51:35.547316 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:35.547171    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-234d4ebd-openshift-default-846b94c4cf-zbvlm"
Jul 06 14:51:35.547795 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:35.547778    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-234d4ebd-openshift-default-846b94c4cf-zbvlm"
Jul 06 14:51:35.572811 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:35.572781    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:51:35.670904 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:35.670871    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:51:35.832523 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:35.832443    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-234d4ebd-openshift-default-846b94c4cf-zbvlm"]
Jul 06 14:51:35.852037 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:35.852010    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:51:35.956466 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:35.956432    2582 kubelet_pods.go:1082] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/e2e-mt-234d4ebd-openshift-default-846b94c4cf-zbvlm" secret="" err="secret \"e2e-mt-234d4ebd-openshift-default-dockercfg-tvkhb\" not found"
Jul 06 14:51:36.084632 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:36.084539    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:51:36.239911 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:36.239875    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:51:36.311765 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:36.311721    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:51:36.419214 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:36.419178    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:51:36.961193 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:36.961155    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-234d4ebd-openshift-default-846b94c4cf-zbvlm" podUID="34f558d9-2168-40d9-aada-917369f45b12" containerName="istio-proxy" containerID="cri-o://3e3324ddc2107a657737338b0d9aeee47ee0968cc43dfe19a4de4201afee222f" gracePeriod=30
Jul 06 14:51:42.217840 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:42.217817    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-234d4ebd-openshift-default-846b94c4cf-zbvlm"
Jul 06 14:51:42.321744 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:42.321637    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/34f558d9-2168-40d9-aada-917369f45b12-credential-socket\") pod \"34f558d9-2168-40d9-aada-917369f45b12\" (UID: \"34f558d9-2168-40d9-aada-917369f45b12\") "
Jul 06 14:51:42.321744 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:42.321697    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/34f558d9-2168-40d9-aada-917369f45b12-istiod-ca-cert\") pod \"34f558d9-2168-40d9-aada-917369f45b12\" (UID: \"34f558d9-2168-40d9-aada-917369f45b12\") "
Jul 06 14:51:42.321744 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:42.321730    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/34f558d9-2168-40d9-aada-917369f45b12-istio-podinfo\") pod \"34f558d9-2168-40d9-aada-917369f45b12\" (UID: \"34f558d9-2168-40d9-aada-917369f45b12\") "
Jul 06 14:51:42.322030 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:42.321771    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/34f558d9-2168-40d9-aada-917369f45b12-istio-data\") pod \"34f558d9-2168-40d9-aada-917369f45b12\" (UID: \"34f558d9-2168-40d9-aada-917369f45b12\") "
Jul 06 14:51:42.322030 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:42.321794    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/34f558d9-2168-40d9-aada-917369f45b12-istio-envoy\") pod \"34f558d9-2168-40d9-aada-917369f45b12\" (UID: \"34f558d9-2168-40d9-aada-917369f45b12\") "
Jul 06 14:51:42.322030 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:42.321856    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/34f558d9-2168-40d9-aada-917369f45b12-workload-socket\") pod \"34f558d9-2168-40d9-aada-917369f45b12\" (UID: \"34f558d9-2168-40d9-aada-917369f45b12\") "
Jul 06 14:51:42.322030 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:42.321880    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/34f558d9-2168-40d9-aada-917369f45b12-workload-certs\") pod \"34f558d9-2168-40d9-aada-917369f45b12\" (UID: \"34f558d9-2168-40d9-aada-917369f45b12\") "
Jul 06 14:51:42.322030 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:42.321928    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zplzs\" (UniqueName: \"kubernetes.io/projected/34f558d9-2168-40d9-aada-917369f45b12-kube-api-access-zplzs\") pod \"34f558d9-2168-40d9-aada-917369f45b12\" (UID: \"34f558d9-2168-40d9-aada-917369f45b12\") "
Jul 06 14:51:42.322030 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:42.321941    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34f558d9-2168-40d9-aada-917369f45b12-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "34f558d9-2168-40d9-aada-917369f45b12" (UID: "34f558d9-2168-40d9-aada-917369f45b12"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:51:42.322339 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:42.321954    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/34f558d9-2168-40d9-aada-917369f45b12-istio-token\") pod \"34f558d9-2168-40d9-aada-917369f45b12\" (UID: \"34f558d9-2168-40d9-aada-917369f45b12\") "
Jul 06 14:51:42.322339 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:42.322234    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/34f558d9-2168-40d9-aada-917369f45b12-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "34f558d9-2168-40d9-aada-917369f45b12" (UID: "34f558d9-2168-40d9-aada-917369f45b12"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:51:42.322339 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:42.322234    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34f558d9-2168-40d9-aada-917369f45b12-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "34f558d9-2168-40d9-aada-917369f45b12" (UID: "34f558d9-2168-40d9-aada-917369f45b12"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:51:42.322493 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:42.322397    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/34f558d9-2168-40d9-aada-917369f45b12-credential-socket\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Jul 06 14:51:42.322493 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:42.322416    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/34f558d9-2168-40d9-aada-917369f45b12-istiod-ca-cert\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Jul 06 14:51:42.322493 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:42.322431    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/34f558d9-2168-40d9-aada-917369f45b12-workload-certs\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Jul 06 14:51:42.322493 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:42.322448    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34f558d9-2168-40d9-aada-917369f45b12-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "34f558d9-2168-40d9-aada-917369f45b12" (UID: "34f558d9-2168-40d9-aada-917369f45b12"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:51:42.322811 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:42.322786    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34f558d9-2168-40d9-aada-917369f45b12-istio-data" (OuterVolumeSpecName: "istio-data") pod "34f558d9-2168-40d9-aada-917369f45b12" (UID: "34f558d9-2168-40d9-aada-917369f45b12"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:51:42.324144 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:42.324112    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/34f558d9-2168-40d9-aada-917369f45b12-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "34f558d9-2168-40d9-aada-917369f45b12" (UID: "34f558d9-2168-40d9-aada-917369f45b12"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 14:51:42.324270 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:42.324164    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/34f558d9-2168-40d9-aada-917369f45b12-istio-token" (OuterVolumeSpecName: "istio-token") pod "34f558d9-2168-40d9-aada-917369f45b12" (UID: "34f558d9-2168-40d9-aada-917369f45b12"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:51:42.324270 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:42.324244    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/34f558d9-2168-40d9-aada-917369f45b12-kube-api-access-zplzs" (OuterVolumeSpecName: "kube-api-access-zplzs") pod "34f558d9-2168-40d9-aada-917369f45b12" (UID: "34f558d9-2168-40d9-aada-917369f45b12"). InnerVolumeSpecName "kube-api-access-zplzs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:51:42.324421 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:42.324302    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34f558d9-2168-40d9-aada-917369f45b12-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "34f558d9-2168-40d9-aada-917369f45b12" (UID: "34f558d9-2168-40d9-aada-917369f45b12"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:51:42.423896 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:42.423841    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/34f558d9-2168-40d9-aada-917369f45b12-workload-socket\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Jul 06 14:51:42.423896 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:42.423888    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zplzs\" (UniqueName: \"kubernetes.io/projected/34f558d9-2168-40d9-aada-917369f45b12-kube-api-access-zplzs\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Jul 06 14:51:42.423896 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:42.423899    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/34f558d9-2168-40d9-aada-917369f45b12-istio-token\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Jul 06 14:51:42.423896 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:42.423907    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/34f558d9-2168-40d9-aada-917369f45b12-istio-podinfo\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Jul 06 14:51:42.424165 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:42.423915    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/34f558d9-2168-40d9-aada-917369f45b12-istio-data\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Jul 06 14:51:42.424165 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:42.423924    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/34f558d9-2168-40d9-aada-917369f45b12-istio-envoy\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Jul 06 14:51:42.851807 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:42.851775    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:51:42.961013 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:42.960970    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:51:42.989969 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:42.989930    2582 generic.go:356] "Generic (PLEG): container finished" podID="34f558d9-2168-40d9-aada-917369f45b12" containerID="3e3324ddc2107a657737338b0d9aeee47ee0968cc43dfe19a4de4201afee222f" exitCode=0
Jul 06 14:51:42.990152 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:42.989978    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-234d4ebd-openshift-default-846b94c4cf-zbvlm"
Jul 06 14:51:42.990152 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:42.990010    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-234d4ebd-openshift-default-846b94c4cf-zbvlm" event={"ID":"34f558d9-2168-40d9-aada-917369f45b12","Type":"ContainerDied","Data":"3e3324ddc2107a657737338b0d9aeee47ee0968cc43dfe19a4de4201afee222f"}
Jul 06 14:51:42.990152 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:42.990066    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-234d4ebd-openshift-default-846b94c4cf-zbvlm" event={"ID":"34f558d9-2168-40d9-aada-917369f45b12","Type":"ContainerDied","Data":"90f40b4ba1d87f7cdf85859c91315cc952cb406197b3a5f22a91ef1a6544bd4a"}
Jul 06 14:51:42.990152 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:42.990097    2582 scope.go:117] "RemoveContainer" containerID="3e3324ddc2107a657737338b0d9aeee47ee0968cc43dfe19a4de4201afee222f"
Jul 06 14:51:42.999145 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:42.999120    2582 scope.go:117] "RemoveContainer" containerID="aefde7d06aa4fdffbc225e9a58a0aa2512f85674e97d5b1527a93c0f61e48f58"
Jul 06 14:51:43.007070 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:43.007051    2582 scope.go:117] "RemoveContainer" containerID="3e3324ddc2107a657737338b0d9aeee47ee0968cc43dfe19a4de4201afee222f"
Jul 06 14:51:43.007332 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:51:43.007312    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e3324ddc2107a657737338b0d9aeee47ee0968cc43dfe19a4de4201afee222f\": container with ID starting with 3e3324ddc2107a657737338b0d9aeee47ee0968cc43dfe19a4de4201afee222f not found: ID does not exist" containerID="3e3324ddc2107a657737338b0d9aeee47ee0968cc43dfe19a4de4201afee222f"
Jul 06 14:51:43.007368 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:43.007342    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e3324ddc2107a657737338b0d9aeee47ee0968cc43dfe19a4de4201afee222f"} err="failed to get container status \"3e3324ddc2107a657737338b0d9aeee47ee0968cc43dfe19a4de4201afee222f\": rpc error: code = NotFound desc = could not find container \"3e3324ddc2107a657737338b0d9aeee47ee0968cc43dfe19a4de4201afee222f\": container with ID starting with 3e3324ddc2107a657737338b0d9aeee47ee0968cc43dfe19a4de4201afee222f not found: ID does not exist"
Jul 06 14:51:43.007368 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:43.007361    2582 scope.go:117] "RemoveContainer" containerID="aefde7d06aa4fdffbc225e9a58a0aa2512f85674e97d5b1527a93c0f61e48f58"
Jul 06 14:51:43.007596 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:51:43.007576    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aefde7d06aa4fdffbc225e9a58a0aa2512f85674e97d5b1527a93c0f61e48f58\": container with ID starting with aefde7d06aa4fdffbc225e9a58a0aa2512f85674e97d5b1527a93c0f61e48f58 not found: ID does not exist" containerID="aefde7d06aa4fdffbc225e9a58a0aa2512f85674e97d5b1527a93c0f61e48f58"
Jul 06 14:51:43.007641 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:43.007602    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aefde7d06aa4fdffbc225e9a58a0aa2512f85674e97d5b1527a93c0f61e48f58"} err="failed to get container status \"aefde7d06aa4fdffbc225e9a58a0aa2512f85674e97d5b1527a93c0f61e48f58\": rpc error: code = NotFound desc = could not find container \"aefde7d06aa4fdffbc225e9a58a0aa2512f85674e97d5b1527a93c0f61e48f58\": container with ID starting with aefde7d06aa4fdffbc225e9a58a0aa2512f85674e97d5b1527a93c0f61e48f58 not found: ID does not exist"
Jul 06 14:51:43.042417 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:43.042382    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-234d4ebd-openshift-default-846b94c4cf-zbvlm"]
Jul 06 14:51:43.049551 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:43.049525    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-234d4ebd-openshift-default-846b94c4cf-zbvlm"]
Jul 06 14:51:43.061854 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:43.061829    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:51:43.215189 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:43.215153    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:51:43.499077 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:43.498992    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="34f558d9-2168-40d9-aada-917369f45b12" path="/var/lib/kubelet/pods/34f558d9-2168-40d9-aada-917369f45b12/volumes"
Jul 06 14:51:43.637734 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:43.637695    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:51:43.736533 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:43.736494    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:51:50.584799 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:50.584760    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:51:50.685442 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:50.685406    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:51:59.615976 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:51:59.615938    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:52:00.005932 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:52:00.005890    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:52:00.273083 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:52:00.272996    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:52:02.787395 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:52:02.787360    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:52:02.962207 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:52:02.962172    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:52:03.059192 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:52:03.059100    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:52:03.239786 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:52:03.239754    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:52:03.679165 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:52:03.679114    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:52:03.780051 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:52:03.779991    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:52:07.188415 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:52:07.188377    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:52:07.346401 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:52:07.346365    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nkcvz"]
Jul 06 14:52:35.396858 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:52:35.396812    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-4937319b/e2e-lifecycle-model-4937319b-kserve-689d86ff7f-7dt58"]
Jul 06 14:52:35.397340 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:52:35.397289    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34f558d9-2168-40d9-aada-917369f45b12" containerName="istio-proxy"
Jul 06 14:52:35.397340 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:52:35.397309    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="34f558d9-2168-40d9-aada-917369f45b12" containerName="istio-proxy"
Jul 06 14:52:35.397340 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:52:35.397319    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34f558d9-2168-40d9-aada-917369f45b12" containerName="istio-proxy"
Jul 06 14:52:35.397340 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:52:35.397327    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="34f558d9-2168-40d9-aada-917369f45b12" containerName="istio-proxy"
Jul 06 14:52:35.397551 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:52:35.397419    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="34f558d9-2168-40d9-aada-917369f45b12" containerName="istio-proxy"
Jul 06 14:52:35.400242 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:52:35.400220    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-4937319b/e2e-lifecycle-model-4937319b-kserve-689d86ff7f-7dt58"
Jul 06 14:52:35.404636 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:52:35.404608    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-4937319b\"/\"e2e-lifecycle-model-4937319b-kserve-self-signed-certs\""
Jul 06 14:52:35.405339 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:52:35.405323    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-4937319b\"/\"default-dockercfg-4w47q\""
Jul 06 14:52:35.405460 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:52:35.405385    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-4937319b\"/\"kube-root-ca.crt\""
Jul 06 14:52:35.405460 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:52:35.405432    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-4937319b\"/\"openshift-service-ca.crt\""
Jul 06 14:52:35.425549 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:52:35.425513    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-4937319b/e2e-lifecycle-model-4937319b-kserve-689d86ff7f-7dt58"]
Jul 06 14:52:35.476893 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:52:35.476857    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:52:35.586470 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:52:35.586430    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe9254ad-1e3b-41eb-bf11-e206c3b0985f-tls-certs\") pod \"e2e-lifecycle-model-4937319b-kserve-689d86ff7f-7dt58\" (UID: \"fe9254ad-1e3b-41eb-bf11-e206c3b0985f\") " pod="ai-tenant-e2e-mt-4937319b/e2e-lifecycle-model-4937319b-kserve-689d86ff7f-7dt58"
Jul 06 14:52:35.586470 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:52:35.586473    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fe9254ad-1e3b-41eb-bf11-e206c3b0985f-home\") pod \"e2e-lifecycle-model-4937319b-kserve-689d86ff7f-7dt58\" (UID: \"fe9254ad-1e3b-41eb-bf11-e206c3b0985f\") " pod="ai-tenant-e2e-mt-4937319b/e2e-lifecycle-model-4937319b-kserve-689d86ff7f-7dt58"
Jul 06 14:52:35.586717 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:52:35.586495    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fe9254ad-1e3b-41eb-bf11-e206c3b0985f-tmp-dir\") pod \"e2e-lifecycle-model-4937319b-kserve-689d86ff7f-7dt58\" (UID: \"fe9254ad-1e3b-41eb-bf11-e206c3b0985f\") " pod="ai-tenant-e2e-mt-4937319b/e2e-lifecycle-model-4937319b-kserve-689d86ff7f-7dt58"
Jul 06 14:52:35.586717 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:52:35.586575    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6zjqc\" (UniqueName: \"kubernetes.io/projected/fe9254ad-1e3b-41eb-bf11-e206c3b0985f-kube-api-access-6zjqc\") pod \"e2e-lifecycle-model-4937319b-kserve-689d86ff7f-7dt58\" (UID: \"fe9254ad-1e3b-41eb-bf11-e206c3b0985f\") " pod="ai-tenant-e2e-mt-4937319b/e2e-lifecycle-model-4937319b-kserve-689d86ff7f-7dt58"
Jul 06 14:52:35.586717 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:52:35.586621    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fe9254ad-1e3b-41eb-bf11-e206c3b0985f-model-cache\") pod \"e2e-lifecycle-model-4937319b-kserve-689d86ff7f-7dt58\" (UID: \"fe9254ad-1e3b-41eb-bf11-e206c3b0985f\") " pod="ai-tenant-e2e-mt-4937319b/e2e-lifecycle-model-4937319b-kserve-689d86ff7f-7dt58"
Jul 06 14:52:35.586717 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:52:35.586687    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fe9254ad-1e3b-41eb-bf11-e206c3b0985f-dshm\") pod \"e2e-lifecycle-model-4937319b-kserve-689d86ff7f-7dt58\" (UID: \"fe9254ad-1e3b-41eb-bf11-e206c3b0985f\") " pod="ai-tenant-e2e-mt-4937319b/e2e-lifecycle-model-4937319b-kserve-689d86ff7f-7dt58"
Jul 06 14:52:35.687825 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:52:35.687788    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zjqc\" (UniqueName: \"kubernetes.io/projected/fe9254ad-1e3b-41eb-bf11-e206c3b0985f-kube-api-access-6zjqc\") pod \"e2e-lifecycle-model-4937319b-kserve-689d86ff7f-7dt58\" (UID: \"fe9254ad-1e3b-41eb-bf11-e206c3b0985f\") " pod="ai-tenant-e2e-mt-4937319b/e2e-lifecycle-model-4937319b-kserve-689d86ff7f-7dt58"
Jul 06 14:52:35.688005 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:52:35.687832    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fe9254ad-1e3b-41eb-bf11-e206c3b0985f-model-cache\") pod \"e2e-lifecycle-model-4937319b-kserve-689d86ff7f-7dt58\" (UID: \"fe9254ad-1e3b-41eb-bf11-e206c3b0985f\") " pod="ai-tenant-e2e-mt-4937319b/e2e-lifecycle-model-4937319b-kserve-689d86ff7f-7dt58"
Jul 06 14:52:35.688005 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:52:35.687879    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fe9254ad-1e3b-41eb-bf11-e206c3b0985f-dshm\") pod \"e2e-lifecycle-model-4937319b-kserve-689d86ff7f-7dt58\" (UID: \"fe9254ad-1e3b-41eb-bf11-e206c3b0985f\") " pod="ai-tenant-e2e-mt-4937319b/e2e-lifecycle-model-4937319b-kserve-689d86ff7f-7dt58"
Jul 06 14:52:35.688005 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:52:35.687948    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe9254ad-1e3b-41eb-bf11-e206c3b0985f-tls-certs\") pod \"e2e-lifecycle-model-4937319b-kserve-689d86ff7f-7dt58\" (UID: \"fe9254ad-1e3b-41eb-bf11-e206c3b0985f\") " pod="ai-tenant-e2e-mt-4937319b/e2e-lifecycle-model-4937319b-kserve-689d86ff7f-7dt58"
Jul 06 14:52:35.688005 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:52:35.687979    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fe9254ad-1e3b-41eb-bf11-e206c3b0985f-home\") pod \"e2e-lifecycle-model-4937319b-kserve-689d86ff7f-7dt58\" (UID: \"fe9254ad-1e3b-41eb-bf11-e206c3b0985f\") " pod="ai-tenant-e2e-mt-4937319b/e2e-lifecycle-model-4937319b-kserve-689d86ff7f-7dt58"
Jul 06 14:52:35.688309 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:52:35.688006    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fe9254ad-1e3b-41eb-bf11-e206c3b0985f-tmp-dir\") pod \"e2e-lifecycle-model-4937319b-kserve-689d86ff7f-7dt58\" (UID: \"fe9254ad-1e3b-41eb-bf11-e206c3b0985f\") " pod="ai-tenant-e2e-mt-4937319b/e2e-lifecycle-model-4937319b-kserve-689d86ff7f-7dt58"
Jul 06 14:52:35.688395 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:52:35.688374    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fe9254ad-1e3b-41eb-bf11-e206c3b0985f-tmp-dir\") pod \"e2e-lifecycle-model-4937319b-kserve-689d86ff7f-7dt58\" (UID: \"fe9254ad-1e3b-41eb-bf11-e206c3b0985f\") " pod="ai-tenant-e2e-mt-4937319b/e2e-lifecycle-model-4937319b-kserve-689d86ff7f-7dt58"
Jul 06 14:52:35.688443 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:52:35.688392    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fe9254ad-1e3b-41eb-bf11-e206c3b0985f-model-cache\") pod \"e2e-lifecycle-model-4937319b-kserve-689d86ff7f-7dt58\" (UID: \"fe9254ad-1e3b-41eb-bf11-e206c3b0985f\") " pod="ai-tenant-e2e-mt-4937319b/e2e-lifecycle-model-4937319b-kserve-689d86ff7f-7dt58"
Jul 06 14:52:35.688483 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:52:35.688454    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fe9254ad-1e3b-41eb-bf11-e206c3b0985f-home\") pod \"e2e-lifecycle-model-4937319b-kserve-689d86ff7f-7dt58\" (UID: \"fe9254ad-1e3b-41eb-bf11-e206c3b0985f\") " pod="ai-tenant-e2e-mt-4937319b/e2e-lifecycle-model-4937319b-kserve-689d86ff7f-7dt58"
Jul 06 14:52:35.690199 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:52:35.690178    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fe9254ad-1e3b-41eb-bf11-e206c3b0985f-dshm\") pod \"e2e-lifecycle-model-4937319b-kserve-689d86ff7f-7dt58\" (UID: \"fe9254ad-1e3b-41eb-bf11-e206c3b0985f\") " pod="ai-tenant-e2e-mt-4937319b/e2e-lifecycle-model-4937319b-kserve-689d86ff7f-7dt58"
Jul 06 14:52:35.690350 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:52:35.690333    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe9254ad-1e3b-41eb-bf11-e206c3b0985f-tls-certs\") pod \"e2e-lifecycle-model-4937319b-kserve-689d86ff7f-7dt58\" (UID: \"fe9254ad-1e3b-41eb-bf11-e206c3b0985f\") " pod="ai-tenant-e2e-mt-4937319b/e2e-lifecycle-model-4937319b-kserve-689d86ff7f-7dt58"
Jul 06 14:52:35.697216 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:52:35.697195    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zjqc\" (UniqueName: \"kubernetes.io/projected/fe9254ad-1e3b-41eb-bf11-e206c3b0985f-kube-api-access-6zjqc\") pod \"e2e-lifecycle-model-4937319b-kserve-689d86ff7f-7dt58\" (UID: \"fe9254ad-1e3b-41eb-bf11-e206c3b0985f\") " pod="ai-tenant-e2e-mt-4937319b/e2e-lifecycle-model-4937319b-kserve-689d86ff7f-7dt58"
Jul 06 14:52:35.711059 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:52:35.711027    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-4937319b/e2e-lifecycle-model-4937319b-kserve-689d86ff7f-7dt58"
Jul 06 14:52:35.847464 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:52:35.847433    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-4937319b/e2e-lifecycle-model-4937319b-kserve-689d86ff7f-7dt58"]
Jul 06 14:52:35.849421 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:52:35.849390    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfe9254ad_1e3b_41eb_bf11_e206c3b0985f.slice/crio-408a680aa8ccb530fe2ee5188eeccee67df01d49befe024affc76682152b0f80 WatchSource:0}: Error finding container 408a680aa8ccb530fe2ee5188eeccee67df01d49befe024affc76682152b0f80: Status 404 returned error can't find the container with id 408a680aa8ccb530fe2ee5188eeccee67df01d49befe024affc76682152b0f80
Jul 06 14:52:36.221630 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:52:36.221595    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-4937319b/e2e-lifecycle-model-4937319b-kserve-689d86ff7f-7dt58" event={"ID":"fe9254ad-1e3b-41eb-bf11-e206c3b0985f","Type":"ContainerStarted","Data":"b60832aa61ef127b79cb4062f148caf9a29a26c9791a8d12992a8f8071f7959f"}
Jul 06 14:52:36.221630 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:52:36.221635    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-4937319b/e2e-lifecycle-model-4937319b-kserve-689d86ff7f-7dt58" event={"ID":"fe9254ad-1e3b-41eb-bf11-e206c3b0985f","Type":"ContainerStarted","Data":"408a680aa8ccb530fe2ee5188eeccee67df01d49befe024affc76682152b0f80"}
Jul 06 14:52:36.245960 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:52:36.245910    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-4937319b/e2e-lifecycle-model-4937319b-kserve-689d86ff7f-7dt58" podStartSLOduration=1.245896696 podStartE2EDuration="1.245896696s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:52:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:52:36.245054711 +0000 UTC m=+1783.165335143" watchObservedRunningTime="2026-07-06 14:52:36.245896696 +0000 UTC m=+1783.166177159"
Jul 06 14:52:38.772782 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:52:38.772749    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nkcvz"]
Jul 06 14:52:45.711394 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:52:45.711298    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-4937319b/e2e-lifecycle-model-4937319b-kserve-689d86ff7f-7dt58"
Jul 06 14:52:45.711394 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:52:45.711356    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-4937319b/e2e-lifecycle-model-4937319b-kserve-689d86ff7f-7dt58"
Jul 06 14:52:45.723861 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:52:45.723827    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-4937319b/e2e-lifecycle-model-4937319b-kserve-689d86ff7f-7dt58"
Jul 06 14:52:46.276576 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:52:46.276549    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-4937319b/e2e-lifecycle-model-4937319b-kserve-689d86ff7f-7dt58"
Jul 06 14:52:52.478117 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:52:52.478075    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nkcvz"]
Jul 06 14:52:55.063533 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:52:55.063480    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:52:55.790341 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:52:55.790304    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:53:01.175927 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:53:01.175888    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:53:06.094913 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:53:06.094874    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-4937319b/e2e-lifecycle-model-4937319b-kserve-689d86ff7f-7dt58"]
Jul 06 14:53:06.149917 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:53:06.149880    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:53:06.252378 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:53:06.252343    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nkcvz"]
Jul 06 14:53:21.120418 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:53:21.120350    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-mt-4937319b/e2e-lifecycle-model-4937319b-kserve-689d86ff7f-7dt58" podUID="fe9254ad-1e3b-41eb-bf11-e206c3b0985f" containerName="main" containerID="cri-o://b60832aa61ef127b79cb4062f148caf9a29a26c9791a8d12992a8f8071f7959f" gracePeriod=45
Jul 06 14:53:21.375593 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:53:21.375529    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-4937319b/e2e-lifecycle-model-4937319b-kserve-689d86ff7f-7dt58"
Jul 06 14:53:21.417802 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:53:21.417765    2582 generic.go:356] "Generic (PLEG): container finished" podID="fe9254ad-1e3b-41eb-bf11-e206c3b0985f" containerID="b60832aa61ef127b79cb4062f148caf9a29a26c9791a8d12992a8f8071f7959f" exitCode=0
Jul 06 14:53:21.417990 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:53:21.417813    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-4937319b/e2e-lifecycle-model-4937319b-kserve-689d86ff7f-7dt58"
Jul 06 14:53:21.417990 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:53:21.417834    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-4937319b/e2e-lifecycle-model-4937319b-kserve-689d86ff7f-7dt58" event={"ID":"fe9254ad-1e3b-41eb-bf11-e206c3b0985f","Type":"ContainerDied","Data":"b60832aa61ef127b79cb4062f148caf9a29a26c9791a8d12992a8f8071f7959f"}
Jul 06 14:53:21.417990 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:53:21.417869    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-4937319b/e2e-lifecycle-model-4937319b-kserve-689d86ff7f-7dt58" event={"ID":"fe9254ad-1e3b-41eb-bf11-e206c3b0985f","Type":"ContainerDied","Data":"408a680aa8ccb530fe2ee5188eeccee67df01d49befe024affc76682152b0f80"}
Jul 06 14:53:21.417990 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:53:21.417886    2582 scope.go:117] "RemoveContainer" containerID="b60832aa61ef127b79cb4062f148caf9a29a26c9791a8d12992a8f8071f7959f"
Jul 06 14:53:21.427346 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:53:21.427326    2582 scope.go:117] "RemoveContainer" containerID="b60832aa61ef127b79cb4062f148caf9a29a26c9791a8d12992a8f8071f7959f"
Jul 06 14:53:21.427713 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:53:21.427691    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b60832aa61ef127b79cb4062f148caf9a29a26c9791a8d12992a8f8071f7959f\": container with ID starting with b60832aa61ef127b79cb4062f148caf9a29a26c9791a8d12992a8f8071f7959f not found: ID does not exist" containerID="b60832aa61ef127b79cb4062f148caf9a29a26c9791a8d12992a8f8071f7959f"
Jul 06 14:53:21.427803 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:53:21.427722    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b60832aa61ef127b79cb4062f148caf9a29a26c9791a8d12992a8f8071f7959f"} err="failed to get container status \"b60832aa61ef127b79cb4062f148caf9a29a26c9791a8d12992a8f8071f7959f\": rpc error: code = NotFound desc = could not find container \"b60832aa61ef127b79cb4062f148caf9a29a26c9791a8d12992a8f8071f7959f\": container with ID starting with b60832aa61ef127b79cb4062f148caf9a29a26c9791a8d12992a8f8071f7959f not found: ID does not exist"
Jul 06 14:53:21.482786 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:53:21.482754    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6zjqc\" (UniqueName: \"kubernetes.io/projected/fe9254ad-1e3b-41eb-bf11-e206c3b0985f-kube-api-access-6zjqc\") pod \"fe9254ad-1e3b-41eb-bf11-e206c3b0985f\" (UID: \"fe9254ad-1e3b-41eb-bf11-e206c3b0985f\") "
Jul 06 14:53:21.482786 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:53:21.482799    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fe9254ad-1e3b-41eb-bf11-e206c3b0985f-model-cache\") pod \"fe9254ad-1e3b-41eb-bf11-e206c3b0985f\" (UID: \"fe9254ad-1e3b-41eb-bf11-e206c3b0985f\") "
Jul 06 14:53:21.483050 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:53:21.482829    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fe9254ad-1e3b-41eb-bf11-e206c3b0985f-home\") pod \"fe9254ad-1e3b-41eb-bf11-e206c3b0985f\" (UID: \"fe9254ad-1e3b-41eb-bf11-e206c3b0985f\") "
Jul 06 14:53:21.483050 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:53:21.482927    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe9254ad-1e3b-41eb-bf11-e206c3b0985f-tls-certs\") pod \"fe9254ad-1e3b-41eb-bf11-e206c3b0985f\" (UID: \"fe9254ad-1e3b-41eb-bf11-e206c3b0985f\") "
Jul 06 14:53:21.483050 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:53:21.482953    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fe9254ad-1e3b-41eb-bf11-e206c3b0985f-dshm\") pod \"fe9254ad-1e3b-41eb-bf11-e206c3b0985f\" (UID: \"fe9254ad-1e3b-41eb-bf11-e206c3b0985f\") "
Jul 06 14:53:21.483050 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:53:21.483000    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fe9254ad-1e3b-41eb-bf11-e206c3b0985f-tmp-dir\") pod \"fe9254ad-1e3b-41eb-bf11-e206c3b0985f\" (UID: \"fe9254ad-1e3b-41eb-bf11-e206c3b0985f\") "
Jul 06 14:53:21.483242 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:53:21.483108    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe9254ad-1e3b-41eb-bf11-e206c3b0985f-home" (OuterVolumeSpecName: "home") pod "fe9254ad-1e3b-41eb-bf11-e206c3b0985f" (UID: "fe9254ad-1e3b-41eb-bf11-e206c3b0985f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:53:21.483242 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:53:21.483122    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe9254ad-1e3b-41eb-bf11-e206c3b0985f-model-cache" (OuterVolumeSpecName: "model-cache") pod "fe9254ad-1e3b-41eb-bf11-e206c3b0985f" (UID: "fe9254ad-1e3b-41eb-bf11-e206c3b0985f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:53:21.483327 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:53:21.483258    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe9254ad-1e3b-41eb-bf11-e206c3b0985f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "fe9254ad-1e3b-41eb-bf11-e206c3b0985f" (UID: "fe9254ad-1e3b-41eb-bf11-e206c3b0985f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:53:21.483386 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:53:21.483350    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fe9254ad-1e3b-41eb-bf11-e206c3b0985f-tmp-dir\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Jul 06 14:53:21.483386 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:53:21.483370    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fe9254ad-1e3b-41eb-bf11-e206c3b0985f-model-cache\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Jul 06 14:53:21.483386 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:53:21.483379    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fe9254ad-1e3b-41eb-bf11-e206c3b0985f-home\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Jul 06 14:53:21.485103 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:53:21.485077    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe9254ad-1e3b-41eb-bf11-e206c3b0985f-kube-api-access-6zjqc" (OuterVolumeSpecName: "kube-api-access-6zjqc") pod "fe9254ad-1e3b-41eb-bf11-e206c3b0985f" (UID: "fe9254ad-1e3b-41eb-bf11-e206c3b0985f"). InnerVolumeSpecName "kube-api-access-6zjqc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:53:21.485203 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:53:21.485081    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe9254ad-1e3b-41eb-bf11-e206c3b0985f-dshm" (OuterVolumeSpecName: "dshm") pod "fe9254ad-1e3b-41eb-bf11-e206c3b0985f" (UID: "fe9254ad-1e3b-41eb-bf11-e206c3b0985f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:53:21.485203 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:53:21.485138    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fe9254ad-1e3b-41eb-bf11-e206c3b0985f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "fe9254ad-1e3b-41eb-bf11-e206c3b0985f" (UID: "fe9254ad-1e3b-41eb-bf11-e206c3b0985f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:53:21.584931 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:53:21.584892    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6zjqc\" (UniqueName: \"kubernetes.io/projected/fe9254ad-1e3b-41eb-bf11-e206c3b0985f-kube-api-access-6zjqc\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Jul 06 14:53:21.584931 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:53:21.584932    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe9254ad-1e3b-41eb-bf11-e206c3b0985f-tls-certs\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Jul 06 14:53:21.585147 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:53:21.584942    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fe9254ad-1e3b-41eb-bf11-e206c3b0985f-dshm\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Jul 06 14:53:21.751556 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:53:21.751516    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-4937319b/e2e-lifecycle-model-4937319b-kserve-689d86ff7f-7dt58"]
Jul 06 14:53:21.759596 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:53:21.759566    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-4937319b/e2e-lifecycle-model-4937319b-kserve-689d86ff7f-7dt58"]
Jul 06 14:53:23.498804 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:53:23.498714    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fe9254ad-1e3b-41eb-bf11-e206c3b0985f" path="/var/lib/kubelet/pods/fe9254ad-1e3b-41eb-bf11-e206c3b0985f/volumes"
Jul 06 14:53:42.610400 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:53:42.610362    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:53:43.891612 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:53:43.891569    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:53:45.847989 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:53:45.847952    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nkcvz"]
Jul 06 14:53:49.822787 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:53:49.822749    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:53:49.890869 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:53:49.890834    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:53:50.128001 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:53:50.127900    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:53:50.392310 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:53:50.392214    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:53:51.521492 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:53:51.521461    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:53:51.620422 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:53:51.620391    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:53:51.724208 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:53:51.724169    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:53:52.556198 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:53:52.556164    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:53:52.656197 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:53:52.656162    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:53:52.770888 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:53:52.770853    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:53:54.275310 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:53:54.275278    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:53:55.355545 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:53:55.355508    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nkcvz"]
Jul 06 14:54:00.449568 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:54:00.449535    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:54:00.546459 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:54:00.546429    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:54:01.171018 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:54:01.170988    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:54:08.430073 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:54:08.430038    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:54:08.452283 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:54:08.452243    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nkcvz"]
Jul 06 14:54:08.554878 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:54:08.554830    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:54:08.651871 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:54:08.651812    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:54:19.161267 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:54:19.161177    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:54:19.492641 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:54:19.492555    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:54:40.424264 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:54:40.424227    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:54:46.428232 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:54:46.428194    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:54:46.531466 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:54:46.531427    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:54:46.771489 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:54:46.771379    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:54:47.296392 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:54:47.296363    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:54:47.504031 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:54:47.503999    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:54:50.526507 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:54:50.526469    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:54:50.648631 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:54:50.648593    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:54:50.745989 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:54:50.745946    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:54:50.900178 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:54:50.900088    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:54:51.214369 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:54:51.214332    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:54:51.309460 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:54:51.309428    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:54:55.007849 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:54:55.007811    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:54:55.335776 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:54:55.335679    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:54:55.604544 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:54:55.604453    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-139570-openshift-default-64465c5c65-vkg2f"]
Jul 06 14:54:55.604820 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:54:55.604801    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe9254ad-1e3b-41eb-bf11-e206c3b0985f" containerName="main"
Jul 06 14:54:55.604820 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:54:55.604818    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe9254ad-1e3b-41eb-bf11-e206c3b0985f" containerName="main"
Jul 06 14:54:55.604969 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:54:55.604874    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe9254ad-1e3b-41eb-bf11-e206c3b0985f" containerName="main"
Jul 06 14:54:55.604969 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:54:55.604883    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="34f558d9-2168-40d9-aada-917369f45b12" containerName="istio-proxy"
Jul 06 14:54:55.607920 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:54:55.607899    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-139570-openshift-default-64465c5c65-vkg2f"
Jul 06 14:54:55.610403 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:54:55.610378    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-139570-openshift-default-dockercfg-b9xqc\""
Jul 06 14:54:55.620617 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:54:55.620589    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-139570-openshift-default-64465c5c65-vkg2f"]
Jul 06 14:54:55.636174 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:54:55.636144    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:54:55.713748 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:54:55.713711    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56l79\" (UniqueName: \"kubernetes.io/projected/7b2dd392-86c5-46dc-b359-39f8999c8c63-kube-api-access-56l79\") pod \"e2e-inf-b-139570-openshift-default-64465c5c65-vkg2f\" (UID: \"7b2dd392-86c5-46dc-b359-39f8999c8c63\") " pod="openshift-ingress/e2e-inf-b-139570-openshift-default-64465c5c65-vkg2f"
Jul 06 14:54:55.713926 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:54:55.713765    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b2dd392-86c5-46dc-b359-39f8999c8c63-credential-socket\") pod \"e2e-inf-b-139570-openshift-default-64465c5c65-vkg2f\" (UID: \"7b2dd392-86c5-46dc-b359-39f8999c8c63\") " pod="openshift-ingress/e2e-inf-b-139570-openshift-default-64465c5c65-vkg2f"
Jul 06 14:54:55.713926 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:54:55.713822    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7b2dd392-86c5-46dc-b359-39f8999c8c63-istio-token\") pod \"e2e-inf-b-139570-openshift-default-64465c5c65-vkg2f\" (UID: \"7b2dd392-86c5-46dc-b359-39f8999c8c63\") " pod="openshift-ingress/e2e-inf-b-139570-openshift-default-64465c5c65-vkg2f"
Jul 06 14:54:55.713926 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:54:55.713881    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7b2dd392-86c5-46dc-b359-39f8999c8c63-istiod-ca-cert\") pod \"e2e-inf-b-139570-openshift-default-64465c5c65-vkg2f\" (UID: \"7b2dd392-86c5-46dc-b359-39f8999c8c63\") " pod="openshift-ingress/e2e-inf-b-139570-openshift-default-64465c5c65-vkg2f"
Jul 06 14:54:55.714043 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:54:55.713954    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7b2dd392-86c5-46dc-b359-39f8999c8c63-istio-envoy\") pod \"e2e-inf-b-139570-openshift-default-64465c5c65-vkg2f\" (UID: \"7b2dd392-86c5-46dc-b359-39f8999c8c63\") " pod="openshift-ingress/e2e-inf-b-139570-openshift-default-64465c5c65-vkg2f"
Jul 06 14:54:55.714043 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:54:55.713970    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7b2dd392-86c5-46dc-b359-39f8999c8c63-istio-podinfo\") pod \"e2e-inf-b-139570-openshift-default-64465c5c65-vkg2f\" (UID: \"7b2dd392-86c5-46dc-b359-39f8999c8c63\") " pod="openshift-ingress/e2e-inf-b-139570-openshift-default-64465c5c65-vkg2f"
Jul 06 14:54:55.714043 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:54:55.714022    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b2dd392-86c5-46dc-b359-39f8999c8c63-workload-socket\") pod \"e2e-inf-b-139570-openshift-default-64465c5c65-vkg2f\" (UID: \"7b2dd392-86c5-46dc-b359-39f8999c8c63\") " pod="openshift-ingress/e2e-inf-b-139570-openshift-default-64465c5c65-vkg2f"
Jul 06 14:54:55.714149 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:54:55.714053    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7b2dd392-86c5-46dc-b359-39f8999c8c63-istio-data\") pod \"e2e-inf-b-139570-openshift-default-64465c5c65-vkg2f\" (UID: \"7b2dd392-86c5-46dc-b359-39f8999c8c63\") " pod="openshift-ingress/e2e-inf-b-139570-openshift-default-64465c5c65-vkg2f"
Jul 06 14:54:55.714149 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:54:55.714083    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7b2dd392-86c5-46dc-b359-39f8999c8c63-workload-certs\") pod \"e2e-inf-b-139570-openshift-default-64465c5c65-vkg2f\" (UID: \"7b2dd392-86c5-46dc-b359-39f8999c8c63\") " pod="openshift-ingress/e2e-inf-b-139570-openshift-default-64465c5c65-vkg2f"
Jul 06 14:54:55.815365 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:54:55.815324    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7b2dd392-86c5-46dc-b359-39f8999c8c63-istiod-ca-cert\") pod \"e2e-inf-b-139570-openshift-default-64465c5c65-vkg2f\" (UID: \"7b2dd392-86c5-46dc-b359-39f8999c8c63\") " pod="openshift-ingress/e2e-inf-b-139570-openshift-default-64465c5c65-vkg2f"
Jul 06 14:54:55.815534 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:54:55.815377    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7b2dd392-86c5-46dc-b359-39f8999c8c63-istio-envoy\") pod \"e2e-inf-b-139570-openshift-default-64465c5c65-vkg2f\" (UID: \"7b2dd392-86c5-46dc-b359-39f8999c8c63\") " pod="openshift-ingress/e2e-inf-b-139570-openshift-default-64465c5c65-vkg2f"
Jul 06 14:54:55.815534 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:54:55.815499    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7b2dd392-86c5-46dc-b359-39f8999c8c63-istio-podinfo\") pod \"e2e-inf-b-139570-openshift-default-64465c5c65-vkg2f\" (UID: \"7b2dd392-86c5-46dc-b359-39f8999c8c63\") " pod="openshift-ingress/e2e-inf-b-139570-openshift-default-64465c5c65-vkg2f"
Jul 06 14:54:55.815670 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:54:55.815562    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b2dd392-86c5-46dc-b359-39f8999c8c63-workload-socket\") pod \"e2e-inf-b-139570-openshift-default-64465c5c65-vkg2f\" (UID: \"7b2dd392-86c5-46dc-b359-39f8999c8c63\") " pod="openshift-ingress/e2e-inf-b-139570-openshift-default-64465c5c65-vkg2f"
Jul 06 14:54:55.815670 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:54:55.815604    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7b2dd392-86c5-46dc-b359-39f8999c8c63-istio-data\") pod \"e2e-inf-b-139570-openshift-default-64465c5c65-vkg2f\" (UID: \"7b2dd392-86c5-46dc-b359-39f8999c8c63\") " pod="openshift-ingress/e2e-inf-b-139570-openshift-default-64465c5c65-vkg2f"
Jul 06 14:54:55.815811 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:54:55.815786    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7b2dd392-86c5-46dc-b359-39f8999c8c63-workload-certs\") pod \"e2e-inf-b-139570-openshift-default-64465c5c65-vkg2f\" (UID: \"7b2dd392-86c5-46dc-b359-39f8999c8c63\") " pod="openshift-ingress/e2e-inf-b-139570-openshift-default-64465c5c65-vkg2f"
Jul 06 14:54:55.815882 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:54:55.815848    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56l79\" (UniqueName: \"kubernetes.io/projected/7b2dd392-86c5-46dc-b359-39f8999c8c63-kube-api-access-56l79\") pod \"e2e-inf-b-139570-openshift-default-64465c5c65-vkg2f\" (UID: \"7b2dd392-86c5-46dc-b359-39f8999c8c63\") " pod="openshift-ingress/e2e-inf-b-139570-openshift-default-64465c5c65-vkg2f"
Jul 06 14:54:55.815944 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:54:55.815887    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b2dd392-86c5-46dc-b359-39f8999c8c63-credential-socket\") pod \"e2e-inf-b-139570-openshift-default-64465c5c65-vkg2f\" (UID: \"7b2dd392-86c5-46dc-b359-39f8999c8c63\") " pod="openshift-ingress/e2e-inf-b-139570-openshift-default-64465c5c65-vkg2f"
Jul 06 14:54:55.815944 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:54:55.815911    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7b2dd392-86c5-46dc-b359-39f8999c8c63-istio-token\") pod \"e2e-inf-b-139570-openshift-default-64465c5c65-vkg2f\" (UID: \"7b2dd392-86c5-46dc-b359-39f8999c8c63\") " pod="openshift-ingress/e2e-inf-b-139570-openshift-default-64465c5c65-vkg2f"
Jul 06 14:54:55.815944 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:54:55.815926    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b2dd392-86c5-46dc-b359-39f8999c8c63-workload-socket\") pod \"e2e-inf-b-139570-openshift-default-64465c5c65-vkg2f\" (UID: \"7b2dd392-86c5-46dc-b359-39f8999c8c63\") " pod="openshift-ingress/e2e-inf-b-139570-openshift-default-64465c5c65-vkg2f"
Jul 06 14:54:55.816106 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:54:55.815995    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7b2dd392-86c5-46dc-b359-39f8999c8c63-istio-data\") pod \"e2e-inf-b-139570-openshift-default-64465c5c65-vkg2f\" (UID: \"7b2dd392-86c5-46dc-b359-39f8999c8c63\") " pod="openshift-ingress/e2e-inf-b-139570-openshift-default-64465c5c65-vkg2f"
Jul 06 14:54:55.816227 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:54:55.816207    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7b2dd392-86c5-46dc-b359-39f8999c8c63-workload-certs\") pod \"e2e-inf-b-139570-openshift-default-64465c5c65-vkg2f\" (UID: \"7b2dd392-86c5-46dc-b359-39f8999c8c63\") " pod="openshift-ingress/e2e-inf-b-139570-openshift-default-64465c5c65-vkg2f"
Jul 06 14:54:55.816425 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:54:55.816214    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7b2dd392-86c5-46dc-b359-39f8999c8c63-istiod-ca-cert\") pod \"e2e-inf-b-139570-openshift-default-64465c5c65-vkg2f\" (UID: \"7b2dd392-86c5-46dc-b359-39f8999c8c63\") " pod="openshift-ingress/e2e-inf-b-139570-openshift-default-64465c5c65-vkg2f"
Jul 06 14:54:55.816513 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:54:55.816277    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b2dd392-86c5-46dc-b359-39f8999c8c63-credential-socket\") pod \"e2e-inf-b-139570-openshift-default-64465c5c65-vkg2f\" (UID: \"7b2dd392-86c5-46dc-b359-39f8999c8c63\") " pod="openshift-ingress/e2e-inf-b-139570-openshift-default-64465c5c65-vkg2f"
Jul 06 14:54:55.817847 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:54:55.817825    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7b2dd392-86c5-46dc-b359-39f8999c8c63-istio-envoy\") pod \"e2e-inf-b-139570-openshift-default-64465c5c65-vkg2f\" (UID: \"7b2dd392-86c5-46dc-b359-39f8999c8c63\") " pod="openshift-ingress/e2e-inf-b-139570-openshift-default-64465c5c65-vkg2f"
Jul 06 14:54:55.818054 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:54:55.818034    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7b2dd392-86c5-46dc-b359-39f8999c8c63-istio-podinfo\") pod \"e2e-inf-b-139570-openshift-default-64465c5c65-vkg2f\" (UID: \"7b2dd392-86c5-46dc-b359-39f8999c8c63\") " pod="openshift-ingress/e2e-inf-b-139570-openshift-default-64465c5c65-vkg2f"
Jul 06 14:54:55.825164 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:54:55.825129    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7b2dd392-86c5-46dc-b359-39f8999c8c63-istio-token\") pod \"e2e-inf-b-139570-openshift-default-64465c5c65-vkg2f\" (UID: \"7b2dd392-86c5-46dc-b359-39f8999c8c63\") " pod="openshift-ingress/e2e-inf-b-139570-openshift-default-64465c5c65-vkg2f"
Jul 06 14:54:55.825292 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:54:55.825189    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-56l79\" (UniqueName: \"kubernetes.io/projected/7b2dd392-86c5-46dc-b359-39f8999c8c63-kube-api-access-56l79\") pod \"e2e-inf-b-139570-openshift-default-64465c5c65-vkg2f\" (UID: \"7b2dd392-86c5-46dc-b359-39f8999c8c63\") " pod="openshift-ingress/e2e-inf-b-139570-openshift-default-64465c5c65-vkg2f"
Jul 06 14:54:55.919440 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:54:55.919405    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-139570-openshift-default-64465c5c65-vkg2f"
Jul 06 14:54:56.060587 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:54:56.060476    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-139570-openshift-default-64465c5c65-vkg2f"]
Jul 06 14:54:56.063333 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:54:56.063293    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b2dd392_86c5_46dc_b359_39f8999c8c63.slice/crio-4f7a1ca2f6a71ebf6b702c6a38194e69fcbdd341374fe62a3b97fc1b2fc60b41 WatchSource:0}: Error finding container 4f7a1ca2f6a71ebf6b702c6a38194e69fcbdd341374fe62a3b97fc1b2fc60b41: Status 404 returned error can't find the container with id 4f7a1ca2f6a71ebf6b702c6a38194e69fcbdd341374fe62a3b97fc1b2fc60b41
Jul 06 14:54:56.065485 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:54:56.065452    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:54:56.065565 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:54:56.065530    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:54:56.065565 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:54:56.065560    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:54:56.253574 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:54:56.253437    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:54:56.827683 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:54:56.827635    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-139570-openshift-default-64465c5c65-vkg2f" event={"ID":"7b2dd392-86c5-46dc-b359-39f8999c8c63","Type":"ContainerStarted","Data":"21957478c043a8e5eef3bda89a069187bd2f11d24986cf7763f2f34e3104c6f7"}
Jul 06 14:54:56.827823 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:54:56.827706    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-139570-openshift-default-64465c5c65-vkg2f" event={"ID":"7b2dd392-86c5-46dc-b359-39f8999c8c63","Type":"ContainerStarted","Data":"4f7a1ca2f6a71ebf6b702c6a38194e69fcbdd341374fe62a3b97fc1b2fc60b41"}
Jul 06 14:54:56.850492 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:54:56.850442    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-139570-openshift-default-64465c5c65-vkg2f" podStartSLOduration=1.8504271920000002 podStartE2EDuration="1.850427192s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:54:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:54:56.849883136 +0000 UTC m=+1923.770163565" watchObservedRunningTime="2026-07-06 14:54:56.850427192 +0000 UTC m=+1923.770707624"
Jul 06 14:54:56.919881 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:54:56.919847    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-139570-openshift-default-64465c5c65-vkg2f"
Jul 06 14:54:57.925003 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:54:57.924971    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-139570-openshift-default-64465c5c65-vkg2f"
Jul 06 14:54:58.241771 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:54:58.241685    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nkcvz"]
Jul 06 14:54:58.837009 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:54:58.836970    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-139570-openshift-default-64465c5c65-vkg2f"
Jul 06 14:54:58.837892 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:54:58.837867    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-139570-openshift-default-64465c5c65-vkg2f"
Jul 06 14:54:58.839408 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:54:58.839366    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:54:58.936384 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:54:58.936349    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:54:59.048791 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:54:59.048755    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:54:59.586890 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:54:59.586850    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:54:59.687797 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:54:59.687766    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:54:59.807452 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:54:59.807419    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:55:03.316927 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:55:03.316893    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:55:11.744073 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:55:11.743991    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nkcvz"]
Jul 06 14:55:12.797245 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:55:12.797210    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:55:13.792397 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:55:13.792357    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:55:14.145795 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:55:14.144949    2582 patch_prober.go:28] interesting pod/e2e-inf-b-139570-openshift-default-64465c5c65-vkg2f container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": read tcp 10.133.0.2:53866->10.133.0.37:15021: read: connection reset by peer" start-of-body=
Jul 06 14:55:14.145795 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:55:14.145049    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-139570-openshift-default-64465c5c65-vkg2f" podUID="7b2dd392-86c5-46dc-b359-39f8999c8c63" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": read tcp 10.133.0.2:53866->10.133.0.37:15021: read: connection reset by peer"
Jul 06 14:55:14.916489 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:55:14.916454    2582 generic.go:356] "Generic (PLEG): container finished" podID="7b2dd392-86c5-46dc-b359-39f8999c8c63" containerID="21957478c043a8e5eef3bda89a069187bd2f11d24986cf7763f2f34e3104c6f7" exitCode=0
Jul 06 14:55:14.916688 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:55:14.916524    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-139570-openshift-default-64465c5c65-vkg2f" event={"ID":"7b2dd392-86c5-46dc-b359-39f8999c8c63","Type":"ContainerDied","Data":"21957478c043a8e5eef3bda89a069187bd2f11d24986cf7763f2f34e3104c6f7"}
Jul 06 14:55:14.916937 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:55:14.916921    2582 scope.go:117] "RemoveContainer" containerID="21957478c043a8e5eef3bda89a069187bd2f11d24986cf7763f2f34e3104c6f7"
Jul 06 14:55:14.917869 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:55:14.917843    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:55:14.917929 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:55:14.917920    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:55:14.917969 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:55:14.917958    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:55:15.923320 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:55:15.923288    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-139570-openshift-default-64465c5c65-vkg2f" event={"ID":"7b2dd392-86c5-46dc-b359-39f8999c8c63","Type":"ContainerStarted","Data":"e1da472ab537ba105867816d1a592f03a762611ee1cd13d5ba1a3d497b562167"}
Jul 06 14:55:16.919740 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:55:16.919708    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-139570-openshift-default-64465c5c65-vkg2f"
Jul 06 14:55:16.919957 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:55:16.919939    2582 patch_prober.go:28] interesting pod/e2e-inf-b-139570-openshift-default-64465c5c65-vkg2f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body=
Jul 06 14:55:16.920006 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:55:16.919980    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-139570-openshift-default-64465c5c65-vkg2f" podUID="7b2dd392-86c5-46dc-b359-39f8999c8c63" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused"
Jul 06 14:55:17.920495 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:55:17.920451    2582 patch_prober.go:28] interesting pod/e2e-inf-b-139570-openshift-default-64465c5c65-vkg2f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body=
Jul 06 14:55:17.920987 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:55:17.920516    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-139570-openshift-default-64465c5c65-vkg2f" podUID="7b2dd392-86c5-46dc-b359-39f8999c8c63" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused"
Jul 06 14:55:18.920403 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:55:18.920367    2582 patch_prober.go:28] interesting pod/e2e-inf-b-139570-openshift-default-64465c5c65-vkg2f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body=
Jul 06 14:55:18.920577 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:55:18.920427    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-139570-openshift-default-64465c5c65-vkg2f" podUID="7b2dd392-86c5-46dc-b359-39f8999c8c63" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused"
Jul 06 14:55:19.929009 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:55:19.928972    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-139570-openshift-default-64465c5c65-vkg2f"
Jul 06 14:55:19.929455 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:55:19.929279    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-139570-openshift-default-64465c5c65-vkg2f"
Jul 06 14:55:19.929989 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:55:19.929969    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-139570-openshift-default-64465c5c65-vkg2f"
Jul 06 14:55:21.174127 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:55:21.174093    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:55:21.274785 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:55:21.274749    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:55:25.250925 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:55:25.250891    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-ebef4e/test-model-ebef4e-kserve-6d6696d655-8c26j"]
Jul 06 14:55:25.254607 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:55:25.254580    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-ebef4e/test-model-ebef4e-kserve-6d6696d655-8c26j"
Jul 06 14:55:25.258319 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:55:25.258297    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-ebef4e\"/\"openshift-service-ca.crt\""
Jul 06 14:55:25.258466 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:55:25.258439    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-ebef4e\"/\"default-dockercfg-zxxv5\""
Jul 06 14:55:25.258582 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:55:25.258463    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-ebef4e\"/\"test-model-ebef4e-kserve-self-signed-certs\""
Jul 06 14:55:25.258582 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:55:25.258442    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-ebef4e\"/\"kube-root-ca.crt\""
Jul 06 14:55:25.263705 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:55:25.263617    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-ebef4e/test-model-ebef4e-kserve-6d6696d655-8c26j"]
Jul 06 14:55:25.274766 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:55:25.274733    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:55:25.405350 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:55:25.405306    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/878e87d4-f822-4299-a1ab-c4dd584ec9c5-tmp-dir\") pod \"test-model-ebef4e-kserve-6d6696d655-8c26j\" (UID: \"878e87d4-f822-4299-a1ab-c4dd584ec9c5\") " pod="ai-tenant-e2e-inf-a-ebef4e/test-model-ebef4e-kserve-6d6696d655-8c26j"
Jul 06 14:55:25.405534 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:55:25.405358    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/878e87d4-f822-4299-a1ab-c4dd584ec9c5-dshm\") pod \"test-model-ebef4e-kserve-6d6696d655-8c26j\" (UID: \"878e87d4-f822-4299-a1ab-c4dd584ec9c5\") " pod="ai-tenant-e2e-inf-a-ebef4e/test-model-ebef4e-kserve-6d6696d655-8c26j"
Jul 06 14:55:25.405534 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:55:25.405400    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/878e87d4-f822-4299-a1ab-c4dd584ec9c5-tls-certs\") pod \"test-model-ebef4e-kserve-6d6696d655-8c26j\" (UID: \"878e87d4-f822-4299-a1ab-c4dd584ec9c5\") " pod="ai-tenant-e2e-inf-a-ebef4e/test-model-ebef4e-kserve-6d6696d655-8c26j"
Jul 06 14:55:25.405534 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:55:25.405511    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qc5w9\" (UniqueName: \"kubernetes.io/projected/878e87d4-f822-4299-a1ab-c4dd584ec9c5-kube-api-access-qc5w9\") pod \"test-model-ebef4e-kserve-6d6696d655-8c26j\" (UID: \"878e87d4-f822-4299-a1ab-c4dd584ec9c5\") " pod="ai-tenant-e2e-inf-a-ebef4e/test-model-ebef4e-kserve-6d6696d655-8c26j"
Jul 06 14:55:25.405642 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:55:25.405583    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/878e87d4-f822-4299-a1ab-c4dd584ec9c5-model-cache\") pod \"test-model-ebef4e-kserve-6d6696d655-8c26j\" (UID: \"878e87d4-f822-4299-a1ab-c4dd584ec9c5\") " pod="ai-tenant-e2e-inf-a-ebef4e/test-model-ebef4e-kserve-6d6696d655-8c26j"
Jul 06 14:55:25.405642 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:55:25.405601    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/878e87d4-f822-4299-a1ab-c4dd584ec9c5-home\") pod \"test-model-ebef4e-kserve-6d6696d655-8c26j\" (UID: \"878e87d4-f822-4299-a1ab-c4dd584ec9c5\") " pod="ai-tenant-e2e-inf-a-ebef4e/test-model-ebef4e-kserve-6d6696d655-8c26j"
Jul 06 14:55:25.506696 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:55:25.506587    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qc5w9\" (UniqueName: \"kubernetes.io/projected/878e87d4-f822-4299-a1ab-c4dd584ec9c5-kube-api-access-qc5w9\") pod \"test-model-ebef4e-kserve-6d6696d655-8c26j\" (UID: \"878e87d4-f822-4299-a1ab-c4dd584ec9c5\") " pod="ai-tenant-e2e-inf-a-ebef4e/test-model-ebef4e-kserve-6d6696d655-8c26j"
Jul 06 14:55:25.506849 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:55:25.506776    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/878e87d4-f822-4299-a1ab-c4dd584ec9c5-model-cache\") pod \"test-model-ebef4e-kserve-6d6696d655-8c26j\" (UID: \"878e87d4-f822-4299-a1ab-c4dd584ec9c5\") " pod="ai-tenant-e2e-inf-a-ebef4e/test-model-ebef4e-kserve-6d6696d655-8c26j"
Jul 06 14:55:25.506849 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:55:25.506808    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/878e87d4-f822-4299-a1ab-c4dd584ec9c5-home\") pod \"test-model-ebef4e-kserve-6d6696d655-8c26j\" (UID: \"878e87d4-f822-4299-a1ab-c4dd584ec9c5\") " pod="ai-tenant-e2e-inf-a-ebef4e/test-model-ebef4e-kserve-6d6696d655-8c26j"
Jul 06 14:55:25.506935 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:55:25.506862    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/878e87d4-f822-4299-a1ab-c4dd584ec9c5-tmp-dir\") pod \"test-model-ebef4e-kserve-6d6696d655-8c26j\" (UID: \"878e87d4-f822-4299-a1ab-c4dd584ec9c5\") " pod="ai-tenant-e2e-inf-a-ebef4e/test-model-ebef4e-kserve-6d6696d655-8c26j"
Jul 06 14:55:25.506935 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:55:25.506892    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/878e87d4-f822-4299-a1ab-c4dd584ec9c5-dshm\") pod \"test-model-ebef4e-kserve-6d6696d655-8c26j\" (UID: \"878e87d4-f822-4299-a1ab-c4dd584ec9c5\") " pod="ai-tenant-e2e-inf-a-ebef4e/test-model-ebef4e-kserve-6d6696d655-8c26j"
Jul 06 14:55:25.506935 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:55:25.506907    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/878e87d4-f822-4299-a1ab-c4dd584ec9c5-tls-certs\") pod \"test-model-ebef4e-kserve-6d6696d655-8c26j\" (UID: \"878e87d4-f822-4299-a1ab-c4dd584ec9c5\") " pod="ai-tenant-e2e-inf-a-ebef4e/test-model-ebef4e-kserve-6d6696d655-8c26j"
Jul 06 14:55:25.507198 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:55:25.507174    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/878e87d4-f822-4299-a1ab-c4dd584ec9c5-model-cache\") pod \"test-model-ebef4e-kserve-6d6696d655-8c26j\" (UID: \"878e87d4-f822-4299-a1ab-c4dd584ec9c5\") " pod="ai-tenant-e2e-inf-a-ebef4e/test-model-ebef4e-kserve-6d6696d655-8c26j"
Jul 06 14:55:25.507276 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:55:25.507195    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/878e87d4-f822-4299-a1ab-c4dd584ec9c5-home\") pod \"test-model-ebef4e-kserve-6d6696d655-8c26j\" (UID: \"878e87d4-f822-4299-a1ab-c4dd584ec9c5\") " pod="ai-tenant-e2e-inf-a-ebef4e/test-model-ebef4e-kserve-6d6696d655-8c26j"
Jul 06 14:55:25.507276 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:55:25.507243    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/878e87d4-f822-4299-a1ab-c4dd584ec9c5-tmp-dir\") pod \"test-model-ebef4e-kserve-6d6696d655-8c26j\" (UID: \"878e87d4-f822-4299-a1ab-c4dd584ec9c5\") " pod="ai-tenant-e2e-inf-a-ebef4e/test-model-ebef4e-kserve-6d6696d655-8c26j"
Jul 06 14:55:25.509153 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:55:25.509103    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/878e87d4-f822-4299-a1ab-c4dd584ec9c5-dshm\") pod \"test-model-ebef4e-kserve-6d6696d655-8c26j\" (UID: \"878e87d4-f822-4299-a1ab-c4dd584ec9c5\") " pod="ai-tenant-e2e-inf-a-ebef4e/test-model-ebef4e-kserve-6d6696d655-8c26j"
Jul 06 14:55:25.509433 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:55:25.509413    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/878e87d4-f822-4299-a1ab-c4dd584ec9c5-tls-certs\") pod \"test-model-ebef4e-kserve-6d6696d655-8c26j\" (UID: \"878e87d4-f822-4299-a1ab-c4dd584ec9c5\") " pod="ai-tenant-e2e-inf-a-ebef4e/test-model-ebef4e-kserve-6d6696d655-8c26j"
Jul 06 14:55:25.516216 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:55:25.516185    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qc5w9\" (UniqueName: \"kubernetes.io/projected/878e87d4-f822-4299-a1ab-c4dd584ec9c5-kube-api-access-qc5w9\") pod \"test-model-ebef4e-kserve-6d6696d655-8c26j\" (UID: \"878e87d4-f822-4299-a1ab-c4dd584ec9c5\") " pod="ai-tenant-e2e-inf-a-ebef4e/test-model-ebef4e-kserve-6d6696d655-8c26j"
Jul 06 14:55:25.564866 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:55:25.564825    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-ebef4e/test-model-ebef4e-kserve-6d6696d655-8c26j"
Jul 06 14:55:25.700822 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:55:25.700796    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-ebef4e/test-model-ebef4e-kserve-6d6696d655-8c26j"]
Jul 06 14:55:25.703042 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:55:25.703014    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod878e87d4_f822_4299_a1ab_c4dd584ec9c5.slice/crio-588fa25389b61976400c4aa7486eb9f797f72f0b60e60d5e35d0904957f42dfa WatchSource:0}: Error finding container 588fa25389b61976400c4aa7486eb9f797f72f0b60e60d5e35d0904957f42dfa: Status 404 returned error can't find the container with id 588fa25389b61976400c4aa7486eb9f797f72f0b60e60d5e35d0904957f42dfa
Jul 06 14:55:25.986686 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:55:25.986621    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-ebef4e/test-model-ebef4e-kserve-6d6696d655-8c26j" event={"ID":"878e87d4-f822-4299-a1ab-c4dd584ec9c5","Type":"ContainerStarted","Data":"77661092af5c931137d7c708bf1439374b57b27956dc16f1ee3dda4b214bbca3"}
Jul 06 14:55:25.986686 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:55:25.986686    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-ebef4e/test-model-ebef4e-kserve-6d6696d655-8c26j" event={"ID":"878e87d4-f822-4299-a1ab-c4dd584ec9c5","Type":"ContainerStarted","Data":"588fa25389b61976400c4aa7486eb9f797f72f0b60e60d5e35d0904957f42dfa"}
Jul 06 14:55:26.007207 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:55:26.007151    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-ebef4e/test-model-ebef4e-kserve-6d6696d655-8c26j" podStartSLOduration=1.007134739 podStartE2EDuration="1.007134739s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:55:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:55:26.004901485 +0000 UTC m=+1952.925181915" watchObservedRunningTime="2026-07-06 14:55:26.007134739 +0000 UTC m=+1952.927415211"
Jul 06 14:55:29.079144 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:55:29.079108    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nkcvz"]
Jul 06 14:55:35.565141 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:55:35.565102    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-ebef4e/test-model-ebef4e-kserve-6d6696d655-8c26j"
Jul 06 14:55:35.565681 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:55:35.565153    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-ebef4e/test-model-ebef4e-kserve-6d6696d655-8c26j"
Jul 06 14:55:35.577599 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:55:35.577569    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-ebef4e/test-model-ebef4e-kserve-6d6696d655-8c26j"
Jul 06 14:55:36.048375 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:55:36.048347    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-ebef4e/test-model-ebef4e-kserve-6d6696d655-8c26j"
Jul 06 14:55:39.637185 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:55:39.637151    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nkcvz"]
Jul 06 14:55:57.146041 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:55:57.145957    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:56:00.957824 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:56:00.957787    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nkcvz"]
Jul 06 14:56:14.941395 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:56:14.941357    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nkcvz"]
Jul 06 14:56:17.579581 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:56:17.579547    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-ebef4e/test-model-ebef4e-kserve-6d6696d655-8c26j"]
Jul 06 14:56:17.630567 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:56:17.630533    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:56:18.732679 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:56:18.732623    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:56:18.905699 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:56:18.905631    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:56:19.291422 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:56:19.291392    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:56:19.559976 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:56:19.559882    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:56:19.765996 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:56:19.765959    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:56:20.000275 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:56:20.000241    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:56:24.326812 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:56:24.326772    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:56:30.145772 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:56:30.145731    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nkcvz"]
Jul 06 14:56:32.599807 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:56:32.599763    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-ebef4e/test-model-ebef4e-kserve-6d6696d655-8c26j" podUID="878e87d4-f822-4299-a1ab-c4dd584ec9c5" containerName="main" containerID="cri-o://77661092af5c931137d7c708bf1439374b57b27956dc16f1ee3dda4b214bbca3" gracePeriod=45
Jul 06 14:56:32.849191 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:56:32.849163    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-ebef4e/test-model-ebef4e-kserve-6d6696d655-8c26j"
Jul 06 14:56:32.922875 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:56:32.922834    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/878e87d4-f822-4299-a1ab-c4dd584ec9c5-tmp-dir\") pod \"878e87d4-f822-4299-a1ab-c4dd584ec9c5\" (UID: \"878e87d4-f822-4299-a1ab-c4dd584ec9c5\") "
Jul 06 14:56:32.923060 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:56:32.922883    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/878e87d4-f822-4299-a1ab-c4dd584ec9c5-model-cache\") pod \"878e87d4-f822-4299-a1ab-c4dd584ec9c5\" (UID: \"878e87d4-f822-4299-a1ab-c4dd584ec9c5\") "
Jul 06 14:56:32.923060 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:56:32.922911    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/878e87d4-f822-4299-a1ab-c4dd584ec9c5-dshm\") pod \"878e87d4-f822-4299-a1ab-c4dd584ec9c5\" (UID: \"878e87d4-f822-4299-a1ab-c4dd584ec9c5\") "
Jul 06 14:56:32.923060 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:56:32.922962    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qc5w9\" (UniqueName: \"kubernetes.io/projected/878e87d4-f822-4299-a1ab-c4dd584ec9c5-kube-api-access-qc5w9\") pod \"878e87d4-f822-4299-a1ab-c4dd584ec9c5\" (UID: \"878e87d4-f822-4299-a1ab-c4dd584ec9c5\") "
Jul 06 14:56:32.923230 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:56:32.923195    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/878e87d4-f822-4299-a1ab-c4dd584ec9c5-model-cache" (OuterVolumeSpecName: "model-cache") pod "878e87d4-f822-4299-a1ab-c4dd584ec9c5" (UID: "878e87d4-f822-4299-a1ab-c4dd584ec9c5"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:56:32.923230 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:56:32.923207    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/878e87d4-f822-4299-a1ab-c4dd584ec9c5-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "878e87d4-f822-4299-a1ab-c4dd584ec9c5" (UID: "878e87d4-f822-4299-a1ab-c4dd584ec9c5"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:56:32.923340 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:56:32.923238    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/878e87d4-f822-4299-a1ab-c4dd584ec9c5-home\") pod \"878e87d4-f822-4299-a1ab-c4dd584ec9c5\" (UID: \"878e87d4-f822-4299-a1ab-c4dd584ec9c5\") "
Jul 06 14:56:32.923340 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:56:32.923319    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/878e87d4-f822-4299-a1ab-c4dd584ec9c5-tls-certs\") pod \"878e87d4-f822-4299-a1ab-c4dd584ec9c5\" (UID: \"878e87d4-f822-4299-a1ab-c4dd584ec9c5\") "
Jul 06 14:56:32.923516 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:56:32.923494    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/878e87d4-f822-4299-a1ab-c4dd584ec9c5-home" (OuterVolumeSpecName: "home") pod "878e87d4-f822-4299-a1ab-c4dd584ec9c5" (UID: "878e87d4-f822-4299-a1ab-c4dd584ec9c5"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:56:32.923612 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:56:32.923594    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/878e87d4-f822-4299-a1ab-c4dd584ec9c5-tmp-dir\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Jul 06 14:56:32.923681 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:56:32.923618    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/878e87d4-f822-4299-a1ab-c4dd584ec9c5-model-cache\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Jul 06 14:56:32.923681 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:56:32.923631    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/878e87d4-f822-4299-a1ab-c4dd584ec9c5-home\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Jul 06 14:56:32.925385 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:56:32.925353    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/878e87d4-f822-4299-a1ab-c4dd584ec9c5-kube-api-access-qc5w9" (OuterVolumeSpecName: "kube-api-access-qc5w9") pod "878e87d4-f822-4299-a1ab-c4dd584ec9c5" (UID: "878e87d4-f822-4299-a1ab-c4dd584ec9c5"). InnerVolumeSpecName "kube-api-access-qc5w9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:56:32.925490 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:56:32.925384    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/878e87d4-f822-4299-a1ab-c4dd584ec9c5-dshm" (OuterVolumeSpecName: "dshm") pod "878e87d4-f822-4299-a1ab-c4dd584ec9c5" (UID: "878e87d4-f822-4299-a1ab-c4dd584ec9c5"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:56:32.925490 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:56:32.925440    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/878e87d4-f822-4299-a1ab-c4dd584ec9c5-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "878e87d4-f822-4299-a1ab-c4dd584ec9c5" (UID: "878e87d4-f822-4299-a1ab-c4dd584ec9c5"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:56:33.024371 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:56:33.024330    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qc5w9\" (UniqueName: \"kubernetes.io/projected/878e87d4-f822-4299-a1ab-c4dd584ec9c5-kube-api-access-qc5w9\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Jul 06 14:56:33.024371 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:56:33.024363    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/878e87d4-f822-4299-a1ab-c4dd584ec9c5-tls-certs\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Jul 06 14:56:33.024371 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:56:33.024379    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/878e87d4-f822-4299-a1ab-c4dd584ec9c5-dshm\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Jul 06 14:56:33.289811 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:56:33.289718    2582 generic.go:356] "Generic (PLEG): container finished" podID="878e87d4-f822-4299-a1ab-c4dd584ec9c5" containerID="77661092af5c931137d7c708bf1439374b57b27956dc16f1ee3dda4b214bbca3" exitCode=0
Jul 06 14:56:33.289811 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:56:33.289758    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-ebef4e/test-model-ebef4e-kserve-6d6696d655-8c26j" event={"ID":"878e87d4-f822-4299-a1ab-c4dd584ec9c5","Type":"ContainerDied","Data":"77661092af5c931137d7c708bf1439374b57b27956dc16f1ee3dda4b214bbca3"}
Jul 06 14:56:33.289811 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:56:33.289761    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-ebef4e/test-model-ebef4e-kserve-6d6696d655-8c26j"
Jul 06 14:56:33.289811 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:56:33.289790    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-ebef4e/test-model-ebef4e-kserve-6d6696d655-8c26j" event={"ID":"878e87d4-f822-4299-a1ab-c4dd584ec9c5","Type":"ContainerDied","Data":"588fa25389b61976400c4aa7486eb9f797f72f0b60e60d5e35d0904957f42dfa"}
Jul 06 14:56:33.289811 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:56:33.289813    2582 scope.go:117] "RemoveContainer" containerID="77661092af5c931137d7c708bf1439374b57b27956dc16f1ee3dda4b214bbca3"
Jul 06 14:56:33.298973 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:56:33.298956    2582 scope.go:117] "RemoveContainer" containerID="77661092af5c931137d7c708bf1439374b57b27956dc16f1ee3dda4b214bbca3"
Jul 06 14:56:33.299230 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:56:33.299209    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"77661092af5c931137d7c708bf1439374b57b27956dc16f1ee3dda4b214bbca3\": container with ID starting with 77661092af5c931137d7c708bf1439374b57b27956dc16f1ee3dda4b214bbca3 not found: ID does not exist" containerID="77661092af5c931137d7c708bf1439374b57b27956dc16f1ee3dda4b214bbca3"
Jul 06 14:56:33.299298 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:56:33.299241    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"77661092af5c931137d7c708bf1439374b57b27956dc16f1ee3dda4b214bbca3"} err="failed to get container status \"77661092af5c931137d7c708bf1439374b57b27956dc16f1ee3dda4b214bbca3\": rpc error: code = NotFound desc = could not find container \"77661092af5c931137d7c708bf1439374b57b27956dc16f1ee3dda4b214bbca3\": container with ID starting with 77661092af5c931137d7c708bf1439374b57b27956dc16f1ee3dda4b214bbca3 not found: ID does not exist"
Jul 06 14:56:33.312568 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:56:33.312542    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-ebef4e/test-model-ebef4e-kserve-6d6696d655-8c26j"]
Jul 06 14:56:33.319132 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:56:33.319106    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-ebef4e/test-model-ebef4e-kserve-6d6696d655-8c26j"]
Jul 06 14:56:33.499123 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:56:33.499084    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="878e87d4-f822-4299-a1ab-c4dd584ec9c5" path="/var/lib/kubelet/pods/878e87d4-f822-4299-a1ab-c4dd584ec9c5/volumes"
Jul 06 14:56:44.352446 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:56:44.352408    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:56:44.479726 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:56:44.479687    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:57:02.763206 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:02.763166    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:57:03.067046 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:03.066940    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:57:03.288724 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:03.288689    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:57:03.480634 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:03.480599    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:57:03.978712 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:03.978682    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:57:04.097798 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:04.097716    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:57:04.193099 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:04.193062    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:57:04.371177 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:04.371089    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:57:07.247628 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:07.247589    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nkcvz"]
Jul 06 14:57:10.737245 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:10.737165    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:57:10.840857 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:10.840819    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:57:11.028141 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:11.028043    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-139570-openshift-default-64465c5c65-vkg2f"]
Jul 06 14:57:11.028310 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:11.028284    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-139570-openshift-default-64465c5c65-vkg2f" podUID="7b2dd392-86c5-46dc-b359-39f8999c8c63" containerName="istio-proxy" containerID="cri-o://e1da472ab537ba105867816d1a592f03a762611ee1cd13d5ba1a3d497b562167" gracePeriod=30
Jul 06 14:57:11.053928 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:11.053897    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:57:11.283407 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:11.283274    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:57:11.638817 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:11.638714    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:57:11.985978 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:11.985942    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:57:12.956435 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:12.956405    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:57:15.385954 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:15.385864    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:57:15.481950 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:15.481918    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:57:15.632039 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:15.632008    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:57:15.807096 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:15.807056    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:57:16.280949 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:16.280918    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-139570-openshift-default-64465c5c65-vkg2f"
Jul 06 14:57:16.310278 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:16.310243    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:57:16.315355 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:16.315331    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7b2dd392-86c5-46dc-b359-39f8999c8c63-istio-envoy\") pod \"7b2dd392-86c5-46dc-b359-39f8999c8c63\" (UID: \"7b2dd392-86c5-46dc-b359-39f8999c8c63\") "
Jul 06 14:57:16.315532 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:16.315384    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7b2dd392-86c5-46dc-b359-39f8999c8c63-istio-data\") pod \"7b2dd392-86c5-46dc-b359-39f8999c8c63\" (UID: \"7b2dd392-86c5-46dc-b359-39f8999c8c63\") "
Jul 06 14:57:16.315532 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:16.315423    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b2dd392-86c5-46dc-b359-39f8999c8c63-workload-socket\") pod \"7b2dd392-86c5-46dc-b359-39f8999c8c63\" (UID: \"7b2dd392-86c5-46dc-b359-39f8999c8c63\") "
Jul 06 14:57:16.315532 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:16.315461    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7b2dd392-86c5-46dc-b359-39f8999c8c63-workload-certs\") pod \"7b2dd392-86c5-46dc-b359-39f8999c8c63\" (UID: \"7b2dd392-86c5-46dc-b359-39f8999c8c63\") "
Jul 06 14:57:16.315532 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:16.315488    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b2dd392-86c5-46dc-b359-39f8999c8c63-credential-socket\") pod \"7b2dd392-86c5-46dc-b359-39f8999c8c63\" (UID: \"7b2dd392-86c5-46dc-b359-39f8999c8c63\") "
Jul 06 14:57:16.315532 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:16.315512    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7b2dd392-86c5-46dc-b359-39f8999c8c63-istiod-ca-cert\") pod \"7b2dd392-86c5-46dc-b359-39f8999c8c63\" (UID: \"7b2dd392-86c5-46dc-b359-39f8999c8c63\") "
Jul 06 14:57:16.315844 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:16.315545    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7b2dd392-86c5-46dc-b359-39f8999c8c63-istio-token\") pod \"7b2dd392-86c5-46dc-b359-39f8999c8c63\" (UID: \"7b2dd392-86c5-46dc-b359-39f8999c8c63\") "
Jul 06 14:57:16.315844 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:16.315632    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-56l79\" (UniqueName: \"kubernetes.io/projected/7b2dd392-86c5-46dc-b359-39f8999c8c63-kube-api-access-56l79\") pod \"7b2dd392-86c5-46dc-b359-39f8999c8c63\" (UID: \"7b2dd392-86c5-46dc-b359-39f8999c8c63\") "
Jul 06 14:57:16.315844 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:16.315688    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7b2dd392-86c5-46dc-b359-39f8999c8c63-istio-podinfo\") pod \"7b2dd392-86c5-46dc-b359-39f8999c8c63\" (UID: \"7b2dd392-86c5-46dc-b359-39f8999c8c63\") "
Jul 06 14:57:16.315844 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:16.315807    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b2dd392-86c5-46dc-b359-39f8999c8c63-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7b2dd392-86c5-46dc-b359-39f8999c8c63" (UID: "7b2dd392-86c5-46dc-b359-39f8999c8c63"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:57:16.316125 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:16.315996    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7b2dd392-86c5-46dc-b359-39f8999c8c63-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7b2dd392-86c5-46dc-b359-39f8999c8c63" (UID: "7b2dd392-86c5-46dc-b359-39f8999c8c63"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:57:16.316125 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:16.316046    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7b2dd392-86c5-46dc-b359-39f8999c8c63-workload-certs\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Jul 06 14:57:16.316239 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:16.316206    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b2dd392-86c5-46dc-b359-39f8999c8c63-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7b2dd392-86c5-46dc-b359-39f8999c8c63" (UID: "7b2dd392-86c5-46dc-b359-39f8999c8c63"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:57:16.316300 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:16.316270    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b2dd392-86c5-46dc-b359-39f8999c8c63-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7b2dd392-86c5-46dc-b359-39f8999c8c63" (UID: "7b2dd392-86c5-46dc-b359-39f8999c8c63"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:57:16.316357 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:16.316312    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b2dd392-86c5-46dc-b359-39f8999c8c63-istio-data" (OuterVolumeSpecName: "istio-data") pod "7b2dd392-86c5-46dc-b359-39f8999c8c63" (UID: "7b2dd392-86c5-46dc-b359-39f8999c8c63"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:57:16.317922 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:16.317889    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7b2dd392-86c5-46dc-b359-39f8999c8c63-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7b2dd392-86c5-46dc-b359-39f8999c8c63" (UID: "7b2dd392-86c5-46dc-b359-39f8999c8c63"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 14:57:16.318429 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:16.318401    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b2dd392-86c5-46dc-b359-39f8999c8c63-kube-api-access-56l79" (OuterVolumeSpecName: "kube-api-access-56l79") pod "7b2dd392-86c5-46dc-b359-39f8999c8c63" (UID: "7b2dd392-86c5-46dc-b359-39f8999c8c63"). InnerVolumeSpecName "kube-api-access-56l79". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:57:16.318516 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:16.318485    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b2dd392-86c5-46dc-b359-39f8999c8c63-istio-token" (OuterVolumeSpecName: "istio-token") pod "7b2dd392-86c5-46dc-b359-39f8999c8c63" (UID: "7b2dd392-86c5-46dc-b359-39f8999c8c63"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:57:16.318516 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:16.318492    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b2dd392-86c5-46dc-b359-39f8999c8c63-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7b2dd392-86c5-46dc-b359-39f8999c8c63" (UID: "7b2dd392-86c5-46dc-b359-39f8999c8c63"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:57:16.407196 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:16.407151    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:57:16.417416 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:16.417386    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b2dd392-86c5-46dc-b359-39f8999c8c63-workload-socket\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Jul 06 14:57:16.417416 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:16.417415    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b2dd392-86c5-46dc-b359-39f8999c8c63-credential-socket\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Jul 06 14:57:16.417416 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:16.417424    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7b2dd392-86c5-46dc-b359-39f8999c8c63-istiod-ca-cert\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Jul 06 14:57:16.417695 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:16.417432    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7b2dd392-86c5-46dc-b359-39f8999c8c63-istio-token\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Jul 06 14:57:16.417695 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:16.417440    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-56l79\" (UniqueName: \"kubernetes.io/projected/7b2dd392-86c5-46dc-b359-39f8999c8c63-kube-api-access-56l79\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Jul 06 14:57:16.417695 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:16.417448    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7b2dd392-86c5-46dc-b359-39f8999c8c63-istio-podinfo\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Jul 06 14:57:16.417695 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:16.417456    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7b2dd392-86c5-46dc-b359-39f8999c8c63-istio-envoy\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Jul 06 14:57:16.417695 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:16.417464    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7b2dd392-86c5-46dc-b359-39f8999c8c63-istio-data\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Jul 06 14:57:16.483508 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:16.483475    2582 generic.go:356] "Generic (PLEG): container finished" podID="7b2dd392-86c5-46dc-b359-39f8999c8c63" containerID="e1da472ab537ba105867816d1a592f03a762611ee1cd13d5ba1a3d497b562167" exitCode=0
Jul 06 14:57:16.483678 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:16.483520    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-139570-openshift-default-64465c5c65-vkg2f"
Jul 06 14:57:16.483678 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:16.483557    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-139570-openshift-default-64465c5c65-vkg2f" event={"ID":"7b2dd392-86c5-46dc-b359-39f8999c8c63","Type":"ContainerDied","Data":"e1da472ab537ba105867816d1a592f03a762611ee1cd13d5ba1a3d497b562167"}
Jul 06 14:57:16.483678 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:16.483613    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-139570-openshift-default-64465c5c65-vkg2f" event={"ID":"7b2dd392-86c5-46dc-b359-39f8999c8c63","Type":"ContainerDied","Data":"4f7a1ca2f6a71ebf6b702c6a38194e69fcbdd341374fe62a3b97fc1b2fc60b41"}
Jul 06 14:57:16.483678 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:16.483634    2582 scope.go:117] "RemoveContainer" containerID="e1da472ab537ba105867816d1a592f03a762611ee1cd13d5ba1a3d497b562167"
Jul 06 14:57:16.493048 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:16.493024    2582 scope.go:117] "RemoveContainer" containerID="21957478c043a8e5eef3bda89a069187bd2f11d24986cf7763f2f34e3104c6f7"
Jul 06 14:57:16.500842 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:16.500819    2582 scope.go:117] "RemoveContainer" containerID="e1da472ab537ba105867816d1a592f03a762611ee1cd13d5ba1a3d497b562167"
Jul 06 14:57:16.501123 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:57:16.501096    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e1da472ab537ba105867816d1a592f03a762611ee1cd13d5ba1a3d497b562167\": container with ID starting with e1da472ab537ba105867816d1a592f03a762611ee1cd13d5ba1a3d497b562167 not found: ID does not exist" containerID="e1da472ab537ba105867816d1a592f03a762611ee1cd13d5ba1a3d497b562167"
Jul 06 14:57:16.501186 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:16.501134    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e1da472ab537ba105867816d1a592f03a762611ee1cd13d5ba1a3d497b562167"} err="failed to get container status \"e1da472ab537ba105867816d1a592f03a762611ee1cd13d5ba1a3d497b562167\": rpc error: code = NotFound desc = could not find container \"e1da472ab537ba105867816d1a592f03a762611ee1cd13d5ba1a3d497b562167\": container with ID starting with e1da472ab537ba105867816d1a592f03a762611ee1cd13d5ba1a3d497b562167 not found: ID does not exist"
Jul 06 14:57:16.501186 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:16.501153    2582 scope.go:117] "RemoveContainer" containerID="21957478c043a8e5eef3bda89a069187bd2f11d24986cf7763f2f34e3104c6f7"
Jul 06 14:57:16.501415 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:57:16.501397    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"21957478c043a8e5eef3bda89a069187bd2f11d24986cf7763f2f34e3104c6f7\": container with ID starting with 21957478c043a8e5eef3bda89a069187bd2f11d24986cf7763f2f34e3104c6f7 not found: ID does not exist" containerID="21957478c043a8e5eef3bda89a069187bd2f11d24986cf7763f2f34e3104c6f7"
Jul 06 14:57:16.501466 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:16.501420    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21957478c043a8e5eef3bda89a069187bd2f11d24986cf7763f2f34e3104c6f7"} err="failed to get container status \"21957478c043a8e5eef3bda89a069187bd2f11d24986cf7763f2f34e3104c6f7\": rpc error: code = NotFound desc = could not find container \"21957478c043a8e5eef3bda89a069187bd2f11d24986cf7763f2f34e3104c6f7\": container with ID starting with 21957478c043a8e5eef3bda89a069187bd2f11d24986cf7763f2f34e3104c6f7 not found: ID does not exist"
Jul 06 14:57:16.505586 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:16.505560    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-139570-openshift-default-64465c5c65-vkg2f"]
Jul 06 14:57:16.511476 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:16.511450    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-139570-openshift-default-64465c5c65-vkg2f"]
Jul 06 14:57:17.499053 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:17.499021    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7b2dd392-86c5-46dc-b359-39f8999c8c63" path="/var/lib/kubelet/pods/7b2dd392-86c5-46dc-b359-39f8999c8c63/volumes"
Jul 06 14:57:18.945449 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:18.945401    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:57:19.932730 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:19.932694    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:57:20.450090 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:20.450015    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:57:20.853371 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:20.853279    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:57:20.903929 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:20.903889    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-ed33e6-openshift-default-b89c874c7-fvbjz"]
Jul 06 14:57:20.904429 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:20.904408    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b2dd392-86c5-46dc-b359-39f8999c8c63" containerName="istio-proxy"
Jul 06 14:57:20.904429 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:20.904430    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b2dd392-86c5-46dc-b359-39f8999c8c63" containerName="istio-proxy"
Jul 06 14:57:20.904573 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:20.904450    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b2dd392-86c5-46dc-b359-39f8999c8c63" containerName="istio-proxy"
Jul 06 14:57:20.904573 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:20.904458    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b2dd392-86c5-46dc-b359-39f8999c8c63" containerName="istio-proxy"
Jul 06 14:57:20.904573 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:20.904471    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="878e87d4-f822-4299-a1ab-c4dd584ec9c5" containerName="main"
Jul 06 14:57:20.904573 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:20.904480    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="878e87d4-f822-4299-a1ab-c4dd584ec9c5" containerName="main"
Jul 06 14:57:20.904845 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:20.904586    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b2dd392-86c5-46dc-b359-39f8999c8c63" containerName="istio-proxy"
Jul 06 14:57:20.904845 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:20.904600    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="878e87d4-f822-4299-a1ab-c4dd584ec9c5" containerName="main"
Jul 06 14:57:20.909179 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:20.909157    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-ed33e6-openshift-default-b89c874c7-fvbjz"
Jul 06 14:57:20.912388 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:20.912366    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-ed33e6-openshift-default-dockercfg-dn452\""
Jul 06 14:57:20.954158 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:20.954117    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2ef2b668-523d-43cb-8f49-10405521df61-istio-podinfo\") pod \"e2e-api-b-ed33e6-openshift-default-b89c874c7-fvbjz\" (UID: \"2ef2b668-523d-43cb-8f49-10405521df61\") " pod="openshift-ingress/e2e-api-b-ed33e6-openshift-default-b89c874c7-fvbjz"
Jul 06 14:57:20.954328 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:20.954181    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ef2b668-523d-43cb-8f49-10405521df61-workload-socket\") pod \"e2e-api-b-ed33e6-openshift-default-b89c874c7-fvbjz\" (UID: \"2ef2b668-523d-43cb-8f49-10405521df61\") " pod="openshift-ingress/e2e-api-b-ed33e6-openshift-default-b89c874c7-fvbjz"
Jul 06 14:57:20.954328 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:20.954246    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2ef2b668-523d-43cb-8f49-10405521df61-istiod-ca-cert\") pod \"e2e-api-b-ed33e6-openshift-default-b89c874c7-fvbjz\" (UID: \"2ef2b668-523d-43cb-8f49-10405521df61\") " pod="openshift-ingress/e2e-api-b-ed33e6-openshift-default-b89c874c7-fvbjz"
Jul 06 14:57:20.954328 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:20.954287    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2ef2b668-523d-43cb-8f49-10405521df61-istio-envoy\") pod \"e2e-api-b-ed33e6-openshift-default-b89c874c7-fvbjz\" (UID: \"2ef2b668-523d-43cb-8f49-10405521df61\") " pod="openshift-ingress/e2e-api-b-ed33e6-openshift-default-b89c874c7-fvbjz"
Jul 06 14:57:20.954328 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:20.954308    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-586hv\" (UniqueName: \"kubernetes.io/projected/2ef2b668-523d-43cb-8f49-10405521df61-kube-api-access-586hv\") pod \"e2e-api-b-ed33e6-openshift-default-b89c874c7-fvbjz\" (UID: \"2ef2b668-523d-43cb-8f49-10405521df61\") " pod="openshift-ingress/e2e-api-b-ed33e6-openshift-default-b89c874c7-fvbjz"
Jul 06 14:57:20.954465 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:20.954357    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ef2b668-523d-43cb-8f49-10405521df61-credential-socket\") pod \"e2e-api-b-ed33e6-openshift-default-b89c874c7-fvbjz\" (UID: \"2ef2b668-523d-43cb-8f49-10405521df61\") " pod="openshift-ingress/e2e-api-b-ed33e6-openshift-default-b89c874c7-fvbjz"
Jul 06 14:57:20.954465 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:20.954372    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2ef2b668-523d-43cb-8f49-10405521df61-istio-data\") pod \"e2e-api-b-ed33e6-openshift-default-b89c874c7-fvbjz\" (UID: \"2ef2b668-523d-43cb-8f49-10405521df61\") " pod="openshift-ingress/e2e-api-b-ed33e6-openshift-default-b89c874c7-fvbjz"
Jul 06 14:57:20.954465 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:20.954405    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2ef2b668-523d-43cb-8f49-10405521df61-workload-certs\") pod \"e2e-api-b-ed33e6-openshift-default-b89c874c7-fvbjz\" (UID: \"2ef2b668-523d-43cb-8f49-10405521df61\") " pod="openshift-ingress/e2e-api-b-ed33e6-openshift-default-b89c874c7-fvbjz"
Jul 06 14:57:20.954465 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:20.954425    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2ef2b668-523d-43cb-8f49-10405521df61-istio-token\") pod \"e2e-api-b-ed33e6-openshift-default-b89c874c7-fvbjz\" (UID: \"2ef2b668-523d-43cb-8f49-10405521df61\") " pod="openshift-ingress/e2e-api-b-ed33e6-openshift-default-b89c874c7-fvbjz"
Jul 06 14:57:20.970240 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:20.970211    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-ed33e6-openshift-default-b89c874c7-fvbjz"]
Jul 06 14:57:20.987014 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:20.986981    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nkcvz"]
Jul 06 14:57:21.055057 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:21.055023    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2ef2b668-523d-43cb-8f49-10405521df61-istio-data\") pod \"e2e-api-b-ed33e6-openshift-default-b89c874c7-fvbjz\" (UID: \"2ef2b668-523d-43cb-8f49-10405521df61\") " pod="openshift-ingress/e2e-api-b-ed33e6-openshift-default-b89c874c7-fvbjz"
Jul 06 14:57:21.055246 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:21.055066    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2ef2b668-523d-43cb-8f49-10405521df61-workload-certs\") pod \"e2e-api-b-ed33e6-openshift-default-b89c874c7-fvbjz\" (UID: \"2ef2b668-523d-43cb-8f49-10405521df61\") " pod="openshift-ingress/e2e-api-b-ed33e6-openshift-default-b89c874c7-fvbjz"
Jul 06 14:57:21.055246 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:21.055086    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2ef2b668-523d-43cb-8f49-10405521df61-istio-token\") pod \"e2e-api-b-ed33e6-openshift-default-b89c874c7-fvbjz\" (UID: \"2ef2b668-523d-43cb-8f49-10405521df61\") " pod="openshift-ingress/e2e-api-b-ed33e6-openshift-default-b89c874c7-fvbjz"
Jul 06 14:57:21.055246 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:21.055148    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2ef2b668-523d-43cb-8f49-10405521df61-istio-podinfo\") pod \"e2e-api-b-ed33e6-openshift-default-b89c874c7-fvbjz\" (UID: \"2ef2b668-523d-43cb-8f49-10405521df61\") " pod="openshift-ingress/e2e-api-b-ed33e6-openshift-default-b89c874c7-fvbjz"
Jul 06 14:57:21.055246 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:21.055197    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ef2b668-523d-43cb-8f49-10405521df61-workload-socket\") pod \"e2e-api-b-ed33e6-openshift-default-b89c874c7-fvbjz\" (UID: \"2ef2b668-523d-43cb-8f49-10405521df61\") " pod="openshift-ingress/e2e-api-b-ed33e6-openshift-default-b89c874c7-fvbjz"
Jul 06 14:57:21.055246 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:21.055232    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2ef2b668-523d-43cb-8f49-10405521df61-istiod-ca-cert\") pod \"e2e-api-b-ed33e6-openshift-default-b89c874c7-fvbjz\" (UID: \"2ef2b668-523d-43cb-8f49-10405521df61\") " pod="openshift-ingress/e2e-api-b-ed33e6-openshift-default-b89c874c7-fvbjz"
Jul 06 14:57:21.055549 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:21.055262    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2ef2b668-523d-43cb-8f49-10405521df61-istio-envoy\") pod \"e2e-api-b-ed33e6-openshift-default-b89c874c7-fvbjz\" (UID: \"2ef2b668-523d-43cb-8f49-10405521df61\") " pod="openshift-ingress/e2e-api-b-ed33e6-openshift-default-b89c874c7-fvbjz"
Jul 06 14:57:21.055549 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:21.055286    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-586hv\" (UniqueName: \"kubernetes.io/projected/2ef2b668-523d-43cb-8f49-10405521df61-kube-api-access-586hv\") pod \"e2e-api-b-ed33e6-openshift-default-b89c874c7-fvbjz\" (UID: \"2ef2b668-523d-43cb-8f49-10405521df61\") " pod="openshift-ingress/e2e-api-b-ed33e6-openshift-default-b89c874c7-fvbjz"
Jul 06 14:57:21.055549 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:21.055326    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ef2b668-523d-43cb-8f49-10405521df61-credential-socket\") pod \"e2e-api-b-ed33e6-openshift-default-b89c874c7-fvbjz\" (UID: \"2ef2b668-523d-43cb-8f49-10405521df61\") " pod="openshift-ingress/e2e-api-b-ed33e6-openshift-default-b89c874c7-fvbjz"
Jul 06 14:57:21.055549 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:21.055473    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2ef2b668-523d-43cb-8f49-10405521df61-istio-data\") pod \"e2e-api-b-ed33e6-openshift-default-b89c874c7-fvbjz\" (UID: \"2ef2b668-523d-43cb-8f49-10405521df61\") " pod="openshift-ingress/e2e-api-b-ed33e6-openshift-default-b89c874c7-fvbjz"
Jul 06 14:57:21.055549 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:21.055493    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2ef2b668-523d-43cb-8f49-10405521df61-workload-certs\") pod \"e2e-api-b-ed33e6-openshift-default-b89c874c7-fvbjz\" (UID: \"2ef2b668-523d-43cb-8f49-10405521df61\") " pod="openshift-ingress/e2e-api-b-ed33e6-openshift-default-b89c874c7-fvbjz"
Jul 06 14:57:21.055847 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:21.055741    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ef2b668-523d-43cb-8f49-10405521df61-workload-socket\") pod \"e2e-api-b-ed33e6-openshift-default-b89c874c7-fvbjz\" (UID: \"2ef2b668-523d-43cb-8f49-10405521df61\") " pod="openshift-ingress/e2e-api-b-ed33e6-openshift-default-b89c874c7-fvbjz"
Jul 06 14:57:21.055847 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:21.055798    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ef2b668-523d-43cb-8f49-10405521df61-credential-socket\") pod \"e2e-api-b-ed33e6-openshift-default-b89c874c7-fvbjz\" (UID: \"2ef2b668-523d-43cb-8f49-10405521df61\") " pod="openshift-ingress/e2e-api-b-ed33e6-openshift-default-b89c874c7-fvbjz"
Jul 06 14:57:21.056260 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:21.056229    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2ef2b668-523d-43cb-8f49-10405521df61-istiod-ca-cert\") pod \"e2e-api-b-ed33e6-openshift-default-b89c874c7-fvbjz\" (UID: \"2ef2b668-523d-43cb-8f49-10405521df61\") " pod="openshift-ingress/e2e-api-b-ed33e6-openshift-default-b89c874c7-fvbjz"
Jul 06 14:57:21.057837 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:21.057811    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2ef2b668-523d-43cb-8f49-10405521df61-istio-envoy\") pod \"e2e-api-b-ed33e6-openshift-default-b89c874c7-fvbjz\" (UID: \"2ef2b668-523d-43cb-8f49-10405521df61\") " pod="openshift-ingress/e2e-api-b-ed33e6-openshift-default-b89c874c7-fvbjz"
Jul 06 14:57:21.058028 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:21.058013    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2ef2b668-523d-43cb-8f49-10405521df61-istio-podinfo\") pod \"e2e-api-b-ed33e6-openshift-default-b89c874c7-fvbjz\" (UID: \"2ef2b668-523d-43cb-8f49-10405521df61\") " pod="openshift-ingress/e2e-api-b-ed33e6-openshift-default-b89c874c7-fvbjz"
Jul 06 14:57:21.082457 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:21.082430    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-586hv\" (UniqueName: \"kubernetes.io/projected/2ef2b668-523d-43cb-8f49-10405521df61-kube-api-access-586hv\") pod \"e2e-api-b-ed33e6-openshift-default-b89c874c7-fvbjz\" (UID: \"2ef2b668-523d-43cb-8f49-10405521df61\") " pod="openshift-ingress/e2e-api-b-ed33e6-openshift-default-b89c874c7-fvbjz"
Jul 06 14:57:21.099362 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:21.099329    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2ef2b668-523d-43cb-8f49-10405521df61-istio-token\") pod \"e2e-api-b-ed33e6-openshift-default-b89c874c7-fvbjz\" (UID: \"2ef2b668-523d-43cb-8f49-10405521df61\") " pod="openshift-ingress/e2e-api-b-ed33e6-openshift-default-b89c874c7-fvbjz"
Jul 06 14:57:21.163152 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:21.163118    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:57:21.220042 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:21.220010    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-ed33e6-openshift-default-b89c874c7-fvbjz"
Jul 06 14:57:21.392468 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:21.392435    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-ed33e6-openshift-default-b89c874c7-fvbjz"]
Jul 06 14:57:21.395580 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:57:21.395554    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ef2b668_523d_43cb_8f49_10405521df61.slice/crio-33b56c969cbbf59f3bcb63bd0ce7114327b2ed1943fbac5cd29ee6088aea2ad9 WatchSource:0}: Error finding container 33b56c969cbbf59f3bcb63bd0ce7114327b2ed1943fbac5cd29ee6088aea2ad9: Status 404 returned error can't find the container with id 33b56c969cbbf59f3bcb63bd0ce7114327b2ed1943fbac5cd29ee6088aea2ad9
Jul 06 14:57:21.397535 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:21.397502    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:57:21.397587 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:21.397573    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:57:21.397630 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:21.397605    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:57:21.512419 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:21.512384    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-ed33e6-openshift-default-b89c874c7-fvbjz" event={"ID":"2ef2b668-523d-43cb-8f49-10405521df61","Type":"ContainerStarted","Data":"bcf4f340a8872cf3224f867bddedaec5e785553da20ed0683e1479fd22330a15"}
Jul 06 14:57:21.512911 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:21.512443    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-ed33e6-openshift-default-b89c874c7-fvbjz" event={"ID":"2ef2b668-523d-43cb-8f49-10405521df61","Type":"ContainerStarted","Data":"33b56c969cbbf59f3bcb63bd0ce7114327b2ed1943fbac5cd29ee6088aea2ad9"}
Jul 06 14:57:21.552102 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:21.552043    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-ed33e6-openshift-default-b89c874c7-fvbjz" podStartSLOduration=1.552021356 podStartE2EDuration="1.552021356s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:57:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:57:21.550509234 +0000 UTC m=+2068.470789663" watchObservedRunningTime="2026-07-06 14:57:21.552021356 +0000 UTC m=+2068.472301785"
Jul 06 14:57:22.220416 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:22.220379    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-ed33e6-openshift-default-b89c874c7-fvbjz"
Jul 06 14:57:22.225802 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:22.225768    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-ed33e6-openshift-default-b89c874c7-fvbjz"
Jul 06 14:57:22.517795 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:22.517703    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-ed33e6-openshift-default-b89c874c7-fvbjz"
Jul 06 14:57:22.518761 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:22.518742    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-ed33e6-openshift-default-b89c874c7-fvbjz"
Jul 06 14:57:23.880015 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:23.879962    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:57:24.029404 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:24.029357    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:57:24.145739 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:24.145626    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:57:24.675245 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:24.675205    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:57:24.785848 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:24.785816    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:57:24.903092 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:24.903060    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:57:28.306717 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:28.306682    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:57:35.580287 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:35.580250    2582 generic.go:356] "Generic (PLEG): container finished" podID="2ef2b668-523d-43cb-8f49-10405521df61" containerID="bcf4f340a8872cf3224f867bddedaec5e785553da20ed0683e1479fd22330a15" exitCode=0
Jul 06 14:57:35.580788 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:35.580326    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-ed33e6-openshift-default-b89c874c7-fvbjz" event={"ID":"2ef2b668-523d-43cb-8f49-10405521df61","Type":"ContainerDied","Data":"bcf4f340a8872cf3224f867bddedaec5e785553da20ed0683e1479fd22330a15"}
Jul 06 14:57:35.580788 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:35.580759    2582 scope.go:117] "RemoveContainer" containerID="bcf4f340a8872cf3224f867bddedaec5e785553da20ed0683e1479fd22330a15"
Jul 06 14:57:35.581786 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:35.581758    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:57:35.581858 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:35.581840    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:57:35.581920 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:35.581905    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:57:36.391399 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:36.391361    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nkcvz"]
Jul 06 14:57:36.587493 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:36.587456    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-ed33e6-openshift-default-b89c874c7-fvbjz" event={"ID":"2ef2b668-523d-43cb-8f49-10405521df61","Type":"ContainerStarted","Data":"ed1e770ef6e053b1a3bff7ad55d3edea978002b1a258ecded325341f18716978"}
Jul 06 14:57:36.594317 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:36.594285    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:57:37.008479 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:37.008440    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:57:37.122939 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:37.122892    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:57:37.219418 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:37.219361    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:57:37.221151 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:37.221130    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-ed33e6-openshift-default-b89c874c7-fvbjz"
Jul 06 14:57:37.222271 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:37.222246    2582 patch_prober.go:28] interesting pod/e2e-api-b-ed33e6-openshift-default-b89c874c7-fvbjz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body=
Jul 06 14:57:37.222356 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:37.222299    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-ed33e6-openshift-default-b89c874c7-fvbjz" podUID="2ef2b668-523d-43cb-8f49-10405521df61" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused"
Jul 06 14:57:37.412442 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:37.412409    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:57:37.518075 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:37.518042    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-ed33e6-openshift-default-b89c874c7-fvbjz"
Jul 06 14:57:38.221094 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:38.221058    2582 patch_prober.go:28] interesting pod/e2e-api-b-ed33e6-openshift-default-b89c874c7-fvbjz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body=
Jul 06 14:57:38.221478 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:38.221126    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-ed33e6-openshift-default-b89c874c7-fvbjz" podUID="2ef2b668-523d-43cb-8f49-10405521df61" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused"
Jul 06 14:57:39.221393 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:39.221357    2582 patch_prober.go:28] interesting pod/e2e-api-b-ed33e6-openshift-default-b89c874c7-fvbjz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body=
Jul 06 14:57:39.221815 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:39.221425    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-ed33e6-openshift-default-b89c874c7-fvbjz" podUID="2ef2b668-523d-43cb-8f49-10405521df61" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused"
Jul 06 14:57:40.221122 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:40.221084    2582 patch_prober.go:28] interesting pod/e2e-api-b-ed33e6-openshift-default-b89c874c7-fvbjz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body=
Jul 06 14:57:40.221318 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:40.221138    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-ed33e6-openshift-default-b89c874c7-fvbjz" podUID="2ef2b668-523d-43cb-8f49-10405521df61" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused"
Jul 06 14:57:41.224693 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:41.224642    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-ed33e6-openshift-default-b89c874c7-fvbjz"
Jul 06 14:57:41.225561 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:41.225543    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-ed33e6-openshift-default-b89c874c7-fvbjz"
Jul 06 14:57:43.243858 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:43.243821    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:57:43.442290 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:43.442249    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:57:43.573321 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:43.573229    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:57:43.815886 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:43.815825    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:57:44.013602 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:44.013540    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:57:44.412251 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:44.412217    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:57:44.581087 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:44.581058    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:57:44.682369 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:44.682284    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:57:44.857282 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:44.857247    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:57:46.884510 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:46.884477    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nkcvz"]
Jul 06 14:57:50.591260 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:50.591227    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:57:50.732412 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:50.732375    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:57:50.916833 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:50.916792    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-ed33e6-openshift-default-b89c874c7-fvbjz"]
Jul 06 14:57:50.917054 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:50.917027    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-ed33e6-openshift-default-b89c874c7-fvbjz" podUID="2ef2b668-523d-43cb-8f49-10405521df61" containerName="istio-proxy" containerID="cri-o://ed1e770ef6e053b1a3bff7ad55d3edea978002b1a258ecded325341f18716978" gracePeriod=30
Jul 06 14:57:50.959727 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:50.959691    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:57:51.136421 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:51.136389    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:57:51.467466 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:51.467433    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:57:51.898171 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:51.898084    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:57:52.350453 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:52.350421    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:57:53.634472 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:53.634437    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:57:53.757325 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:53.757295    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:57:54.880079 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:54.880038    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:57:55.146420 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:55.146306    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:57:55.407482 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:55.407452    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:57:56.067623 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:56.067586    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:57:56.170967 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:56.170942    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-ed33e6-openshift-default-b89c874c7-fvbjz"
Jul 06 14:57:56.212181 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:56.212089    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:57:56.278879 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:56.278843    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2ef2b668-523d-43cb-8f49-10405521df61-istio-data\") pod \"2ef2b668-523d-43cb-8f49-10405521df61\" (UID: \"2ef2b668-523d-43cb-8f49-10405521df61\") "
Jul 06 14:57:56.278879 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:56.278878    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2ef2b668-523d-43cb-8f49-10405521df61-istio-podinfo\") pod \"2ef2b668-523d-43cb-8f49-10405521df61\" (UID: \"2ef2b668-523d-43cb-8f49-10405521df61\") "
Jul 06 14:57:56.279102 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:56.278897    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ef2b668-523d-43cb-8f49-10405521df61-workload-socket\") pod \"2ef2b668-523d-43cb-8f49-10405521df61\" (UID: \"2ef2b668-523d-43cb-8f49-10405521df61\") "
Jul 06 14:57:56.279102 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:56.278914    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-586hv\" (UniqueName: \"kubernetes.io/projected/2ef2b668-523d-43cb-8f49-10405521df61-kube-api-access-586hv\") pod \"2ef2b668-523d-43cb-8f49-10405521df61\" (UID: \"2ef2b668-523d-43cb-8f49-10405521df61\") "
Jul 06 14:57:56.279102 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:56.278955    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2ef2b668-523d-43cb-8f49-10405521df61-workload-certs\") pod \"2ef2b668-523d-43cb-8f49-10405521df61\" (UID: \"2ef2b668-523d-43cb-8f49-10405521df61\") "
Jul 06 14:57:56.279102 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:56.278998    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ef2b668-523d-43cb-8f49-10405521df61-credential-socket\") pod \"2ef2b668-523d-43cb-8f49-10405521df61\" (UID: \"2ef2b668-523d-43cb-8f49-10405521df61\") "
Jul 06 14:57:56.279102 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:56.279041    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2ef2b668-523d-43cb-8f49-10405521df61-istio-envoy\") pod \"2ef2b668-523d-43cb-8f49-10405521df61\" (UID: \"2ef2b668-523d-43cb-8f49-10405521df61\") "
Jul 06 14:57:56.279102 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:56.279067    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2ef2b668-523d-43cb-8f49-10405521df61-istio-token\") pod \"2ef2b668-523d-43cb-8f49-10405521df61\" (UID: \"2ef2b668-523d-43cb-8f49-10405521df61\") "
Jul 06 14:57:56.279411 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:56.279140    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2ef2b668-523d-43cb-8f49-10405521df61-istiod-ca-cert\") pod \"2ef2b668-523d-43cb-8f49-10405521df61\" (UID: \"2ef2b668-523d-43cb-8f49-10405521df61\") "
Jul 06 14:57:56.279411 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:56.279181    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ef2b668-523d-43cb-8f49-10405521df61-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2ef2b668-523d-43cb-8f49-10405521df61" (UID: "2ef2b668-523d-43cb-8f49-10405521df61"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:57:56.279411 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:56.279371    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ef2b668-523d-43cb-8f49-10405521df61-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2ef2b668-523d-43cb-8f49-10405521df61" (UID: "2ef2b668-523d-43cb-8f49-10405521df61"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:57:56.279574 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:56.279431    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ef2b668-523d-43cb-8f49-10405521df61-workload-socket\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Jul 06 14:57:56.279574 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:56.279454    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2ef2b668-523d-43cb-8f49-10405521df61-workload-certs\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Jul 06 14:57:56.279574 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:56.279500    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2ef2b668-523d-43cb-8f49-10405521df61-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2ef2b668-523d-43cb-8f49-10405521df61" (UID: "2ef2b668-523d-43cb-8f49-10405521df61"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:57:56.279771 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:56.279575    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ef2b668-523d-43cb-8f49-10405521df61-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2ef2b668-523d-43cb-8f49-10405521df61" (UID: "2ef2b668-523d-43cb-8f49-10405521df61"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:57:56.279996 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:56.279970    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ef2b668-523d-43cb-8f49-10405521df61-istio-data" (OuterVolumeSpecName: "istio-data") pod "2ef2b668-523d-43cb-8f49-10405521df61" (UID: "2ef2b668-523d-43cb-8f49-10405521df61"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:57:56.281205 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:56.281183    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2ef2b668-523d-43cb-8f49-10405521df61-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2ef2b668-523d-43cb-8f49-10405521df61" (UID: "2ef2b668-523d-43cb-8f49-10405521df61"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 14:57:56.281323 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:56.281305    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ef2b668-523d-43cb-8f49-10405521df61-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2ef2b668-523d-43cb-8f49-10405521df61" (UID: "2ef2b668-523d-43cb-8f49-10405521df61"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:57:56.281380 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:56.281309    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ef2b668-523d-43cb-8f49-10405521df61-kube-api-access-586hv" (OuterVolumeSpecName: "kube-api-access-586hv") pod "2ef2b668-523d-43cb-8f49-10405521df61" (UID: "2ef2b668-523d-43cb-8f49-10405521df61"). InnerVolumeSpecName "kube-api-access-586hv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:57:56.281417 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:56.281379    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ef2b668-523d-43cb-8f49-10405521df61-istio-token" (OuterVolumeSpecName: "istio-token") pod "2ef2b668-523d-43cb-8f49-10405521df61" (UID: "2ef2b668-523d-43cb-8f49-10405521df61"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:57:56.380033 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:56.379988    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ef2b668-523d-43cb-8f49-10405521df61-credential-socket\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Jul 06 14:57:56.380033 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:56.380024    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2ef2b668-523d-43cb-8f49-10405521df61-istio-envoy\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Jul 06 14:57:56.380033 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:56.380037    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2ef2b668-523d-43cb-8f49-10405521df61-istio-token\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Jul 06 14:57:56.380276 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:56.380048    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2ef2b668-523d-43cb-8f49-10405521df61-istiod-ca-cert\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Jul 06 14:57:56.380276 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:56.380060    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2ef2b668-523d-43cb-8f49-10405521df61-istio-data\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Jul 06 14:57:56.380276 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:56.380070    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2ef2b668-523d-43cb-8f49-10405521df61-istio-podinfo\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Jul 06 14:57:56.380276 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:56.380082    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-586hv\" (UniqueName: \"kubernetes.io/projected/2ef2b668-523d-43cb-8f49-10405521df61-kube-api-access-586hv\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Jul 06 14:57:56.678330 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:56.678297    2582 generic.go:356] "Generic (PLEG): container finished" podID="2ef2b668-523d-43cb-8f49-10405521df61" containerID="ed1e770ef6e053b1a3bff7ad55d3edea978002b1a258ecded325341f18716978" exitCode=0
Jul 06 14:57:56.678497 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:56.678350    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-ed33e6-openshift-default-b89c874c7-fvbjz" event={"ID":"2ef2b668-523d-43cb-8f49-10405521df61","Type":"ContainerDied","Data":"ed1e770ef6e053b1a3bff7ad55d3edea978002b1a258ecded325341f18716978"}
Jul 06 14:57:56.678497 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:56.678355    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-ed33e6-openshift-default-b89c874c7-fvbjz"
Jul 06 14:57:56.678497 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:56.678390    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-ed33e6-openshift-default-b89c874c7-fvbjz" event={"ID":"2ef2b668-523d-43cb-8f49-10405521df61","Type":"ContainerDied","Data":"33b56c969cbbf59f3bcb63bd0ce7114327b2ed1943fbac5cd29ee6088aea2ad9"}
Jul 06 14:57:56.678497 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:56.678411    2582 scope.go:117] "RemoveContainer" containerID="ed1e770ef6e053b1a3bff7ad55d3edea978002b1a258ecded325341f18716978"
Jul 06 14:57:56.687827 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:56.687806    2582 scope.go:117] "RemoveContainer" containerID="bcf4f340a8872cf3224f867bddedaec5e785553da20ed0683e1479fd22330a15"
Jul 06 14:57:56.695541 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:56.695524    2582 scope.go:117] "RemoveContainer" containerID="ed1e770ef6e053b1a3bff7ad55d3edea978002b1a258ecded325341f18716978"
Jul 06 14:57:56.695817 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:57:56.695797    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ed1e770ef6e053b1a3bff7ad55d3edea978002b1a258ecded325341f18716978\": container with ID starting with ed1e770ef6e053b1a3bff7ad55d3edea978002b1a258ecded325341f18716978 not found: ID does not exist" containerID="ed1e770ef6e053b1a3bff7ad55d3edea978002b1a258ecded325341f18716978"
Jul 06 14:57:56.695878 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:56.695827    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed1e770ef6e053b1a3bff7ad55d3edea978002b1a258ecded325341f18716978"} err="failed to get container status \"ed1e770ef6e053b1a3bff7ad55d3edea978002b1a258ecded325341f18716978\": rpc error: code = NotFound desc = could not find container \"ed1e770ef6e053b1a3bff7ad55d3edea978002b1a258ecded325341f18716978\": container with ID starting with ed1e770ef6e053b1a3bff7ad55d3edea978002b1a258ecded325341f18716978 not found: ID does not exist"
Jul 06 14:57:56.695878 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:56.695844    2582 scope.go:117] "RemoveContainer" containerID="bcf4f340a8872cf3224f867bddedaec5e785553da20ed0683e1479fd22330a15"
Jul 06 14:57:56.696092 ip-10-0-137-145 kubenswrapper[2582]: E0706 14:57:56.696075    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bcf4f340a8872cf3224f867bddedaec5e785553da20ed0683e1479fd22330a15\": container with ID starting with bcf4f340a8872cf3224f867bddedaec5e785553da20ed0683e1479fd22330a15 not found: ID does not exist" containerID="bcf4f340a8872cf3224f867bddedaec5e785553da20ed0683e1479fd22330a15"
Jul 06 14:57:56.696126 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:56.696100    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bcf4f340a8872cf3224f867bddedaec5e785553da20ed0683e1479fd22330a15"} err="failed to get container status \"bcf4f340a8872cf3224f867bddedaec5e785553da20ed0683e1479fd22330a15\": rpc error: code = NotFound desc = could not find container \"bcf4f340a8872cf3224f867bddedaec5e785553da20ed0683e1479fd22330a15\": container with ID starting with bcf4f340a8872cf3224f867bddedaec5e785553da20ed0683e1479fd22330a15 not found: ID does not exist"
Jul 06 14:57:56.701502 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:56.701478    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-ed33e6-openshift-default-b89c874c7-fvbjz"]
Jul 06 14:57:56.705253 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:56.705230    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-ed33e6-openshift-default-b89c874c7-fvbjz"]
Jul 06 14:57:57.499202 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:57.499168    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2ef2b668-523d-43cb-8f49-10405521df61" path="/var/lib/kubelet/pods/2ef2b668-523d-43cb-8f49-10405521df61/volumes"
Jul 06 14:57:59.269166 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:59.269132    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:57:59.661861 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:57:59.661830    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:58:00.024902 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:58:00.016948    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-a38db2-openshift-default-6cbf8f6455-t2qp5"]
Jul 06 14:58:00.024902 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:58:00.017418    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ef2b668-523d-43cb-8f49-10405521df61" containerName="istio-proxy"
Jul 06 14:58:00.024902 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:58:00.017438    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ef2b668-523d-43cb-8f49-10405521df61" containerName="istio-proxy"
Jul 06 14:58:00.024902 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:58:00.017518    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="2ef2b668-523d-43cb-8f49-10405521df61" containerName="istio-proxy"
Jul 06 14:58:00.024902 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:58:00.017529    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b2dd392-86c5-46dc-b359-39f8999c8c63" containerName="istio-proxy"
Jul 06 14:58:00.024902 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:58:00.021947    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-a38db2-openshift-default-6cbf8f6455-t2qp5"
Jul 06 14:58:00.025817 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:58:00.025210    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-a38db2-openshift-default-dockercfg-pbs2b\""
Jul 06 14:58:00.057233 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:58:00.057194    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-a38db2-openshift-default-6cbf8f6455-t2qp5"]
Jul 06 14:58:00.106294 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:58:00.106259    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:58:00.213597 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:58:00.213560    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a63fb6ba-c943-4742-a487-ceb3267c9455-istio-podinfo\") pod \"e2e-shared-b-a38db2-openshift-default-6cbf8f6455-t2qp5\" (UID: \"a63fb6ba-c943-4742-a487-ceb3267c9455\") " pod="openshift-ingress/e2e-shared-b-a38db2-openshift-default-6cbf8f6455-t2qp5"
Jul 06 14:58:00.213834 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:58:00.213602    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a63fb6ba-c943-4742-a487-ceb3267c9455-istiod-ca-cert\") pod \"e2e-shared-b-a38db2-openshift-default-6cbf8f6455-t2qp5\" (UID: \"a63fb6ba-c943-4742-a487-ceb3267c9455\") " pod="openshift-ingress/e2e-shared-b-a38db2-openshift-default-6cbf8f6455-t2qp5"
Jul 06 14:58:00.213834 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:58:00.213647    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a63fb6ba-c943-4742-a487-ceb3267c9455-credential-socket\") pod \"e2e-shared-b-a38db2-openshift-default-6cbf8f6455-t2qp5\" (UID: \"a63fb6ba-c943-4742-a487-ceb3267c9455\") " pod="openshift-ingress/e2e-shared-b-a38db2-openshift-default-6cbf8f6455-t2qp5"
Jul 06 14:58:00.213834 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:58:00.213715    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kt74q\" (UniqueName: \"kubernetes.io/projected/a63fb6ba-c943-4742-a487-ceb3267c9455-kube-api-access-kt74q\") pod \"e2e-shared-b-a38db2-openshift-default-6cbf8f6455-t2qp5\" (UID: \"a63fb6ba-c943-4742-a487-ceb3267c9455\") " pod="openshift-ingress/e2e-shared-b-a38db2-openshift-default-6cbf8f6455-t2qp5"
Jul 06 14:58:00.213834 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:58:00.213764    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a63fb6ba-c943-4742-a487-ceb3267c9455-workload-socket\") pod \"e2e-shared-b-a38db2-openshift-default-6cbf8f6455-t2qp5\" (UID: \"a63fb6ba-c943-4742-a487-ceb3267c9455\") " pod="openshift-ingress/e2e-shared-b-a38db2-openshift-default-6cbf8f6455-t2qp5"
Jul 06 14:58:00.213834 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:58:00.213798    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a63fb6ba-c943-4742-a487-ceb3267c9455-istio-data\") pod \"e2e-shared-b-a38db2-openshift-default-6cbf8f6455-t2qp5\" (UID: \"a63fb6ba-c943-4742-a487-ceb3267c9455\") " pod="openshift-ingress/e2e-shared-b-a38db2-openshift-default-6cbf8f6455-t2qp5"
Jul 06 14:58:00.214082 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:58:00.213905    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a63fb6ba-c943-4742-a487-ceb3267c9455-istio-envoy\") pod \"e2e-shared-b-a38db2-openshift-default-6cbf8f6455-t2qp5\" (UID: \"a63fb6ba-c943-4742-a487-ceb3267c9455\") " pod="openshift-ingress/e2e-shared-b-a38db2-openshift-default-6cbf8f6455-t2qp5"
Jul 06 14:58:00.214082 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:58:00.213935    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a63fb6ba-c943-4742-a487-ceb3267c9455-istio-token\") pod \"e2e-shared-b-a38db2-openshift-default-6cbf8f6455-t2qp5\" (UID: \"a63fb6ba-c943-4742-a487-ceb3267c9455\") " pod="openshift-ingress/e2e-shared-b-a38db2-openshift-default-6cbf8f6455-t2qp5"
Jul 06 14:58:00.214082 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:58:00.213963    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a63fb6ba-c943-4742-a487-ceb3267c9455-workload-certs\") pod \"e2e-shared-b-a38db2-openshift-default-6cbf8f6455-t2qp5\" (UID: \"a63fb6ba-c943-4742-a487-ceb3267c9455\") " pod="openshift-ingress/e2e-shared-b-a38db2-openshift-default-6cbf8f6455-t2qp5"
Jul 06 14:58:00.315228 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:58:00.315137    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a63fb6ba-c943-4742-a487-ceb3267c9455-credential-socket\") pod \"e2e-shared-b-a38db2-openshift-default-6cbf8f6455-t2qp5\" (UID: \"a63fb6ba-c943-4742-a487-ceb3267c9455\") " pod="openshift-ingress/e2e-shared-b-a38db2-openshift-default-6cbf8f6455-t2qp5"
Jul 06 14:58:00.315228 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:58:00.315180    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kt74q\" (UniqueName: \"kubernetes.io/projected/a63fb6ba-c943-4742-a487-ceb3267c9455-kube-api-access-kt74q\") pod \"e2e-shared-b-a38db2-openshift-default-6cbf8f6455-t2qp5\" (UID: \"a63fb6ba-c943-4742-a487-ceb3267c9455\") " pod="openshift-ingress/e2e-shared-b-a38db2-openshift-default-6cbf8f6455-t2qp5"
Jul 06 14:58:00.315765 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:58:00.315309    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a63fb6ba-c943-4742-a487-ceb3267c9455-workload-socket\") pod \"e2e-shared-b-a38db2-openshift-default-6cbf8f6455-t2qp5\" (UID: \"a63fb6ba-c943-4742-a487-ceb3267c9455\") " pod="openshift-ingress/e2e-shared-b-a38db2-openshift-default-6cbf8f6455-t2qp5"
Jul 06 14:58:00.315765 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:58:00.315362    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a63fb6ba-c943-4742-a487-ceb3267c9455-istio-data\") pod \"e2e-shared-b-a38db2-openshift-default-6cbf8f6455-t2qp5\" (UID: \"a63fb6ba-c943-4742-a487-ceb3267c9455\") " pod="openshift-ingress/e2e-shared-b-a38db2-openshift-default-6cbf8f6455-t2qp5"
Jul 06 14:58:00.315765 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:58:00.315412    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a63fb6ba-c943-4742-a487-ceb3267c9455-istio-envoy\") pod \"e2e-shared-b-a38db2-openshift-default-6cbf8f6455-t2qp5\" (UID: \"a63fb6ba-c943-4742-a487-ceb3267c9455\") " pod="openshift-ingress/e2e-shared-b-a38db2-openshift-default-6cbf8f6455-t2qp5"
Jul 06 14:58:00.315765 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:58:00.315443    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a63fb6ba-c943-4742-a487-ceb3267c9455-istio-token\") pod \"e2e-shared-b-a38db2-openshift-default-6cbf8f6455-t2qp5\" (UID: \"a63fb6ba-c943-4742-a487-ceb3267c9455\") " pod="openshift-ingress/e2e-shared-b-a38db2-openshift-default-6cbf8f6455-t2qp5"
Jul 06 14:58:00.315765 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:58:00.315469    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a63fb6ba-c943-4742-a487-ceb3267c9455-workload-certs\") pod \"e2e-shared-b-a38db2-openshift-default-6cbf8f6455-t2qp5\" (UID: \"a63fb6ba-c943-4742-a487-ceb3267c9455\") " pod="openshift-ingress/e2e-shared-b-a38db2-openshift-default-6cbf8f6455-t2qp5"
Jul 06 14:58:00.315765 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:58:00.315600    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a63fb6ba-c943-4742-a487-ceb3267c9455-credential-socket\") pod \"e2e-shared-b-a38db2-openshift-default-6cbf8f6455-t2qp5\" (UID: \"a63fb6ba-c943-4742-a487-ceb3267c9455\") " pod="openshift-ingress/e2e-shared-b-a38db2-openshift-default-6cbf8f6455-t2qp5"
Jul 06 14:58:00.315765 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:58:00.315724    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a63fb6ba-c943-4742-a487-ceb3267c9455-workload-socket\") pod \"e2e-shared-b-a38db2-openshift-default-6cbf8f6455-t2qp5\" (UID: \"a63fb6ba-c943-4742-a487-ceb3267c9455\") " pod="openshift-ingress/e2e-shared-b-a38db2-openshift-default-6cbf8f6455-t2qp5"
Jul 06 14:58:00.315765 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:58:00.315757    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a63fb6ba-c943-4742-a487-ceb3267c9455-istio-data\") pod \"e2e-shared-b-a38db2-openshift-default-6cbf8f6455-t2qp5\" (UID: \"a63fb6ba-c943-4742-a487-ceb3267c9455\") " pod="openshift-ingress/e2e-shared-b-a38db2-openshift-default-6cbf8f6455-t2qp5"
Jul 06 14:58:00.316025 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:58:00.315822    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a63fb6ba-c943-4742-a487-ceb3267c9455-istio-podinfo\") pod \"e2e-shared-b-a38db2-openshift-default-6cbf8f6455-t2qp5\" (UID: \"a63fb6ba-c943-4742-a487-ceb3267c9455\") " pod="openshift-ingress/e2e-shared-b-a38db2-openshift-default-6cbf8f6455-t2qp5"
Jul 06 14:58:00.316025 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:58:00.315833    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a63fb6ba-c943-4742-a487-ceb3267c9455-workload-certs\") pod \"e2e-shared-b-a38db2-openshift-default-6cbf8f6455-t2qp5\" (UID: \"a63fb6ba-c943-4742-a487-ceb3267c9455\") " pod="openshift-ingress/e2e-shared-b-a38db2-openshift-default-6cbf8f6455-t2qp5"
Jul 06 14:58:00.316025 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:58:00.315850    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a63fb6ba-c943-4742-a487-ceb3267c9455-istiod-ca-cert\") pod \"e2e-shared-b-a38db2-openshift-default-6cbf8f6455-t2qp5\" (UID: \"a63fb6ba-c943-4742-a487-ceb3267c9455\") " pod="openshift-ingress/e2e-shared-b-a38db2-openshift-default-6cbf8f6455-t2qp5"
Jul 06 14:58:00.316384 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:58:00.316364    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a63fb6ba-c943-4742-a487-ceb3267c9455-istiod-ca-cert\") pod \"e2e-shared-b-a38db2-openshift-default-6cbf8f6455-t2qp5\" (UID: \"a63fb6ba-c943-4742-a487-ceb3267c9455\") " pod="openshift-ingress/e2e-shared-b-a38db2-openshift-default-6cbf8f6455-t2qp5"
Jul 06 14:58:00.317685 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:58:00.317648    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a63fb6ba-c943-4742-a487-ceb3267c9455-istio-envoy\") pod \"e2e-shared-b-a38db2-openshift-default-6cbf8f6455-t2qp5\" (UID: \"a63fb6ba-c943-4742-a487-ceb3267c9455\") " pod="openshift-ingress/e2e-shared-b-a38db2-openshift-default-6cbf8f6455-t2qp5"
Jul 06 14:58:00.318105 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:58:00.318085    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a63fb6ba-c943-4742-a487-ceb3267c9455-istio-podinfo\") pod \"e2e-shared-b-a38db2-openshift-default-6cbf8f6455-t2qp5\" (UID: \"a63fb6ba-c943-4742-a487-ceb3267c9455\") " pod="openshift-ingress/e2e-shared-b-a38db2-openshift-default-6cbf8f6455-t2qp5"
Jul 06 14:58:00.329155 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:58:00.329132    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kt74q\" (UniqueName: \"kubernetes.io/projected/a63fb6ba-c943-4742-a487-ceb3267c9455-kube-api-access-kt74q\") pod \"e2e-shared-b-a38db2-openshift-default-6cbf8f6455-t2qp5\" (UID: \"a63fb6ba-c943-4742-a487-ceb3267c9455\") " pod="openshift-ingress/e2e-shared-b-a38db2-openshift-default-6cbf8f6455-t2qp5"
Jul 06 14:58:00.330724 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:58:00.330696    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a63fb6ba-c943-4742-a487-ceb3267c9455-istio-token\") pod \"e2e-shared-b-a38db2-openshift-default-6cbf8f6455-t2qp5\" (UID: \"a63fb6ba-c943-4742-a487-ceb3267c9455\") " pod="openshift-ingress/e2e-shared-b-a38db2-openshift-default-6cbf8f6455-t2qp5"
Jul 06 14:58:00.334621 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:58:00.334603    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-a38db2-openshift-default-6cbf8f6455-t2qp5"
Jul 06 14:58:00.497878 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:58:00.497850    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-a38db2-openshift-default-6cbf8f6455-t2qp5"]
Jul 06 14:58:00.498826 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:58:00.498807    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda63fb6ba_c943_4742_a487_ceb3267c9455.slice/crio-a1fa572c5b30e8355b1dd6582e583c9873800565f69339a13878c3c0ee0be58e WatchSource:0}: Error finding container a1fa572c5b30e8355b1dd6582e583c9873800565f69339a13878c3c0ee0be58e: Status 404 returned error can't find the container with id a1fa572c5b30e8355b1dd6582e583c9873800565f69339a13878c3c0ee0be58e
Jul 06 14:58:00.500909 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:58:00.500877    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:58:00.500982 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:58:00.500939    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:58:00.500982 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:58:00.500967    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:58:00.510708 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:58:00.510644    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:58:00.699206 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:58:00.699172    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-a38db2-openshift-default-6cbf8f6455-t2qp5" event={"ID":"a63fb6ba-c943-4742-a487-ceb3267c9455","Type":"ContainerStarted","Data":"1838ecdb16216075bff1693bcdc48aea1c18eb2de8264565bdb84dd96a8b857d"}
Jul 06 14:58:00.699382 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:58:00.699227    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-a38db2-openshift-default-6cbf8f6455-t2qp5" event={"ID":"a63fb6ba-c943-4742-a487-ceb3267c9455","Type":"ContainerStarted","Data":"a1fa572c5b30e8355b1dd6582e583c9873800565f69339a13878c3c0ee0be58e"}
Jul 06 14:58:00.729016 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:58:00.728965    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-a38db2-openshift-default-6cbf8f6455-t2qp5" podStartSLOduration=1.7289487129999999 podStartE2EDuration="1.728948713s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:57:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:58:00.72751063 +0000 UTC m=+2107.647791063" watchObservedRunningTime="2026-07-06 14:58:00.728948713 +0000 UTC m=+2107.649229141"
Jul 06 14:58:00.772080 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:58:00.772049    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nkcvz"]
Jul 06 14:58:01.334999 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:58:01.334965    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-a38db2-openshift-default-6cbf8f6455-t2qp5"
Jul 06 14:58:01.339753 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:58:01.339726    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-a38db2-openshift-default-6cbf8f6455-t2qp5"
Jul 06 14:58:01.703954 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:58:01.703929    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-a38db2-openshift-default-6cbf8f6455-t2qp5"
Jul 06 14:58:01.704955 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:58:01.704934    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-a38db2-openshift-default-6cbf8f6455-t2qp5"
Jul 06 14:58:02.983103 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:58:02.983070    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:58:03.076134 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:58:03.076080    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:58:03.330086 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:58:03.329991    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:58:03.490051 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:58:03.489997    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:58:03.873214 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:58:03.873175    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:58:03.977612 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:58:03.977573    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:58:07.416468 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:58:07.416428    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:58:09.451187 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:58:09.451145    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nkcvz"]
Jul 06 14:58:13.658151 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:58:13.658111    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:58:13.751493 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:58:13.751447    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:58:16.901267 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:58:16.901231    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:58:17.001953 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:58:17.001915    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:58:17.512475 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:58:17.511582    2582 patch_prober.go:28] interesting pod/e2e-shared-b-a38db2-openshift-default-6cbf8f6455-t2qp5 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": read tcp 10.133.0.2:51802->10.133.0.40:15021: read: connection reset by peer" start-of-body=
Jul 06 14:58:17.512475 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:58:17.511680    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-a38db2-openshift-default-6cbf8f6455-t2qp5" podUID="a63fb6ba-c943-4742-a487-ceb3267c9455" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": read tcp 10.133.0.2:51802->10.133.0.40:15021: read: connection reset by peer"
Jul 06 14:58:17.778815 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:58:17.778731    2582 generic.go:356] "Generic (PLEG): container finished" podID="a63fb6ba-c943-4742-a487-ceb3267c9455" containerID="1838ecdb16216075bff1693bcdc48aea1c18eb2de8264565bdb84dd96a8b857d" exitCode=0
Jul 06 14:58:17.778957 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:58:17.778798    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-a38db2-openshift-default-6cbf8f6455-t2qp5" event={"ID":"a63fb6ba-c943-4742-a487-ceb3267c9455","Type":"ContainerDied","Data":"1838ecdb16216075bff1693bcdc48aea1c18eb2de8264565bdb84dd96a8b857d"}
Jul 06 14:58:17.779222 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:58:17.779208    2582 scope.go:117] "RemoveContainer" containerID="1838ecdb16216075bff1693bcdc48aea1c18eb2de8264565bdb84dd96a8b857d"
Jul 06 14:58:17.780195 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:58:17.780158    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:58:17.780302 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:58:17.780231    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:58:17.780302 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:58:17.780273    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:58:18.784832 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:58:18.784795    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-a38db2-openshift-default-6cbf8f6455-t2qp5" event={"ID":"a63fb6ba-c943-4742-a487-ceb3267c9455","Type":"ContainerStarted","Data":"038c6d7f1564f71b0232306569bcdda445025e95ee829f916949799f5ce11fc2"}
Jul 06 14:58:19.335816 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:58:19.335773    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-a38db2-openshift-default-6cbf8f6455-t2qp5"
Jul 06 14:58:19.336544 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:58:19.336522    2582 patch_prober.go:28] interesting pod/e2e-shared-b-a38db2-openshift-default-6cbf8f6455-t2qp5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body=
Jul 06 14:58:19.336772 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:58:19.336734    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-a38db2-openshift-default-6cbf8f6455-t2qp5" podUID="a63fb6ba-c943-4742-a487-ceb3267c9455" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused"
Jul 06 14:58:20.335300 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:58:20.335240    2582 patch_prober.go:28] interesting pod/e2e-shared-b-a38db2-openshift-default-6cbf8f6455-t2qp5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body=
Jul 06 14:58:20.335833 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:58:20.335328    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-a38db2-openshift-default-6cbf8f6455-t2qp5" podUID="a63fb6ba-c943-4742-a487-ceb3267c9455" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused"
Jul 06 14:58:21.336132 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:58:21.336092    2582 patch_prober.go:28] interesting pod/e2e-shared-b-a38db2-openshift-default-6cbf8f6455-t2qp5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body=
Jul 06 14:58:21.336773 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:58:21.336735    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-a38db2-openshift-default-6cbf8f6455-t2qp5" podUID="a63fb6ba-c943-4742-a487-ceb3267c9455" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused"
Jul 06 14:58:22.336097 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:58:22.336049    2582 patch_prober.go:28] interesting pod/e2e-shared-b-a38db2-openshift-default-6cbf8f6455-t2qp5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body=
Jul 06 14:58:22.336321 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:58:22.336133    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-a38db2-openshift-default-6cbf8f6455-t2qp5" podUID="a63fb6ba-c943-4742-a487-ceb3267c9455" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused"
Jul 06 14:58:23.339382 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:58:23.339347    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-a38db2-openshift-default-6cbf8f6455-t2qp5"
Jul 06 14:58:23.339757 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:58:23.339678    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-a38db2-openshift-default-6cbf8f6455-t2qp5"
Jul 06 14:58:23.340225 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:58:23.340211    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-a38db2-openshift-default-6cbf8f6455-t2qp5"
Jul 06 14:58:25.707260 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:58:25.707226    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:58:25.867649 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:58:25.867615    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:58:30.970120 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:58:30.970082    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:58:34.495914 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:58:34.495859    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:58:34.563228 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:58:34.563197    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nkcvz"]
Jul 06 14:58:50.531229 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:58:50.531154    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-a38db2/auth-test-model-a38db2-kserve-64f5879679-klfz5"]
Jul 06 14:58:50.531683 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:58:50.531497    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ef2b668-523d-43cb-8f49-10405521df61" containerName="istio-proxy"
Jul 06 14:58:50.531683 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:58:50.531512    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ef2b668-523d-43cb-8f49-10405521df61" containerName="istio-proxy"
Jul 06 14:58:50.531683 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:58:50.531578    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="2ef2b668-523d-43cb-8f49-10405521df61" containerName="istio-proxy"
Jul 06 14:58:50.534614 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:58:50.534598    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a38db2/auth-test-model-a38db2-kserve-64f5879679-klfz5"
Jul 06 14:58:50.537346 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:58:50.537322    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-a38db2\"/\"kube-root-ca.crt\""
Jul 06 14:58:50.537467 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:58:50.537454    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-a38db2\"/\"default-dockercfg-9l59j\""
Jul 06 14:58:50.538570 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:58:50.538554    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-a38db2\"/\"openshift-service-ca.crt\""
Jul 06 14:58:50.538740 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:58:50.538722    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-a38db2\"/\"auth-test-model-a38db2-kserve-self-signed-certs\""
Jul 06 14:58:50.550588 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:58:50.550562    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-a38db2/auth-test-model-a38db2-kserve-64f5879679-klfz5"]
Jul 06 14:58:50.568218 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:58:50.568183    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dd34832d-7d7b-4942-9d69-6298458a0653-dshm\") pod \"auth-test-model-a38db2-kserve-64f5879679-klfz5\" (UID: \"dd34832d-7d7b-4942-9d69-6298458a0653\") " pod="ai-tenant-e2e-shared-b-a38db2/auth-test-model-a38db2-kserve-64f5879679-klfz5"
Jul 06 14:58:50.568368 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:58:50.568232    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8d42\" (UniqueName: \"kubernetes.io/projected/dd34832d-7d7b-4942-9d69-6298458a0653-kube-api-access-b8d42\") pod \"auth-test-model-a38db2-kserve-64f5879679-klfz5\" (UID: \"dd34832d-7d7b-4942-9d69-6298458a0653\") " pod="ai-tenant-e2e-shared-b-a38db2/auth-test-model-a38db2-kserve-64f5879679-klfz5"
Jul 06 14:58:50.568368 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:58:50.568278    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dd34832d-7d7b-4942-9d69-6298458a0653-model-cache\") pod \"auth-test-model-a38db2-kserve-64f5879679-klfz5\" (UID: \"dd34832d-7d7b-4942-9d69-6298458a0653\") " pod="ai-tenant-e2e-shared-b-a38db2/auth-test-model-a38db2-kserve-64f5879679-klfz5"
Jul 06 14:58:50.568368 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:58:50.568324    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd34832d-7d7b-4942-9d69-6298458a0653-tmp-dir\") pod \"auth-test-model-a38db2-kserve-64f5879679-klfz5\" (UID: \"dd34832d-7d7b-4942-9d69-6298458a0653\") " pod="ai-tenant-e2e-shared-b-a38db2/auth-test-model-a38db2-kserve-64f5879679-klfz5"
Jul 06 14:58:50.568498 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:58:50.568388    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dd34832d-7d7b-4942-9d69-6298458a0653-home\") pod \"auth-test-model-a38db2-kserve-64f5879679-klfz5\" (UID: \"dd34832d-7d7b-4942-9d69-6298458a0653\") " pod="ai-tenant-e2e-shared-b-a38db2/auth-test-model-a38db2-kserve-64f5879679-klfz5"
Jul 06 14:58:50.568498 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:58:50.568436    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd34832d-7d7b-4942-9d69-6298458a0653-tls-certs\") pod \"auth-test-model-a38db2-kserve-64f5879679-klfz5\" (UID: \"dd34832d-7d7b-4942-9d69-6298458a0653\") " pod="ai-tenant-e2e-shared-b-a38db2/auth-test-model-a38db2-kserve-64f5879679-klfz5"
Jul 06 14:58:50.632349 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:58:50.632317    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 14:58:50.669577 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:58:50.669539    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd34832d-7d7b-4942-9d69-6298458a0653-tls-certs\") pod \"auth-test-model-a38db2-kserve-64f5879679-klfz5\" (UID: \"dd34832d-7d7b-4942-9d69-6298458a0653\") " pod="ai-tenant-e2e-shared-b-a38db2/auth-test-model-a38db2-kserve-64f5879679-klfz5"
Jul 06 14:58:50.669577 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:58:50.669579    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dd34832d-7d7b-4942-9d69-6298458a0653-dshm\") pod \"auth-test-model-a38db2-kserve-64f5879679-klfz5\" (UID: \"dd34832d-7d7b-4942-9d69-6298458a0653\") " pod="ai-tenant-e2e-shared-b-a38db2/auth-test-model-a38db2-kserve-64f5879679-klfz5"
Jul 06 14:58:50.669827 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:58:50.669613    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8d42\" (UniqueName: \"kubernetes.io/projected/dd34832d-7d7b-4942-9d69-6298458a0653-kube-api-access-b8d42\") pod \"auth-test-model-a38db2-kserve-64f5879679-klfz5\" (UID: \"dd34832d-7d7b-4942-9d69-6298458a0653\") " pod="ai-tenant-e2e-shared-b-a38db2/auth-test-model-a38db2-kserve-64f5879679-klfz5"
Jul 06 14:58:50.669827 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:58:50.669676    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dd34832d-7d7b-4942-9d69-6298458a0653-model-cache\") pod \"auth-test-model-a38db2-kserve-64f5879679-klfz5\" (UID: \"dd34832d-7d7b-4942-9d69-6298458a0653\") " pod="ai-tenant-e2e-shared-b-a38db2/auth-test-model-a38db2-kserve-64f5879679-klfz5"
Jul 06 14:58:50.669827 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:58:50.669740    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd34832d-7d7b-4942-9d69-6298458a0653-tmp-dir\") pod \"auth-test-model-a38db2-kserve-64f5879679-klfz5\" (UID: \"dd34832d-7d7b-4942-9d69-6298458a0653\") " pod="ai-tenant-e2e-shared-b-a38db2/auth-test-model-a38db2-kserve-64f5879679-klfz5"
Jul 06 14:58:50.669827 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:58:50.669788    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dd34832d-7d7b-4942-9d69-6298458a0653-home\") pod \"auth-test-model-a38db2-kserve-64f5879679-klfz5\" (UID: \"dd34832d-7d7b-4942-9d69-6298458a0653\") " pod="ai-tenant-e2e-shared-b-a38db2/auth-test-model-a38db2-kserve-64f5879679-klfz5"
Jul 06 14:58:50.670159 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:58:50.670127    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd34832d-7d7b-4942-9d69-6298458a0653-tmp-dir\") pod \"auth-test-model-a38db2-kserve-64f5879679-klfz5\" (UID: \"dd34832d-7d7b-4942-9d69-6298458a0653\") " pod="ai-tenant-e2e-shared-b-a38db2/auth-test-model-a38db2-kserve-64f5879679-klfz5"
Jul 06 14:58:50.670159 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:58:50.670139    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dd34832d-7d7b-4942-9d69-6298458a0653-model-cache\") pod \"auth-test-model-a38db2-kserve-64f5879679-klfz5\" (UID: \"dd34832d-7d7b-4942-9d69-6298458a0653\") " pod="ai-tenant-e2e-shared-b-a38db2/auth-test-model-a38db2-kserve-64f5879679-klfz5"
Jul 06 14:58:50.670356 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:58:50.670311    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dd34832d-7d7b-4942-9d69-6298458a0653-home\") pod \"auth-test-model-a38db2-kserve-64f5879679-klfz5\" (UID: \"dd34832d-7d7b-4942-9d69-6298458a0653\") " pod="ai-tenant-e2e-shared-b-a38db2/auth-test-model-a38db2-kserve-64f5879679-klfz5"
Jul 06 14:58:50.672307 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:58:50.672283    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dd34832d-7d7b-4942-9d69-6298458a0653-dshm\") pod \"auth-test-model-a38db2-kserve-64f5879679-klfz5\" (UID: \"dd34832d-7d7b-4942-9d69-6298458a0653\") " pod="ai-tenant-e2e-shared-b-a38db2/auth-test-model-a38db2-kserve-64f5879679-klfz5"
Jul 06 14:58:50.672629 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:58:50.672609    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd34832d-7d7b-4942-9d69-6298458a0653-tls-certs\") pod \"auth-test-model-a38db2-kserve-64f5879679-klfz5\" (UID: \"dd34832d-7d7b-4942-9d69-6298458a0653\") " pod="ai-tenant-e2e-shared-b-a38db2/auth-test-model-a38db2-kserve-64f5879679-klfz5"
Jul 06 14:58:50.680068 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:58:50.680042    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8d42\" (UniqueName: \"kubernetes.io/projected/dd34832d-7d7b-4942-9d69-6298458a0653-kube-api-access-b8d42\") pod \"auth-test-model-a38db2-kserve-64f5879679-klfz5\" (UID: \"dd34832d-7d7b-4942-9d69-6298458a0653\") " pod="ai-tenant-e2e-shared-b-a38db2/auth-test-model-a38db2-kserve-64f5879679-klfz5"
Jul 06 14:58:50.844383 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:58:50.844284    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a38db2/auth-test-model-a38db2-kserve-64f5879679-klfz5"
Jul 06 14:58:50.987011 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:58:50.986970    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-a38db2/auth-test-model-a38db2-kserve-64f5879679-klfz5"]
Jul 06 14:58:50.990222 ip-10-0-137-145 kubenswrapper[2582]: W0706 14:58:50.990179    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddd34832d_7d7b_4942_9d69_6298458a0653.slice/crio-419465618c38d5fa9fe4d7ebed7f5db5fe16bca61567c42ac849174ccab60535 WatchSource:0}: Error finding container 419465618c38d5fa9fe4d7ebed7f5db5fe16bca61567c42ac849174ccab60535: Status 404 returned error can't find the container with id 419465618c38d5fa9fe4d7ebed7f5db5fe16bca61567c42ac849174ccab60535
Jul 06 14:58:51.929780 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:58:51.929748    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a38db2/auth-test-model-a38db2-kserve-64f5879679-klfz5" event={"ID":"dd34832d-7d7b-4942-9d69-6298458a0653","Type":"ContainerStarted","Data":"2ac3cdfc00229f8de6a7f697b41c781a289702fdb649817fae4623fad08d1ee0"}
Jul 06 14:58:51.929780 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:58:51.929788    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a38db2/auth-test-model-a38db2-kserve-64f5879679-klfz5" event={"ID":"dd34832d-7d7b-4942-9d69-6298458a0653","Type":"ContainerStarted","Data":"419465618c38d5fa9fe4d7ebed7f5db5fe16bca61567c42ac849174ccab60535"}
Jul 06 14:58:53.987465 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:58:53.987404    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-a38db2/auth-test-model-a38db2-kserve-64f5879679-klfz5" podStartSLOduration=3.987387668 podStartE2EDuration="3.987387668s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:58:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:58:51.960839268 +0000 UTC m=+2158.881119696" watchObservedRunningTime="2026-07-06 14:58:53.987387668 +0000 UTC m=+2160.907668311"
Jul 06 14:58:53.988360 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:58:53.988337    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nkcvz"]
Jul 06 14:59:00.845015 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:59:00.844977    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-a38db2/auth-test-model-a38db2-kserve-64f5879679-klfz5"
Jul 06 14:59:00.845395 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:59:00.845033    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-a38db2/auth-test-model-a38db2-kserve-64f5879679-klfz5"
Jul 06 14:59:00.857411 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:59:00.857376    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-a38db2/auth-test-model-a38db2-kserve-64f5879679-klfz5"
Jul 06 14:59:00.987985 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:59:00.987950    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-a38db2/auth-test-model-a38db2-kserve-64f5879679-klfz5"
Jul 06 14:59:09.310970 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:59:09.310922    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nkcvz"]
Jul 06 14:59:26.437120 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:59:26.437077    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nkcvz"]
Jul 06 14:59:39.445067 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:59:39.445030    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nkcvz"]
Jul 06 14:59:54.752146 ip-10-0-137-145 kubenswrapper[2582]: I0706 14:59:54.752105    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nkcvz"]
Jul 06 15:00:00.134265 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:00:00.134227    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29722500-t492v"]
Jul 06 15:00:00.137314 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:00:00.137293    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722500-t492v"
Jul 06 15:00:00.140030 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:00:00.140011    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-zd4qd\""
Jul 06 15:00:00.141920 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:00:00.141899    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-a38db2-29722500-f869q"]
Jul 06 15:00:00.145498 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:00:00.145481    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-a38db2-29722500-f869q"
Jul 06 15:00:00.146176 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:00:00.146158    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-58d9da-29722500-z8d4w"]
Jul 06 15:00:00.149263 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:00:00.149235    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29722500-t492v"]
Jul 06 15:00:00.149344 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:00:00.149263    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-58d9da-29722500-z8d4w"
Jul 06 15:00:00.158857 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:00:00.158830    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-a38db2-29722500-f869q"]
Jul 06 15:00:00.161044 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:00:00.161019    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-58d9da-29722500-z8d4w"]
Jul 06 15:00:00.170402 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:00:00.170380    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srcs7\" (UniqueName: \"kubernetes.io/projected/4c3b91b7-3dbf-4524-8cbc-69d25036171a-kube-api-access-srcs7\") pod \"maas-api-key-cleanup-29722500-t492v\" (UID: \"4c3b91b7-3dbf-4524-8cbc-69d25036171a\") " pod="opendatahub/maas-api-key-cleanup-29722500-t492v"
Jul 06 15:00:00.271850 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:00:00.271815    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-srcs7\" (UniqueName: \"kubernetes.io/projected/4c3b91b7-3dbf-4524-8cbc-69d25036171a-kube-api-access-srcs7\") pod \"maas-api-key-cleanup-29722500-t492v\" (UID: \"4c3b91b7-3dbf-4524-8cbc-69d25036171a\") " pod="opendatahub/maas-api-key-cleanup-29722500-t492v"
Jul 06 15:00:00.272040 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:00:00.271857    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7cpv\" (UniqueName: \"kubernetes.io/projected/9f88d38e-62ef-46f8-a921-b2afad3a5c24-kube-api-access-n7cpv\") pod \"maas-api-key-cleanup-e2e-shared-b-a38db2-29722500-f869q\" (UID: \"9f88d38e-62ef-46f8-a921-b2afad3a5c24\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-a38db2-29722500-f869q"
Jul 06 15:00:00.272040 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:00:00.271992    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhzm5\" (UniqueName: \"kubernetes.io/projected/51bd192a-de3b-47fe-ae0e-ecb848a65ee0-kube-api-access-vhzm5\") pod \"maas-api-key-cleanup-e2e-shared-a-58d9da-29722500-z8d4w\" (UID: \"51bd192a-de3b-47fe-ae0e-ecb848a65ee0\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-58d9da-29722500-z8d4w"
Jul 06 15:00:00.282054 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:00:00.282030    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-srcs7\" (UniqueName: \"kubernetes.io/projected/4c3b91b7-3dbf-4524-8cbc-69d25036171a-kube-api-access-srcs7\") pod \"maas-api-key-cleanup-29722500-t492v\" (UID: \"4c3b91b7-3dbf-4524-8cbc-69d25036171a\") " pod="opendatahub/maas-api-key-cleanup-29722500-t492v"
Jul 06 15:00:00.373276 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:00:00.373235    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vhzm5\" (UniqueName: \"kubernetes.io/projected/51bd192a-de3b-47fe-ae0e-ecb848a65ee0-kube-api-access-vhzm5\") pod \"maas-api-key-cleanup-e2e-shared-a-58d9da-29722500-z8d4w\" (UID: \"51bd192a-de3b-47fe-ae0e-ecb848a65ee0\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-58d9da-29722500-z8d4w"
Jul 06 15:00:00.373461 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:00:00.373290    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7cpv\" (UniqueName: \"kubernetes.io/projected/9f88d38e-62ef-46f8-a921-b2afad3a5c24-kube-api-access-n7cpv\") pod \"maas-api-key-cleanup-e2e-shared-b-a38db2-29722500-f869q\" (UID: \"9f88d38e-62ef-46f8-a921-b2afad3a5c24\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-a38db2-29722500-f869q"
Jul 06 15:00:00.382784 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:00:00.382751    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7cpv\" (UniqueName: \"kubernetes.io/projected/9f88d38e-62ef-46f8-a921-b2afad3a5c24-kube-api-access-n7cpv\") pod \"maas-api-key-cleanup-e2e-shared-b-a38db2-29722500-f869q\" (UID: \"9f88d38e-62ef-46f8-a921-b2afad3a5c24\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-a38db2-29722500-f869q"
Jul 06 15:00:00.382784 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:00:00.382783    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhzm5\" (UniqueName: \"kubernetes.io/projected/51bd192a-de3b-47fe-ae0e-ecb848a65ee0-kube-api-access-vhzm5\") pod \"maas-api-key-cleanup-e2e-shared-a-58d9da-29722500-z8d4w\" (UID: \"51bd192a-de3b-47fe-ae0e-ecb848a65ee0\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-58d9da-29722500-z8d4w"
Jul 06 15:00:00.449814 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:00:00.449781    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722500-t492v"
Jul 06 15:00:00.460988 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:00:00.460960    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-a38db2-29722500-f869q"
Jul 06 15:00:00.468077 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:00:00.468051    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-58d9da-29722500-z8d4w"
Jul 06 15:00:00.597168 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:00:00.597142    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29722500-t492v"]
Jul 06 15:00:00.600644 ip-10-0-137-145 kubenswrapper[2582]: W0706 15:00:00.600602    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c3b91b7_3dbf_4524_8cbc_69d25036171a.slice/crio-eeb114a04325a17194512fd4af9e06ce568ed0674d2fae94f0777638fd523396 WatchSource:0}: Error finding container eeb114a04325a17194512fd4af9e06ce568ed0674d2fae94f0777638fd523396: Status 404 returned error can't find the container with id eeb114a04325a17194512fd4af9e06ce568ed0674d2fae94f0777638fd523396
Jul 06 15:00:00.838461 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:00:00.838440    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-a38db2-29722500-f869q"]
Jul 06 15:00:00.841813 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:00:00.841792    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-58d9da-29722500-z8d4w"]
Jul 06 15:00:01.243702 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:00:01.243631    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722500-t492v" event={"ID":"4c3b91b7-3dbf-4524-8cbc-69d25036171a","Type":"ContainerStarted","Data":"7e82722f68892e386ec790e2cce512166c34a3083487dcd74fe763da0e5bc761"}
Jul 06 15:00:01.244155 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:00:01.243749    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722500-t492v" event={"ID":"4c3b91b7-3dbf-4524-8cbc-69d25036171a","Type":"ContainerStarted","Data":"eeb114a04325a17194512fd4af9e06ce568ed0674d2fae94f0777638fd523396"}
Jul 06 15:00:01.245077 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:00:01.245053    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-58d9da-29722500-z8d4w" event={"ID":"51bd192a-de3b-47fe-ae0e-ecb848a65ee0","Type":"ContainerStarted","Data":"ac2deb66f9617a2d583f852f4bf16977754a3d0039b789f6238f5dd505b8f1a2"}
Jul 06 15:00:01.245204 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:00:01.245097    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-58d9da-29722500-z8d4w" event={"ID":"51bd192a-de3b-47fe-ae0e-ecb848a65ee0","Type":"ContainerStarted","Data":"827391ee613195791a48f6ad1dd21466b6c708f55a99eb338993a479afae0555"}
Jul 06 15:00:01.246359 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:00:01.246339    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-a38db2-29722500-f869q" event={"ID":"9f88d38e-62ef-46f8-a921-b2afad3a5c24","Type":"ContainerStarted","Data":"64fda33839eaac05910dd1c60feee35d6931124d19a26854876853757e83586e"}
Jul 06 15:00:01.246468 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:00:01.246377    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-a38db2-29722500-f869q" event={"ID":"9f88d38e-62ef-46f8-a921-b2afad3a5c24","Type":"ContainerStarted","Data":"f438e37d077fc455707db23a02ba18aaf94249f9471ec302296dd29b0461c00f"}
Jul 06 15:00:01.280513 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:00:01.280467    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29722500-t492v" podStartSLOduration=1.280452329 podStartE2EDuration="1.280452329s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:00:01.278987133 +0000 UTC m=+2228.199267562" watchObservedRunningTime="2026-07-06 15:00:01.280452329 +0000 UTC m=+2228.200732758"
Jul 06 15:00:01.322341 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:00:01.322294    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-a38db2-29722500-f869q" podStartSLOduration=1.322278518 podStartE2EDuration="1.322278518s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:00:01.320966701 +0000 UTC m=+2228.241247130" watchObservedRunningTime="2026-07-06 15:00:01.322278518 +0000 UTC m=+2228.242558946"
Jul 06 15:00:01.322509 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:00:01.322365    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-58d9da-29722500-z8d4w" podStartSLOduration=1.32235959 podStartE2EDuration="1.32235959s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:00:01.304758097 +0000 UTC m=+2228.225038526" watchObservedRunningTime="2026-07-06 15:00:01.32235959 +0000 UTC m=+2228.242640019"
Jul 06 15:00:02.252702 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:00:02.252603    2582 generic.go:356] "Generic (PLEG): container finished" podID="4c3b91b7-3dbf-4524-8cbc-69d25036171a" containerID="7e82722f68892e386ec790e2cce512166c34a3083487dcd74fe763da0e5bc761" exitCode=0
Jul 06 15:00:02.253089 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:00:02.252696    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722500-t492v" event={"ID":"4c3b91b7-3dbf-4524-8cbc-69d25036171a","Type":"ContainerDied","Data":"7e82722f68892e386ec790e2cce512166c34a3083487dcd74fe763da0e5bc761"}
Jul 06 15:00:02.254198 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:00:02.254177    2582 generic.go:356] "Generic (PLEG): container finished" podID="51bd192a-de3b-47fe-ae0e-ecb848a65ee0" containerID="ac2deb66f9617a2d583f852f4bf16977754a3d0039b789f6238f5dd505b8f1a2" exitCode=0
Jul 06 15:00:02.254300 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:00:02.254237    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-58d9da-29722500-z8d4w" event={"ID":"51bd192a-de3b-47fe-ae0e-ecb848a65ee0","Type":"ContainerDied","Data":"ac2deb66f9617a2d583f852f4bf16977754a3d0039b789f6238f5dd505b8f1a2"}
Jul 06 15:00:02.255560 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:00:02.255537    2582 generic.go:356] "Generic (PLEG): container finished" podID="9f88d38e-62ef-46f8-a921-b2afad3a5c24" containerID="64fda33839eaac05910dd1c60feee35d6931124d19a26854876853757e83586e" exitCode=0
Jul 06 15:00:02.255629 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:00:02.255585    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-a38db2-29722500-f869q" event={"ID":"9f88d38e-62ef-46f8-a921-b2afad3a5c24","Type":"ContainerDied","Data":"64fda33839eaac05910dd1c60feee35d6931124d19a26854876853757e83586e"}
Jul 06 15:00:03.401462 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:00:03.401436    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-a38db2-29722500-f869q"
Jul 06 15:00:03.447526 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:00:03.447500    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-58d9da-29722500-z8d4w"
Jul 06 15:00:03.450751 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:00:03.450730    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722500-t492v"
Jul 06 15:00:03.499138 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:00:03.499111    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n7cpv\" (UniqueName: \"kubernetes.io/projected/9f88d38e-62ef-46f8-a921-b2afad3a5c24-kube-api-access-n7cpv\") pod \"9f88d38e-62ef-46f8-a921-b2afad3a5c24\" (UID: \"9f88d38e-62ef-46f8-a921-b2afad3a5c24\") "
Jul 06 15:00:03.499323 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:00:03.499226    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-srcs7\" (UniqueName: \"kubernetes.io/projected/4c3b91b7-3dbf-4524-8cbc-69d25036171a-kube-api-access-srcs7\") pod \"4c3b91b7-3dbf-4524-8cbc-69d25036171a\" (UID: \"4c3b91b7-3dbf-4524-8cbc-69d25036171a\") "
Jul 06 15:00:03.499323 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:00:03.499242    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vhzm5\" (UniqueName: \"kubernetes.io/projected/51bd192a-de3b-47fe-ae0e-ecb848a65ee0-kube-api-access-vhzm5\") pod \"51bd192a-de3b-47fe-ae0e-ecb848a65ee0\" (UID: \"51bd192a-de3b-47fe-ae0e-ecb848a65ee0\") "
Jul 06 15:00:03.501569 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:00:03.501537    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c3b91b7-3dbf-4524-8cbc-69d25036171a-kube-api-access-srcs7" (OuterVolumeSpecName: "kube-api-access-srcs7") pod "4c3b91b7-3dbf-4524-8cbc-69d25036171a" (UID: "4c3b91b7-3dbf-4524-8cbc-69d25036171a"). InnerVolumeSpecName "kube-api-access-srcs7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 15:00:03.501814 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:00:03.501794    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f88d38e-62ef-46f8-a921-b2afad3a5c24-kube-api-access-n7cpv" (OuterVolumeSpecName: "kube-api-access-n7cpv") pod "9f88d38e-62ef-46f8-a921-b2afad3a5c24" (UID: "9f88d38e-62ef-46f8-a921-b2afad3a5c24"). InnerVolumeSpecName "kube-api-access-n7cpv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 15:00:03.502586 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:00:03.502558    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51bd192a-de3b-47fe-ae0e-ecb848a65ee0-kube-api-access-vhzm5" (OuterVolumeSpecName: "kube-api-access-vhzm5") pod "51bd192a-de3b-47fe-ae0e-ecb848a65ee0" (UID: "51bd192a-de3b-47fe-ae0e-ecb848a65ee0"). InnerVolumeSpecName "kube-api-access-vhzm5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 15:00:03.600918 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:00:03.600880    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n7cpv\" (UniqueName: \"kubernetes.io/projected/9f88d38e-62ef-46f8-a921-b2afad3a5c24-kube-api-access-n7cpv\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Jul 06 15:00:03.600918 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:00:03.600910    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-srcs7\" (UniqueName: \"kubernetes.io/projected/4c3b91b7-3dbf-4524-8cbc-69d25036171a-kube-api-access-srcs7\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Jul 06 15:00:03.600918 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:00:03.600919    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vhzm5\" (UniqueName: \"kubernetes.io/projected/51bd192a-de3b-47fe-ae0e-ecb848a65ee0-kube-api-access-vhzm5\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Jul 06 15:00:04.265671 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:00:04.265628    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722500-t492v"
Jul 06 15:00:04.265864 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:00:04.265684    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722500-t492v" event={"ID":"4c3b91b7-3dbf-4524-8cbc-69d25036171a","Type":"ContainerDied","Data":"eeb114a04325a17194512fd4af9e06ce568ed0674d2fae94f0777638fd523396"}
Jul 06 15:00:04.265864 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:00:04.265736    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="eeb114a04325a17194512fd4af9e06ce568ed0674d2fae94f0777638fd523396"
Jul 06 15:00:04.266888 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:00:04.266864    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-58d9da-29722500-z8d4w"
Jul 06 15:00:04.267001 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:00:04.266865    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-58d9da-29722500-z8d4w" event={"ID":"51bd192a-de3b-47fe-ae0e-ecb848a65ee0","Type":"ContainerDied","Data":"827391ee613195791a48f6ad1dd21466b6c708f55a99eb338993a479afae0555"}
Jul 06 15:00:04.267066 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:00:04.266997    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="827391ee613195791a48f6ad1dd21466b6c708f55a99eb338993a479afae0555"
Jul 06 15:00:04.268346 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:00:04.268322    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-a38db2-29722500-f869q" event={"ID":"9f88d38e-62ef-46f8-a921-b2afad3a5c24","Type":"ContainerDied","Data":"f438e37d077fc455707db23a02ba18aaf94249f9471ec302296dd29b0461c00f"}
Jul 06 15:00:04.268441 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:00:04.268361    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-a38db2-29722500-f869q"
Jul 06 15:00:04.268441 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:00:04.268366    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f438e37d077fc455707db23a02ba18aaf94249f9471ec302296dd29b0461c00f"
Jul 06 15:00:12.045279 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:00:12.045241    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nkcvz"]
Jul 06 15:00:27.162577 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:00:27.162540    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nkcvz"]
Jul 06 15:00:35.699220 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:00:35.699183    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 15:00:42.980024 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:00:42.979983    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nkcvz"]
Jul 06 15:00:47.761170 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:00:47.761133    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 15:00:48.659283 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:00:48.659251    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-a38db2/auth-test-model-a38db2-kserve-64f5879679-klfz5"]
Jul 06 15:00:48.692878 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:00:48.692847    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 15:00:58.962462 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:00:58.962419    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nkcvz"]
Jul 06 15:01:00.536545 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:01:00.536509    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 15:01:03.679225 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:01:03.679178    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-a38db2/auth-test-model-a38db2-kserve-64f5879679-klfz5" podUID="dd34832d-7d7b-4942-9d69-6298458a0653" containerName="main" containerID="cri-o://2ac3cdfc00229f8de6a7f697b41c781a289702fdb649817fae4623fad08d1ee0" gracePeriod=45
Jul 06 15:01:03.931549 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:01:03.931481    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a38db2/auth-test-model-a38db2-kserve-64f5879679-klfz5"
Jul 06 15:01:04.058822 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:01:04.058785    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dd34832d-7d7b-4942-9d69-6298458a0653-model-cache\") pod \"dd34832d-7d7b-4942-9d69-6298458a0653\" (UID: \"dd34832d-7d7b-4942-9d69-6298458a0653\") "
Jul 06 15:01:04.058988 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:01:04.058830    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd34832d-7d7b-4942-9d69-6298458a0653-tls-certs\") pod \"dd34832d-7d7b-4942-9d69-6298458a0653\" (UID: \"dd34832d-7d7b-4942-9d69-6298458a0653\") "
Jul 06 15:01:04.058988 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:01:04.058868    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b8d42\" (UniqueName: \"kubernetes.io/projected/dd34832d-7d7b-4942-9d69-6298458a0653-kube-api-access-b8d42\") pod \"dd34832d-7d7b-4942-9d69-6298458a0653\" (UID: \"dd34832d-7d7b-4942-9d69-6298458a0653\") "
Jul 06 15:01:04.058988 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:01:04.058916    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dd34832d-7d7b-4942-9d69-6298458a0653-home\") pod \"dd34832d-7d7b-4942-9d69-6298458a0653\" (UID: \"dd34832d-7d7b-4942-9d69-6298458a0653\") "
Jul 06 15:01:04.058988 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:01:04.058937    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd34832d-7d7b-4942-9d69-6298458a0653-tmp-dir\") pod \"dd34832d-7d7b-4942-9d69-6298458a0653\" (UID: \"dd34832d-7d7b-4942-9d69-6298458a0653\") "
Jul 06 15:01:04.059189 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:01:04.059019    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dd34832d-7d7b-4942-9d69-6298458a0653-dshm\") pod \"dd34832d-7d7b-4942-9d69-6298458a0653\" (UID: \"dd34832d-7d7b-4942-9d69-6298458a0653\") "
Jul 06 15:01:04.059189 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:01:04.059128    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd34832d-7d7b-4942-9d69-6298458a0653-model-cache" (OuterVolumeSpecName: "model-cache") pod "dd34832d-7d7b-4942-9d69-6298458a0653" (UID: "dd34832d-7d7b-4942-9d69-6298458a0653"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 15:01:04.059302 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:01:04.059180    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd34832d-7d7b-4942-9d69-6298458a0653-home" (OuterVolumeSpecName: "home") pod "dd34832d-7d7b-4942-9d69-6298458a0653" (UID: "dd34832d-7d7b-4942-9d69-6298458a0653"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 15:01:04.059302 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:01:04.059277    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dd34832d-7d7b-4942-9d69-6298458a0653-home\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Jul 06 15:01:04.059302 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:01:04.059295    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dd34832d-7d7b-4942-9d69-6298458a0653-model-cache\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Jul 06 15:01:04.059302 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:01:04.059287    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd34832d-7d7b-4942-9d69-6298458a0653-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "dd34832d-7d7b-4942-9d69-6298458a0653" (UID: "dd34832d-7d7b-4942-9d69-6298458a0653"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 15:01:04.061169 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:01:04.061148    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd34832d-7d7b-4942-9d69-6298458a0653-kube-api-access-b8d42" (OuterVolumeSpecName: "kube-api-access-b8d42") pod "dd34832d-7d7b-4942-9d69-6298458a0653" (UID: "dd34832d-7d7b-4942-9d69-6298458a0653"). InnerVolumeSpecName "kube-api-access-b8d42". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 15:01:04.061240 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:01:04.061151    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dd34832d-7d7b-4942-9d69-6298458a0653-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "dd34832d-7d7b-4942-9d69-6298458a0653" (UID: "dd34832d-7d7b-4942-9d69-6298458a0653"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 15:01:04.061240 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:01:04.061215    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd34832d-7d7b-4942-9d69-6298458a0653-dshm" (OuterVolumeSpecName: "dshm") pod "dd34832d-7d7b-4942-9d69-6298458a0653" (UID: "dd34832d-7d7b-4942-9d69-6298458a0653"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 15:01:04.159985 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:01:04.159941    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b8d42\" (UniqueName: \"kubernetes.io/projected/dd34832d-7d7b-4942-9d69-6298458a0653-kube-api-access-b8d42\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Jul 06 15:01:04.160161 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:01:04.160000    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd34832d-7d7b-4942-9d69-6298458a0653-tmp-dir\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Jul 06 15:01:04.160161 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:01:04.160012    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dd34832d-7d7b-4942-9d69-6298458a0653-dshm\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Jul 06 15:01:04.160161 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:01:04.160021    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd34832d-7d7b-4942-9d69-6298458a0653-tls-certs\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Jul 06 15:01:04.545699 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:01:04.545667    2582 generic.go:356] "Generic (PLEG): container finished" podID="dd34832d-7d7b-4942-9d69-6298458a0653" containerID="2ac3cdfc00229f8de6a7f697b41c781a289702fdb649817fae4623fad08d1ee0" exitCode=0
Jul 06 15:01:04.545851 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:01:04.545719    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a38db2/auth-test-model-a38db2-kserve-64f5879679-klfz5"
Jul 06 15:01:04.545851 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:01:04.545747    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a38db2/auth-test-model-a38db2-kserve-64f5879679-klfz5" event={"ID":"dd34832d-7d7b-4942-9d69-6298458a0653","Type":"ContainerDied","Data":"2ac3cdfc00229f8de6a7f697b41c781a289702fdb649817fae4623fad08d1ee0"}
Jul 06 15:01:04.545851 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:01:04.545790    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a38db2/auth-test-model-a38db2-kserve-64f5879679-klfz5" event={"ID":"dd34832d-7d7b-4942-9d69-6298458a0653","Type":"ContainerDied","Data":"419465618c38d5fa9fe4d7ebed7f5db5fe16bca61567c42ac849174ccab60535"}
Jul 06 15:01:04.545851 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:01:04.545808    2582 scope.go:117] "RemoveContainer" containerID="2ac3cdfc00229f8de6a7f697b41c781a289702fdb649817fae4623fad08d1ee0"
Jul 06 15:01:04.554504 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:01:04.554488    2582 scope.go:117] "RemoveContainer" containerID="2ac3cdfc00229f8de6a7f697b41c781a289702fdb649817fae4623fad08d1ee0"
Jul 06 15:01:04.554763 ip-10-0-137-145 kubenswrapper[2582]: E0706 15:01:04.554744    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2ac3cdfc00229f8de6a7f697b41c781a289702fdb649817fae4623fad08d1ee0\": container with ID starting with 2ac3cdfc00229f8de6a7f697b41c781a289702fdb649817fae4623fad08d1ee0 not found: ID does not exist" containerID="2ac3cdfc00229f8de6a7f697b41c781a289702fdb649817fae4623fad08d1ee0"
Jul 06 15:01:04.554863 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:01:04.554769    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ac3cdfc00229f8de6a7f697b41c781a289702fdb649817fae4623fad08d1ee0"} err="failed to get container status \"2ac3cdfc00229f8de6a7f697b41c781a289702fdb649817fae4623fad08d1ee0\": rpc error: code = NotFound desc = could not find container \"2ac3cdfc00229f8de6a7f697b41c781a289702fdb649817fae4623fad08d1ee0\": container with ID starting with 2ac3cdfc00229f8de6a7f697b41c781a289702fdb649817fae4623fad08d1ee0 not found: ID does not exist"
Jul 06 15:01:04.567989 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:01:04.567961    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-a38db2/auth-test-model-a38db2-kserve-64f5879679-klfz5"]
Jul 06 15:01:04.576304 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:01:04.576276    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-a38db2/auth-test-model-a38db2-kserve-64f5879679-klfz5"]
Jul 06 15:01:05.498668 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:01:05.498624    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dd34832d-7d7b-4942-9d69-6298458a0653" path="/var/lib/kubelet/pods/dd34832d-7d7b-4942-9d69-6298458a0653/volumes"
Jul 06 15:01:10.263733 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:01:10.263697    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nkcvz"]
Jul 06 15:01:45.323727 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:01:45.323689    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 15:01:45.379826 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:01:45.379792    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-a38db2/sub-test-model-a38db2-kserve-75d846f5f-l5gqn"]
Jul 06 15:01:45.380155 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:01:45.380142    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd34832d-7d7b-4942-9d69-6298458a0653" containerName="main"
Jul 06 15:01:45.380204 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:01:45.380158    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd34832d-7d7b-4942-9d69-6298458a0653" containerName="main"
Jul 06 15:01:45.380204 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:01:45.380170    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f88d38e-62ef-46f8-a921-b2afad3a5c24" containerName="cleanup"
Jul 06 15:01:45.380204 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:01:45.380176    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f88d38e-62ef-46f8-a921-b2afad3a5c24" containerName="cleanup"
Jul 06 15:01:45.380204 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:01:45.380189    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c3b91b7-3dbf-4524-8cbc-69d25036171a" containerName="cleanup"
Jul 06 15:01:45.380204 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:01:45.380194    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c3b91b7-3dbf-4524-8cbc-69d25036171a" containerName="cleanup"
Jul 06 15:01:45.380204 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:01:45.380203    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51bd192a-de3b-47fe-ae0e-ecb848a65ee0" containerName="cleanup"
Jul 06 15:01:45.380389 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:01:45.380209    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="51bd192a-de3b-47fe-ae0e-ecb848a65ee0" containerName="cleanup"
Jul 06 15:01:45.380389 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:01:45.380257    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f88d38e-62ef-46f8-a921-b2afad3a5c24" containerName="cleanup"
Jul 06 15:01:45.380389 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:01:45.380266    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="51bd192a-de3b-47fe-ae0e-ecb848a65ee0" containerName="cleanup"
Jul 06 15:01:45.380389 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:01:45.380273    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c3b91b7-3dbf-4524-8cbc-69d25036171a" containerName="cleanup"
Jul 06 15:01:45.380389 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:01:45.380280    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd34832d-7d7b-4942-9d69-6298458a0653" containerName="main"
Jul 06 15:01:45.383162 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:01:45.383145    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a38db2/sub-test-model-a38db2-kserve-75d846f5f-l5gqn"
Jul 06 15:01:45.387395 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:01:45.387345    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-a38db2\"/\"default-dockercfg-9l59j\""
Jul 06 15:01:45.387515 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:01:45.387390    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-a38db2\"/\"kube-root-ca.crt\""
Jul 06 15:01:45.387515 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:01:45.387414    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-a38db2\"/\"sub-test-model-a38db2-kserve-self-signed-certs\""
Jul 06 15:01:45.387780 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:01:45.387766    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-a38db2\"/\"openshift-service-ca.crt\""
Jul 06 15:01:45.399828 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:01:45.399798    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-a38db2/sub-test-model-a38db2-kserve-75d846f5f-l5gqn"]
Jul 06 15:01:45.522608 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:01:45.522573    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/84858a35-b654-4b1e-b2a4-8b4935b21c5a-home\") pod \"sub-test-model-a38db2-kserve-75d846f5f-l5gqn\" (UID: \"84858a35-b654-4b1e-b2a4-8b4935b21c5a\") " pod="ai-tenant-e2e-shared-b-a38db2/sub-test-model-a38db2-kserve-75d846f5f-l5gqn"
Jul 06 15:01:45.522817 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:01:45.522623    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwx7s\" (UniqueName: \"kubernetes.io/projected/84858a35-b654-4b1e-b2a4-8b4935b21c5a-kube-api-access-hwx7s\") pod \"sub-test-model-a38db2-kserve-75d846f5f-l5gqn\" (UID: \"84858a35-b654-4b1e-b2a4-8b4935b21c5a\") " pod="ai-tenant-e2e-shared-b-a38db2/sub-test-model-a38db2-kserve-75d846f5f-l5gqn"
Jul 06 15:01:45.522817 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:01:45.522646    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/84858a35-b654-4b1e-b2a4-8b4935b21c5a-model-cache\") pod \"sub-test-model-a38db2-kserve-75d846f5f-l5gqn\" (UID: \"84858a35-b654-4b1e-b2a4-8b4935b21c5a\") " pod="ai-tenant-e2e-shared-b-a38db2/sub-test-model-a38db2-kserve-75d846f5f-l5gqn"
Jul 06 15:01:45.522817 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:01:45.522695    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/84858a35-b654-4b1e-b2a4-8b4935b21c5a-dshm\") pod \"sub-test-model-a38db2-kserve-75d846f5f-l5gqn\" (UID: \"84858a35-b654-4b1e-b2a4-8b4935b21c5a\") " pod="ai-tenant-e2e-shared-b-a38db2/sub-test-model-a38db2-kserve-75d846f5f-l5gqn"
Jul 06 15:01:45.522817 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:01:45.522714    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/84858a35-b654-4b1e-b2a4-8b4935b21c5a-tls-certs\") pod \"sub-test-model-a38db2-kserve-75d846f5f-l5gqn\" (UID: \"84858a35-b654-4b1e-b2a4-8b4935b21c5a\") " pod="ai-tenant-e2e-shared-b-a38db2/sub-test-model-a38db2-kserve-75d846f5f-l5gqn"
Jul 06 15:01:45.522817 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:01:45.522729    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/84858a35-b654-4b1e-b2a4-8b4935b21c5a-tmp-dir\") pod \"sub-test-model-a38db2-kserve-75d846f5f-l5gqn\" (UID: \"84858a35-b654-4b1e-b2a4-8b4935b21c5a\") " pod="ai-tenant-e2e-shared-b-a38db2/sub-test-model-a38db2-kserve-75d846f5f-l5gqn"
Jul 06 15:01:45.624466 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:01:45.624382    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/84858a35-b654-4b1e-b2a4-8b4935b21c5a-home\") pod \"sub-test-model-a38db2-kserve-75d846f5f-l5gqn\" (UID: \"84858a35-b654-4b1e-b2a4-8b4935b21c5a\") " pod="ai-tenant-e2e-shared-b-a38db2/sub-test-model-a38db2-kserve-75d846f5f-l5gqn"
Jul 06 15:01:45.624466 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:01:45.624453    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwx7s\" (UniqueName: \"kubernetes.io/projected/84858a35-b654-4b1e-b2a4-8b4935b21c5a-kube-api-access-hwx7s\") pod \"sub-test-model-a38db2-kserve-75d846f5f-l5gqn\" (UID: \"84858a35-b654-4b1e-b2a4-8b4935b21c5a\") " pod="ai-tenant-e2e-shared-b-a38db2/sub-test-model-a38db2-kserve-75d846f5f-l5gqn"
Jul 06 15:01:45.624742 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:01:45.624492    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/84858a35-b654-4b1e-b2a4-8b4935b21c5a-model-cache\") pod \"sub-test-model-a38db2-kserve-75d846f5f-l5gqn\" (UID: \"84858a35-b654-4b1e-b2a4-8b4935b21c5a\") " pod="ai-tenant-e2e-shared-b-a38db2/sub-test-model-a38db2-kserve-75d846f5f-l5gqn"
Jul 06 15:01:45.624742 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:01:45.624523    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/84858a35-b654-4b1e-b2a4-8b4935b21c5a-dshm\") pod \"sub-test-model-a38db2-kserve-75d846f5f-l5gqn\" (UID: \"84858a35-b654-4b1e-b2a4-8b4935b21c5a\") " pod="ai-tenant-e2e-shared-b-a38db2/sub-test-model-a38db2-kserve-75d846f5f-l5gqn"
Jul 06 15:01:45.624862 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:01:45.624752    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/84858a35-b654-4b1e-b2a4-8b4935b21c5a-tls-certs\") pod \"sub-test-model-a38db2-kserve-75d846f5f-l5gqn\" (UID: \"84858a35-b654-4b1e-b2a4-8b4935b21c5a\") " pod="ai-tenant-e2e-shared-b-a38db2/sub-test-model-a38db2-kserve-75d846f5f-l5gqn"
Jul 06 15:01:45.624862 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:01:45.624779    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/84858a35-b654-4b1e-b2a4-8b4935b21c5a-tmp-dir\") pod \"sub-test-model-a38db2-kserve-75d846f5f-l5gqn\" (UID: \"84858a35-b654-4b1e-b2a4-8b4935b21c5a\") " pod="ai-tenant-e2e-shared-b-a38db2/sub-test-model-a38db2-kserve-75d846f5f-l5gqn"
Jul 06 15:01:45.624969 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:01:45.624897    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/84858a35-b654-4b1e-b2a4-8b4935b21c5a-home\") pod \"sub-test-model-a38db2-kserve-75d846f5f-l5gqn\" (UID: \"84858a35-b654-4b1e-b2a4-8b4935b21c5a\") " pod="ai-tenant-e2e-shared-b-a38db2/sub-test-model-a38db2-kserve-75d846f5f-l5gqn"
Jul 06 15:01:45.625204 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:01:45.625174    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/84858a35-b654-4b1e-b2a4-8b4935b21c5a-tmp-dir\") pod \"sub-test-model-a38db2-kserve-75d846f5f-l5gqn\" (UID: \"84858a35-b654-4b1e-b2a4-8b4935b21c5a\") " pod="ai-tenant-e2e-shared-b-a38db2/sub-test-model-a38db2-kserve-75d846f5f-l5gqn"
Jul 06 15:01:45.625416 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:01:45.625238    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/84858a35-b654-4b1e-b2a4-8b4935b21c5a-model-cache\") pod \"sub-test-model-a38db2-kserve-75d846f5f-l5gqn\" (UID: \"84858a35-b654-4b1e-b2a4-8b4935b21c5a\") " pod="ai-tenant-e2e-shared-b-a38db2/sub-test-model-a38db2-kserve-75d846f5f-l5gqn"
Jul 06 15:01:45.627420 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:01:45.627375    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/84858a35-b654-4b1e-b2a4-8b4935b21c5a-dshm\") pod \"sub-test-model-a38db2-kserve-75d846f5f-l5gqn\" (UID: \"84858a35-b654-4b1e-b2a4-8b4935b21c5a\") " pod="ai-tenant-e2e-shared-b-a38db2/sub-test-model-a38db2-kserve-75d846f5f-l5gqn"
Jul 06 15:01:45.628020 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:01:45.627999    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/84858a35-b654-4b1e-b2a4-8b4935b21c5a-tls-certs\") pod \"sub-test-model-a38db2-kserve-75d846f5f-l5gqn\" (UID: \"84858a35-b654-4b1e-b2a4-8b4935b21c5a\") " pod="ai-tenant-e2e-shared-b-a38db2/sub-test-model-a38db2-kserve-75d846f5f-l5gqn"
Jul 06 15:01:45.642591 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:01:45.642558    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwx7s\" (UniqueName: \"kubernetes.io/projected/84858a35-b654-4b1e-b2a4-8b4935b21c5a-kube-api-access-hwx7s\") pod \"sub-test-model-a38db2-kserve-75d846f5f-l5gqn\" (UID: \"84858a35-b654-4b1e-b2a4-8b4935b21c5a\") " pod="ai-tenant-e2e-shared-b-a38db2/sub-test-model-a38db2-kserve-75d846f5f-l5gqn"
Jul 06 15:01:45.692522 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:01:45.692483    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a38db2/sub-test-model-a38db2-kserve-75d846f5f-l5gqn"
Jul 06 15:01:45.837110 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:01:45.836918    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-a38db2/sub-test-model-a38db2-kserve-75d846f5f-l5gqn"]
Jul 06 15:01:45.839722 ip-10-0-137-145 kubenswrapper[2582]: W0706 15:01:45.839698    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod84858a35_b654_4b1e_b2a4_8b4935b21c5a.slice/crio-d81a7bf835ed74e01e19c5cc71a170af2c13b578adfc05f6e457fb8a6ead468d WatchSource:0}: Error finding container d81a7bf835ed74e01e19c5cc71a170af2c13b578adfc05f6e457fb8a6ead468d: Status 404 returned error can't find the container with id d81a7bf835ed74e01e19c5cc71a170af2c13b578adfc05f6e457fb8a6ead468d
Jul 06 15:01:45.923646 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:01:45.923613    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 15:01:46.739331 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:01:46.739299    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a38db2/sub-test-model-a38db2-kserve-75d846f5f-l5gqn" event={"ID":"84858a35-b654-4b1e-b2a4-8b4935b21c5a","Type":"ContainerStarted","Data":"ed7113b219702b75edc64b671e4ca15ac26f0f9158904f0b70e1dfaf7f970b3e"}
Jul 06 15:01:46.739331 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:01:46.739342    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a38db2/sub-test-model-a38db2-kserve-75d846f5f-l5gqn" event={"ID":"84858a35-b654-4b1e-b2a4-8b4935b21c5a","Type":"ContainerStarted","Data":"d81a7bf835ed74e01e19c5cc71a170af2c13b578adfc05f6e457fb8a6ead468d"}
Jul 06 15:01:46.770990 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:01:46.770939    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-a38db2/sub-test-model-a38db2-kserve-75d846f5f-l5gqn" podStartSLOduration=1.770924559 podStartE2EDuration="1.770924559s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:01:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:01:46.770278657 +0000 UTC m=+2333.690559098" watchObservedRunningTime="2026-07-06 15:01:46.770924559 +0000 UTC m=+2333.691204988"
Jul 06 15:01:49.973245 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:01:49.973201    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nkcvz"]
Jul 06 15:01:55.693446 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:01:55.693406    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-a38db2/sub-test-model-a38db2-kserve-75d846f5f-l5gqn"
Jul 06 15:01:55.693446 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:01:55.693453    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-a38db2/sub-test-model-a38db2-kserve-75d846f5f-l5gqn"
Jul 06 15:01:55.706107 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:01:55.706079    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-a38db2/sub-test-model-a38db2-kserve-75d846f5f-l5gqn"
Jul 06 15:01:55.792233 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:01:55.792196    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-a38db2/sub-test-model-a38db2-kserve-75d846f5f-l5gqn"
Jul 06 15:02:03.243096 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:02:03.243057    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nkcvz"]
Jul 06 15:02:17.348403 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:02:17.348368    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 15:02:21.148238 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:02:21.148202    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nkcvz"]
Jul 06 15:02:26.165337 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:02:26.165304    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 15:02:27.202741 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:02:27.202703    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-a38db2/sub-test-model-a38db2-kserve-75d846f5f-l5gqn"]
Jul 06 15:02:27.218196 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:02:27.218148    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 15:02:29.244405 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:02:29.244373    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-58d9da/rate-test-model-58d9da-kserve-5f455c5f8c-clbcn"]
Jul 06 15:02:29.247855 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:02:29.247833    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-58d9da/rate-test-model-58d9da-kserve-5f455c5f8c-clbcn"
Jul 06 15:02:29.251576 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:02:29.251554    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-58d9da\"/\"default-dockercfg-xgm5p\""
Jul 06 15:02:29.251576 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:02:29.251571    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-58d9da\"/\"kube-root-ca.crt\""
Jul 06 15:02:29.251764 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:02:29.251554    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-58d9da\"/\"openshift-service-ca.crt\""
Jul 06 15:02:29.251764 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:02:29.251554    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-58d9da\"/\"rate-test-model-58d9da-kserve-self-signed-certs\""
Jul 06 15:02:29.256606 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:02:29.256583    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-58d9da/rate-test-model-58d9da-kserve-5f455c5f8c-clbcn"]
Jul 06 15:02:29.300069 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:02:29.300042    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 15:02:29.325826 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:02:29.325792    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d140f2a8-922b-4bae-bcc2-23d1f1c98f78-tls-certs\") pod \"rate-test-model-58d9da-kserve-5f455c5f8c-clbcn\" (UID: \"d140f2a8-922b-4bae-bcc2-23d1f1c98f78\") " pod="ai-tenant-e2e-shared-a-58d9da/rate-test-model-58d9da-kserve-5f455c5f8c-clbcn"
Jul 06 15:02:29.325826 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:02:29.325828    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m47nj\" (UniqueName: \"kubernetes.io/projected/d140f2a8-922b-4bae-bcc2-23d1f1c98f78-kube-api-access-m47nj\") pod \"rate-test-model-58d9da-kserve-5f455c5f8c-clbcn\" (UID: \"d140f2a8-922b-4bae-bcc2-23d1f1c98f78\") " pod="ai-tenant-e2e-shared-a-58d9da/rate-test-model-58d9da-kserve-5f455c5f8c-clbcn"
Jul 06 15:02:29.326026 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:02:29.325888    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d140f2a8-922b-4bae-bcc2-23d1f1c98f78-tmp-dir\") pod \"rate-test-model-58d9da-kserve-5f455c5f8c-clbcn\" (UID: \"d140f2a8-922b-4bae-bcc2-23d1f1c98f78\") " pod="ai-tenant-e2e-shared-a-58d9da/rate-test-model-58d9da-kserve-5f455c5f8c-clbcn"
Jul 06 15:02:29.326026 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:02:29.325917    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d140f2a8-922b-4bae-bcc2-23d1f1c98f78-model-cache\") pod \"rate-test-model-58d9da-kserve-5f455c5f8c-clbcn\" (UID: \"d140f2a8-922b-4bae-bcc2-23d1f1c98f78\") " pod="ai-tenant-e2e-shared-a-58d9da/rate-test-model-58d9da-kserve-5f455c5f8c-clbcn"
Jul 06 15:02:29.326026 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:02:29.325976    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d140f2a8-922b-4bae-bcc2-23d1f1c98f78-home\") pod \"rate-test-model-58d9da-kserve-5f455c5f8c-clbcn\" (UID: \"d140f2a8-922b-4bae-bcc2-23d1f1c98f78\") " pod="ai-tenant-e2e-shared-a-58d9da/rate-test-model-58d9da-kserve-5f455c5f8c-clbcn"
Jul 06 15:02:29.326174 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:02:29.326060    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d140f2a8-922b-4bae-bcc2-23d1f1c98f78-dshm\") pod \"rate-test-model-58d9da-kserve-5f455c5f8c-clbcn\" (UID: \"d140f2a8-922b-4bae-bcc2-23d1f1c98f78\") " pod="ai-tenant-e2e-shared-a-58d9da/rate-test-model-58d9da-kserve-5f455c5f8c-clbcn"
Jul 06 15:02:29.426769 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:02:29.426726    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d140f2a8-922b-4bae-bcc2-23d1f1c98f78-tmp-dir\") pod \"rate-test-model-58d9da-kserve-5f455c5f8c-clbcn\" (UID: \"d140f2a8-922b-4bae-bcc2-23d1f1c98f78\") " pod="ai-tenant-e2e-shared-a-58d9da/rate-test-model-58d9da-kserve-5f455c5f8c-clbcn"
Jul 06 15:02:29.426967 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:02:29.426786    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d140f2a8-922b-4bae-bcc2-23d1f1c98f78-model-cache\") pod \"rate-test-model-58d9da-kserve-5f455c5f8c-clbcn\" (UID: \"d140f2a8-922b-4bae-bcc2-23d1f1c98f78\") " pod="ai-tenant-e2e-shared-a-58d9da/rate-test-model-58d9da-kserve-5f455c5f8c-clbcn"
Jul 06 15:02:29.427044 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:02:29.426973    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d140f2a8-922b-4bae-bcc2-23d1f1c98f78-home\") pod \"rate-test-model-58d9da-kserve-5f455c5f8c-clbcn\" (UID: \"d140f2a8-922b-4bae-bcc2-23d1f1c98f78\") " pod="ai-tenant-e2e-shared-a-58d9da/rate-test-model-58d9da-kserve-5f455c5f8c-clbcn"
Jul 06 15:02:29.427104 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:02:29.427090    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d140f2a8-922b-4bae-bcc2-23d1f1c98f78-dshm\") pod \"rate-test-model-58d9da-kserve-5f455c5f8c-clbcn\" (UID: \"d140f2a8-922b-4bae-bcc2-23d1f1c98f78\") " pod="ai-tenant-e2e-shared-a-58d9da/rate-test-model-58d9da-kserve-5f455c5f8c-clbcn"
Jul 06 15:02:29.427182 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:02:29.427158    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d140f2a8-922b-4bae-bcc2-23d1f1c98f78-tls-certs\") pod \"rate-test-model-58d9da-kserve-5f455c5f8c-clbcn\" (UID: \"d140f2a8-922b-4bae-bcc2-23d1f1c98f78\") " pod="ai-tenant-e2e-shared-a-58d9da/rate-test-model-58d9da-kserve-5f455c5f8c-clbcn"
Jul 06 15:02:29.427247 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:02:29.427185    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d140f2a8-922b-4bae-bcc2-23d1f1c98f78-model-cache\") pod \"rate-test-model-58d9da-kserve-5f455c5f8c-clbcn\" (UID: \"d140f2a8-922b-4bae-bcc2-23d1f1c98f78\") " pod="ai-tenant-e2e-shared-a-58d9da/rate-test-model-58d9da-kserve-5f455c5f8c-clbcn"
Jul 06 15:02:29.427247 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:02:29.427193    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m47nj\" (UniqueName: \"kubernetes.io/projected/d140f2a8-922b-4bae-bcc2-23d1f1c98f78-kube-api-access-m47nj\") pod \"rate-test-model-58d9da-kserve-5f455c5f8c-clbcn\" (UID: \"d140f2a8-922b-4bae-bcc2-23d1f1c98f78\") " pod="ai-tenant-e2e-shared-a-58d9da/rate-test-model-58d9da-kserve-5f455c5f8c-clbcn"
Jul 06 15:02:29.427247 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:02:29.427236    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d140f2a8-922b-4bae-bcc2-23d1f1c98f78-tmp-dir\") pod \"rate-test-model-58d9da-kserve-5f455c5f8c-clbcn\" (UID: \"d140f2a8-922b-4bae-bcc2-23d1f1c98f78\") " pod="ai-tenant-e2e-shared-a-58d9da/rate-test-model-58d9da-kserve-5f455c5f8c-clbcn"
Jul 06 15:02:29.427478 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:02:29.427453    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d140f2a8-922b-4bae-bcc2-23d1f1c98f78-home\") pod \"rate-test-model-58d9da-kserve-5f455c5f8c-clbcn\" (UID: \"d140f2a8-922b-4bae-bcc2-23d1f1c98f78\") " pod="ai-tenant-e2e-shared-a-58d9da/rate-test-model-58d9da-kserve-5f455c5f8c-clbcn"
Jul 06 15:02:29.429455 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:02:29.429424    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d140f2a8-922b-4bae-bcc2-23d1f1c98f78-dshm\") pod \"rate-test-model-58d9da-kserve-5f455c5f8c-clbcn\" (UID: \"d140f2a8-922b-4bae-bcc2-23d1f1c98f78\") " pod="ai-tenant-e2e-shared-a-58d9da/rate-test-model-58d9da-kserve-5f455c5f8c-clbcn"
Jul 06 15:02:29.429725 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:02:29.429704    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d140f2a8-922b-4bae-bcc2-23d1f1c98f78-tls-certs\") pod \"rate-test-model-58d9da-kserve-5f455c5f8c-clbcn\" (UID: \"d140f2a8-922b-4bae-bcc2-23d1f1c98f78\") " pod="ai-tenant-e2e-shared-a-58d9da/rate-test-model-58d9da-kserve-5f455c5f8c-clbcn"
Jul 06 15:02:29.436180 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:02:29.436153    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m47nj\" (UniqueName: \"kubernetes.io/projected/d140f2a8-922b-4bae-bcc2-23d1f1c98f78-kube-api-access-m47nj\") pod \"rate-test-model-58d9da-kserve-5f455c5f8c-clbcn\" (UID: \"d140f2a8-922b-4bae-bcc2-23d1f1c98f78\") " pod="ai-tenant-e2e-shared-a-58d9da/rate-test-model-58d9da-kserve-5f455c5f8c-clbcn"
Jul 06 15:02:29.557980 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:02:29.557870    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-58d9da/rate-test-model-58d9da-kserve-5f455c5f8c-clbcn"
Jul 06 15:02:29.701395 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:02:29.701365    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-58d9da/rate-test-model-58d9da-kserve-5f455c5f8c-clbcn"]
Jul 06 15:02:29.704553 ip-10-0-137-145 kubenswrapper[2582]: W0706 15:02:29.704525    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd140f2a8_922b_4bae_bcc2_23d1f1c98f78.slice/crio-3306353966d8d5f64d43edb7b04e3255f7aed579ea00907c68a1539fff465153 WatchSource:0}: Error finding container 3306353966d8d5f64d43edb7b04e3255f7aed579ea00907c68a1539fff465153: Status 404 returned error can't find the container with id 3306353966d8d5f64d43edb7b04e3255f7aed579ea00907c68a1539fff465153
Jul 06 15:02:29.940424 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:02:29.940382    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-58d9da/rate-test-model-58d9da-kserve-5f455c5f8c-clbcn" event={"ID":"d140f2a8-922b-4bae-bcc2-23d1f1c98f78","Type":"ContainerStarted","Data":"3a80fb430b7d9c326be5478c32754f61566c48ad3214ed304efd82d9999f0ffc"}
Jul 06 15:02:29.940618 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:02:29.940433    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-58d9da/rate-test-model-58d9da-kserve-5f455c5f8c-clbcn" event={"ID":"d140f2a8-922b-4bae-bcc2-23d1f1c98f78","Type":"ContainerStarted","Data":"3306353966d8d5f64d43edb7b04e3255f7aed579ea00907c68a1539fff465153"}
Jul 06 15:02:29.962298 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:02:29.962245    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-58d9da/rate-test-model-58d9da-kserve-5f455c5f8c-clbcn" podStartSLOduration=0.962227624 podStartE2EDuration="962.227624ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:02:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:02:29.960779322 +0000 UTC m=+2376.881059764" watchObservedRunningTime="2026-07-06 15:02:29.962227624 +0000 UTC m=+2376.882508092"
Jul 06 15:02:38.312260 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:02:38.312221    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nkcvz"]
Jul 06 15:02:39.558765 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:02:39.558726    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-58d9da/rate-test-model-58d9da-kserve-5f455c5f8c-clbcn"
Jul 06 15:02:39.559207 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:02:39.558867    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-58d9da/rate-test-model-58d9da-kserve-5f455c5f8c-clbcn"
Jul 06 15:02:39.571599 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:02:39.571571    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-58d9da/rate-test-model-58d9da-kserve-5f455c5f8c-clbcn"
Jul 06 15:02:39.996440 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:02:39.996413    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-58d9da/rate-test-model-58d9da-kserve-5f455c5f8c-clbcn"
Jul 06 15:02:42.222627 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:02:42.222584    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-a38db2/sub-test-model-a38db2-kserve-75d846f5f-l5gqn" podUID="84858a35-b654-4b1e-b2a4-8b4935b21c5a" containerName="main" containerID="cri-o://ed7113b219702b75edc64b671e4ca15ac26f0f9158904f0b70e1dfaf7f970b3e" gracePeriod=45
Jul 06 15:02:42.464761 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:02:42.464734    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a38db2/sub-test-model-a38db2-kserve-75d846f5f-l5gqn"
Jul 06 15:02:42.552690 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:02:42.552574    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/84858a35-b654-4b1e-b2a4-8b4935b21c5a-model-cache\") pod \"84858a35-b654-4b1e-b2a4-8b4935b21c5a\" (UID: \"84858a35-b654-4b1e-b2a4-8b4935b21c5a\") "
Jul 06 15:02:42.552690 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:02:42.552632    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/84858a35-b654-4b1e-b2a4-8b4935b21c5a-home\") pod \"84858a35-b654-4b1e-b2a4-8b4935b21c5a\" (UID: \"84858a35-b654-4b1e-b2a4-8b4935b21c5a\") "
Jul 06 15:02:42.552690 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:02:42.552674    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/84858a35-b654-4b1e-b2a4-8b4935b21c5a-tls-certs\") pod \"84858a35-b654-4b1e-b2a4-8b4935b21c5a\" (UID: \"84858a35-b654-4b1e-b2a4-8b4935b21c5a\") "
Jul 06 15:02:42.552949 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:02:42.552705    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/84858a35-b654-4b1e-b2a4-8b4935b21c5a-tmp-dir\") pod \"84858a35-b654-4b1e-b2a4-8b4935b21c5a\" (UID: \"84858a35-b654-4b1e-b2a4-8b4935b21c5a\") "
Jul 06 15:02:42.552949 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:02:42.552749    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hwx7s\" (UniqueName: \"kubernetes.io/projected/84858a35-b654-4b1e-b2a4-8b4935b21c5a-kube-api-access-hwx7s\") pod \"84858a35-b654-4b1e-b2a4-8b4935b21c5a\" (UID: \"84858a35-b654-4b1e-b2a4-8b4935b21c5a\") "
Jul 06 15:02:42.552949 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:02:42.552794    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/84858a35-b654-4b1e-b2a4-8b4935b21c5a-dshm\") pod \"84858a35-b654-4b1e-b2a4-8b4935b21c5a\" (UID: \"84858a35-b654-4b1e-b2a4-8b4935b21c5a\") "
Jul 06 15:02:42.553116 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:02:42.552961    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84858a35-b654-4b1e-b2a4-8b4935b21c5a-model-cache" (OuterVolumeSpecName: "model-cache") pod "84858a35-b654-4b1e-b2a4-8b4935b21c5a" (UID: "84858a35-b654-4b1e-b2a4-8b4935b21c5a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 15:02:42.553116 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:02:42.552967    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84858a35-b654-4b1e-b2a4-8b4935b21c5a-home" (OuterVolumeSpecName: "home") pod "84858a35-b654-4b1e-b2a4-8b4935b21c5a" (UID: "84858a35-b654-4b1e-b2a4-8b4935b21c5a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 15:02:42.553116 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:02:42.553027    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84858a35-b654-4b1e-b2a4-8b4935b21c5a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "84858a35-b654-4b1e-b2a4-8b4935b21c5a" (UID: "84858a35-b654-4b1e-b2a4-8b4935b21c5a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 15:02:42.553116 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:02:42.553073    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/84858a35-b654-4b1e-b2a4-8b4935b21c5a-home\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Jul 06 15:02:42.553116 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:02:42.553090    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/84858a35-b654-4b1e-b2a4-8b4935b21c5a-model-cache\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Jul 06 15:02:42.554909 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:02:42.554880    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84858a35-b654-4b1e-b2a4-8b4935b21c5a-dshm" (OuterVolumeSpecName: "dshm") pod "84858a35-b654-4b1e-b2a4-8b4935b21c5a" (UID: "84858a35-b654-4b1e-b2a4-8b4935b21c5a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 15:02:42.555267 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:02:42.555241    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/84858a35-b654-4b1e-b2a4-8b4935b21c5a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "84858a35-b654-4b1e-b2a4-8b4935b21c5a" (UID: "84858a35-b654-4b1e-b2a4-8b4935b21c5a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 15:02:42.555489 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:02:42.555467    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84858a35-b654-4b1e-b2a4-8b4935b21c5a-kube-api-access-hwx7s" (OuterVolumeSpecName: "kube-api-access-hwx7s") pod "84858a35-b654-4b1e-b2a4-8b4935b21c5a" (UID: "84858a35-b654-4b1e-b2a4-8b4935b21c5a"). InnerVolumeSpecName "kube-api-access-hwx7s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 15:02:42.654184 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:02:42.654145    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/84858a35-b654-4b1e-b2a4-8b4935b21c5a-tls-certs\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Jul 06 15:02:42.654184 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:02:42.654181    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/84858a35-b654-4b1e-b2a4-8b4935b21c5a-tmp-dir\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Jul 06 15:02:42.654184 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:02:42.654194    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hwx7s\" (UniqueName: \"kubernetes.io/projected/84858a35-b654-4b1e-b2a4-8b4935b21c5a-kube-api-access-hwx7s\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Jul 06 15:02:42.654438 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:02:42.654204    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/84858a35-b654-4b1e-b2a4-8b4935b21c5a-dshm\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Jul 06 15:02:43.000780 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:02:43.000742    2582 generic.go:356] "Generic (PLEG): container finished" podID="84858a35-b654-4b1e-b2a4-8b4935b21c5a" containerID="ed7113b219702b75edc64b671e4ca15ac26f0f9158904f0b70e1dfaf7f970b3e" exitCode=0
Jul 06 15:02:43.000780 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:02:43.000781    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a38db2/sub-test-model-a38db2-kserve-75d846f5f-l5gqn"
Jul 06 15:02:43.000780 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:02:43.000786    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a38db2/sub-test-model-a38db2-kserve-75d846f5f-l5gqn" event={"ID":"84858a35-b654-4b1e-b2a4-8b4935b21c5a","Type":"ContainerDied","Data":"ed7113b219702b75edc64b671e4ca15ac26f0f9158904f0b70e1dfaf7f970b3e"}
Jul 06 15:02:43.001077 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:02:43.000815    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a38db2/sub-test-model-a38db2-kserve-75d846f5f-l5gqn" event={"ID":"84858a35-b654-4b1e-b2a4-8b4935b21c5a","Type":"ContainerDied","Data":"d81a7bf835ed74e01e19c5cc71a170af2c13b578adfc05f6e457fb8a6ead468d"}
Jul 06 15:02:43.001077 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:02:43.000831    2582 scope.go:117] "RemoveContainer" containerID="ed7113b219702b75edc64b671e4ca15ac26f0f9158904f0b70e1dfaf7f970b3e"
Jul 06 15:02:43.009711 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:02:43.009692    2582 scope.go:117] "RemoveContainer" containerID="ed7113b219702b75edc64b671e4ca15ac26f0f9158904f0b70e1dfaf7f970b3e"
Jul 06 15:02:43.010005 ip-10-0-137-145 kubenswrapper[2582]: E0706 15:02:43.009986    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ed7113b219702b75edc64b671e4ca15ac26f0f9158904f0b70e1dfaf7f970b3e\": container with ID starting with ed7113b219702b75edc64b671e4ca15ac26f0f9158904f0b70e1dfaf7f970b3e not found: ID does not exist" containerID="ed7113b219702b75edc64b671e4ca15ac26f0f9158904f0b70e1dfaf7f970b3e"
Jul 06 15:02:43.010093 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:02:43.010014    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed7113b219702b75edc64b671e4ca15ac26f0f9158904f0b70e1dfaf7f970b3e"} err="failed to get container status \"ed7113b219702b75edc64b671e4ca15ac26f0f9158904f0b70e1dfaf7f970b3e\": rpc error: code = NotFound desc = could not find container \"ed7113b219702b75edc64b671e4ca15ac26f0f9158904f0b70e1dfaf7f970b3e\": container with ID starting with ed7113b219702b75edc64b671e4ca15ac26f0f9158904f0b70e1dfaf7f970b3e not found: ID does not exist"
Jul 06 15:02:43.032857 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:02:43.032830    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-a38db2/sub-test-model-a38db2-kserve-75d846f5f-l5gqn"]
Jul 06 15:02:43.040375 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:02:43.040350    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-a38db2/sub-test-model-a38db2-kserve-75d846f5f-l5gqn"]
Jul 06 15:02:43.500588 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:02:43.500555    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="84858a35-b654-4b1e-b2a4-8b4935b21c5a" path="/var/lib/kubelet/pods/84858a35-b654-4b1e-b2a4-8b4935b21c5a/volumes"
Jul 06 15:02:52.509095 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:02:52.509064    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 15:02:56.661158 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:02:56.661122    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nkcvz"]
Jul 06 15:03:17.846829 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:03:17.846797    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 15:03:17.946764 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:03:17.946731    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 15:03:19.059995 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:03:19.059955    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nkcvz"]
Jul 06 15:03:26.782156 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:03:26.782122    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 15:03:26.883070 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:03:26.883036    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 15:03:33.978896 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:03:33.978857    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nkcvz"]
Jul 06 15:03:41.380612 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:03:41.380573    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-58d9da/rate-test-model-58d9da-kserve-5f455c5f8c-clbcn"]
Jul 06 15:03:41.411196 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:03:41.411166    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 15:03:42.212016 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:03:42.211984    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 15:03:43.415827 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:03:43.415798    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 15:03:43.856082 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:03:43.855989    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 15:03:44.016962 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:03:44.016929    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 15:03:44.118484 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:03:44.118391    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 15:03:44.332468 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:03:44.332430    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-58d9da-29722500-z8d4w"]
Jul 06 15:03:44.335369 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:03:44.335341    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 15:03:44.336291 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:03:44.336271    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-58d9da-29722500-z8d4w"]
Jul 06 15:03:45.499224 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:03:45.499192    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="51bd192a-de3b-47fe-ae0e-ecb848a65ee0" path="/var/lib/kubelet/pods/51bd192a-de3b-47fe-ae0e-ecb848a65ee0/volumes"
Jul 06 15:03:48.553848 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:03:48.553816    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nkcvz"]
Jul 06 15:03:48.858917 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:03:48.858830    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 15:03:56.400458 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:03:56.400392    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-58d9da/rate-test-model-58d9da-kserve-5f455c5f8c-clbcn" podUID="d140f2a8-922b-4bae-bcc2-23d1f1c98f78" containerName="main" containerID="cri-o://3a80fb430b7d9c326be5478c32754f61566c48ad3214ed304efd82d9999f0ffc" gracePeriod=45
Jul 06 15:03:56.651323 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:03:56.651253    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-58d9da/rate-test-model-58d9da-kserve-5f455c5f8c-clbcn"
Jul 06 15:03:56.725947 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:03:56.725907    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d140f2a8-922b-4bae-bcc2-23d1f1c98f78-tls-certs\") pod \"d140f2a8-922b-4bae-bcc2-23d1f1c98f78\" (UID: \"d140f2a8-922b-4bae-bcc2-23d1f1c98f78\") "
Jul 06 15:03:56.726144 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:03:56.725970    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d140f2a8-922b-4bae-bcc2-23d1f1c98f78-model-cache\") pod \"d140f2a8-922b-4bae-bcc2-23d1f1c98f78\" (UID: \"d140f2a8-922b-4bae-bcc2-23d1f1c98f78\") "
Jul 06 15:03:56.726144 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:03:56.725988    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d140f2a8-922b-4bae-bcc2-23d1f1c98f78-home\") pod \"d140f2a8-922b-4bae-bcc2-23d1f1c98f78\" (UID: \"d140f2a8-922b-4bae-bcc2-23d1f1c98f78\") "
Jul 06 15:03:56.726144 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:03:56.726039    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m47nj\" (UniqueName: \"kubernetes.io/projected/d140f2a8-922b-4bae-bcc2-23d1f1c98f78-kube-api-access-m47nj\") pod \"d140f2a8-922b-4bae-bcc2-23d1f1c98f78\" (UID: \"d140f2a8-922b-4bae-bcc2-23d1f1c98f78\") "
Jul 06 15:03:56.726144 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:03:56.726091    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d140f2a8-922b-4bae-bcc2-23d1f1c98f78-dshm\") pod \"d140f2a8-922b-4bae-bcc2-23d1f1c98f78\" (UID: \"d140f2a8-922b-4bae-bcc2-23d1f1c98f78\") "
Jul 06 15:03:56.726144 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:03:56.726113    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d140f2a8-922b-4bae-bcc2-23d1f1c98f78-tmp-dir\") pod \"d140f2a8-922b-4bae-bcc2-23d1f1c98f78\" (UID: \"d140f2a8-922b-4bae-bcc2-23d1f1c98f78\") "
Jul 06 15:03:56.726409 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:03:56.726287    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d140f2a8-922b-4bae-bcc2-23d1f1c98f78-home" (OuterVolumeSpecName: "home") pod "d140f2a8-922b-4bae-bcc2-23d1f1c98f78" (UID: "d140f2a8-922b-4bae-bcc2-23d1f1c98f78"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 15:03:56.726409 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:03:56.726294    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d140f2a8-922b-4bae-bcc2-23d1f1c98f78-model-cache" (OuterVolumeSpecName: "model-cache") pod "d140f2a8-922b-4bae-bcc2-23d1f1c98f78" (UID: "d140f2a8-922b-4bae-bcc2-23d1f1c98f78"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 15:03:56.726409 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:03:56.726381    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d140f2a8-922b-4bae-bcc2-23d1f1c98f78-model-cache\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Jul 06 15:03:56.726409 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:03:56.726401    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d140f2a8-922b-4bae-bcc2-23d1f1c98f78-home\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Jul 06 15:03:56.726598 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:03:56.726435    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d140f2a8-922b-4bae-bcc2-23d1f1c98f78-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d140f2a8-922b-4bae-bcc2-23d1f1c98f78" (UID: "d140f2a8-922b-4bae-bcc2-23d1f1c98f78"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 15:03:56.728296 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:03:56.728271    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d140f2a8-922b-4bae-bcc2-23d1f1c98f78-dshm" (OuterVolumeSpecName: "dshm") pod "d140f2a8-922b-4bae-bcc2-23d1f1c98f78" (UID: "d140f2a8-922b-4bae-bcc2-23d1f1c98f78"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 15:03:56.728400 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:03:56.728288    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d140f2a8-922b-4bae-bcc2-23d1f1c98f78-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d140f2a8-922b-4bae-bcc2-23d1f1c98f78" (UID: "d140f2a8-922b-4bae-bcc2-23d1f1c98f78"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 15:03:56.728400 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:03:56.728294    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d140f2a8-922b-4bae-bcc2-23d1f1c98f78-kube-api-access-m47nj" (OuterVolumeSpecName: "kube-api-access-m47nj") pod "d140f2a8-922b-4bae-bcc2-23d1f1c98f78" (UID: "d140f2a8-922b-4bae-bcc2-23d1f1c98f78"). InnerVolumeSpecName "kube-api-access-m47nj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 15:03:56.827118 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:03:56.827070    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d140f2a8-922b-4bae-bcc2-23d1f1c98f78-tls-certs\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Jul 06 15:03:56.827118 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:03:56.827113    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m47nj\" (UniqueName: \"kubernetes.io/projected/d140f2a8-922b-4bae-bcc2-23d1f1c98f78-kube-api-access-m47nj\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Jul 06 15:03:56.827118 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:03:56.827123    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d140f2a8-922b-4bae-bcc2-23d1f1c98f78-dshm\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Jul 06 15:03:56.827118 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:03:56.827134    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d140f2a8-922b-4bae-bcc2-23d1f1c98f78-tmp-dir\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Jul 06 15:03:57.342428 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:03:57.342392    2582 generic.go:356] "Generic (PLEG): container finished" podID="d140f2a8-922b-4bae-bcc2-23d1f1c98f78" containerID="3a80fb430b7d9c326be5478c32754f61566c48ad3214ed304efd82d9999f0ffc" exitCode=0
Jul 06 15:03:57.342611 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:03:57.342436    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-58d9da/rate-test-model-58d9da-kserve-5f455c5f8c-clbcn"
Jul 06 15:03:57.342611 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:03:57.342472    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-58d9da/rate-test-model-58d9da-kserve-5f455c5f8c-clbcn" event={"ID":"d140f2a8-922b-4bae-bcc2-23d1f1c98f78","Type":"ContainerDied","Data":"3a80fb430b7d9c326be5478c32754f61566c48ad3214ed304efd82d9999f0ffc"}
Jul 06 15:03:57.342611 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:03:57.342515    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-58d9da/rate-test-model-58d9da-kserve-5f455c5f8c-clbcn" event={"ID":"d140f2a8-922b-4bae-bcc2-23d1f1c98f78","Type":"ContainerDied","Data":"3306353966d8d5f64d43edb7b04e3255f7aed579ea00907c68a1539fff465153"}
Jul 06 15:03:57.342611 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:03:57.342536    2582 scope.go:117] "RemoveContainer" containerID="3a80fb430b7d9c326be5478c32754f61566c48ad3214ed304efd82d9999f0ffc"
Jul 06 15:03:57.357959 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:03:57.357936    2582 scope.go:117] "RemoveContainer" containerID="3a80fb430b7d9c326be5478c32754f61566c48ad3214ed304efd82d9999f0ffc"
Jul 06 15:03:57.358246 ip-10-0-137-145 kubenswrapper[2582]: E0706 15:03:57.358227    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a80fb430b7d9c326be5478c32754f61566c48ad3214ed304efd82d9999f0ffc\": container with ID starting with 3a80fb430b7d9c326be5478c32754f61566c48ad3214ed304efd82d9999f0ffc not found: ID does not exist" containerID="3a80fb430b7d9c326be5478c32754f61566c48ad3214ed304efd82d9999f0ffc"
Jul 06 15:03:57.358331 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:03:57.358254    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a80fb430b7d9c326be5478c32754f61566c48ad3214ed304efd82d9999f0ffc"} err="failed to get container status \"3a80fb430b7d9c326be5478c32754f61566c48ad3214ed304efd82d9999f0ffc\": rpc error: code = NotFound desc = could not find container \"3a80fb430b7d9c326be5478c32754f61566c48ad3214ed304efd82d9999f0ffc\": container with ID starting with 3a80fb430b7d9c326be5478c32754f61566c48ad3214ed304efd82d9999f0ffc not found: ID does not exist"
Jul 06 15:03:57.368485 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:03:57.368461    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-58d9da/rate-test-model-58d9da-kserve-5f455c5f8c-clbcn"]
Jul 06 15:03:57.374190 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:03:57.374167    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-58d9da/rate-test-model-58d9da-kserve-5f455c5f8c-clbcn"]
Jul 06 15:03:57.500153 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:03:57.500121    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d140f2a8-922b-4bae-bcc2-23d1f1c98f78" path="/var/lib/kubelet/pods/d140f2a8-922b-4bae-bcc2-23d1f1c98f78/volumes"
Jul 06 15:04:07.771444 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:07.771410    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 15:04:08.078771 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:08.078680    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 15:04:08.277390 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:08.277354    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 15:04:08.489243 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:08.489214    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 15:04:08.823360 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:08.823278    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 15:04:08.924489 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:08.924453    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 15:04:09.022857 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:09.022825    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 15:04:09.165807 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:09.165774    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-a38db2-29722500-f869q"]
Jul 06 15:04:09.168597 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:09.168572    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-a38db2-29722500-f869q"]
Jul 06 15:04:09.176348 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:09.176300    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 15:04:09.499232 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:09.499134    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9f88d38e-62ef-46f8-a921-b2afad3a5c24" path="/var/lib/kubelet/pods/9f88d38e-62ef-46f8-a921-b2afad3a5c24/volumes"
Jul 06 15:04:11.843754 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:11.843718    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nkcvz"]
Jul 06 15:04:15.094857 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:15.094825    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 15:04:15.199893 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:15.199860    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 15:04:15.317445 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:15.317408    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-a38db2-openshift-default-6cbf8f6455-t2qp5"]
Jul 06 15:04:15.317712 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:15.317687    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-a38db2-openshift-default-6cbf8f6455-t2qp5" podUID="a63fb6ba-c943-4742-a487-ceb3267c9455" containerName="istio-proxy" containerID="cri-o://038c6d7f1564f71b0232306569bcdda445025e95ee829f916949799f5ce11fc2" gracePeriod=30
Jul 06 15:04:15.340541 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:15.340514    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 15:04:15.541938 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:15.541900    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 15:04:20.449286 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:20.449251    2582 generic.go:356] "Generic (PLEG): container finished" podID="a63fb6ba-c943-4742-a487-ceb3267c9455" containerID="038c6d7f1564f71b0232306569bcdda445025e95ee829f916949799f5ce11fc2" exitCode=0
Jul 06 15:04:20.449776 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:20.449310    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-a38db2-openshift-default-6cbf8f6455-t2qp5" event={"ID":"a63fb6ba-c943-4742-a487-ceb3267c9455","Type":"ContainerDied","Data":"038c6d7f1564f71b0232306569bcdda445025e95ee829f916949799f5ce11fc2"}
Jul 06 15:04:20.449776 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:20.449355    2582 scope.go:117] "RemoveContainer" containerID="1838ecdb16216075bff1693bcdc48aea1c18eb2de8264565bdb84dd96a8b857d"
Jul 06 15:04:20.571777 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:20.571754    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-a38db2-openshift-default-6cbf8f6455-t2qp5"
Jul 06 15:04:20.635683 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:20.635539    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a63fb6ba-c943-4742-a487-ceb3267c9455-istio-data\") pod \"a63fb6ba-c943-4742-a487-ceb3267c9455\" (UID: \"a63fb6ba-c943-4742-a487-ceb3267c9455\") "
Jul 06 15:04:20.635683 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:20.635590    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a63fb6ba-c943-4742-a487-ceb3267c9455-istio-podinfo\") pod \"a63fb6ba-c943-4742-a487-ceb3267c9455\" (UID: \"a63fb6ba-c943-4742-a487-ceb3267c9455\") "
Jul 06 15:04:20.635683 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:20.635631    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a63fb6ba-c943-4742-a487-ceb3267c9455-istiod-ca-cert\") pod \"a63fb6ba-c943-4742-a487-ceb3267c9455\" (UID: \"a63fb6ba-c943-4742-a487-ceb3267c9455\") "
Jul 06 15:04:20.636004 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:20.635696    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a63fb6ba-c943-4742-a487-ceb3267c9455-istio-envoy\") pod \"a63fb6ba-c943-4742-a487-ceb3267c9455\" (UID: \"a63fb6ba-c943-4742-a487-ceb3267c9455\") "
Jul 06 15:04:20.636004 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:20.635723    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a63fb6ba-c943-4742-a487-ceb3267c9455-workload-certs\") pod \"a63fb6ba-c943-4742-a487-ceb3267c9455\" (UID: \"a63fb6ba-c943-4742-a487-ceb3267c9455\") "
Jul 06 15:04:20.636004 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:20.635755    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a63fb6ba-c943-4742-a487-ceb3267c9455-credential-socket\") pod \"a63fb6ba-c943-4742-a487-ceb3267c9455\" (UID: \"a63fb6ba-c943-4742-a487-ceb3267c9455\") "
Jul 06 15:04:20.636004 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:20.635802    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kt74q\" (UniqueName: \"kubernetes.io/projected/a63fb6ba-c943-4742-a487-ceb3267c9455-kube-api-access-kt74q\") pod \"a63fb6ba-c943-4742-a487-ceb3267c9455\" (UID: \"a63fb6ba-c943-4742-a487-ceb3267c9455\") "
Jul 06 15:04:20.636004 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:20.635831    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a63fb6ba-c943-4742-a487-ceb3267c9455-workload-socket\") pod \"a63fb6ba-c943-4742-a487-ceb3267c9455\" (UID: \"a63fb6ba-c943-4742-a487-ceb3267c9455\") "
Jul 06 15:04:20.636004 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:20.635853    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a63fb6ba-c943-4742-a487-ceb3267c9455-istio-token\") pod \"a63fb6ba-c943-4742-a487-ceb3267c9455\" (UID: \"a63fb6ba-c943-4742-a487-ceb3267c9455\") "
Jul 06 15:04:20.636321 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:20.636119    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a63fb6ba-c943-4742-a487-ceb3267c9455-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a63fb6ba-c943-4742-a487-ceb3267c9455" (UID: "a63fb6ba-c943-4742-a487-ceb3267c9455"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 15:04:20.636321 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:20.636249    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a63fb6ba-c943-4742-a487-ceb3267c9455-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a63fb6ba-c943-4742-a487-ceb3267c9455" (UID: "a63fb6ba-c943-4742-a487-ceb3267c9455"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 15:04:20.636428 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:20.636347    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a63fb6ba-c943-4742-a487-ceb3267c9455-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a63fb6ba-c943-4742-a487-ceb3267c9455" (UID: "a63fb6ba-c943-4742-a487-ceb3267c9455"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 15:04:20.636479 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:20.636459    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a63fb6ba-c943-4742-a487-ceb3267c9455-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a63fb6ba-c943-4742-a487-ceb3267c9455" (UID: "a63fb6ba-c943-4742-a487-ceb3267c9455"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 15:04:20.636888 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:20.636862    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a63fb6ba-c943-4742-a487-ceb3267c9455-istio-data" (OuterVolumeSpecName: "istio-data") pod "a63fb6ba-c943-4742-a487-ceb3267c9455" (UID: "a63fb6ba-c943-4742-a487-ceb3267c9455"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 15:04:20.638130 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:20.638105    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a63fb6ba-c943-4742-a487-ceb3267c9455-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a63fb6ba-c943-4742-a487-ceb3267c9455" (UID: "a63fb6ba-c943-4742-a487-ceb3267c9455"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 15:04:20.638130 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:20.638108    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a63fb6ba-c943-4742-a487-ceb3267c9455-istio-token" (OuterVolumeSpecName: "istio-token") pod "a63fb6ba-c943-4742-a487-ceb3267c9455" (UID: "a63fb6ba-c943-4742-a487-ceb3267c9455"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 15:04:20.638296 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:20.638276    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a63fb6ba-c943-4742-a487-ceb3267c9455-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a63fb6ba-c943-4742-a487-ceb3267c9455" (UID: "a63fb6ba-c943-4742-a487-ceb3267c9455"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 15:04:20.638391 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:20.638374    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a63fb6ba-c943-4742-a487-ceb3267c9455-kube-api-access-kt74q" (OuterVolumeSpecName: "kube-api-access-kt74q") pod "a63fb6ba-c943-4742-a487-ceb3267c9455" (UID: "a63fb6ba-c943-4742-a487-ceb3267c9455"). InnerVolumeSpecName "kube-api-access-kt74q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 15:04:20.697291 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:20.697259    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-pqfl8_c98e166b-42be-4564-b226-bff9639867d2/manager/0.log"
Jul 06 15:04:20.736764 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:20.736727    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a63fb6ba-c943-4742-a487-ceb3267c9455-workload-socket\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Jul 06 15:04:20.736764 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:20.736758    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a63fb6ba-c943-4742-a487-ceb3267c9455-istio-token\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Jul 06 15:04:20.736764 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:20.736767    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a63fb6ba-c943-4742-a487-ceb3267c9455-istio-data\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Jul 06 15:04:20.736764 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:20.736775    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a63fb6ba-c943-4742-a487-ceb3267c9455-istio-podinfo\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Jul 06 15:04:20.737054 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:20.736784    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a63fb6ba-c943-4742-a487-ceb3267c9455-istiod-ca-cert\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Jul 06 15:04:20.737054 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:20.736794    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a63fb6ba-c943-4742-a487-ceb3267c9455-istio-envoy\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Jul 06 15:04:20.737054 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:20.736801    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a63fb6ba-c943-4742-a487-ceb3267c9455-workload-certs\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Jul 06 15:04:20.737054 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:20.736808    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a63fb6ba-c943-4742-a487-ceb3267c9455-credential-socket\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Jul 06 15:04:20.737054 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:20.736819    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kt74q\" (UniqueName: \"kubernetes.io/projected/a63fb6ba-c943-4742-a487-ceb3267c9455-kube-api-access-kt74q\") on node \"ip-10-0-137-145.ec2.internal\" DevicePath \"\""
Jul 06 15:04:21.058966 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:21.058937    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29722485-j42nc_6eb8e6a1-164b-4e46-bc3d-74d79973ec6b/cleanup/0.log"
Jul 06 15:04:21.174357 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:21.174329    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29722500-t492v_4c3b91b7-3dbf-4524-8cbc-69d25036171a/cleanup/0.log"
Jul 06 15:04:21.454648 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:21.454618    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-a38db2-openshift-default-6cbf8f6455-t2qp5" event={"ID":"a63fb6ba-c943-4742-a487-ceb3267c9455","Type":"ContainerDied","Data":"a1fa572c5b30e8355b1dd6582e583c9873800565f69339a13878c3c0ee0be58e"}
Jul 06 15:04:21.455123 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:21.454649    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-a38db2-openshift-default-6cbf8f6455-t2qp5"
Jul 06 15:04:21.455123 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:21.454697    2582 scope.go:117] "RemoveContainer" containerID="038c6d7f1564f71b0232306569bcdda445025e95ee829f916949799f5ce11fc2"
Jul 06 15:04:21.485004 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:21.484974    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-a38db2-openshift-default-6cbf8f6455-t2qp5"]
Jul 06 15:04:21.492364 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:21.492335    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-a38db2-openshift-default-6cbf8f6455-t2qp5"]
Jul 06 15:04:21.499550 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:21.499524    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a63fb6ba-c943-4742-a487-ceb3267c9455" path="/var/lib/kubelet/pods/a63fb6ba-c943-4742-a487-ceb3267c9455/volumes"
Jul 06 15:04:21.691446 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:21.691411    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-557ddcc9b5-n6rcd_4d365742-5bd2-4dd7-84da-209a1bee7142/manager/0.log"
Jul 06 15:04:21.714449 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:21.714380    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-557ddcc9b5-n6rcd_4d365742-5bd2-4dd7-84da-209a1bee7142/copy-manifests/0.log"
Jul 06 15:04:22.069002 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:22.068922    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-w88fb_157b4d97-1f8b-41a9-a1e8-e463e08aed0a/postgres/0.log"
Jul 06 15:04:24.002931 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:24.002901    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-nkcvz_aaae66ed-43be-4fc9-8b35-77d7330476a6/limitador/0.log"
Jul 06 15:04:24.581434 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:24.581407    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-szk4j_68c3e410-778f-417e-a018-bb0f57344a26/discovery/0.log"
Jul 06 15:04:24.697021 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:24.696990    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7b5f845fbc-4cq42_4683bcda-8e38-4d5a-a8d5-283e7f0985f1/kube-auth-proxy/0.log"
Jul 06 15:04:24.918319 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:24.918281    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-lkxb4_eefcbb73-dab6-4344-abbd-c972ef1e5a9a/istio-proxy/1.log"
Jul 06 15:04:25.160859 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:25.160816    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-k7dkq_fadfc4ff-b375-4673-a9eb-431bcb0b8fb3/payload-processing/0.log"
Jul 06 15:04:25.273476 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:25.273401    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6c998bcc47-7mmnb_7831bfca-c689-4707-918f-9b1b6fe52258/router/0.log"
Jul 06 15:04:25.846574 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:25.846544    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-ptfrh_39f2a134-38e0-4d12-a2e0-9e40af629763/main/0.log"
Jul 06 15:04:26.074389 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:26.074360    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-hvwvr_9177faec-dfee-428d-99b0-4a4c531eaaa7/main/0.log"
Jul 06 15:04:30.256450 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:30.256417    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 15:04:30.736332 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:30.736301    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 15:04:30.767828 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:30.767790    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-gbbmr/must-gather-n6bwx"]
Jul 06 15:04:30.768154 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:30.768141    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d140f2a8-922b-4bae-bcc2-23d1f1c98f78" containerName="main"
Jul 06 15:04:30.768202 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:30.768156    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="d140f2a8-922b-4bae-bcc2-23d1f1c98f78" containerName="main"
Jul 06 15:04:30.768202 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:30.768176    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a63fb6ba-c943-4742-a487-ceb3267c9455" containerName="istio-proxy"
Jul 06 15:04:30.768202 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:30.768182    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="a63fb6ba-c943-4742-a487-ceb3267c9455" containerName="istio-proxy"
Jul 06 15:04:30.768202 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:30.768191    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84858a35-b654-4b1e-b2a4-8b4935b21c5a" containerName="main"
Jul 06 15:04:30.768202 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:30.768196    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="84858a35-b654-4b1e-b2a4-8b4935b21c5a" containerName="main"
Jul 06 15:04:30.768356 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:30.768255    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="a63fb6ba-c943-4742-a487-ceb3267c9455" containerName="istio-proxy"
Jul 06 15:04:30.768356 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:30.768264    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="d140f2a8-922b-4bae-bcc2-23d1f1c98f78" containerName="main"
Jul 06 15:04:30.768356 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:30.768269    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="84858a35-b654-4b1e-b2a4-8b4935b21c5a" containerName="main"
Jul 06 15:04:30.768356 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:30.768331    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a63fb6ba-c943-4742-a487-ceb3267c9455" containerName="istio-proxy"
Jul 06 15:04:30.768356 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:30.768338    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="a63fb6ba-c943-4742-a487-ceb3267c9455" containerName="istio-proxy"
Jul 06 15:04:30.768505 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:30.768379    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="a63fb6ba-c943-4742-a487-ceb3267c9455" containerName="istio-proxy"
Jul 06 15:04:30.771280 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:30.771264    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gbbmr/must-gather-n6bwx"
Jul 06 15:04:30.777144 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:30.777121    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gbbmr\"/\"kube-root-ca.crt\""
Jul 06 15:04:30.777288 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:30.777124    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-gbbmr\"/\"default-dockercfg-5wsdq\""
Jul 06 15:04:30.777288 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:30.777163    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gbbmr\"/\"openshift-service-ca.crt\""
Jul 06 15:04:30.787470 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:30.787443    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gbbmr/must-gather-n6bwx"]
Jul 06 15:04:30.828135 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:30.828097    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82pq8\" (UniqueName: \"kubernetes.io/projected/d363e942-b2c0-48e2-b0ae-0ef25a3869f7-kube-api-access-82pq8\") pod \"must-gather-n6bwx\" (UID: \"d363e942-b2c0-48e2-b0ae-0ef25a3869f7\") " pod="openshift-must-gather-gbbmr/must-gather-n6bwx"
Jul 06 15:04:30.828320 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:30.828140    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d363e942-b2c0-48e2-b0ae-0ef25a3869f7-must-gather-output\") pod \"must-gather-n6bwx\" (UID: \"d363e942-b2c0-48e2-b0ae-0ef25a3869f7\") " pod="openshift-must-gather-gbbmr/must-gather-n6bwx"
Jul 06 15:04:30.928981 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:30.928928    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82pq8\" (UniqueName: \"kubernetes.io/projected/d363e942-b2c0-48e2-b0ae-0ef25a3869f7-kube-api-access-82pq8\") pod \"must-gather-n6bwx\" (UID: \"d363e942-b2c0-48e2-b0ae-0ef25a3869f7\") " pod="openshift-must-gather-gbbmr/must-gather-n6bwx"
Jul 06 15:04:30.928981 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:30.928982    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d363e942-b2c0-48e2-b0ae-0ef25a3869f7-must-gather-output\") pod \"must-gather-n6bwx\" (UID: \"d363e942-b2c0-48e2-b0ae-0ef25a3869f7\") " pod="openshift-must-gather-gbbmr/must-gather-n6bwx"
Jul 06 15:04:30.929334 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:30.929315    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d363e942-b2c0-48e2-b0ae-0ef25a3869f7-must-gather-output\") pod \"must-gather-n6bwx\" (UID: \"d363e942-b2c0-48e2-b0ae-0ef25a3869f7\") " pod="openshift-must-gather-gbbmr/must-gather-n6bwx"
Jul 06 15:04:30.945585 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:30.945558    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-82pq8\" (UniqueName: \"kubernetes.io/projected/d363e942-b2c0-48e2-b0ae-0ef25a3869f7-kube-api-access-82pq8\") pod \"must-gather-n6bwx\" (UID: \"d363e942-b2c0-48e2-b0ae-0ef25a3869f7\") " pod="openshift-must-gather-gbbmr/must-gather-n6bwx"
Jul 06 15:04:30.983272 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:30.983240    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log" limit=1024
Jul 06 15:04:31.080488 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:31.080404    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gbbmr/must-gather-n6bwx"
Jul 06 15:04:31.249762 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:31.248345    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gbbmr/must-gather-n6bwx"]
Jul 06 15:04:31.255344 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:31.255323    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 15:04:31.506595 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:31.506557    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gbbmr/must-gather-n6bwx" event={"ID":"d363e942-b2c0-48e2-b0ae-0ef25a3869f7","Type":"ContainerStarted","Data":"8d9536a1d68f038f0a33bd840a20a1c2baabbd398cac7e5f914a0d91acd8c05f"}
Jul 06 15:04:33.520419 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:33.520343    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gbbmr/must-gather-n6bwx" event={"ID":"d363e942-b2c0-48e2-b0ae-0ef25a3869f7","Type":"ContainerStarted","Data":"ff8d2b9b22637679b59f4e154a0442c236f55ccd8915efa25e104c1e4438281a"}
Jul 06 15:04:33.520419 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:33.520385    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gbbmr/must-gather-n6bwx" event={"ID":"d363e942-b2c0-48e2-b0ae-0ef25a3869f7","Type":"ContainerStarted","Data":"1fb35794af254dd6a9a04e903d9f75988935b3a775c5e0d531b90ac5fd77ede9"}
Jul 06 15:04:33.537786 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:33.537722    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-gbbmr/must-gather-n6bwx" podStartSLOduration=1.595953891 podStartE2EDuration="3.537699266s" totalImagesPullingTime="1.941745375s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:04:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:04:33.536358197 +0000 UTC m=+2500.456638630" watchObservedRunningTime="2026-07-06 15:04:33.537699266 +0000 UTC m=+2500.457979696"
Jul 06 15:04:34.860513 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:34.860479    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-mbkvc_201f4c6e-b9d8-4a99-9f4e-b8f59e69ad1d/global-pull-secret-syncer/0.log"
Jul 06 15:04:34.923713 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:34.923680    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-8lp29_ee1bac90-b7e7-41b0-a7e0-b804e6fafdef/konnectivity-agent/0.log"
Jul 06 15:04:35.011760 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:35.011707    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-145.ec2.internal_2683f4c10fa530ba79d25a7535e0e727/haproxy/0.log"
Jul 06 15:04:40.214214 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:40.214179    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-nkcvz_aaae66ed-43be-4fc9-8b35-77d7330476a6/limitador/0.log"
Jul 06 15:04:42.298529 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:42.298496    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-5kn2v_c9139faa-b66e-43d4-9a07-bd16a63ff0f8/cluster-monitoring-operator/0.log"
Jul 06 15:04:42.687277 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:42.687225    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rnr84_3ab8d9b2-b7ce-49c8-9ab9-f8bf02453276/node-exporter/0.log"
Jul 06 15:04:42.717797 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:42.717752    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rnr84_3ab8d9b2-b7ce-49c8-9ab9-f8bf02453276/kube-rbac-proxy/0.log"
Jul 06 15:04:42.751118 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:42.751086    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rnr84_3ab8d9b2-b7ce-49c8-9ab9-f8bf02453276/init-textfile/0.log"
Jul 06 15:04:44.637741 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:44.637703    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-gbbmr/perf-node-gather-daemonset-n8p5h"]
Jul 06 15:04:44.645786 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:44.645757    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gbbmr/perf-node-gather-daemonset-n8p5h"
Jul 06 15:04:44.651312 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:44.651284    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gbbmr/perf-node-gather-daemonset-n8p5h"]
Jul 06 15:04:44.770023 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:44.769972    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f4716a94-ec38-4fe6-ac29-94d079d08ae9-podres\") pod \"perf-node-gather-daemonset-n8p5h\" (UID: \"f4716a94-ec38-4fe6-ac29-94d079d08ae9\") " pod="openshift-must-gather-gbbmr/perf-node-gather-daemonset-n8p5h"
Jul 06 15:04:44.770222 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:44.770126    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hlmv\" (UniqueName: \"kubernetes.io/projected/f4716a94-ec38-4fe6-ac29-94d079d08ae9-kube-api-access-4hlmv\") pod \"perf-node-gather-daemonset-n8p5h\" (UID: \"f4716a94-ec38-4fe6-ac29-94d079d08ae9\") " pod="openshift-must-gather-gbbmr/perf-node-gather-daemonset-n8p5h"
Jul 06 15:04:44.770222 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:44.770201    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f4716a94-ec38-4fe6-ac29-94d079d08ae9-proc\") pod \"perf-node-gather-daemonset-n8p5h\" (UID: \"f4716a94-ec38-4fe6-ac29-94d079d08ae9\") " pod="openshift-must-gather-gbbmr/perf-node-gather-daemonset-n8p5h"
Jul 06 15:04:44.770339 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:44.770263    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f4716a94-ec38-4fe6-ac29-94d079d08ae9-lib-modules\") pod \"perf-node-gather-daemonset-n8p5h\" (UID: \"f4716a94-ec38-4fe6-ac29-94d079d08ae9\") " pod="openshift-must-gather-gbbmr/perf-node-gather-daemonset-n8p5h"
Jul 06 15:04:44.770339 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:44.770294    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f4716a94-ec38-4fe6-ac29-94d079d08ae9-sys\") pod \"perf-node-gather-daemonset-n8p5h\" (UID: \"f4716a94-ec38-4fe6-ac29-94d079d08ae9\") " pod="openshift-must-gather-gbbmr/perf-node-gather-daemonset-n8p5h"
Jul 06 15:04:44.871749 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:44.871713    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f4716a94-ec38-4fe6-ac29-94d079d08ae9-proc\") pod \"perf-node-gather-daemonset-n8p5h\" (UID: \"f4716a94-ec38-4fe6-ac29-94d079d08ae9\") " pod="openshift-must-gather-gbbmr/perf-node-gather-daemonset-n8p5h"
Jul 06 15:04:44.871946 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:44.871767    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f4716a94-ec38-4fe6-ac29-94d079d08ae9-lib-modules\") pod \"perf-node-gather-daemonset-n8p5h\" (UID: \"f4716a94-ec38-4fe6-ac29-94d079d08ae9\") " pod="openshift-must-gather-gbbmr/perf-node-gather-daemonset-n8p5h"
Jul 06 15:04:44.871946 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:44.871785    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f4716a94-ec38-4fe6-ac29-94d079d08ae9-sys\") pod \"perf-node-gather-daemonset-n8p5h\" (UID: \"f4716a94-ec38-4fe6-ac29-94d079d08ae9\") " pod="openshift-must-gather-gbbmr/perf-node-gather-daemonset-n8p5h"
Jul 06 15:04:44.871946 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:44.871826    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f4716a94-ec38-4fe6-ac29-94d079d08ae9-podres\") pod \"perf-node-gather-daemonset-n8p5h\" (UID: \"f4716a94-ec38-4fe6-ac29-94d079d08ae9\") " pod="openshift-must-gather-gbbmr/perf-node-gather-daemonset-n8p5h"
Jul 06 15:04:44.871946 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:44.871874    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hlmv\" (UniqueName: \"kubernetes.io/projected/f4716a94-ec38-4fe6-ac29-94d079d08ae9-kube-api-access-4hlmv\") pod \"perf-node-gather-daemonset-n8p5h\" (UID: \"f4716a94-ec38-4fe6-ac29-94d079d08ae9\") " pod="openshift-must-gather-gbbmr/perf-node-gather-daemonset-n8p5h"
Jul 06 15:04:44.871946 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:44.871874    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f4716a94-ec38-4fe6-ac29-94d079d08ae9-proc\") pod \"perf-node-gather-daemonset-n8p5h\" (UID: \"f4716a94-ec38-4fe6-ac29-94d079d08ae9\") " pod="openshift-must-gather-gbbmr/perf-node-gather-daemonset-n8p5h"
Jul 06 15:04:44.872194 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:44.871948    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f4716a94-ec38-4fe6-ac29-94d079d08ae9-sys\") pod \"perf-node-gather-daemonset-n8p5h\" (UID: \"f4716a94-ec38-4fe6-ac29-94d079d08ae9\") " pod="openshift-must-gather-gbbmr/perf-node-gather-daemonset-n8p5h"
Jul 06 15:04:44.872194 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:44.871952    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f4716a94-ec38-4fe6-ac29-94d079d08ae9-lib-modules\") pod \"perf-node-gather-daemonset-n8p5h\" (UID: \"f4716a94-ec38-4fe6-ac29-94d079d08ae9\") " pod="openshift-must-gather-gbbmr/perf-node-gather-daemonset-n8p5h"
Jul 06 15:04:44.872194 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:44.872035    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f4716a94-ec38-4fe6-ac29-94d079d08ae9-podres\") pod \"perf-node-gather-daemonset-n8p5h\" (UID: \"f4716a94-ec38-4fe6-ac29-94d079d08ae9\") " pod="openshift-must-gather-gbbmr/perf-node-gather-daemonset-n8p5h"
Jul 06 15:04:44.893806 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:44.893720    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hlmv\" (UniqueName: \"kubernetes.io/projected/f4716a94-ec38-4fe6-ac29-94d079d08ae9-kube-api-access-4hlmv\") pod \"perf-node-gather-daemonset-n8p5h\" (UID: \"f4716a94-ec38-4fe6-ac29-94d079d08ae9\") " pod="openshift-must-gather-gbbmr/perf-node-gather-daemonset-n8p5h"
Jul 06 15:04:44.966608 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:44.966573    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gbbmr/perf-node-gather-daemonset-n8p5h"
Jul 06 15:04:45.154277 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:45.154132    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gbbmr/perf-node-gather-daemonset-n8p5h"]
Jul 06 15:04:45.164286 ip-10-0-137-145 kubenswrapper[2582]: W0706 15:04:45.164254    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podf4716a94_ec38_4fe6_ac29_94d079d08ae9.slice/crio-4c7c741411c3abe52cd8c89256e22ceda386b733995323620102e0b2bbc64091 WatchSource:0}: Error finding container 4c7c741411c3abe52cd8c89256e22ceda386b733995323620102e0b2bbc64091: Status 404 returned error can't find the container with id 4c7c741411c3abe52cd8c89256e22ceda386b733995323620102e0b2bbc64091
Jul 06 15:04:45.616740 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:45.616693    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gbbmr/perf-node-gather-daemonset-n8p5h" event={"ID":"f4716a94-ec38-4fe6-ac29-94d079d08ae9","Type":"ContainerStarted","Data":"fc0d490bcbb78f720c6659d9510f45a452429e96f635717b8c31975d11f4d477"}
Jul 06 15:04:45.616991 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:45.616772    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gbbmr/perf-node-gather-daemonset-n8p5h" event={"ID":"f4716a94-ec38-4fe6-ac29-94d079d08ae9","Type":"ContainerStarted","Data":"4c7c741411c3abe52cd8c89256e22ceda386b733995323620102e0b2bbc64091"}
Jul 06 15:04:45.616991 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:45.616806    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-gbbmr/perf-node-gather-daemonset-n8p5h"
Jul 06 15:04:45.635636 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:45.635574    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-gbbmr/perf-node-gather-daemonset-n8p5h" podStartSLOduration=1.635550318 podStartE2EDuration="1.635550318s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 15:04:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:04:45.633986002 +0000 UTC m=+2512.554266423" watchObservedRunningTime="2026-07-06 15:04:45.635550318 +0000 UTC m=+2512.555830750"
Jul 06 15:04:46.512066 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:46.512034    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5d456fdbcd-fjz8x_dbf0b322-237d-4eb6-bbc2-f99f6c34fd20/volume-data-source-validator/0.log"
Jul 06 15:04:47.549088 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:47.549060    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-2t99k_0656cec5-7e50-4dfc-af2d-9a33adde49e3/dns/0.log"
Jul 06 15:04:47.570270 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:47.570244    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-2t99k_0656cec5-7e50-4dfc-af2d-9a33adde49e3/kube-rbac-proxy/0.log"
Jul 06 15:04:47.723260 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:47.723233    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-95qwv_5554b54b-fec2-4059-9f42-845d87fc9961/dns-node-resolver/0.log"
Jul 06 15:04:48.321338 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:48.321310    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6556f6b698-2qxrh_3de1c042-065e-4441-be64-4b75163f94b0/registry/0.log"
Jul 06 15:04:48.386454 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:48.386429    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-k72tt_19ce583c-bcbe-4393-ae34-afd29df988b7/node-ca/0.log"
Jul 06 15:04:49.452222 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:49.452193    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-szk4j_68c3e410-778f-417e-a018-bb0f57344a26/discovery/0.log"
Jul 06 15:04:49.471460 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:49.471434    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7b5f845fbc-4cq42_4683bcda-8e38-4d5a-a8d5-283e7f0985f1/kube-auth-proxy/0.log"
Jul 06 15:04:49.526946 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:49.526912    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-lkxb4_eefcbb73-dab6-4344-abbd-c972ef1e5a9a/istio-proxy/0.log"
Jul 06 15:04:49.564352 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:49.564320    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-lkxb4_eefcbb73-dab6-4344-abbd-c972ef1e5a9a/istio-proxy/1.log"
Jul 06 15:04:49.650897 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:49.650868    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-k7dkq_fadfc4ff-b375-4673-a9eb-431bcb0b8fb3/payload-processing/0.log"
Jul 06 15:04:49.673696 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:49.673668    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6c998bcc47-7mmnb_7831bfca-c689-4707-918f-9b1b6fe52258/router/0.log"
Jul 06 15:04:50.393127 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:50.393100    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-w7js7_1de327c8-c76b-4f68-be9f-04fcdb31ed23/serve-healthcheck-canary/0.log"
Jul 06 15:04:51.010143 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:51.010101    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pfg9l_105734b3-e5f3-4bf2-8f66-df587a4caec2/kube-rbac-proxy/0.log"
Jul 06 15:04:51.044684 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:51.044634    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pfg9l_105734b3-e5f3-4bf2-8f66-df587a4caec2/exporter/0.log"
Jul 06 15:04:51.074935 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:51.074891    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pfg9l_105734b3-e5f3-4bf2-8f66-df587a4caec2/extractor/0.log"
Jul 06 15:04:51.636622 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:51.636586    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-gbbmr/perf-node-gather-daemonset-n8p5h"
Jul 06 15:04:53.738675 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:53.738632    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-pqfl8_c98e166b-42be-4564-b226-bff9639867d2/manager/0.log"
Jul 06 15:04:53.941430 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:53.941400    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29722485-j42nc_6eb8e6a1-164b-4e46-bc3d-74d79973ec6b/cleanup/0.log"
Jul 06 15:04:53.967902 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:53.967873    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29722500-t492v_4c3b91b7-3dbf-4524-8cbc-69d25036171a/cleanup/0.log"
Jul 06 15:04:54.257800 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:54.257702    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-557ddcc9b5-n6rcd_4d365742-5bd2-4dd7-84da-209a1bee7142/manager/0.log"
Jul 06 15:04:54.280711 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:54.280682    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-557ddcc9b5-n6rcd_4d365742-5bd2-4dd7-84da-209a1bee7142/copy-manifests/0.log"
Jul 06 15:04:54.441283 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:54.441253    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-w88fb_157b4d97-1f8b-41a9-a1e8-e463e08aed0a/postgres/0.log"
Jul 06 15:04:55.305081 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:55.305044    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-szk4j_68c3e410-778f-417e-a018-bb0f57344a26/discovery/0.log"
Jul 06 15:04:55.314267 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:55.314243    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7b5f845fbc-4cq42_4683bcda-8e38-4d5a-a8d5-283e7f0985f1/kube-auth-proxy/0.log"
Jul 06 15:04:55.348938 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:55.348905    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-lkxb4_eefcbb73-dab6-4344-abbd-c972ef1e5a9a/istio-proxy/0.log"
Jul 06 15:04:55.387857 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:55.387822    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-lkxb4_eefcbb73-dab6-4344-abbd-c972ef1e5a9a/istio-proxy/1.log"
Jul 06 15:04:55.455504 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:55.455456    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-k7dkq_fadfc4ff-b375-4673-a9eb-431bcb0b8fb3/payload-processing/0.log"
Jul 06 15:04:55.471376 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:55.471349    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6c998bcc47-7mmnb_7831bfca-c689-4707-918f-9b1b6fe52258/router/0.log"
Jul 06 15:04:56.841554 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:56.841510    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-szk4j_68c3e410-778f-417e-a018-bb0f57344a26/discovery/0.log"
Jul 06 15:04:56.856738 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:56.856709    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7b5f845fbc-4cq42_4683bcda-8e38-4d5a-a8d5-283e7f0985f1/kube-auth-proxy/0.log"
Jul 06 15:04:56.907817 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:56.907773    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-lkxb4_eefcbb73-dab6-4344-abbd-c972ef1e5a9a/istio-proxy/0.log"
Jul 06 15:04:56.943045 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:56.943013    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-lkxb4_eefcbb73-dab6-4344-abbd-c972ef1e5a9a/istio-proxy/1.log"
Jul 06 15:04:57.009532 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:57.009502    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-k7dkq_fadfc4ff-b375-4673-a9eb-431bcb0b8fb3/payload-processing/0.log"
Jul 06 15:04:57.028095 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:04:57.028065    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6c998bcc47-7mmnb_7831bfca-c689-4707-918f-9b1b6fe52258/router/0.log"
Jul 06 15:05:00.954832 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:05:00.954800    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-xqwr8_d620f679-c4f6-4131-aebf-36b50b4433a9/kube-storage-version-migrator-operator/1.log"
Jul 06 15:05:00.956284 ip-10-0-137-145 kubenswrapper[2582]: I0706 15:05:00.956259    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-xqwr8_d620f679-c4f6-4131-aebf-36b50b4433a9/kube-storage-version-migrator-operator/0.log"