Jul 27 17:01:26.700122 ip-10-0-137-134 systemd[1]: Starting Kubernetes Kubelet...
Jul 27 17:01:27.057219 ip-10-0-137-134 kubenswrapper[2580]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 27 17:01:27.057219 ip-10-0-137-134 kubenswrapper[2580]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 27 17:01:27.057219 ip-10-0-137-134 kubenswrapper[2580]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 27 17:01:27.057219 ip-10-0-137-134 kubenswrapper[2580]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 27 17:01:27.057219 ip-10-0-137-134 kubenswrapper[2580]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 27 17:01:27.057995 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.057287    2580 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 27 17:01:27.061621 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.061597    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 17:01:27.061621 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.061616    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 17:01:27.061621 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.061621    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 17:01:27.061621 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.061625    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 17:01:27.061621 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.061629    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 17:01:27.061931 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.061633    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 17:01:27.061931 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.061637    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 17:01:27.061931 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.061643    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 17:01:27.061931 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.061649    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 17:01:27.061931 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.061654    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 17:01:27.061931 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.061658    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 17:01:27.061931 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.061662    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 17:01:27.061931 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.061666    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 17:01:27.061931 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.061670    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 17:01:27.061931 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.061674    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 17:01:27.061931 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.061678    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 17:01:27.061931 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.061682    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 17:01:27.061931 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.061685    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 17:01:27.061931 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.061689    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 17:01:27.061931 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.061693    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 17:01:27.061931 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.061696    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 17:01:27.061931 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.061701    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 17:01:27.061931 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.061705    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 17:01:27.061931 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.061710    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 17:01:27.062705 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.061716    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 17:01:27.062705 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.061720    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 17:01:27.062705 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.061724    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 17:01:27.062705 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.061728    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 17:01:27.062705 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.061734    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 17:01:27.062705 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.061738    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 17:01:27.062705 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.061742    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 17:01:27.062705 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.061746    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 17:01:27.062705 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.061751    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 17:01:27.062705 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.061755    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 17:01:27.062705 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.061760    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 17:01:27.062705 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.061764    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 17:01:27.062705 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.061768    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 17:01:27.062705 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.061772    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 17:01:27.062705 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.061778    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 17:01:27.062705 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.061782    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 17:01:27.062705 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.061786    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 17:01:27.062705 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.061790    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 17:01:27.062705 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.061794    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 17:01:27.062705 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.061799    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 17:01:27.063565 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.061803    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 17:01:27.063565 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.061807    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 17:01:27.063565 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.061812    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 17:01:27.063565 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.061816    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 17:01:27.063565 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.061820    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 17:01:27.063565 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.061824    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 17:01:27.063565 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.061846    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 17:01:27.063565 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.061850    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 17:01:27.063565 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.061854    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 17:01:27.063565 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.061858    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 17:01:27.063565 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.061863    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 17:01:27.063565 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.061867    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 17:01:27.063565 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.061871    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 17:01:27.063565 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.061875    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 17:01:27.063565 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.061880    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 17:01:27.063565 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.061884    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 17:01:27.063565 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.061889    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 17:01:27.063565 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.061893    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 17:01:27.063565 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.061897    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 17:01:27.063565 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.061901    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 17:01:27.064435 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.061905    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 17:01:27.064435 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.061909    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 17:01:27.064435 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.061913    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 17:01:27.064435 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.061918    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 17:01:27.064435 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.061922    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 17:01:27.064435 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.061926    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 17:01:27.064435 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.061933    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 17:01:27.064435 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.061937    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 17:01:27.064435 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.061941    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 17:01:27.064435 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.061945    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 17:01:27.064435 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.061950    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 17:01:27.064435 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.061954    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 17:01:27.064435 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.061958    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 17:01:27.064435 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.061962    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 17:01:27.064435 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.061967    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 17:01:27.064435 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.061971    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 17:01:27.064435 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.061976    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 17:01:27.064435 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.061980    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 17:01:27.064435 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.061984    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 17:01:27.064435 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.061990    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 17:01:27.065313 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.061994    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 17:01:27.065313 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.061998    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 17:01:27.065313 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.062002    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 17:01:27.065313 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.062007    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 17:01:27.065313 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.062011    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 17:01:27.065313 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.062015    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 17:01:27.065313 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.062020    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 17:01:27.065313 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.062026    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 17:01:27.065313 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.062031    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 17:01:27.065313 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.062036    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 17:01:27.065313 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.062041    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 17:01:27.065313 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.062046    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 17:01:27.065313 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.062050    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 17:01:27.065313 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.062054    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 17:01:27.065313 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.062058    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 17:01:27.065313 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.063217    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 17:01:27.065313 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.063227    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 17:01:27.065313 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.063236    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 17:01:27.065313 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.063243    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 17:01:27.066205 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.063248    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 17:01:27.066205 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.063253    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 17:01:27.066205 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.063258    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 17:01:27.066205 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.063263    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 17:01:27.066205 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.063267    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 17:01:27.066205 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.063272    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 17:01:27.066205 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.063277    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 17:01:27.066205 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.063282    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 17:01:27.066205 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.063287    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 17:01:27.066205 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.063291    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 17:01:27.066205 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.063295    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 17:01:27.066205 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.063299    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 17:01:27.066205 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.063303    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 17:01:27.066205 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.063309    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 17:01:27.066205 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.063314    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 17:01:27.066205 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.063320    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 17:01:27.066205 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.063324    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 17:01:27.066205 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.063330    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 17:01:27.066205 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.063336    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 17:01:27.066717 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.063340    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 17:01:27.066717 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.063345    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 17:01:27.066717 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.063349    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 17:01:27.066717 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.063353    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 17:01:27.066717 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.063357    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 17:01:27.066717 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.063361    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 17:01:27.066717 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.063365    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 17:01:27.066717 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.063369    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 17:01:27.066717 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.063375    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 17:01:27.066717 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.063379    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 17:01:27.066717 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.063383    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 17:01:27.066717 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.063388    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 17:01:27.066717 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.063393    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 17:01:27.066717 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.063398    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 17:01:27.066717 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.063402    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 17:01:27.066717 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.063407    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 17:01:27.066717 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.063412    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 17:01:27.066717 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.063416    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 17:01:27.066717 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.063421    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 17:01:27.066717 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.063425    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 17:01:27.067314 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.063429    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 17:01:27.067314 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.063433    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 17:01:27.067314 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.063437    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 17:01:27.067314 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.063442    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 17:01:27.067314 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.063446    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 17:01:27.067314 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.063450    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 17:01:27.067314 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.063457    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 17:01:27.067314 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.063464    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 17:01:27.067314 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.063468    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 17:01:27.067314 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.063473    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 17:01:27.067314 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.063477    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 17:01:27.067314 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.063482    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 17:01:27.067314 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.063485    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 17:01:27.067314 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.063490    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 17:01:27.067314 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.063494    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 17:01:27.067314 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.063499    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 17:01:27.067314 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.063503    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 17:01:27.067314 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.063508    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 17:01:27.067314 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.063513    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 17:01:27.067996 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.063517    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 17:01:27.067996 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.063521    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 17:01:27.067996 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.063525    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 17:01:27.067996 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.063529    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 17:01:27.067996 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.063534    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 17:01:27.067996 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.063540    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 17:01:27.067996 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.063544    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 17:01:27.067996 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.063549    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 17:01:27.067996 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.063553    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 17:01:27.067996 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.063557    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 17:01:27.067996 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.063561    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 17:01:27.067996 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.063564    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 17:01:27.067996 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.063568    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 17:01:27.067996 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.063572    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 17:01:27.067996 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.063576    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 17:01:27.067996 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.063580    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 17:01:27.067996 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.063584    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 17:01:27.067996 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.063588    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 17:01:27.067996 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.063592    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 17:01:27.067996 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.063596    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 17:01:27.068558 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.063600    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 17:01:27.068558 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.063605    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 17:01:27.068558 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.063610    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 17:01:27.068558 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.063614    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 17:01:27.068558 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.063618    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 17:01:27.068558 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.063622    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 17:01:27.068558 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.063627    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 17:01:27.068558 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.063630    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 17:01:27.068558 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.063634    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 17:01:27.068558 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.063638    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 17:01:27.068558 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.063642    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 17:01:27.068558 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.063647    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 17:01:27.068558 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.063651    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 17:01:27.068558 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.063655    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 17:01:27.068558 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.063659    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 17:01:27.068558 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.063663    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 17:01:27.068558 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.063668    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 17:01:27.068558 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.064267    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 17:01:27.068558 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.064275    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 17:01:27.068558 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.064280    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 17:01:27.069237 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.064284    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 17:01:27.069237 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.064289    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 17:01:27.069237 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.064293    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 17:01:27.069237 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.064297    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 17:01:27.069237 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.064302    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 17:01:27.069237 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.064309    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 17:01:27.069237 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.064315    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 17:01:27.069237 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.064320    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 17:01:27.069237 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.064326    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 17:01:27.069237 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.064330    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 17:01:27.069237 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.064335    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 17:01:27.069237 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.064339    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 17:01:27.069237 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.064344    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 17:01:27.069237 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.064349    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 17:01:27.069237 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.064353    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 17:01:27.069237 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.064357    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 17:01:27.069237 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.064362    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 17:01:27.069237 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.064366    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 17:01:27.069237 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.064370    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 17:01:27.069713 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.064374    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 17:01:27.069713 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.064378    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 17:01:27.069713 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.064383    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 17:01:27.069713 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.064387    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 17:01:27.069713 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.064391    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 17:01:27.069713 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.064395    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 17:01:27.069713 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.064399    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 17:01:27.069713 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.064403    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 17:01:27.069713 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.064408    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 17:01:27.069713 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.064412    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 17:01:27.069713 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.064418    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 17:01:27.069713 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.064422    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 17:01:27.069713 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.064426    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 17:01:27.069713 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.064430    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 17:01:27.069713 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.064434    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 17:01:27.069713 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.064438    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 17:01:27.069713 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.064441    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 17:01:27.069713 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.064445    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 17:01:27.069713 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.064449    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 17:01:27.069713 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.064453    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 17:01:27.070235 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.064457    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 17:01:27.070235 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.064461    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 17:01:27.070235 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.064465    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 17:01:27.070235 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.064469    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 17:01:27.070235 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.064474    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 17:01:27.070235 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.064478    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 17:01:27.070235 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.064482    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 17:01:27.070235 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.064488    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 17:01:27.070235 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.064492    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 17:01:27.070235 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.064496    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 17:01:27.070235 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.064501    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 17:01:27.070235 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.064506    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 17:01:27.070235 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.064510    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 17:01:27.070235 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.064514    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 17:01:27.070235 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.064518    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 17:01:27.070235 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.064523    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 17:01:27.070235 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.064527    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 17:01:27.070235 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.064531    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 17:01:27.070235 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.064535    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 17:01:27.070235 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.064540    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 17:01:27.070716 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.064544    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 17:01:27.070716 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.064548    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 17:01:27.070716 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.064553    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 17:01:27.070716 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.064559    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 17:01:27.070716 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.064564    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 17:01:27.070716 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.064568    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 17:01:27.070716 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.064573    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 17:01:27.070716 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.064577    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 17:01:27.070716 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.064581    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 17:01:27.070716 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.064585    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 17:01:27.070716 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.064589    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 17:01:27.070716 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.064593    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 17:01:27.070716 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.064597    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 17:01:27.070716 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.064604    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 17:01:27.070716 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.064608    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 17:01:27.070716 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.064612    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 17:01:27.070716 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.064616    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 17:01:27.070716 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.064620    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 17:01:27.070716 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.064624    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 17:01:27.071202 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.064629    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 17:01:27.071202 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.064633    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 17:01:27.071202 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.064638    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 17:01:27.071202 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.064642    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 17:01:27.071202 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.064646    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 17:01:27.071202 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.064650    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 17:01:27.071202 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.064654    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 17:01:27.071202 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.064659    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 17:01:27.071202 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.064663    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 17:01:27.071202 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.064667    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 17:01:27.071202 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.064671    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 17:01:27.071202 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.064676    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 17:01:27.071202 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.064680    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 17:01:27.071202 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.064686    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 17:01:27.071202 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.064690    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 17:01:27.071202 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.064694    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 17:01:27.071202 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.064699    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 17:01:27.071202 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.064705    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 17:01:27.071202 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.064797    2580 flags.go:64] FLAG: --address="0.0.0.0"
Jul 27 17:01:27.071202 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.064807    2580 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 27 17:01:27.071202 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.064816    2580 flags.go:64] FLAG: --anonymous-auth="true"
Jul 27 17:01:27.071815 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.064823    2580 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 27 17:01:27.071815 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.064844    2580 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 27 17:01:27.071815 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.064849    2580 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 27 17:01:27.071815 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.064855    2580 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 27 17:01:27.071815 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.064862    2580 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 27 17:01:27.071815 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.064867    2580 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 27 17:01:27.071815 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.064872    2580 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 27 17:01:27.071815 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.064877    2580 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 27 17:01:27.071815 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.064882    2580 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 27 17:01:27.071815 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.064887    2580 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 27 17:01:27.071815 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.064892    2580 flags.go:64] FLAG: --cgroup-root=""
Jul 27 17:01:27.071815 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.064897    2580 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 27 17:01:27.071815 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.064901    2580 flags.go:64] FLAG: --client-ca-file=""
Jul 27 17:01:27.071815 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.064908    2580 flags.go:64] FLAG: --cloud-provider="external"
Jul 27 17:01:27.071815 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.064913    2580 flags.go:64] FLAG: --cluster-dns="[]"
Jul 27 17:01:27.071815 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.064919    2580 flags.go:64] FLAG: --cluster-domain=""
Jul 27 17:01:27.071815 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.064924    2580 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 27 17:01:27.071815 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.064929    2580 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 27 17:01:27.071815 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.064934    2580 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 27 17:01:27.071815 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.064939    2580 flags.go:64] FLAG: --container-log-max-files="5"
Jul 27 17:01:27.071815 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.064945    2580 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 27 17:01:27.071815 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.064950    2580 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 27 17:01:27.071815 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.064955    2580 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 27 17:01:27.072418 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.064960    2580 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 27 17:01:27.072418 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.064967    2580 flags.go:64] FLAG: --contention-profiling="false"
Jul 27 17:01:27.072418 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.064971    2580 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 27 17:01:27.072418 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.064976    2580 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 27 17:01:27.072418 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.064982    2580 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 27 17:01:27.072418 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.064987    2580 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 27 17:01:27.072418 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.064993    2580 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 27 17:01:27.072418 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.064998    2580 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 27 17:01:27.072418 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.065003    2580 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 27 17:01:27.072418 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.065007    2580 flags.go:64] FLAG: --enable-load-reader="false"
Jul 27 17:01:27.072418 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.065012    2580 flags.go:64] FLAG: --enable-server="true"
Jul 27 17:01:27.072418 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.065016    2580 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 27 17:01:27.072418 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.065023    2580 flags.go:64] FLAG: --event-burst="100"
Jul 27 17:01:27.072418 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.065027    2580 flags.go:64] FLAG: --event-qps="50"
Jul 27 17:01:27.072418 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.065033    2580 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 27 17:01:27.072418 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.065038    2580 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 27 17:01:27.072418 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.065043    2580 flags.go:64] FLAG: --eviction-hard=""
Jul 27 17:01:27.072418 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.065054    2580 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 27 17:01:27.072418 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.065059    2580 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 27 17:01:27.072418 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.065063    2580 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 27 17:01:27.072418 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.065068    2580 flags.go:64] FLAG: --eviction-soft=""
Jul 27 17:01:27.072418 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.065073    2580 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 27 17:01:27.072418 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.065078    2580 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 27 17:01:27.072418 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.065083    2580 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 27 17:01:27.072418 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.065088    2580 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 27 17:01:27.073042 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.065092    2580 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 27 17:01:27.073042 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.065097    2580 flags.go:64] FLAG: --fail-swap-on="true"
Jul 27 17:01:27.073042 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.065101    2580 flags.go:64] FLAG: --feature-gates=""
Jul 27 17:01:27.073042 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.065107    2580 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 27 17:01:27.073042 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.065112    2580 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 27 17:01:27.073042 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.065117    2580 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 27 17:01:27.073042 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.065122    2580 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 27 17:01:27.073042 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.065127    2580 flags.go:64] FLAG: --healthz-port="10248"
Jul 27 17:01:27.073042 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.065134    2580 flags.go:64] FLAG: --help="false"
Jul 27 17:01:27.073042 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.065138    2580 flags.go:64] FLAG: --hostname-override="ip-10-0-137-134.ec2.internal"
Jul 27 17:01:27.073042 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.065143    2580 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 27 17:01:27.073042 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.065148    2580 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 27 17:01:27.073042 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.065153    2580 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 27 17:01:27.073042 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.065158    2580 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 27 17:01:27.073042 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.065164    2580 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 27 17:01:27.073042 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.065168    2580 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 27 17:01:27.073042 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.065173    2580 flags.go:64] FLAG: --image-service-endpoint=""
Jul 27 17:01:27.073042 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.065178    2580 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 27 17:01:27.073042 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.065182    2580 flags.go:64] FLAG: --kube-api-burst="100"
Jul 27 17:01:27.073042 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.065187    2580 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 27 17:01:27.073042 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.065192    2580 flags.go:64] FLAG: --kube-api-qps="50"
Jul 27 17:01:27.073042 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.065197    2580 flags.go:64] FLAG: --kube-reserved=""
Jul 27 17:01:27.073042 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.065201    2580 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 27 17:01:27.073042 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.065206    2580 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 27 17:01:27.073627 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.065210    2580 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 27 17:01:27.073627 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.065215    2580 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 27 17:01:27.073627 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.065220    2580 flags.go:64] FLAG: --lock-file=""
Jul 27 17:01:27.073627 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.065224    2580 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 27 17:01:27.073627 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.065229    2580 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 27 17:01:27.073627 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.065233    2580 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 27 17:01:27.073627 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.065242    2580 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 27 17:01:27.073627 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.065247    2580 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 27 17:01:27.073627 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.065252    2580 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 27 17:01:27.073627 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.065256    2580 flags.go:64] FLAG: --logging-format="text"
Jul 27 17:01:27.073627 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.065261    2580 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 27 17:01:27.073627 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.065266    2580 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 27 17:01:27.073627 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.065271    2580 flags.go:64] FLAG: --manifest-url=""
Jul 27 17:01:27.073627 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.065275    2580 flags.go:64] FLAG: --manifest-url-header=""
Jul 27 17:01:27.073627 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.065284    2580 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 27 17:01:27.073627 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.065289    2580 flags.go:64] FLAG: --max-open-files="1000000"
Jul 27 17:01:27.073627 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.065296    2580 flags.go:64] FLAG: --max-pods="110"
Jul 27 17:01:27.073627 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.065301    2580 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 27 17:01:27.073627 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.065306    2580 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 27 17:01:27.073627 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.065310    2580 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 27 17:01:27.073627 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.065315    2580 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 27 17:01:27.073627 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.065319    2580 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 27 17:01:27.073627 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.065324    2580 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 27 17:01:27.073627 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.065329    2580 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 27 17:01:27.073627 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.065338    2580 flags.go:64] FLAG: --node-status-max-images="50"
Jul 27 17:01:27.074247 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.065343    2580 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 27 17:01:27.074247 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.065355    2580 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 27 17:01:27.074247 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.065361    2580 flags.go:64] FLAG: --pod-cidr=""
Jul 27 17:01:27.074247 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.065365    2580 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 27 17:01:27.074247 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.065373    2580 flags.go:64] FLAG: --pod-manifest-path=""
Jul 27 17:01:27.074247 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.065378    2580 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 27 17:01:27.074247 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.065383    2580 flags.go:64] FLAG: --pods-per-core="0"
Jul 27 17:01:27.074247 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.065388    2580 flags.go:64] FLAG: --port="10250"
Jul 27 17:01:27.074247 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.065392    2580 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 27 17:01:27.074247 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.065397    2580 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-032b2e7477785f248"
Jul 27 17:01:27.074247 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.065402    2580 flags.go:64] FLAG: --qos-reserved=""
Jul 27 17:01:27.074247 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.065407    2580 flags.go:64] FLAG: --read-only-port="10255"
Jul 27 17:01:27.074247 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.065412    2580 flags.go:64] FLAG: --register-node="true"
Jul 27 17:01:27.074247 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.065417    2580 flags.go:64] FLAG: --register-with-taints=""
Jul 27 17:01:27.074247 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.065422    2580 flags.go:64] FLAG: --registry-burst="10"
Jul 27 17:01:27.074247 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.065428    2580 flags.go:64] FLAG: --registry-qps="5"
Jul 27 17:01:27.074247 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.065432    2580 flags.go:64] FLAG: --reserved-cpus=""
Jul 27 17:01:27.074247 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.065437    2580 flags.go:64] FLAG: --reserved-memory=""
Jul 27 17:01:27.074247 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.065443    2580 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 27 17:01:27.074247 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.065449    2580 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 27 17:01:27.074247 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.065453    2580 flags.go:64] FLAG: --rotate-certificates="false"
Jul 27 17:01:27.074247 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.065458    2580 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 27 17:01:27.074247 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.065465    2580 flags.go:64] FLAG: --runonce="false"
Jul 27 17:01:27.074247 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.065471    2580 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 27 17:01:27.074247 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.065476    2580 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 27 17:01:27.074864 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.065481    2580 flags.go:64] FLAG: --seccomp-default="false"
Jul 27 17:01:27.074864 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.065485    2580 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 27 17:01:27.074864 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.065490    2580 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 27 17:01:27.074864 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.065495    2580 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 27 17:01:27.074864 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.065500    2580 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 27 17:01:27.074864 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.065505    2580 flags.go:64] FLAG: --storage-driver-password="root"
Jul 27 17:01:27.074864 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.065509    2580 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 27 17:01:27.074864 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.065514    2580 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 27 17:01:27.074864 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.065518    2580 flags.go:64] FLAG: --storage-driver-user="root"
Jul 27 17:01:27.074864 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.065523    2580 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 27 17:01:27.074864 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.065528    2580 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 27 17:01:27.074864 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.065533    2580 flags.go:64] FLAG: --system-cgroups=""
Jul 27 17:01:27.074864 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.065538    2580 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 27 17:01:27.074864 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.065546    2580 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 27 17:01:27.074864 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.065550    2580 flags.go:64] FLAG: --tls-cert-file=""
Jul 27 17:01:27.074864 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.065555    2580 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 27 17:01:27.074864 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.065562    2580 flags.go:64] FLAG: --tls-min-version=""
Jul 27 17:01:27.074864 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.065567    2580 flags.go:64] FLAG: --tls-private-key-file=""
Jul 27 17:01:27.074864 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.065571    2580 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 27 17:01:27.074864 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.065576    2580 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 27 17:01:27.074864 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.065581    2580 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 27 17:01:27.074864 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.065586    2580 flags.go:64] FLAG: --v="2"
Jul 27 17:01:27.074864 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.065591    2580 flags.go:64] FLAG: --version="false"
Jul 27 17:01:27.074864 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.065598    2580 flags.go:64] FLAG: --vmodule=""
Jul 27 17:01:27.074864 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.065604    2580 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 27 17:01:27.075500 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.065610    2580 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 27 17:01:27.075500 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.065804    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 17:01:27.075500 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.065811    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 17:01:27.075500 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.065817    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 17:01:27.075500 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.065824    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 17:01:27.075500 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.065845    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 17:01:27.075500 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.065850    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 17:01:27.075500 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.065855    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 17:01:27.075500 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.065859    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 17:01:27.075500 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.065863    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 17:01:27.075500 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.065867    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 17:01:27.075500 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.065872    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 17:01:27.075500 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.065876    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 17:01:27.075500 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.065880    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 17:01:27.075500 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.065884    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 17:01:27.075500 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.065890    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 17:01:27.075500 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.065894    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 17:01:27.075500 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.065898    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 17:01:27.075500 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.065902    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 17:01:27.075500 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.065907    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 17:01:27.076008 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.065912    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 17:01:27.076008 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.065917    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 17:01:27.076008 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.065922    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 17:01:27.076008 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.065927    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 17:01:27.076008 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.065931    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 17:01:27.076008 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.065937    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 17:01:27.076008 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.065941    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 17:01:27.076008 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.065946    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 17:01:27.076008 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.065950    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 17:01:27.076008 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.065954    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 17:01:27.076008 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.065958    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 17:01:27.076008 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.065963    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 17:01:27.076008 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.065968    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 17:01:27.076008 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.065972    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 17:01:27.076008 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.065976    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 17:01:27.076008 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.065980    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 17:01:27.076008 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.065986    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 17:01:27.076008 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.065992    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 17:01:27.076008 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.065996    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 17:01:27.076008 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.066000    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 17:01:27.076494 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.066005    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 17:01:27.076494 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.066009    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 17:01:27.076494 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.066014    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 17:01:27.076494 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.066018    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 17:01:27.076494 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.066022    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 17:01:27.076494 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.066026    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 17:01:27.076494 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.066030    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 17:01:27.076494 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.066034    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 17:01:27.076494 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.066038    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 17:01:27.076494 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.066043    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 17:01:27.076494 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.066047    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 17:01:27.076494 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.066051    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 17:01:27.076494 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.066056    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 17:01:27.076494 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.066060    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 17:01:27.076494 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.066064    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 17:01:27.076494 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.066068    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 17:01:27.076494 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.066072    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 17:01:27.076494 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.066077    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 17:01:27.076494 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.066081    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 17:01:27.076494 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.066085    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 17:01:27.077003 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.066089    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 17:01:27.077003 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.066093    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 17:01:27.077003 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.066097    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 17:01:27.077003 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.066102    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 17:01:27.077003 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.066108    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 17:01:27.077003 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.066113    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 17:01:27.077003 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.066117    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 17:01:27.077003 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.066121    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 17:01:27.077003 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.066127    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 17:01:27.077003 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.066134    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 17:01:27.077003 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.066138    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 17:01:27.077003 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.066143    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 17:01:27.077003 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.066149    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 17:01:27.077003 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.066155    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 17:01:27.077003 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.066160    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 17:01:27.077003 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.066165    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 17:01:27.077003 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.066171    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 17:01:27.077003 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.066175    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 17:01:27.077003 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.066180    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 17:01:27.077003 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.066184    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 17:01:27.077485 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.066188    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 17:01:27.077485 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.066195    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 17:01:27.077485 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.066200    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 17:01:27.077485 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.066206    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 17:01:27.077485 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.066210    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 17:01:27.077485 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.066214    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 17:01:27.077485 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.066218    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 17:01:27.077485 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.066222    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 17:01:27.077485 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.066226    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 17:01:27.077485 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.066230    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 17:01:27.077485 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.066234    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 17:01:27.077485 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.066239    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 17:01:27.077485 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.066243    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 17:01:27.077485 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.066247    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 17:01:27.077485 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.066251    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 17:01:27.077485 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.066256    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 17:01:27.077485 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.066260    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 17:01:27.077485 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.066265    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 17:01:27.077485 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.066272    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 17:01:27.077968 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.066277    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 17:01:27.077968 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.066807    2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 27 17:01:27.077968 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.073465    2580 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 27 17:01:27.077968 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.073482    2580 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 27 17:01:27.077968 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.073496    2580 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 27 17:01:27.077968 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.073501    2580 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 27 17:01:27.077968 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.073558    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 17:01:27.077968 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.073563    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 17:01:27.077968 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.073566    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 17:01:27.077968 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.073569    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 17:01:27.077968 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.073572    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 17:01:27.077968 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.073574    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 17:01:27.077968 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.073577    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 17:01:27.077968 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.073580    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 17:01:27.077968 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.073582    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 17:01:27.078340 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.073585    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 17:01:27.078340 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.073588    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 17:01:27.078340 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.073590    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 17:01:27.078340 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.073593    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 17:01:27.078340 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.073596    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 17:01:27.078340 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.073598    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 17:01:27.078340 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.073601    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 17:01:27.078340 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.073605    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 17:01:27.078340 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.073609    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 17:01:27.078340 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.073611    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 17:01:27.078340 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.073614    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 17:01:27.078340 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.073616    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 17:01:27.078340 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.073620    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 17:01:27.078340 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.073624    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 17:01:27.078340 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.073627    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 17:01:27.078340 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.073630    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 17:01:27.078340 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.073632    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 17:01:27.078340 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.073635    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 17:01:27.078340 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.073638    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 17:01:27.078798 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.073640    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 17:01:27.078798 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.073649    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 17:01:27.078798 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.073652    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 17:01:27.078798 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.073655    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 17:01:27.078798 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.073657    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 17:01:27.078798 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.073660    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 17:01:27.078798 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.073662    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 17:01:27.078798 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.073665    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 17:01:27.078798 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.073667    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 17:01:27.078798 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.073670    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 17:01:27.078798 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.073673    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 17:01:27.078798 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.073675    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 17:01:27.078798 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.073678    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 17:01:27.078798 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.073680    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 17:01:27.078798 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.073683    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 17:01:27.078798 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.073686    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 17:01:27.078798 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.073688    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 17:01:27.078798 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.073690    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 17:01:27.078798 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.073693    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 17:01:27.078798 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.073695    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 17:01:27.079299 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.073698    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 17:01:27.079299 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.073700    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 17:01:27.079299 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.073703    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 17:01:27.079299 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.073705    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 17:01:27.079299 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.073708    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 17:01:27.079299 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.073710    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 17:01:27.079299 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.073714    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 17:01:27.079299 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.073718    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 17:01:27.079299 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.073720    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 17:01:27.079299 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.073723    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 17:01:27.079299 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.073726    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 17:01:27.079299 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.073728    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 17:01:27.079299 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.073732    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 17:01:27.079299 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.073735    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 17:01:27.079299 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.073743    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 17:01:27.079299 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.073746    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 17:01:27.079299 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.073748    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 17:01:27.079299 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.073751    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 17:01:27.079299 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.073753    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 17:01:27.079299 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.073756    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 17:01:27.079782 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.073758    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 17:01:27.079782 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.073761    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 17:01:27.079782 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.073763    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 17:01:27.079782 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.073766    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 17:01:27.079782 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.073768    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 17:01:27.079782 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.073771    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 17:01:27.079782 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.073773    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 17:01:27.079782 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.073776    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 17:01:27.079782 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.073778    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 17:01:27.079782 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.073781    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 17:01:27.079782 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.073783    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 17:01:27.079782 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.073786    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 17:01:27.079782 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.073788    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 17:01:27.079782 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.073791    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 17:01:27.079782 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.073793    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 17:01:27.079782 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.073796    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 17:01:27.079782 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.073798    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 17:01:27.079782 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.073801    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 17:01:27.079782 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.073803    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 17:01:27.079782 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.073806    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 17:01:27.080272 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.073808    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 17:01:27.080272 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.073810    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 17:01:27.080272 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.073813    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 17:01:27.080272 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.073815    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 17:01:27.080272 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.073818    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 17:01:27.080272 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.073821    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 17:01:27.080272 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.073824    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 17:01:27.080272 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.073849    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 17:01:27.080272 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.073852    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 17:01:27.080272 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.073855    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 17:01:27.080272 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.073857    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 17:01:27.080272 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.073863    2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 27 17:01:27.080272 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.073997    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 17:01:27.080272 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.074001    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 17:01:27.080637 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.074004    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 17:01:27.080637 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.074007    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 17:01:27.080637 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.074010    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 17:01:27.080637 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.074013    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 17:01:27.080637 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.074016    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 17:01:27.080637 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.074018    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 17:01:27.080637 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.074021    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 17:01:27.080637 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.074023    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 17:01:27.080637 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.074026    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 17:01:27.080637 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.074028    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 17:01:27.080637 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.074031    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 17:01:27.080637 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.074034    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 17:01:27.080637 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.074036    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 17:01:27.080637 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.074039    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 17:01:27.080637 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.074041    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 17:01:27.080637 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.074044    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 17:01:27.080637 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.074046    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 17:01:27.080637 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.074049    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 17:01:27.080637 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.074051    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 17:01:27.081182 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.074054    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 17:01:27.081182 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.074056    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 17:01:27.081182 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.074059    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 17:01:27.081182 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.074061    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 17:01:27.081182 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.074064    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 17:01:27.081182 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.074067    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 17:01:27.081182 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.074069    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 17:01:27.081182 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.074077    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 17:01:27.081182 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.074080    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 17:01:27.081182 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.074082    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 17:01:27.081182 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.074085    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 17:01:27.081182 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.074088    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 17:01:27.081182 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.074090    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 17:01:27.081182 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.074093    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 17:01:27.081182 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.074095    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 17:01:27.081182 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.074097    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 17:01:27.081182 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.074100    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 17:01:27.081182 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.074102    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 17:01:27.081182 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.074104    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 17:01:27.081182 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.074107    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 17:01:27.081662 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.074109    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 17:01:27.081662 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.074112    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 17:01:27.081662 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.074114    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 17:01:27.081662 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.074117    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 17:01:27.081662 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.074119    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 17:01:27.081662 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.074121    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 17:01:27.081662 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.074124    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 17:01:27.081662 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.074126    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 17:01:27.081662 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.074129    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 17:01:27.081662 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.074131    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 17:01:27.081662 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.074134    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 17:01:27.081662 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.074136    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 17:01:27.081662 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.074139    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 17:01:27.081662 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.074141    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 17:01:27.081662 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.074143    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 17:01:27.081662 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.074146    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 17:01:27.081662 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.074149    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 17:01:27.081662 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.074151    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 17:01:27.081662 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.074154    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 17:01:27.081662 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.074156    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 17:01:27.082142 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.074167    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 17:01:27.082142 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.074170    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 17:01:27.082142 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.074173    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 17:01:27.082142 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.074176    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 17:01:27.082142 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.074179    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 17:01:27.082142 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.074182    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 17:01:27.082142 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.074185    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 17:01:27.082142 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.074187    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 17:01:27.082142 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.074190    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 17:01:27.082142 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.074193    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 17:01:27.082142 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.074197    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 17:01:27.082142 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.074200    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 17:01:27.082142 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.074203    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 17:01:27.082142 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.074206    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 17:01:27.082142 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.074208    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 17:01:27.082142 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.074211    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 17:01:27.082142 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.074213    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 17:01:27.082142 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.074216    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 17:01:27.082142 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.074219    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 17:01:27.082644 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.074221    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 17:01:27.082644 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.074224    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 17:01:27.082644 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.074228    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 17:01:27.082644 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.074231    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 17:01:27.082644 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.074233    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 17:01:27.082644 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.074235    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 17:01:27.082644 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.074238    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 17:01:27.082644 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.074240    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 17:01:27.082644 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.074243    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 17:01:27.082644 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.074245    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 17:01:27.082644 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.074248    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 17:01:27.082644 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.074251    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 17:01:27.082644 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.074253    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 17:01:27.082644 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.074256    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 17:01:27.082644 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.074264    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 17:01:27.082644 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.074267    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 17:01:27.082644 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.074269    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 17:01:27.082644 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.074272    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 17:01:27.082644 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:27.074274    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 17:01:27.083376 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.074279    2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 27 17:01:27.083376 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.074388    2580 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 27 17:01:27.083376 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.076370    2580 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 27 17:01:27.083376 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.077571    2580 server.go:1019] "Starting client certificate rotation"
Jul 27 17:01:27.083376 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.077679    2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 27 17:01:27.083376 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.077716    2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 27 17:01:27.083376 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.079792    2580 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 27 17:01:27.084458 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.084440    2580 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 27 17:01:27.094461 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.094444    2580 log.go:25] "Validated CRI v1 runtime API"
Jul 27 17:01:27.098603 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.098587    2580 log.go:25] "Validated CRI v1 image API"
Jul 27 17:01:27.099862 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.099849    2580 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 27 17:01:27.105904 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.105879    2580 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 9a9e24b7-6590-4728-9474-70d7e78551ed:/dev/nvme0n1p3 dba0a9cb-5c55-454e-82f0-09f4be84ce5c:/dev/nvme0n1p4]
Jul 27 17:01:27.105966 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.105903    2580 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 27 17:01:27.111119 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.111018    2580 manager.go:216] Machine: {Timestamp:2026-07-27 17:01:27.109661905 +0000 UTC m=+0.306406699 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101721 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2c5b2a2e0d836d74b4e17f844cd2ad SystemUUID:ec2c5b2a-2e0d-836d-74b4-e17f844cd2ad BootID:d9cca831-0088-4bcf-a60a-67a09a8820bc Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:18:9c:12:ff:6b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:18:9c:12:ff:6b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:be:41:f8:23:15:59 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 27 17:01:27.111119 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.111116    2580 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 27 17:01:27.111224 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.111213    2580 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 27 17:01:27.111582 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.111567    2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 27 17:01:27.113768 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.113742    2580 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 27 17:01:27.113906 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.113771    2580 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-134.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 27 17:01:27.114877 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.114866    2580 topology_manager.go:138] "Creating topology manager with none policy"
Jul 27 17:01:27.114877 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.114878    2580 container_manager_linux.go:309] "Creating device plugin manager"
Jul 27 17:01:27.114948 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.114886    2580 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 27 17:01:27.115380 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.115370    2580 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 27 17:01:27.116042 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.116033    2580 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 27 17:01:27.117791 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.117779    2580 state_mem.go:36] "Initialized new in-memory state store"
Jul 27 17:01:27.117929 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.117918    2580 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 27 17:01:27.117969 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.117949    2580 kubelet.go:486] "Attempting to sync node with API server"
Jul 27 17:01:27.117969 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.117963    2580 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 27 17:01:27.118021 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.117981    2580 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 27 17:01:27.118021 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.117994    2580 kubelet.go:398] "Adding apiserver pod source"
Jul 27 17:01:27.118021 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.118005    2580 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 27 17:01:27.118414 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.118403    2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 27 17:01:27.118460 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.118421    2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 27 17:01:27.121575 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.121558    2580 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 27 17:01:27.123326 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.123313    2580 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 27 17:01:27.123378 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.123342    2580 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 27 17:01:27.124780 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.124767    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 27 17:01:27.124865 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.124784    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 27 17:01:27.124865 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.124790    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 27 17:01:27.124865 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.124794    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 27 17:01:27.124865 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.124803    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 27 17:01:27.124865 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.124808    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 27 17:01:27.124865 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.124817    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 27 17:01:27.124865 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.124825    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 27 17:01:27.124865 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.124849    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 27 17:01:27.124865 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.124856    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 27 17:01:27.124865 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.124864    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 27 17:01:27.124865 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.124870    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 27 17:01:27.125492 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.125482    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 27 17:01:27.125492 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.125492    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 27 17:01:27.127166 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:01:27.127143    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-134.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 27 17:01:27.127223 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:01:27.127161    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 27 17:01:27.128662 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.128646    2580 server.go:1268] "Started kubelet"
Jul 27 17:01:27.129465 ip-10-0-137-134 systemd[1]: Started Kubernetes Kubelet.
Jul 27 17:01:27.130388 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.129766    2580 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 27 17:01:27.130388 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.129843    2580 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 27 17:01:27.130388 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.129923    2580 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 27 17:01:27.131820 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.131772    2580 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 27 17:01:27.132135 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.132120    2580 server.go:310] "Adding debug handlers to kubelet server"
Jul 27 17:01:27.134858 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.134821    2580 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-134.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 27 17:01:27.135381 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:01:27.135350    2580 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 27 17:01:27.137969 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:01:27.136868    2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-134.ec2.internal.18c63430f262d446  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-134.ec2.internal,UID:ip-10-0-137-134.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-137-134.ec2.internal,},FirstTimestamp:2026-07-27 17:01:27.128618054 +0000 UTC m=+0.325362857,LastTimestamp:2026-07-27 17:01:27.128618054 +0000 UTC m=+0.325362857,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-134.ec2.internal,}"
Jul 27 17:01:27.138199 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.138177    2580 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 27 17:01:27.138199 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.138198    2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 27 17:01:27.138343 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:01:27.138264    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-134.ec2.internal\" not found"
Jul 27 17:01:27.138971 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.138772    2580 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 27 17:01:27.138971 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.138858    2580 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 27 17:01:27.138971 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.138872    2580 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 27 17:01:27.138971 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.138939    2580 reconstruct.go:97] "Volume reconstruction finished"
Jul 27 17:01:27.138971 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.138950    2580 reconciler.go:29] "Reconciler: start to sync state"
Jul 27 17:01:27.139247 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.139228    2580 factory.go:55] Registering systemd factory
Jul 27 17:01:27.139293 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.139252    2580 factory.go:223] Registration of the systemd container factory successfully
Jul 27 17:01:27.139709 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.139693    2580 factory.go:153] Registering CRI-O factory
Jul 27 17:01:27.139709 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.139710    2580 factory.go:223] Registration of the crio container factory successfully
Jul 27 17:01:27.139849 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.139776    2580 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 27 17:01:27.139849 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.139799    2580 factory.go:103] Registering Raw factory
Jul 27 17:01:27.140245 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.140228    2580 manager.go:1196] Started watching for new ooms in manager
Jul 27 17:01:27.140695 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.140677    2580 manager.go:349] Starting recovery of all containers
Jul 27 17:01:27.142394 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.142255    2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-cc457"
Jul 27 17:01:27.147334 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:01:27.147300    2580 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-137-134.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 27 17:01:27.147506 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:01:27.147482    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 27 17:01:27.149194 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.149171    2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-cc457"
Jul 27 17:01:27.151880 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.151863    2580 manager.go:354] Recovery completed
Jul 27 17:01:27.153492 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:01:27.153473    2580 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Jul 27 17:01:27.156737 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.156725    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 17:01:27.158529 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.158509    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-134.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 17:01:27.158601 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.158538    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-134.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 17:01:27.158601 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.158553    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-134.ec2.internal" event="NodeHasSufficientPID"
Jul 27 17:01:27.159042 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.159030    2580 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 27 17:01:27.159042 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.159039    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 17:01:27.159124 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.159041    2580 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 27 17:01:27.159124 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.159089    2580 state_mem.go:36] "Initialized new in-memory state store"
Jul 27 17:01:27.159672 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.159659    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-134.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 17:01:27.159736 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.159682    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-134.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 17:01:27.160004 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.159980    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-134.ec2.internal" event="NodeHasSufficientPID"
Jul 27 17:01:27.160627 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.160610    2580 policy_none.go:49] "None policy: Start"
Jul 27 17:01:27.160768 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.160754    2580 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 27 17:01:27.160899 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.160886    2580 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 27 17:01:27.161148 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:01:27.161055    2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-134.ec2.internal.18c63430f42b318b  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-134.ec2.internal,UID:ip-10-0-137-134.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-137-134.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-137-134.ec2.internal,},FirstTimestamp:2026-07-27 17:01:27.158526347 +0000 UTC m=+0.355271143,LastTimestamp:2026-07-27 17:01:27.158526347 +0000 UTC m=+0.355271143,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-134.ec2.internal,}"
Jul 27 17:01:27.162236 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.162220    2580 policy_none.go:47] "Start"
Jul 27 17:01:27.194522 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.194393    2580 manager.go:337] "Starting Device Plugin manager"
Jul 27 17:01:27.194595 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:01:27.194542    2580 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 27 17:01:27.194595 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.194556    2580 server.go:87] "Starting device plugin registration server"
Jul 27 17:01:27.194747 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.194734    2580 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 27 17:01:27.194809 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.194749    2580 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 27 17:01:27.194876 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.194855    2580 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 27 17:01:27.194950 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.194937    2580 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 27 17:01:27.194990 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.194951    2580 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 27 17:01:27.195395 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:01:27.195376    2580 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 27 17:01:27.195481 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:01:27.195426    2580 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-134.ec2.internal\" not found"
Jul 27 17:01:27.263513 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.263488    2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 27 17:01:27.264616 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.264528    2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 27 17:01:27.264616 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.264562    2580 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 27 17:01:27.264616 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.264579    2580 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 27 17:01:27.264616 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:01:27.264612    2580 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 27 17:01:27.266768 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.266747    2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 17:01:27.295767 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.295748    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 17:01:27.296488 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.296465    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-134.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 17:01:27.296566 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.296497    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-134.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 17:01:27.296566 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.296507    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-134.ec2.internal" event="NodeHasSufficientPID"
Jul 27 17:01:27.296566 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.296527    2580 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-134.ec2.internal"
Jul 27 17:01:27.304595 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.304581    2580 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-134.ec2.internal"
Jul 27 17:01:27.304643 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:01:27.304601    2580 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-134.ec2.internal\": node \"ip-10-0-137-134.ec2.internal\" not found"
Jul 27 17:01:27.320797 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:01:27.320752    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-134.ec2.internal\" not found"
Jul 27 17:01:27.365439 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.365419    2580 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-134.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-134.ec2.internal"]
Jul 27 17:01:27.365524 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.365485    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 17:01:27.366805 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.366780    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-134.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 17:01:27.366892 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.366813    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-134.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 17:01:27.366892 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.366823    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-134.ec2.internal" event="NodeHasSufficientPID"
Jul 27 17:01:27.368069 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.368057    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 17:01:27.368181 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.368166    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-134.ec2.internal"
Jul 27 17:01:27.368231 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.368199    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 17:01:27.368750 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.368726    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-134.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 17:01:27.368750 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.368747    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-134.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 17:01:27.368901 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.368757    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-134.ec2.internal" event="NodeHasSufficientPID"
Jul 27 17:01:27.368901 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.368774    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-134.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 17:01:27.368901 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.368797    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-134.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 17:01:27.368901 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.368811    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-134.ec2.internal" event="NodeHasSufficientPID"
Jul 27 17:01:27.370044 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.370028    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-134.ec2.internal"
Jul 27 17:01:27.370089 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.370064    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 17:01:27.370749 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.370726    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-134.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 17:01:27.370817 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.370760    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-134.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 17:01:27.370817 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.370773    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-134.ec2.internal" event="NodeHasSufficientPID"
Jul 27 17:01:27.398371 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:01:27.398352    2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-134.ec2.internal\" not found" node="ip-10-0-137-134.ec2.internal"
Jul 27 17:01:27.402658 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:01:27.402640    2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-134.ec2.internal\" not found" node="ip-10-0-137-134.ec2.internal"
Jul 27 17:01:27.421483 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:01:27.421464    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-134.ec2.internal\" not found"
Jul 27 17:01:27.440259 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.440238    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/33da85977499fd84717c6ccc4c4fa1cd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-134.ec2.internal\" (UID: \"33da85977499fd84717c6ccc4c4fa1cd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-134.ec2.internal"
Jul 27 17:01:27.440314 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.440263    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/083a17672f59f98418db0cff06013128-config\") pod \"kube-apiserver-proxy-ip-10-0-137-134.ec2.internal\" (UID: \"083a17672f59f98418db0cff06013128\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-134.ec2.internal"
Jul 27 17:01:27.440314 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.440279    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/33da85977499fd84717c6ccc4c4fa1cd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-134.ec2.internal\" (UID: \"33da85977499fd84717c6ccc4c4fa1cd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-134.ec2.internal"
Jul 27 17:01:27.522348 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:01:27.522326    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-134.ec2.internal\" not found"
Jul 27 17:01:27.540640 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.540612    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/33da85977499fd84717c6ccc4c4fa1cd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-134.ec2.internal\" (UID: \"33da85977499fd84717c6ccc4c4fa1cd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-134.ec2.internal"
Jul 27 17:01:27.540640 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.540645    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/33da85977499fd84717c6ccc4c4fa1cd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-134.ec2.internal\" (UID: \"33da85977499fd84717c6ccc4c4fa1cd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-134.ec2.internal"
Jul 27 17:01:27.540746 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.540661    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/083a17672f59f98418db0cff06013128-config\") pod \"kube-apiserver-proxy-ip-10-0-137-134.ec2.internal\" (UID: \"083a17672f59f98418db0cff06013128\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-134.ec2.internal"
Jul 27 17:01:27.540746 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.540697    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/083a17672f59f98418db0cff06013128-config\") pod \"kube-apiserver-proxy-ip-10-0-137-134.ec2.internal\" (UID: \"083a17672f59f98418db0cff06013128\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-134.ec2.internal"
Jul 27 17:01:27.540746 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.540708    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/33da85977499fd84717c6ccc4c4fa1cd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-134.ec2.internal\" (UID: \"33da85977499fd84717c6ccc4c4fa1cd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-134.ec2.internal"
Jul 27 17:01:27.540746 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.540718    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/33da85977499fd84717c6ccc4c4fa1cd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-134.ec2.internal\" (UID: \"33da85977499fd84717c6ccc4c4fa1cd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-134.ec2.internal"
Jul 27 17:01:27.622863 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:01:27.622790    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-134.ec2.internal\" not found"
Jul 27 17:01:27.704989 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.704954    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-134.ec2.internal"
Jul 27 17:01:27.706138 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:27.706119    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-134.ec2.internal"
Jul 27 17:01:27.723680 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:01:27.723658    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-134.ec2.internal\" not found"
Jul 27 17:01:27.828517 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:01:27.828484    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-134.ec2.internal\" not found"
Jul 27 17:01:27.935181 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:01:27.935119    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-134.ec2.internal\" not found"
Jul 27 17:01:28.042800 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:01:28.042775    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-134.ec2.internal\" not found"
Jul 27 17:01:28.073366 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:28.073347    2580 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 17:01:28.077521 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:28.077495    2580 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 27 17:01:28.077634 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:28.077614    2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 27 17:01:28.077697 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:28.077673    2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 27 17:01:28.142979 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:01:28.142958    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-134.ec2.internal\" not found"
Jul 27 17:01:28.154966 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:28.154933    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-26 16:56:27 +0000 UTC" deadline="2028-05-02 09:38:40.58515173 +0000 UTC"
Jul 27 17:01:28.154966 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:28.154961    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15472h37m12.430194314s"
Jul 27 17:01:28.226518 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:28.226481    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33da85977499fd84717c6ccc4c4fa1cd.slice/crio-c2812b19e9816a9151cdfc1a2279f8892682330587e979db3d1ca5c454918255 WatchSource:0}: Error finding container c2812b19e9816a9151cdfc1a2279f8892682330587e979db3d1ca5c454918255: Status 404 returned error can't find the container with id c2812b19e9816a9151cdfc1a2279f8892682330587e979db3d1ca5c454918255
Jul 27 17:01:28.233038 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:28.233022    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 17:01:28.243931 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:01:28.243911    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-134.ec2.internal\" not found"
Jul 27 17:01:28.256019 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:28.255997    2580 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 17:01:28.267636 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:28.267595    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-134.ec2.internal" event={"ID":"33da85977499fd84717c6ccc4c4fa1cd","Type":"ContainerStarted","Data":"c2812b19e9816a9151cdfc1a2279f8892682330587e979db3d1ca5c454918255"}
Jul 27 17:01:28.343622 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:28.343605    2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-134.ec2.internal"
Jul 27 17:01:28.357195 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:28.357176    2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 27 17:01:28.359193 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:28.359181    2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-134.ec2.internal"
Jul 27 17:01:28.368743 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:28.368727    2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 27 17:01:28.638263 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:28.638183    2580 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 17:01:29.119264 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.119187    2580 apiserver.go:52] "Watching apiserver"
Jul 27 17:01:29.128954 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.128929    2580 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 27 17:01:29.131187 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.131160    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-7h9zp","openshift-multus/multus-additional-cni-plugins-vlzgx","kube-system/global-pull-secret-syncer-g6775","kube-system/konnectivity-agent-gdxlg","openshift-dns/node-resolver-kt2nr","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-134.ec2.internal","openshift-multus/network-metrics-daemon-s5bhd","openshift-network-diagnostics/network-check-target-x5xw7","openshift-network-operator/iptables-alerter-4ksfn","openshift-ovn-kubernetes/ovnkube-node-grkdn","kube-system/kube-apiserver-proxy-ip-10-0-137-134.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8qwz2","openshift-cluster-node-tuning-operator/tuned-jv9gw","openshift-image-registry/node-ca-dk4md"]
Jul 27 17:01:29.132756 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.132731    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s5bhd"
Jul 27 17:01:29.132848 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:01:29.132821    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s5bhd" podUID="d26abfd5-3102-42ec-a7e0-c5abe0e9dc85"
Jul 27 17:01:29.134236 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.134211    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-jv9gw"
Jul 27 17:01:29.135316 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.135284    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g6775"
Jul 27 17:01:29.135400 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:01:29.135345    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g6775" podUID="2b793cd9-1cc7-4f3b-b882-1999e673076d"
Jul 27 17:01:29.136497 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.136463    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gdxlg"
Jul 27 17:01:29.136626 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.136604    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 27 17:01:29.137022 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.136937    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-d6n57\""
Jul 27 17:01:29.137022 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.136943    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 27 17:01:29.137744 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.137723    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-kt2nr"
Jul 27 17:01:29.138879 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.138788    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 27 17:01:29.139555 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.139020    2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 27 17:01:29.139555 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.139065    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-dk4md"
Jul 27 17:01:29.139555 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.139425    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 27 17:01:29.139555 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.139486    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-krnrc\""
Jul 27 17:01:29.139926 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.139909    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 27 17:01:29.140316 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.140300    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-pbnxf\""
Jul 27 17:01:29.140388 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.140333    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 27 17:01:29.140987 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.140628    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4ksfn"
Jul 27 17:01:29.142356 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.142205    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7h9zp"
Jul 27 17:01:29.145384 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.144479    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 27 17:01:29.145384 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.144503    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-tjst9\""
Jul 27 17:01:29.145384 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.144617    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 27 17:01:29.145384 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.144874    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 27 17:01:29.145384 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.145149    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 27 17:01:29.145384 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.145159    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 27 17:01:29.145384 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.145254    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-sz2bz\""
Jul 27 17:01:29.145384 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.145308    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 27 17:01:29.145817 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.145591    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-nw7k9\""
Jul 27 17:01:29.146812 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.146497    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-vlzgx"
Jul 27 17:01:29.146812 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.146589    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 27 17:01:29.146812 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.146646    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 27 17:01:29.147897 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.147858    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 27 17:01:29.148254 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.148236    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-grkdn"
Jul 27 17:01:29.148340 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.148264    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 27 17:01:29.148457 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.148431    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/48eef739-faf5-48db-a1ef-c47a4b6971bd-etc-sysctl-d\") pod \"tuned-jv9gw\" (UID: \"48eef739-faf5-48db-a1ef-c47a4b6971bd\") " pod="openshift-cluster-node-tuning-operator/tuned-jv9gw"
Jul 27 17:01:29.148557 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.148473    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/48eef739-faf5-48db-a1ef-c47a4b6971bd-sys\") pod \"tuned-jv9gw\" (UID: \"48eef739-faf5-48db-a1ef-c47a4b6971bd\") " pod="openshift-cluster-node-tuning-operator/tuned-jv9gw"
Jul 27 17:01:29.148557 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.148500    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/48eef739-faf5-48db-a1ef-c47a4b6971bd-var-lib-kubelet\") pod \"tuned-jv9gw\" (UID: \"48eef739-faf5-48db-a1ef-c47a4b6971bd\") " pod="openshift-cluster-node-tuning-operator/tuned-jv9gw"
Jul 27 17:01:29.148557 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.148528    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbklx\" (UniqueName: \"kubernetes.io/projected/0ed8e5dc-750b-42d0-86b3-7d1e6802c992-kube-api-access-hbklx\") pod \"node-resolver-kt2nr\" (UID: \"0ed8e5dc-750b-42d0-86b3-7d1e6802c992\") " pod="openshift-dns/node-resolver-kt2nr"
Jul 27 17:01:29.148713 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.148555    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0bb4594a-a23f-4e66-a579-087b20377307-host\") pod \"node-ca-dk4md\" (UID: \"0bb4594a-a23f-4e66-a579-087b20377307\") " pod="openshift-image-registry/node-ca-dk4md"
Jul 27 17:01:29.148713 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.148582    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/48eef739-faf5-48db-a1ef-c47a4b6971bd-etc-kubernetes\") pod \"tuned-jv9gw\" (UID: \"48eef739-faf5-48db-a1ef-c47a4b6971bd\") " pod="openshift-cluster-node-tuning-operator/tuned-jv9gw"
Jul 27 17:01:29.148713 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.148611    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lsp8w\" (UniqueName: \"kubernetes.io/projected/48eef739-faf5-48db-a1ef-c47a4b6971bd-kube-api-access-lsp8w\") pod \"tuned-jv9gw\" (UID: \"48eef739-faf5-48db-a1ef-c47a4b6971bd\") " pod="openshift-cluster-node-tuning-operator/tuned-jv9gw"
Jul 27 17:01:29.148713 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.148661    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2b793cd9-1cc7-4f3b-b882-1999e673076d-original-pull-secret\") pod \"global-pull-secret-syncer-g6775\" (UID: \"2b793cd9-1cc7-4f3b-b882-1999e673076d\") " pod="kube-system/global-pull-secret-syncer-g6775"
Jul 27 17:01:29.148713 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.148694    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0bb4594a-a23f-4e66-a579-087b20377307-serviceca\") pod \"node-ca-dk4md\" (UID: \"0bb4594a-a23f-4e66-a579-087b20377307\") " pod="openshift-image-registry/node-ca-dk4md"
Jul 27 17:01:29.149005 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.148725    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-glmfw\" (UniqueName: \"kubernetes.io/projected/d26abfd5-3102-42ec-a7e0-c5abe0e9dc85-kube-api-access-glmfw\") pod \"network-metrics-daemon-s5bhd\" (UID: \"d26abfd5-3102-42ec-a7e0-c5abe0e9dc85\") " pod="openshift-multus/network-metrics-daemon-s5bhd"
Jul 27 17:01:29.149005 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.148751    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/48eef739-faf5-48db-a1ef-c47a4b6971bd-etc-modprobe-d\") pod \"tuned-jv9gw\" (UID: \"48eef739-faf5-48db-a1ef-c47a4b6971bd\") " pod="openshift-cluster-node-tuning-operator/tuned-jv9gw"
Jul 27 17:01:29.149005 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.148776    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/48eef739-faf5-48db-a1ef-c47a4b6971bd-etc-systemd\") pod \"tuned-jv9gw\" (UID: \"48eef739-faf5-48db-a1ef-c47a4b6971bd\") " pod="openshift-cluster-node-tuning-operator/tuned-jv9gw"
Jul 27 17:01:29.149005 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.148809    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/48eef739-faf5-48db-a1ef-c47a4b6971bd-lib-modules\") pod \"tuned-jv9gw\" (UID: \"48eef739-faf5-48db-a1ef-c47a4b6971bd\") " pod="openshift-cluster-node-tuning-operator/tuned-jv9gw"
Jul 27 17:01:29.149005 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.148887    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2b793cd9-1cc7-4f3b-b882-1999e673076d-kubelet-config\") pod \"global-pull-secret-syncer-g6775\" (UID: \"2b793cd9-1cc7-4f3b-b882-1999e673076d\") " pod="kube-system/global-pull-secret-syncer-g6775"
Jul 27 17:01:29.149005 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.148912    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0ed8e5dc-750b-42d0-86b3-7d1e6802c992-hosts-file\") pod \"node-resolver-kt2nr\" (UID: \"0ed8e5dc-750b-42d0-86b3-7d1e6802c992\") " pod="openshift-dns/node-resolver-kt2nr"
Jul 27 17:01:29.149005 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.148937    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/48eef739-faf5-48db-a1ef-c47a4b6971bd-etc-sysconfig\") pod \"tuned-jv9gw\" (UID: \"48eef739-faf5-48db-a1ef-c47a4b6971bd\") " pod="openshift-cluster-node-tuning-operator/tuned-jv9gw"
Jul 27 17:01:29.149005 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.148958    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/48eef739-faf5-48db-a1ef-c47a4b6971bd-etc-tuned\") pod \"tuned-jv9gw\" (UID: \"48eef739-faf5-48db-a1ef-c47a4b6971bd\") " pod="openshift-cluster-node-tuning-operator/tuned-jv9gw"
Jul 27 17:01:29.149005 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.148980    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6e5b6418-be32-4e11-88d2-929d0f6f52d6-konnectivity-ca\") pod \"konnectivity-agent-gdxlg\" (UID: \"6e5b6418-be32-4e11-88d2-929d0f6f52d6\") " pod="kube-system/konnectivity-agent-gdxlg"
Jul 27 17:01:29.149005 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.149004    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/48eef739-faf5-48db-a1ef-c47a4b6971bd-host\") pod \"tuned-jv9gw\" (UID: \"48eef739-faf5-48db-a1ef-c47a4b6971bd\") " pod="openshift-cluster-node-tuning-operator/tuned-jv9gw"
Jul 27 17:01:29.149521 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.149026    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6e5b6418-be32-4e11-88d2-929d0f6f52d6-agent-certs\") pod \"konnectivity-agent-gdxlg\" (UID: \"6e5b6418-be32-4e11-88d2-929d0f6f52d6\") " pod="kube-system/konnectivity-agent-gdxlg"
Jul 27 17:01:29.149521 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.149046    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ed8e5dc-750b-42d0-86b3-7d1e6802c992-tmp-dir\") pod \"node-resolver-kt2nr\" (UID: \"0ed8e5dc-750b-42d0-86b3-7d1e6802c992\") " pod="openshift-dns/node-resolver-kt2nr"
Jul 27 17:01:29.149521 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.149140    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d26abfd5-3102-42ec-a7e0-c5abe0e9dc85-metrics-certs\") pod \"network-metrics-daemon-s5bhd\" (UID: \"d26abfd5-3102-42ec-a7e0-c5abe0e9dc85\") " pod="openshift-multus/network-metrics-daemon-s5bhd"
Jul 27 17:01:29.149521 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.149167    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/48eef739-faf5-48db-a1ef-c47a4b6971bd-etc-sysctl-conf\") pod \"tuned-jv9gw\" (UID: \"48eef739-faf5-48db-a1ef-c47a4b6971bd\") " pod="openshift-cluster-node-tuning-operator/tuned-jv9gw"
Jul 27 17:01:29.149521 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.149194    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nw575\" (UniqueName: \"kubernetes.io/projected/0bb4594a-a23f-4e66-a579-087b20377307-kube-api-access-nw575\") pod \"node-ca-dk4md\" (UID: \"0bb4594a-a23f-4e66-a579-087b20377307\") " pod="openshift-image-registry/node-ca-dk4md"
Jul 27 17:01:29.149521 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.149230    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/48eef739-faf5-48db-a1ef-c47a4b6971bd-run\") pod \"tuned-jv9gw\" (UID: \"48eef739-faf5-48db-a1ef-c47a4b6971bd\") " pod="openshift-cluster-node-tuning-operator/tuned-jv9gw"
Jul 27 17:01:29.149521 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.149263    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/48eef739-faf5-48db-a1ef-c47a4b6971bd-tmp\") pod \"tuned-jv9gw\" (UID: \"48eef739-faf5-48db-a1ef-c47a4b6971bd\") " pod="openshift-cluster-node-tuning-operator/tuned-jv9gw"
Jul 27 17:01:29.149521 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.149299    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2b793cd9-1cc7-4f3b-b882-1999e673076d-dbus\") pod \"global-pull-secret-syncer-g6775\" (UID: \"2b793cd9-1cc7-4f3b-b882-1999e673076d\") " pod="kube-system/global-pull-secret-syncer-g6775"
Jul 27 17:01:29.149897 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.149714    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5xw7"
Jul 27 17:01:29.149897 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:01:29.149781    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x5xw7" podUID="8789c3a3-c9f7-43f1-8ea2-b279c80fe9a7"
Jul 27 17:01:29.151240 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.151055    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 27 17:01:29.151240 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.151061    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 27 17:01:29.151524 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.151506    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8qwz2"
Jul 27 17:01:29.155593 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.155572    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-r2twh\""
Jul 27 17:01:29.156070 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.156044    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 27 17:01:29.156223 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.156201    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 27 17:01:29.156315 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.156110    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 27 17:01:29.156369 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.156047    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 27 17:01:29.157501 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.157485    2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 27 17:01:29.157613 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.157564    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 27 17:01:29.157613 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.157581    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 27 17:01:29.157739 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.157679    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 27 17:01:29.157798 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.157789    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-hdt6r\""
Jul 27 17:01:29.157868 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.157486    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 27 17:01:29.157868 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.157817    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-ltmlm\""
Jul 27 17:01:29.162793 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.162774    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 27 17:01:29.182424 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.182403    2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-rgp7c"
Jul 27 17:01:29.192751 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.192723    2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-rgp7c"
Jul 27 17:01:29.240222 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.240200    2580 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 27 17:01:29.249763 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.249741    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d8e1cb0d-8f4b-4e00-91bc-9d112926115c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-grkdn\" (UID: \"d8e1cb0d-8f4b-4e00-91bc-9d112926115c\") " pod="openshift-ovn-kubernetes/ovnkube-node-grkdn"
Jul 27 17:01:29.249882 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.249778    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f9a42d19-2eff-4160-a5ec-950fffedb6a3-host-var-lib-kubelet\") pod \"multus-7h9zp\" (UID: \"f9a42d19-2eff-4160-a5ec-950fffedb6a3\") " pod="openshift-multus/multus-7h9zp"
Jul 27 17:01:29.249882 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.249807    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/48eef739-faf5-48db-a1ef-c47a4b6971bd-tmp\") pod \"tuned-jv9gw\" (UID: \"48eef739-faf5-48db-a1ef-c47a4b6971bd\") " pod="openshift-cluster-node-tuning-operator/tuned-jv9gw"
Jul 27 17:01:29.249882 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.249857    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d8e1cb0d-8f4b-4e00-91bc-9d112926115c-run-systemd\") pod \"ovnkube-node-grkdn\" (UID: \"d8e1cb0d-8f4b-4e00-91bc-9d112926115c\") " pod="openshift-ovn-kubernetes/ovnkube-node-grkdn"
Jul 27 17:01:29.250037 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.249902    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f9a42d19-2eff-4160-a5ec-950fffedb6a3-host-run-netns\") pod \"multus-7h9zp\" (UID: \"f9a42d19-2eff-4160-a5ec-950fffedb6a3\") " pod="openshift-multus/multus-7h9zp"
Jul 27 17:01:29.250037 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.249922    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f9a42d19-2eff-4160-a5ec-950fffedb6a3-hostroot\") pod \"multus-7h9zp\" (UID: \"f9a42d19-2eff-4160-a5ec-950fffedb6a3\") " pod="openshift-multus/multus-7h9zp"
Jul 27 17:01:29.250037 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.249966    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7834bc12-869c-4364-b081-1c665ba26024-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vlzgx\" (UID: \"7834bc12-869c-4364-b081-1c665ba26024\") " pod="openshift-multus/multus-additional-cni-plugins-vlzgx"
Jul 27 17:01:29.250037 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.250008    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/48eef739-faf5-48db-a1ef-c47a4b6971bd-sys\") pod \"tuned-jv9gw\" (UID: \"48eef739-faf5-48db-a1ef-c47a4b6971bd\") " pod="openshift-cluster-node-tuning-operator/tuned-jv9gw"
Jul 27 17:01:29.250230 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.250046    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/48eef739-faf5-48db-a1ef-c47a4b6971bd-var-lib-kubelet\") pod \"tuned-jv9gw\" (UID: \"48eef739-faf5-48db-a1ef-c47a4b6971bd\") " pod="openshift-cluster-node-tuning-operator/tuned-jv9gw"
Jul 27 17:01:29.250230 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.250071    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/48eef739-faf5-48db-a1ef-c47a4b6971bd-sys\") pod \"tuned-jv9gw\" (UID: \"48eef739-faf5-48db-a1ef-c47a4b6971bd\") " pod="openshift-cluster-node-tuning-operator/tuned-jv9gw"
Jul 27 17:01:29.250230 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.250075    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d8e1cb0d-8f4b-4e00-91bc-9d112926115c-run-openvswitch\") pod \"ovnkube-node-grkdn\" (UID: \"d8e1cb0d-8f4b-4e00-91bc-9d112926115c\") " pod="openshift-ovn-kubernetes/ovnkube-node-grkdn"
Jul 27 17:01:29.250230 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.250127    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f9a42d19-2eff-4160-a5ec-950fffedb6a3-system-cni-dir\") pod \"multus-7h9zp\" (UID: \"f9a42d19-2eff-4160-a5ec-950fffedb6a3\") " pod="openshift-multus/multus-7h9zp"
Jul 27 17:01:29.250230 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.250140    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/48eef739-faf5-48db-a1ef-c47a4b6971bd-var-lib-kubelet\") pod \"tuned-jv9gw\" (UID: \"48eef739-faf5-48db-a1ef-c47a4b6971bd\") " pod="openshift-cluster-node-tuning-operator/tuned-jv9gw"
Jul 27 17:01:29.250230 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.250140    2580 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 27 17:01:29.250230 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.250153    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f9a42d19-2eff-4160-a5ec-950fffedb6a3-host-var-lib-cni-bin\") pod \"multus-7h9zp\" (UID: \"f9a42d19-2eff-4160-a5ec-950fffedb6a3\") " pod="openshift-multus/multus-7h9zp"
Jul 27 17:01:29.250230 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.250188    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7834bc12-869c-4364-b081-1c665ba26024-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vlzgx\" (UID: \"7834bc12-869c-4364-b081-1c665ba26024\") " pod="openshift-multus/multus-additional-cni-plugins-vlzgx"
Jul 27 17:01:29.250230 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.250215    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b162f98d-8b75-4f43-9e96-18587dae9d8d-sys-fs\") pod \"aws-ebs-csi-driver-node-8qwz2\" (UID: \"b162f98d-8b75-4f43-9e96-18587dae9d8d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8qwz2"
Jul 27 17:01:29.250688 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.250238    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2b793cd9-1cc7-4f3b-b882-1999e673076d-original-pull-secret\") pod \"global-pull-secret-syncer-g6775\" (UID: \"2b793cd9-1cc7-4f3b-b882-1999e673076d\") " pod="kube-system/global-pull-secret-syncer-g6775"
Jul 27 17:01:29.250688 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.250261    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0bb4594a-a23f-4e66-a579-087b20377307-serviceca\") pod \"node-ca-dk4md\" (UID: \"0bb4594a-a23f-4e66-a579-087b20377307\") " pod="openshift-image-registry/node-ca-dk4md"
Jul 27 17:01:29.250688 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.250288    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7834bc12-869c-4364-b081-1c665ba26024-cni-binary-copy\") pod \"multus-additional-cni-plugins-vlzgx\" (UID: \"7834bc12-869c-4364-b081-1c665ba26024\") " pod="openshift-multus/multus-additional-cni-plugins-vlzgx"
Jul 27 17:01:29.250688 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.250316    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/48eef739-faf5-48db-a1ef-c47a4b6971bd-etc-systemd\") pod \"tuned-jv9gw\" (UID: \"48eef739-faf5-48db-a1ef-c47a4b6971bd\") " pod="openshift-cluster-node-tuning-operator/tuned-jv9gw"
Jul 27 17:01:29.250688 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:01:29.250349    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 17:01:29.250688 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.250362    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f9a42d19-2eff-4160-a5ec-950fffedb6a3-multus-socket-dir-parent\") pod \"multus-7h9zp\" (UID: \"f9a42d19-2eff-4160-a5ec-950fffedb6a3\") " pod="openshift-multus/multus-7h9zp"
Jul 27 17:01:29.250688 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.250388    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b162f98d-8b75-4f43-9e96-18587dae9d8d-etc-selinux\") pod \"aws-ebs-csi-driver-node-8qwz2\" (UID: \"b162f98d-8b75-4f43-9e96-18587dae9d8d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8qwz2"
Jul 27 17:01:29.250688 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:01:29.250433    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b793cd9-1cc7-4f3b-b882-1999e673076d-original-pull-secret podName:2b793cd9-1cc7-4f3b-b882-1999e673076d nodeName:}" failed. No retries permitted until 2026-07-27 17:01:29.750391481 +0000 UTC m=+2.947136279 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2b793cd9-1cc7-4f3b-b882-1999e673076d-original-pull-secret") pod "global-pull-secret-syncer-g6775" (UID: "2b793cd9-1cc7-4f3b-b882-1999e673076d") : object "kube-system"/"original-pull-secret" not registered
Jul 27 17:01:29.250688 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.250461    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/48eef739-faf5-48db-a1ef-c47a4b6971bd-etc-systemd\") pod \"tuned-jv9gw\" (UID: \"48eef739-faf5-48db-a1ef-c47a4b6971bd\") " pod="openshift-cluster-node-tuning-operator/tuned-jv9gw"
Jul 27 17:01:29.250688 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.250517    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2b793cd9-1cc7-4f3b-b882-1999e673076d-kubelet-config\") pod \"global-pull-secret-syncer-g6775\" (UID: \"2b793cd9-1cc7-4f3b-b882-1999e673076d\") " pod="kube-system/global-pull-secret-syncer-g6775"
Jul 27 17:01:29.250688 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.250545    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0ed8e5dc-750b-42d0-86b3-7d1e6802c992-hosts-file\") pod \"node-resolver-kt2nr\" (UID: \"0ed8e5dc-750b-42d0-86b3-7d1e6802c992\") " pod="openshift-dns/node-resolver-kt2nr"
Jul 27 17:01:29.250688 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.250573    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a5ae6ff9-02a8-4eac-abfc-5f113b100357-host-slash\") pod \"iptables-alerter-4ksfn\" (UID: \"a5ae6ff9-02a8-4eac-abfc-5f113b100357\") " pod="openshift-network-operator/iptables-alerter-4ksfn"
Jul 27 17:01:29.250688 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.250598    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d8e1cb0d-8f4b-4e00-91bc-9d112926115c-host-run-netns\") pod \"ovnkube-node-grkdn\" (UID: \"d8e1cb0d-8f4b-4e00-91bc-9d112926115c\") " pod="openshift-ovn-kubernetes/ovnkube-node-grkdn"
Jul 27 17:01:29.250688 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.250623    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d8e1cb0d-8f4b-4e00-91bc-9d112926115c-host-run-ovn-kubernetes\") pod \"ovnkube-node-grkdn\" (UID: \"d8e1cb0d-8f4b-4e00-91bc-9d112926115c\") " pod="openshift-ovn-kubernetes/ovnkube-node-grkdn"
Jul 27 17:01:29.250688 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.250670    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2b793cd9-1cc7-4f3b-b882-1999e673076d-kubelet-config\") pod \"global-pull-secret-syncer-g6775\" (UID: \"2b793cd9-1cc7-4f3b-b882-1999e673076d\") " pod="kube-system/global-pull-secret-syncer-g6775"
Jul 27 17:01:29.251526 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.250736    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f9a42d19-2eff-4160-a5ec-950fffedb6a3-os-release\") pod \"multus-7h9zp\" (UID: \"f9a42d19-2eff-4160-a5ec-950fffedb6a3\") " pod="openshift-multus/multus-7h9zp"
Jul 27 17:01:29.251526 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.250747    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0ed8e5dc-750b-42d0-86b3-7d1e6802c992-hosts-file\") pod \"node-resolver-kt2nr\" (UID: \"0ed8e5dc-750b-42d0-86b3-7d1e6802c992\") " pod="openshift-dns/node-resolver-kt2nr"
Jul 27 17:01:29.251526 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.250779    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0bb4594a-a23f-4e66-a579-087b20377307-serviceca\") pod \"node-ca-dk4md\" (UID: \"0bb4594a-a23f-4e66-a579-087b20377307\") " pod="openshift-image-registry/node-ca-dk4md"
Jul 27 17:01:29.251526 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.250792    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6e5b6418-be32-4e11-88d2-929d0f6f52d6-konnectivity-ca\") pod \"konnectivity-agent-gdxlg\" (UID: \"6e5b6418-be32-4e11-88d2-929d0f6f52d6\") " pod="kube-system/konnectivity-agent-gdxlg"
Jul 27 17:01:29.251526 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.250824    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a5ae6ff9-02a8-4eac-abfc-5f113b100357-iptables-alerter-script\") pod \"iptables-alerter-4ksfn\" (UID: \"a5ae6ff9-02a8-4eac-abfc-5f113b100357\") " pod="openshift-network-operator/iptables-alerter-4ksfn"
Jul 27 17:01:29.251526 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.250866    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d8e1cb0d-8f4b-4e00-91bc-9d112926115c-systemd-units\") pod \"ovnkube-node-grkdn\" (UID: \"d8e1cb0d-8f4b-4e00-91bc-9d112926115c\") " pod="openshift-ovn-kubernetes/ovnkube-node-grkdn"
Jul 27 17:01:29.251526 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.250921    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d8e1cb0d-8f4b-4e00-91bc-9d112926115c-var-lib-openvswitch\") pod \"ovnkube-node-grkdn\" (UID: \"d8e1cb0d-8f4b-4e00-91bc-9d112926115c\") " pod="openshift-ovn-kubernetes/ovnkube-node-grkdn"
Jul 27 17:01:29.251526 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.250948    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-glpq8\" (UniqueName: \"kubernetes.io/projected/d8e1cb0d-8f4b-4e00-91bc-9d112926115c-kube-api-access-glpq8\") pod \"ovnkube-node-grkdn\" (UID: \"d8e1cb0d-8f4b-4e00-91bc-9d112926115c\") " pod="openshift-ovn-kubernetes/ovnkube-node-grkdn"
Jul 27 17:01:29.251526 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.250976    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f9a42d19-2eff-4160-a5ec-950fffedb6a3-host-var-lib-cni-multus\") pod \"multus-7h9zp\" (UID: \"f9a42d19-2eff-4160-a5ec-950fffedb6a3\") " pod="openshift-multus/multus-7h9zp"
Jul 27 17:01:29.251526 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.251003    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7834bc12-869c-4364-b081-1c665ba26024-system-cni-dir\") pod \"multus-additional-cni-plugins-vlzgx\" (UID: \"7834bc12-869c-4364-b081-1c665ba26024\") " pod="openshift-multus/multus-additional-cni-plugins-vlzgx"
Jul 27 17:01:29.251526 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.251030    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/48eef739-faf5-48db-a1ef-c47a4b6971bd-host\") pod \"tuned-jv9gw\" (UID: \"48eef739-faf5-48db-a1ef-c47a4b6971bd\") " pod="openshift-cluster-node-tuning-operator/tuned-jv9gw"
Jul 27 17:01:29.251526 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.251055    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ed8e5dc-750b-42d0-86b3-7d1e6802c992-tmp-dir\") pod \"node-resolver-kt2nr\" (UID: \"0ed8e5dc-750b-42d0-86b3-7d1e6802c992\") " pod="openshift-dns/node-resolver-kt2nr"
Jul 27 17:01:29.251526 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.251078    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d8e1cb0d-8f4b-4e00-91bc-9d112926115c-host-kubelet\") pod \"ovnkube-node-grkdn\" (UID: \"d8e1cb0d-8f4b-4e00-91bc-9d112926115c\") " pod="openshift-ovn-kubernetes/ovnkube-node-grkdn"
Jul 27 17:01:29.251526 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.251103    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d8e1cb0d-8f4b-4e00-91bc-9d112926115c-log-socket\") pod \"ovnkube-node-grkdn\" (UID: \"d8e1cb0d-8f4b-4e00-91bc-9d112926115c\") " pod="openshift-ovn-kubernetes/ovnkube-node-grkdn"
Jul 27 17:01:29.251526 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.251188    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/48eef739-faf5-48db-a1ef-c47a4b6971bd-host\") pod \"tuned-jv9gw\" (UID: \"48eef739-faf5-48db-a1ef-c47a4b6971bd\") " pod="openshift-cluster-node-tuning-operator/tuned-jv9gw"
Jul 27 17:01:29.251526 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.251219    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d8e1cb0d-8f4b-4e00-91bc-9d112926115c-host-cni-bin\") pod \"ovnkube-node-grkdn\" (UID: \"d8e1cb0d-8f4b-4e00-91bc-9d112926115c\") " pod="openshift-ovn-kubernetes/ovnkube-node-grkdn"
Jul 27 17:01:29.251526 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.251243    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d8e1cb0d-8f4b-4e00-91bc-9d112926115c-ovnkube-script-lib\") pod \"ovnkube-node-grkdn\" (UID: \"d8e1cb0d-8f4b-4e00-91bc-9d112926115c\") " pod="openshift-ovn-kubernetes/ovnkube-node-grkdn"
Jul 27 17:01:29.252324 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.251270    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b162f98d-8b75-4f43-9e96-18587dae9d8d-registration-dir\") pod \"aws-ebs-csi-driver-node-8qwz2\" (UID: \"b162f98d-8b75-4f43-9e96-18587dae9d8d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8qwz2"
Jul 27 17:01:29.252324 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.251298    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d26abfd5-3102-42ec-a7e0-c5abe0e9dc85-metrics-certs\") pod \"network-metrics-daemon-s5bhd\" (UID: \"d26abfd5-3102-42ec-a7e0-c5abe0e9dc85\") " pod="openshift-multus/network-metrics-daemon-s5bhd"
Jul 27 17:01:29.252324 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.251323    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nw575\" (UniqueName: \"kubernetes.io/projected/0bb4594a-a23f-4e66-a579-087b20377307-kube-api-access-nw575\") pod \"node-ca-dk4md\" (UID: \"0bb4594a-a23f-4e66-a579-087b20377307\") " pod="openshift-image-registry/node-ca-dk4md"
Jul 27 17:01:29.252324 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.251350    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d8e1cb0d-8f4b-4e00-91bc-9d112926115c-host-cni-netd\") pod \"ovnkube-node-grkdn\" (UID: \"d8e1cb0d-8f4b-4e00-91bc-9d112926115c\") " pod="openshift-ovn-kubernetes/ovnkube-node-grkdn"
Jul 27 17:01:29.252324 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.251374    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/48eef739-faf5-48db-a1ef-c47a4b6971bd-run\") pod \"tuned-jv9gw\" (UID: \"48eef739-faf5-48db-a1ef-c47a4b6971bd\") " pod="openshift-cluster-node-tuning-operator/tuned-jv9gw"
Jul 27 17:01:29.252324 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.251398    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2b793cd9-1cc7-4f3b-b882-1999e673076d-dbus\") pod \"global-pull-secret-syncer-g6775\" (UID: \"2b793cd9-1cc7-4f3b-b882-1999e673076d\") " pod="kube-system/global-pull-secret-syncer-g6775"
Jul 27 17:01:29.252324 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.251404    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6e5b6418-be32-4e11-88d2-929d0f6f52d6-konnectivity-ca\") pod \"konnectivity-agent-gdxlg\" (UID: \"6e5b6418-be32-4e11-88d2-929d0f6f52d6\") " pod="kube-system/konnectivity-agent-gdxlg"
Jul 27 17:01:29.252324 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.251419    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ed8e5dc-750b-42d0-86b3-7d1e6802c992-tmp-dir\") pod \"node-resolver-kt2nr\" (UID: \"0ed8e5dc-750b-42d0-86b3-7d1e6802c992\") " pod="openshift-dns/node-resolver-kt2nr"
Jul 27 17:01:29.252324 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.251423    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d8e1cb0d-8f4b-4e00-91bc-9d112926115c-ovnkube-config\") pod \"ovnkube-node-grkdn\" (UID: \"d8e1cb0d-8f4b-4e00-91bc-9d112926115c\") " pod="openshift-ovn-kubernetes/ovnkube-node-grkdn"
Jul 27 17:01:29.252324 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.251490    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6kb9\" (UniqueName: \"kubernetes.io/projected/8789c3a3-c9f7-43f1-8ea2-b279c80fe9a7-kube-api-access-l6kb9\") pod \"network-check-target-x5xw7\" (UID: \"8789c3a3-c9f7-43f1-8ea2-b279c80fe9a7\") " pod="openshift-network-diagnostics/network-check-target-x5xw7"
Jul 27 17:01:29.252324 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.251514    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f9a42d19-2eff-4160-a5ec-950fffedb6a3-multus-cni-dir\") pod \"multus-7h9zp\" (UID: \"f9a42d19-2eff-4160-a5ec-950fffedb6a3\") " pod="openshift-multus/multus-7h9zp"
Jul 27 17:01:29.252324 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.251539    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7834bc12-869c-4364-b081-1c665ba26024-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vlzgx\" (UID: \"7834bc12-869c-4364-b081-1c665ba26024\") " pod="openshift-multus/multus-additional-cni-plugins-vlzgx"
Jul 27 17:01:29.252324 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.251606    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/48eef739-faf5-48db-a1ef-c47a4b6971bd-etc-sysctl-d\") pod \"tuned-jv9gw\" (UID: \"48eef739-faf5-48db-a1ef-c47a4b6971bd\") " pod="openshift-cluster-node-tuning-operator/tuned-jv9gw"
Jul 27 17:01:29.252324 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.251634    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/48eef739-faf5-48db-a1ef-c47a4b6971bd-run\") pod \"tuned-jv9gw\" (UID: \"48eef739-faf5-48db-a1ef-c47a4b6971bd\") " pod="openshift-cluster-node-tuning-operator/tuned-jv9gw"
Jul 27 17:01:29.252324 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.251655    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbklx\" (UniqueName: \"kubernetes.io/projected/0ed8e5dc-750b-42d0-86b3-7d1e6802c992-kube-api-access-hbklx\") pod \"node-resolver-kt2nr\" (UID: \"0ed8e5dc-750b-42d0-86b3-7d1e6802c992\") " pod="openshift-dns/node-resolver-kt2nr"
Jul 27 17:01:29.252324 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.251671    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2b793cd9-1cc7-4f3b-b882-1999e673076d-dbus\") pod \"global-pull-secret-syncer-g6775\" (UID: \"2b793cd9-1cc7-4f3b-b882-1999e673076d\") " pod="kube-system/global-pull-secret-syncer-g6775"
Jul 27 17:01:29.252324 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.251711    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0bb4594a-a23f-4e66-a579-087b20377307-host\") pod \"node-ca-dk4md\" (UID: \"0bb4594a-a23f-4e66-a579-087b20377307\") " pod="openshift-image-registry/node-ca-dk4md"
Jul 27 17:01:29.253154 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.251747    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/48eef739-faf5-48db-a1ef-c47a4b6971bd-etc-sysctl-d\") pod \"tuned-jv9gw\" (UID: \"48eef739-faf5-48db-a1ef-c47a4b6971bd\") " pod="openshift-cluster-node-tuning-operator/tuned-jv9gw"
Jul 27 17:01:29.253154 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.251744    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f9a42d19-2eff-4160-a5ec-950fffedb6a3-cni-binary-copy\") pod \"multus-7h9zp\" (UID: \"f9a42d19-2eff-4160-a5ec-950fffedb6a3\") " pod="openshift-multus/multus-7h9zp"
Jul 27 17:01:29.253154 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.251783    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f9a42d19-2eff-4160-a5ec-950fffedb6a3-multus-daemon-config\") pod \"multus-7h9zp\" (UID: \"f9a42d19-2eff-4160-a5ec-950fffedb6a3\") " pod="openshift-multus/multus-7h9zp"
Jul 27 17:01:29.253154 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.251825    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0bb4594a-a23f-4e66-a579-087b20377307-host\") pod \"node-ca-dk4md\" (UID: \"0bb4594a-a23f-4e66-a579-087b20377307\") " pod="openshift-image-registry/node-ca-dk4md"
Jul 27 17:01:29.253154 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.251878    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b162f98d-8b75-4f43-9e96-18587dae9d8d-socket-dir\") pod \"aws-ebs-csi-driver-node-8qwz2\" (UID: \"b162f98d-8b75-4f43-9e96-18587dae9d8d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8qwz2"
Jul 27 17:01:29.253154 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.251908    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/48eef739-faf5-48db-a1ef-c47a4b6971bd-etc-kubernetes\") pod \"tuned-jv9gw\" (UID: \"48eef739-faf5-48db-a1ef-c47a4b6971bd\") " pod="openshift-cluster-node-tuning-operator/tuned-jv9gw"
Jul 27 17:01:29.253154 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.251936    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lsp8w\" (UniqueName: \"kubernetes.io/projected/48eef739-faf5-48db-a1ef-c47a4b6971bd-kube-api-access-lsp8w\") pod \"tuned-jv9gw\" (UID: \"48eef739-faf5-48db-a1ef-c47a4b6971bd\") " pod="openshift-cluster-node-tuning-operator/tuned-jv9gw"
Jul 27 17:01:29.253154 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.251970    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d8e1cb0d-8f4b-4e00-91bc-9d112926115c-run-ovn\") pod \"ovnkube-node-grkdn\" (UID: \"d8e1cb0d-8f4b-4e00-91bc-9d112926115c\") " pod="openshift-ovn-kubernetes/ovnkube-node-grkdn"
Jul 27 17:01:29.253154 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.251997    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f9a42d19-2eff-4160-a5ec-950fffedb6a3-host-run-k8s-cni-cncf-io\") pod \"multus-7h9zp\" (UID: \"f9a42d19-2eff-4160-a5ec-950fffedb6a3\") " pod="openshift-multus/multus-7h9zp"
Jul 27 17:01:29.253154 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:01:29.252022    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 17:01:29.253154 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.252023    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/48eef739-faf5-48db-a1ef-c47a4b6971bd-etc-kubernetes\") pod \"tuned-jv9gw\" (UID: \"48eef739-faf5-48db-a1ef-c47a4b6971bd\") " pod="openshift-cluster-node-tuning-operator/tuned-jv9gw"
Jul 27 17:01:29.253154 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.252023    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h94jc\" (UniqueName: \"kubernetes.io/projected/b162f98d-8b75-4f43-9e96-18587dae9d8d-kube-api-access-h94jc\") pod \"aws-ebs-csi-driver-node-8qwz2\" (UID: \"b162f98d-8b75-4f43-9e96-18587dae9d8d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8qwz2"
Jul 27 17:01:29.253154 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:01:29.252086    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d26abfd5-3102-42ec-a7e0-c5abe0e9dc85-metrics-certs podName:d26abfd5-3102-42ec-a7e0-c5abe0e9dc85 nodeName:}" failed. No retries permitted until 2026-07-27 17:01:29.752068508 +0000 UTC m=+2.948813316 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d26abfd5-3102-42ec-a7e0-c5abe0e9dc85-metrics-certs") pod "network-metrics-daemon-s5bhd" (UID: "d26abfd5-3102-42ec-a7e0-c5abe0e9dc85") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 17:01:29.253154 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.252128    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-glmfw\" (UniqueName: \"kubernetes.io/projected/d26abfd5-3102-42ec-a7e0-c5abe0e9dc85-kube-api-access-glmfw\") pod \"network-metrics-daemon-s5bhd\" (UID: \"d26abfd5-3102-42ec-a7e0-c5abe0e9dc85\") " pod="openshift-multus/network-metrics-daemon-s5bhd"
Jul 27 17:01:29.253154 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.252157    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/48eef739-faf5-48db-a1ef-c47a4b6971bd-etc-modprobe-d\") pod \"tuned-jv9gw\" (UID: \"48eef739-faf5-48db-a1ef-c47a4b6971bd\") " pod="openshift-cluster-node-tuning-operator/tuned-jv9gw"
Jul 27 17:01:29.253154 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.252187    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d8e1cb0d-8f4b-4e00-91bc-9d112926115c-etc-openvswitch\") pod \"ovnkube-node-grkdn\" (UID: \"d8e1cb0d-8f4b-4e00-91bc-9d112926115c\") " pod="openshift-ovn-kubernetes/ovnkube-node-grkdn"
Jul 27 17:01:29.253154 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.252213    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d8e1cb0d-8f4b-4e00-91bc-9d112926115c-env-overrides\") pod \"ovnkube-node-grkdn\" (UID: \"d8e1cb0d-8f4b-4e00-91bc-9d112926115c\") " pod="openshift-ovn-kubernetes/ovnkube-node-grkdn"
Jul 27 17:01:29.253848 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.252246    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7834bc12-869c-4364-b081-1c665ba26024-cnibin\") pod \"multus-additional-cni-plugins-vlzgx\" (UID: \"7834bc12-869c-4364-b081-1c665ba26024\") " pod="openshift-multus/multus-additional-cni-plugins-vlzgx"
Jul 27 17:01:29.253848 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.252276    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/48eef739-faf5-48db-a1ef-c47a4b6971bd-lib-modules\") pod \"tuned-jv9gw\" (UID: \"48eef739-faf5-48db-a1ef-c47a4b6971bd\") " pod="openshift-cluster-node-tuning-operator/tuned-jv9gw"
Jul 27 17:01:29.253848 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.252308    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/48eef739-faf5-48db-a1ef-c47a4b6971bd-etc-modprobe-d\") pod \"tuned-jv9gw\" (UID: \"48eef739-faf5-48db-a1ef-c47a4b6971bd\") " pod="openshift-cluster-node-tuning-operator/tuned-jv9gw"
Jul 27 17:01:29.253848 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.252333    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d8e1cb0d-8f4b-4e00-91bc-9d112926115c-host-slash\") pod \"ovnkube-node-grkdn\" (UID: \"d8e1cb0d-8f4b-4e00-91bc-9d112926115c\") " pod="openshift-ovn-kubernetes/ovnkube-node-grkdn"
Jul 27 17:01:29.253848 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.252382    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d8e1cb0d-8f4b-4e00-91bc-9d112926115c-node-log\") pod \"ovnkube-node-grkdn\" (UID: \"d8e1cb0d-8f4b-4e00-91bc-9d112926115c\") " pod="openshift-ovn-kubernetes/ovnkube-node-grkdn"
Jul 27 17:01:29.253848 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.252423    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/48eef739-faf5-48db-a1ef-c47a4b6971bd-lib-modules\") pod \"tuned-jv9gw\" (UID: \"48eef739-faf5-48db-a1ef-c47a4b6971bd\") " pod="openshift-cluster-node-tuning-operator/tuned-jv9gw"
Jul 27 17:01:29.253848 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.252430    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d8e1cb0d-8f4b-4e00-91bc-9d112926115c-ovn-node-metrics-cert\") pod \"ovnkube-node-grkdn\" (UID: \"d8e1cb0d-8f4b-4e00-91bc-9d112926115c\") " pod="openshift-ovn-kubernetes/ovnkube-node-grkdn"
Jul 27 17:01:29.253848 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.252462    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f9a42d19-2eff-4160-a5ec-950fffedb6a3-multus-conf-dir\") pod \"multus-7h9zp\" (UID: \"f9a42d19-2eff-4160-a5ec-950fffedb6a3\") " pod="openshift-multus/multus-7h9zp"
Jul 27 17:01:29.253848 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.252486    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b162f98d-8b75-4f43-9e96-18587dae9d8d-device-dir\") pod \"aws-ebs-csi-driver-node-8qwz2\" (UID: \"b162f98d-8b75-4f43-9e96-18587dae9d8d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8qwz2"
Jul 27 17:01:29.253848 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.252524    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/48eef739-faf5-48db-a1ef-c47a4b6971bd-etc-sysconfig\") pod \"tuned-jv9gw\" (UID: \"48eef739-faf5-48db-a1ef-c47a4b6971bd\") " pod="openshift-cluster-node-tuning-operator/tuned-jv9gw"
Jul 27 17:01:29.253848 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.252554    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/48eef739-faf5-48db-a1ef-c47a4b6971bd-etc-tuned\") pod \"tuned-jv9gw\" (UID: \"48eef739-faf5-48db-a1ef-c47a4b6971bd\") " pod="openshift-cluster-node-tuning-operator/tuned-jv9gw"
Jul 27 17:01:29.253848 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.252577    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f9a42d19-2eff-4160-a5ec-950fffedb6a3-cnibin\") pod \"multus-7h9zp\" (UID: \"f9a42d19-2eff-4160-a5ec-950fffedb6a3\") " pod="openshift-multus/multus-7h9zp"
Jul 27 17:01:29.253848 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.252603    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7834bc12-869c-4364-b081-1c665ba26024-os-release\") pod \"multus-additional-cni-plugins-vlzgx\" (UID: \"7834bc12-869c-4364-b081-1c665ba26024\") " pod="openshift-multus/multus-additional-cni-plugins-vlzgx"
Jul 27 17:01:29.253848 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.252630    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gfs9\" (UniqueName: \"kubernetes.io/projected/7834bc12-869c-4364-b081-1c665ba26024-kube-api-access-2gfs9\") pod \"multus-additional-cni-plugins-vlzgx\" (UID: \"7834bc12-869c-4364-b081-1c665ba26024\") " pod="openshift-multus/multus-additional-cni-plugins-vlzgx"
Jul 27 17:01:29.253848 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.252656    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b162f98d-8b75-4f43-9e96-18587dae9d8d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8qwz2\" (UID: \"b162f98d-8b75-4f43-9e96-18587dae9d8d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8qwz2"
Jul 27 17:01:29.253848 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.252683    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6e5b6418-be32-4e11-88d2-929d0f6f52d6-agent-certs\") pod \"konnectivity-agent-gdxlg\" (UID: \"6e5b6418-be32-4e11-88d2-929d0f6f52d6\") " pod="kube-system/konnectivity-agent-gdxlg"
Jul 27 17:01:29.253848 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.252724    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44pgh\" (UniqueName: \"kubernetes.io/projected/a5ae6ff9-02a8-4eac-abfc-5f113b100357-kube-api-access-44pgh\") pod \"iptables-alerter-4ksfn\" (UID: \"a5ae6ff9-02a8-4eac-abfc-5f113b100357\") " pod="openshift-network-operator/iptables-alerter-4ksfn"
Jul 27 17:01:29.254738 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.252770    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f9a42d19-2eff-4160-a5ec-950fffedb6a3-host-run-multus-certs\") pod \"multus-7h9zp\" (UID: \"f9a42d19-2eff-4160-a5ec-950fffedb6a3\") " pod="openshift-multus/multus-7h9zp"
Jul 27 17:01:29.254738 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.252783    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/48eef739-faf5-48db-a1ef-c47a4b6971bd-etc-sysconfig\") pod \"tuned-jv9gw\" (UID: \"48eef739-faf5-48db-a1ef-c47a4b6971bd\") " pod="openshift-cluster-node-tuning-operator/tuned-jv9gw"
Jul 27 17:01:29.254738 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.252800    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f9a42d19-2eff-4160-a5ec-950fffedb6a3-etc-kubernetes\") pod \"multus-7h9zp\" (UID: \"f9a42d19-2eff-4160-a5ec-950fffedb6a3\") " pod="openshift-multus/multus-7h9zp"
Jul 27 17:01:29.254738 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.252856    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h845b\" (UniqueName: \"kubernetes.io/projected/f9a42d19-2eff-4160-a5ec-950fffedb6a3-kube-api-access-h845b\") pod \"multus-7h9zp\" (UID: \"f9a42d19-2eff-4160-a5ec-950fffedb6a3\") " pod="openshift-multus/multus-7h9zp"
Jul 27 17:01:29.254738 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.252891    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/48eef739-faf5-48db-a1ef-c47a4b6971bd-etc-sysctl-conf\") pod \"tuned-jv9gw\" (UID: \"48eef739-faf5-48db-a1ef-c47a4b6971bd\") " pod="openshift-cluster-node-tuning-operator/tuned-jv9gw"
Jul 27 17:01:29.254738 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.253015    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/48eef739-faf5-48db-a1ef-c47a4b6971bd-etc-sysctl-conf\") pod \"tuned-jv9gw\" (UID: \"48eef739-faf5-48db-a1ef-c47a4b6971bd\") " pod="openshift-cluster-node-tuning-operator/tuned-jv9gw"
Jul 27 17:01:29.254738 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.254298    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/48eef739-faf5-48db-a1ef-c47a4b6971bd-tmp\") pod \"tuned-jv9gw\" (UID: \"48eef739-faf5-48db-a1ef-c47a4b6971bd\") " pod="openshift-cluster-node-tuning-operator/tuned-jv9gw"
Jul 27 17:01:29.255180 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.255153    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/48eef739-faf5-48db-a1ef-c47a4b6971bd-etc-tuned\") pod \"tuned-jv9gw\" (UID: \"48eef739-faf5-48db-a1ef-c47a4b6971bd\") " pod="openshift-cluster-node-tuning-operator/tuned-jv9gw"
Jul 27 17:01:29.255465 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.255442    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6e5b6418-be32-4e11-88d2-929d0f6f52d6-agent-certs\") pod \"konnectivity-agent-gdxlg\" (UID: \"6e5b6418-be32-4e11-88d2-929d0f6f52d6\") " pod="kube-system/konnectivity-agent-gdxlg"
Jul 27 17:01:29.273535 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.273507    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lsp8w\" (UniqueName: \"kubernetes.io/projected/48eef739-faf5-48db-a1ef-c47a4b6971bd-kube-api-access-lsp8w\") pod \"tuned-jv9gw\" (UID: \"48eef739-faf5-48db-a1ef-c47a4b6971bd\") " pod="openshift-cluster-node-tuning-operator/tuned-jv9gw"
Jul 27 17:01:29.273767 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.273743    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbklx\" (UniqueName: \"kubernetes.io/projected/0ed8e5dc-750b-42d0-86b3-7d1e6802c992-kube-api-access-hbklx\") pod \"node-resolver-kt2nr\" (UID: \"0ed8e5dc-750b-42d0-86b3-7d1e6802c992\") " pod="openshift-dns/node-resolver-kt2nr"
Jul 27 17:01:29.274159 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.274135    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nw575\" (UniqueName: \"kubernetes.io/projected/0bb4594a-a23f-4e66-a579-087b20377307-kube-api-access-nw575\") pod \"node-ca-dk4md\" (UID: \"0bb4594a-a23f-4e66-a579-087b20377307\") " pod="openshift-image-registry/node-ca-dk4md"
Jul 27 17:01:29.275889 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.275864    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-glmfw\" (UniqueName: \"kubernetes.io/projected/d26abfd5-3102-42ec-a7e0-c5abe0e9dc85-kube-api-access-glmfw\") pod \"network-metrics-daemon-s5bhd\" (UID: \"d26abfd5-3102-42ec-a7e0-c5abe0e9dc85\") " pod="openshift-multus/network-metrics-daemon-s5bhd"
Jul 27 17:01:29.353343 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.353320    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d8e1cb0d-8f4b-4e00-91bc-9d112926115c-ovnkube-config\") pod \"ovnkube-node-grkdn\" (UID: \"d8e1cb0d-8f4b-4e00-91bc-9d112926115c\") " pod="openshift-ovn-kubernetes/ovnkube-node-grkdn"
Jul 27 17:01:29.353475 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.353351    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6kb9\" (UniqueName: \"kubernetes.io/projected/8789c3a3-c9f7-43f1-8ea2-b279c80fe9a7-kube-api-access-l6kb9\") pod \"network-check-target-x5xw7\" (UID: \"8789c3a3-c9f7-43f1-8ea2-b279c80fe9a7\") " pod="openshift-network-diagnostics/network-check-target-x5xw7"
Jul 27 17:01:29.353475 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.353367    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f9a42d19-2eff-4160-a5ec-950fffedb6a3-multus-cni-dir\") pod \"multus-7h9zp\" (UID: \"f9a42d19-2eff-4160-a5ec-950fffedb6a3\") " pod="openshift-multus/multus-7h9zp"
Jul 27 17:01:29.353475 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.353383    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7834bc12-869c-4364-b081-1c665ba26024-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vlzgx\" (UID: \"7834bc12-869c-4364-b081-1c665ba26024\") " pod="openshift-multus/multus-additional-cni-plugins-vlzgx"
Jul 27 17:01:29.353475 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.353455    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f9a42d19-2eff-4160-a5ec-950fffedb6a3-multus-cni-dir\") pod \"multus-7h9zp\" (UID: \"f9a42d19-2eff-4160-a5ec-950fffedb6a3\") " pod="openshift-multus/multus-7h9zp"
Jul 27 17:01:29.353686 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.353516    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f9a42d19-2eff-4160-a5ec-950fffedb6a3-cni-binary-copy\") pod \"multus-7h9zp\" (UID: \"f9a42d19-2eff-4160-a5ec-950fffedb6a3\") " pod="openshift-multus/multus-7h9zp"
Jul 27 17:01:29.353686 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.353556    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f9a42d19-2eff-4160-a5ec-950fffedb6a3-multus-daemon-config\") pod \"multus-7h9zp\" (UID: \"f9a42d19-2eff-4160-a5ec-950fffedb6a3\") " pod="openshift-multus/multus-7h9zp"
Jul 27 17:01:29.353686 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.353581    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b162f98d-8b75-4f43-9e96-18587dae9d8d-socket-dir\") pod \"aws-ebs-csi-driver-node-8qwz2\" (UID: \"b162f98d-8b75-4f43-9e96-18587dae9d8d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8qwz2"
Jul 27 17:01:29.353686 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.353610    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d8e1cb0d-8f4b-4e00-91bc-9d112926115c-run-ovn\") pod \"ovnkube-node-grkdn\" (UID: \"d8e1cb0d-8f4b-4e00-91bc-9d112926115c\") " pod="openshift-ovn-kubernetes/ovnkube-node-grkdn"
Jul 27 17:01:29.353686 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.353636    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f9a42d19-2eff-4160-a5ec-950fffedb6a3-host-run-k8s-cni-cncf-io\") pod \"multus-7h9zp\" (UID: \"f9a42d19-2eff-4160-a5ec-950fffedb6a3\") " pod="openshift-multus/multus-7h9zp"
Jul 27 17:01:29.353686 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.353675    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h94jc\" (UniqueName: \"kubernetes.io/projected/b162f98d-8b75-4f43-9e96-18587dae9d8d-kube-api-access-h94jc\") pod \"aws-ebs-csi-driver-node-8qwz2\" (UID: \"b162f98d-8b75-4f43-9e96-18587dae9d8d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8qwz2"
Jul 27 17:01:29.354000 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.353704    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d8e1cb0d-8f4b-4e00-91bc-9d112926115c-etc-openvswitch\") pod \"ovnkube-node-grkdn\" (UID: \"d8e1cb0d-8f4b-4e00-91bc-9d112926115c\") " pod="openshift-ovn-kubernetes/ovnkube-node-grkdn"
Jul 27 17:01:29.354000 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.353699    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7834bc12-869c-4364-b081-1c665ba26024-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vlzgx\" (UID: \"7834bc12-869c-4364-b081-1c665ba26024\") " pod="openshift-multus/multus-additional-cni-plugins-vlzgx"
Jul 27 17:01:29.354000 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.353729    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d8e1cb0d-8f4b-4e00-91bc-9d112926115c-env-overrides\") pod \"ovnkube-node-grkdn\" (UID: \"d8e1cb0d-8f4b-4e00-91bc-9d112926115c\") " pod="openshift-ovn-kubernetes/ovnkube-node-grkdn"
Jul 27 17:01:29.354000 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.353761    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7834bc12-869c-4364-b081-1c665ba26024-cnibin\") pod \"multus-additional-cni-plugins-vlzgx\" (UID: \"7834bc12-869c-4364-b081-1c665ba26024\") " pod="openshift-multus/multus-additional-cni-plugins-vlzgx"
Jul 27 17:01:29.354000 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.353808    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d8e1cb0d-8f4b-4e00-91bc-9d112926115c-host-slash\") pod \"ovnkube-node-grkdn\" (UID: \"d8e1cb0d-8f4b-4e00-91bc-9d112926115c\") " pod="openshift-ovn-kubernetes/ovnkube-node-grkdn"
Jul 27 17:01:29.354000 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.353858    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d8e1cb0d-8f4b-4e00-91bc-9d112926115c-node-log\") pod \"ovnkube-node-grkdn\" (UID: \"d8e1cb0d-8f4b-4e00-91bc-9d112926115c\") " pod="openshift-ovn-kubernetes/ovnkube-node-grkdn"
Jul 27 17:01:29.354000 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.353903    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d8e1cb0d-8f4b-4e00-91bc-9d112926115c-ovn-node-metrics-cert\") pod \"ovnkube-node-grkdn\" (UID: \"d8e1cb0d-8f4b-4e00-91bc-9d112926115c\") " pod="openshift-ovn-kubernetes/ovnkube-node-grkdn"
Jul 27 17:01:29.354000 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.353938    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f9a42d19-2eff-4160-a5ec-950fffedb6a3-host-run-k8s-cni-cncf-io\") pod \"multus-7h9zp\" (UID: \"f9a42d19-2eff-4160-a5ec-950fffedb6a3\") " pod="openshift-multus/multus-7h9zp"
Jul 27 17:01:29.354000 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.353947    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f9a42d19-2eff-4160-a5ec-950fffedb6a3-multus-conf-dir\") pod \"multus-7h9zp\" (UID: \"f9a42d19-2eff-4160-a5ec-950fffedb6a3\") " pod="openshift-multus/multus-7h9zp"
Jul 27 17:01:29.354000 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.353987    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b162f98d-8b75-4f43-9e96-18587dae9d8d-device-dir\") pod \"aws-ebs-csi-driver-node-8qwz2\" (UID: \"b162f98d-8b75-4f43-9e96-18587dae9d8d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8qwz2"
Jul 27 17:01:29.354000 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.353995    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d8e1cb0d-8f4b-4e00-91bc-9d112926115c-ovnkube-config\") pod \"ovnkube-node-grkdn\" (UID: \"d8e1cb0d-8f4b-4e00-91bc-9d112926115c\") " pod="openshift-ovn-kubernetes/ovnkube-node-grkdn"
Jul 27 17:01:29.354563 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.354019    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f9a42d19-2eff-4160-a5ec-950fffedb6a3-cnibin\") pod \"multus-7h9zp\" (UID: \"f9a42d19-2eff-4160-a5ec-950fffedb6a3\") " pod="openshift-multus/multus-7h9zp"
Jul 27 17:01:29.354563 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.354040    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d8e1cb0d-8f4b-4e00-91bc-9d112926115c-host-slash\") pod \"ovnkube-node-grkdn\" (UID: \"d8e1cb0d-8f4b-4e00-91bc-9d112926115c\") " pod="openshift-ovn-kubernetes/ovnkube-node-grkdn"
Jul 27 17:01:29.354563 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.354047    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7834bc12-869c-4364-b081-1c665ba26024-os-release\") pod \"multus-additional-cni-plugins-vlzgx\" (UID: \"7834bc12-869c-4364-b081-1c665ba26024\") " pod="openshift-multus/multus-additional-cni-plugins-vlzgx"
Jul 27 17:01:29.354563 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.354079    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gfs9\" (UniqueName: \"kubernetes.io/projected/7834bc12-869c-4364-b081-1c665ba26024-kube-api-access-2gfs9\") pod \"multus-additional-cni-plugins-vlzgx\" (UID: \"7834bc12-869c-4364-b081-1c665ba26024\") " pod="openshift-multus/multus-additional-cni-plugins-vlzgx"
Jul 27 17:01:29.354563 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.354106    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7834bc12-869c-4364-b081-1c665ba26024-os-release\") pod \"multus-additional-cni-plugins-vlzgx\" (UID: \"7834bc12-869c-4364-b081-1c665ba26024\") " pod="openshift-multus/multus-additional-cni-plugins-vlzgx"
Jul 27 17:01:29.354563 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.354124    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b162f98d-8b75-4f43-9e96-18587dae9d8d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8qwz2\" (UID: \"b162f98d-8b75-4f43-9e96-18587dae9d8d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8qwz2"
Jul 27 17:01:29.354563 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.354154    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44pgh\" (UniqueName: \"kubernetes.io/projected/a5ae6ff9-02a8-4eac-abfc-5f113b100357-kube-api-access-44pgh\") pod \"iptables-alerter-4ksfn\" (UID: \"a5ae6ff9-02a8-4eac-abfc-5f113b100357\") " pod="openshift-network-operator/iptables-alerter-4ksfn"
Jul 27 17:01:29.354563 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.354197    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f9a42d19-2eff-4160-a5ec-950fffedb6a3-host-run-multus-certs\") pod \"multus-7h9zp\" (UID: \"f9a42d19-2eff-4160-a5ec-950fffedb6a3\") " pod="openshift-multus/multus-7h9zp"
Jul 27 17:01:29.354563 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.354212    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f9a42d19-2eff-4160-a5ec-950fffedb6a3-multus-daemon-config\") pod \"multus-7h9zp\" (UID: \"f9a42d19-2eff-4160-a5ec-950fffedb6a3\") " pod="openshift-multus/multus-7h9zp"
Jul 27 17:01:29.354563 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.354222    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b162f98d-8b75-4f43-9e96-18587dae9d8d-socket-dir\") pod \"aws-ebs-csi-driver-node-8qwz2\" (UID: \"b162f98d-8b75-4f43-9e96-18587dae9d8d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8qwz2"
Jul 27 17:01:29.354563 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.353902    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7834bc12-869c-4364-b081-1c665ba26024-cnibin\") pod \"multus-additional-cni-plugins-vlzgx\" (UID: \"7834bc12-869c-4364-b081-1c665ba26024\") " pod="openshift-multus/multus-additional-cni-plugins-vlzgx"
Jul 27 17:01:29.354563 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.354122    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d8e1cb0d-8f4b-4e00-91bc-9d112926115c-env-overrides\") pod \"ovnkube-node-grkdn\" (UID: \"d8e1cb0d-8f4b-4e00-91bc-9d112926115c\") " pod="openshift-ovn-kubernetes/ovnkube-node-grkdn"
Jul 27 17:01:29.354563 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.353991    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f9a42d19-2eff-4160-a5ec-950fffedb6a3-multus-conf-dir\") pod \"multus-7h9zp\" (UID: \"f9a42d19-2eff-4160-a5ec-950fffedb6a3\") " pod="openshift-multus/multus-7h9zp"
Jul 27 17:01:29.354563 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.354227    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f9a42d19-2eff-4160-a5ec-950fffedb6a3-etc-kubernetes\") pod \"multus-7h9zp\" (UID: \"f9a42d19-2eff-4160-a5ec-950fffedb6a3\") " pod="openshift-multus/multus-7h9zp"
Jul 27 17:01:29.354563 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.354306    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h845b\" (UniqueName: \"kubernetes.io/projected/f9a42d19-2eff-4160-a5ec-950fffedb6a3-kube-api-access-h845b\") pod \"multus-7h9zp\" (UID: \"f9a42d19-2eff-4160-a5ec-950fffedb6a3\") " pod="openshift-multus/multus-7h9zp"
Jul 27 17:01:29.354563 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.354315    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f9a42d19-2eff-4160-a5ec-950fffedb6a3-host-run-multus-certs\") pod \"multus-7h9zp\" (UID: \"f9a42d19-2eff-4160-a5ec-950fffedb6a3\") " pod="openshift-multus/multus-7h9zp"
Jul 27 17:01:29.354563 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.354280    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b162f98d-8b75-4f43-9e96-18587dae9d8d-device-dir\") pod \"aws-ebs-csi-driver-node-8qwz2\" (UID: \"b162f98d-8b75-4f43-9e96-18587dae9d8d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8qwz2"
Jul 27 17:01:29.355420 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.354334    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f9a42d19-2eff-4160-a5ec-950fffedb6a3-cnibin\") pod \"multus-7h9zp\" (UID: \"f9a42d19-2eff-4160-a5ec-950fffedb6a3\") " pod="openshift-multus/multus-7h9zp"
Jul 27 17:01:29.355420 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.354337    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d8e1cb0d-8f4b-4e00-91bc-9d112926115c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-grkdn\" (UID: \"d8e1cb0d-8f4b-4e00-91bc-9d112926115c\") " pod="openshift-ovn-kubernetes/ovnkube-node-grkdn"
Jul 27 17:01:29.355420 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.354362    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d8e1cb0d-8f4b-4e00-91bc-9d112926115c-run-ovn\") pod \"ovnkube-node-grkdn\" (UID: \"d8e1cb0d-8f4b-4e00-91bc-9d112926115c\") " pod="openshift-ovn-kubernetes/ovnkube-node-grkdn"
Jul 27 17:01:29.355420 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.354392    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f9a42d19-2eff-4160-a5ec-950fffedb6a3-host-var-lib-kubelet\") pod \"multus-7h9zp\" (UID: \"f9a42d19-2eff-4160-a5ec-950fffedb6a3\") " pod="openshift-multus/multus-7h9zp"
Jul 27 17:01:29.355420 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.354421    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d8e1cb0d-8f4b-4e00-91bc-9d112926115c-node-log\") pod \"ovnkube-node-grkdn\" (UID: \"d8e1cb0d-8f4b-4e00-91bc-9d112926115c\") " pod="openshift-ovn-kubernetes/ovnkube-node-grkdn"
Jul 27 17:01:29.355420 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.354421    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d8e1cb0d-8f4b-4e00-91bc-9d112926115c-run-systemd\") pod \"ovnkube-node-grkdn\" (UID: \"d8e1cb0d-8f4b-4e00-91bc-9d112926115c\") " pod="openshift-ovn-kubernetes/ovnkube-node-grkdn"
Jul 27 17:01:29.355420 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.354452    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d8e1cb0d-8f4b-4e00-91bc-9d112926115c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-grkdn\" (UID: \"d8e1cb0d-8f4b-4e00-91bc-9d112926115c\") " pod="openshift-ovn-kubernetes/ovnkube-node-grkdn"
Jul 27 17:01:29.355420 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.354463    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f9a42d19-2eff-4160-a5ec-950fffedb6a3-host-run-netns\") pod \"multus-7h9zp\" (UID: \"f9a42d19-2eff-4160-a5ec-950fffedb6a3\") " pod="openshift-multus/multus-7h9zp"
Jul 27 17:01:29.355420 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.354479    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d8e1cb0d-8f4b-4e00-91bc-9d112926115c-run-systemd\") pod \"ovnkube-node-grkdn\" (UID: \"d8e1cb0d-8f4b-4e00-91bc-9d112926115c\") " pod="openshift-ovn-kubernetes/ovnkube-node-grkdn"
Jul 27 17:01:29.355420 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.354498    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f9a42d19-2eff-4160-a5ec-950fffedb6a3-hostroot\") pod \"multus-7h9zp\" (UID: \"f9a42d19-2eff-4160-a5ec-950fffedb6a3\") " pod="openshift-multus/multus-7h9zp"
Jul 27 17:01:29.355420 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.354528    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f9a42d19-2eff-4160-a5ec-950fffedb6a3-etc-kubernetes\") pod \"multus-7h9zp\" (UID: \"f9a42d19-2eff-4160-a5ec-950fffedb6a3\") " pod="openshift-multus/multus-7h9zp"
Jul 27 17:01:29.355420 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.354529    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7834bc12-869c-4364-b081-1c665ba26024-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vlzgx\" (UID: \"7834bc12-869c-4364-b081-1c665ba26024\") " pod="openshift-multus/multus-additional-cni-plugins-vlzgx"
Jul 27 17:01:29.355420 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.354546    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d8e1cb0d-8f4b-4e00-91bc-9d112926115c-etc-openvswitch\") pod \"ovnkube-node-grkdn\" (UID: \"d8e1cb0d-8f4b-4e00-91bc-9d112926115c\") " pod="openshift-ovn-kubernetes/ovnkube-node-grkdn"
Jul 27 17:01:29.355420 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.354544    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f9a42d19-2eff-4160-a5ec-950fffedb6a3-host-var-lib-kubelet\") pod \"multus-7h9zp\" (UID: \"f9a42d19-2eff-4160-a5ec-950fffedb6a3\") " pod="openshift-multus/multus-7h9zp"
Jul 27 17:01:29.355420 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.354502    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f9a42d19-2eff-4160-a5ec-950fffedb6a3-host-run-netns\") pod \"multus-7h9zp\" (UID: \"f9a42d19-2eff-4160-a5ec-950fffedb6a3\") " pod="openshift-multus/multus-7h9zp"
Jul 27 17:01:29.355420 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.354596    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b162f98d-8b75-4f43-9e96-18587dae9d8d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8qwz2\" (UID: \"b162f98d-8b75-4f43-9e96-18587dae9d8d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8qwz2"
Jul 27 17:01:29.355420 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.354732    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f9a42d19-2eff-4160-a5ec-950fffedb6a3-hostroot\") pod \"multus-7h9zp\" (UID: \"f9a42d19-2eff-4160-a5ec-950fffedb6a3\") " pod="openshift-multus/multus-7h9zp"
Jul 27 17:01:29.355420 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.354742    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d8e1cb0d-8f4b-4e00-91bc-9d112926115c-run-openvswitch\") pod \"ovnkube-node-grkdn\" (UID: \"d8e1cb0d-8f4b-4e00-91bc-9d112926115c\") " pod="openshift-ovn-kubernetes/ovnkube-node-grkdn"
Jul 27 17:01:29.356303 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.354768    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d8e1cb0d-8f4b-4e00-91bc-9d112926115c-run-openvswitch\") pod \"ovnkube-node-grkdn\" (UID: \"d8e1cb0d-8f4b-4e00-91bc-9d112926115c\") " pod="openshift-ovn-kubernetes/ovnkube-node-grkdn"
Jul 27 17:01:29.356303 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.354771    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f9a42d19-2eff-4160-a5ec-950fffedb6a3-system-cni-dir\") pod \"multus-7h9zp\" (UID: \"f9a42d19-2eff-4160-a5ec-950fffedb6a3\") " pod="openshift-multus/multus-7h9zp"
Jul 27 17:01:29.356303 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.354798    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f9a42d19-2eff-4160-a5ec-950fffedb6a3-host-var-lib-cni-bin\") pod \"multus-7h9zp\" (UID: \"f9a42d19-2eff-4160-a5ec-950fffedb6a3\") " pod="openshift-multus/multus-7h9zp"
Jul 27 17:01:29.356303 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.354844    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f9a42d19-2eff-4160-a5ec-950fffedb6a3-cni-binary-copy\") pod \"multus-7h9zp\" (UID: \"f9a42d19-2eff-4160-a5ec-950fffedb6a3\") " pod="openshift-multus/multus-7h9zp"
Jul 27 17:01:29.356303 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.354850    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7834bc12-869c-4364-b081-1c665ba26024-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vlzgx\" (UID: \"7834bc12-869c-4364-b081-1c665ba26024\") " pod="openshift-multus/multus-additional-cni-plugins-vlzgx"
Jul 27 17:01:29.356303 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.354870    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f9a42d19-2eff-4160-a5ec-950fffedb6a3-host-var-lib-cni-bin\") pod \"multus-7h9zp\" (UID: \"f9a42d19-2eff-4160-a5ec-950fffedb6a3\") " pod="openshift-multus/multus-7h9zp"
Jul 27 17:01:29.356303 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.354874    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f9a42d19-2eff-4160-a5ec-950fffedb6a3-system-cni-dir\") pod \"multus-7h9zp\" (UID: \"f9a42d19-2eff-4160-a5ec-950fffedb6a3\") " pod="openshift-multus/multus-7h9zp"
Jul 27 17:01:29.356303 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.354879    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b162f98d-8b75-4f43-9e96-18587dae9d8d-sys-fs\") pod \"aws-ebs-csi-driver-node-8qwz2\" (UID: \"b162f98d-8b75-4f43-9e96-18587dae9d8d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8qwz2"
Jul 27 17:01:29.356303 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.354940    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7834bc12-869c-4364-b081-1c665ba26024-cni-binary-copy\") pod \"multus-additional-cni-plugins-vlzgx\" (UID: \"7834bc12-869c-4364-b081-1c665ba26024\") " pod="openshift-multus/multus-additional-cni-plugins-vlzgx"
Jul 27 17:01:29.356303 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.354973    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b162f98d-8b75-4f43-9e96-18587dae9d8d-sys-fs\") pod \"aws-ebs-csi-driver-node-8qwz2\" (UID: \"b162f98d-8b75-4f43-9e96-18587dae9d8d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8qwz2"
Jul 27 17:01:29.356303 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.354974    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f9a42d19-2eff-4160-a5ec-950fffedb6a3-multus-socket-dir-parent\") pod \"multus-7h9zp\" (UID: \"f9a42d19-2eff-4160-a5ec-950fffedb6a3\") " pod="openshift-multus/multus-7h9zp"
Jul 27 17:01:29.356303 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.355009    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b162f98d-8b75-4f43-9e96-18587dae9d8d-etc-selinux\") pod \"aws-ebs-csi-driver-node-8qwz2\" (UID: \"b162f98d-8b75-4f43-9e96-18587dae9d8d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8qwz2"
Jul 27 17:01:29.356303 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.355025    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f9a42d19-2eff-4160-a5ec-950fffedb6a3-multus-socket-dir-parent\") pod \"multus-7h9zp\" (UID: \"f9a42d19-2eff-4160-a5ec-950fffedb6a3\") " pod="openshift-multus/multus-7h9zp"
Jul 27 17:01:29.356303 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.355040    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a5ae6ff9-02a8-4eac-abfc-5f113b100357-host-slash\") pod \"iptables-alerter-4ksfn\" (UID: \"a5ae6ff9-02a8-4eac-abfc-5f113b100357\") " pod="openshift-network-operator/iptables-alerter-4ksfn"
Jul 27 17:01:29.356303 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.355069    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d8e1cb0d-8f4b-4e00-91bc-9d112926115c-host-run-netns\") pod \"ovnkube-node-grkdn\" (UID: \"d8e1cb0d-8f4b-4e00-91bc-9d112926115c\") " pod="openshift-ovn-kubernetes/ovnkube-node-grkdn"
Jul 27 17:01:29.356303 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.355128    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a5ae6ff9-02a8-4eac-abfc-5f113b100357-host-slash\") pod \"iptables-alerter-4ksfn\" (UID: \"a5ae6ff9-02a8-4eac-abfc-5f113b100357\") " pod="openshift-network-operator/iptables-alerter-4ksfn"
Jul 27 17:01:29.356303 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.355140    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7834bc12-869c-4364-b081-1c665ba26024-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vlzgx\" (UID: \"7834bc12-869c-4364-b081-1c665ba26024\") " pod="openshift-multus/multus-additional-cni-plugins-vlzgx"
Jul 27 17:01:29.357009 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.355141    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b162f98d-8b75-4f43-9e96-18587dae9d8d-etc-selinux\") pod \"aws-ebs-csi-driver-node-8qwz2\" (UID: \"b162f98d-8b75-4f43-9e96-18587dae9d8d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8qwz2"
Jul 27 17:01:29.357009 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.355163    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d8e1cb0d-8f4b-4e00-91bc-9d112926115c-host-run-netns\") pod \"ovnkube-node-grkdn\" (UID: \"d8e1cb0d-8f4b-4e00-91bc-9d112926115c\") " pod="openshift-ovn-kubernetes/ovnkube-node-grkdn"
Jul 27 17:01:29.357009 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.355179    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d8e1cb0d-8f4b-4e00-91bc-9d112926115c-host-run-ovn-kubernetes\") pod \"ovnkube-node-grkdn\" (UID: \"d8e1cb0d-8f4b-4e00-91bc-9d112926115c\") " pod="openshift-ovn-kubernetes/ovnkube-node-grkdn"
Jul 27 17:01:29.357009 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.355219    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f9a42d19-2eff-4160-a5ec-950fffedb6a3-os-release\") pod \"multus-7h9zp\" (UID: \"f9a42d19-2eff-4160-a5ec-950fffedb6a3\") " pod="openshift-multus/multus-7h9zp"
Jul 27 17:01:29.357009 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.355265    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d8e1cb0d-8f4b-4e00-91bc-9d112926115c-host-run-ovn-kubernetes\") pod \"ovnkube-node-grkdn\" (UID: \"d8e1cb0d-8f4b-4e00-91bc-9d112926115c\") " pod="openshift-ovn-kubernetes/ovnkube-node-grkdn"
Jul 27 17:01:29.357009 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.355267    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a5ae6ff9-02a8-4eac-abfc-5f113b100357-iptables-alerter-script\") pod \"iptables-alerter-4ksfn\" (UID: \"a5ae6ff9-02a8-4eac-abfc-5f113b100357\") " pod="openshift-network-operator/iptables-alerter-4ksfn"
Jul 27 17:01:29.357009 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.355346    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d8e1cb0d-8f4b-4e00-91bc-9d112926115c-systemd-units\") pod \"ovnkube-node-grkdn\" (UID: \"d8e1cb0d-8f4b-4e00-91bc-9d112926115c\") " pod="openshift-ovn-kubernetes/ovnkube-node-grkdn"
Jul 27 17:01:29.357009 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.355370    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f9a42d19-2eff-4160-a5ec-950fffedb6a3-os-release\") pod \"multus-7h9zp\" (UID: \"f9a42d19-2eff-4160-a5ec-950fffedb6a3\") " pod="openshift-multus/multus-7h9zp"
Jul 27 17:01:29.357009 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.355386    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d8e1cb0d-8f4b-4e00-91bc-9d112926115c-var-lib-openvswitch\") pod \"ovnkube-node-grkdn\" (UID: \"d8e1cb0d-8f4b-4e00-91bc-9d112926115c\") " pod="openshift-ovn-kubernetes/ovnkube-node-grkdn"
Jul 27 17:01:29.357009 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.355414    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-glpq8\" (UniqueName: \"kubernetes.io/projected/d8e1cb0d-8f4b-4e00-91bc-9d112926115c-kube-api-access-glpq8\") pod \"ovnkube-node-grkdn\" (UID: \"d8e1cb0d-8f4b-4e00-91bc-9d112926115c\") " pod="openshift-ovn-kubernetes/ovnkube-node-grkdn"
Jul 27 17:01:29.357009 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.355428    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7834bc12-869c-4364-b081-1c665ba26024-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vlzgx\" (UID: \"7834bc12-869c-4364-b081-1c665ba26024\") " pod="openshift-multus/multus-additional-cni-plugins-vlzgx"
Jul 27 17:01:29.357009 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.355440    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f9a42d19-2eff-4160-a5ec-950fffedb6a3-host-var-lib-cni-multus\") pod \"multus-7h9zp\" (UID: \"f9a42d19-2eff-4160-a5ec-950fffedb6a3\") " pod="openshift-multus/multus-7h9zp"
Jul 27 17:01:29.357009 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.355419    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d8e1cb0d-8f4b-4e00-91bc-9d112926115c-systemd-units\") pod \"ovnkube-node-grkdn\" (UID: \"d8e1cb0d-8f4b-4e00-91bc-9d112926115c\") " pod="openshift-ovn-kubernetes/ovnkube-node-grkdn"
Jul 27 17:01:29.357009 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.355468    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7834bc12-869c-4364-b081-1c665ba26024-system-cni-dir\") pod \"multus-additional-cni-plugins-vlzgx\" (UID: \"7834bc12-869c-4364-b081-1c665ba26024\") " pod="openshift-multus/multus-additional-cni-plugins-vlzgx"
Jul 27 17:01:29.357009 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.355474    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d8e1cb0d-8f4b-4e00-91bc-9d112926115c-var-lib-openvswitch\") pod \"ovnkube-node-grkdn\" (UID: \"d8e1cb0d-8f4b-4e00-91bc-9d112926115c\") " pod="openshift-ovn-kubernetes/ovnkube-node-grkdn"
Jul 27 17:01:29.357009 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.355499    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d8e1cb0d-8f4b-4e00-91bc-9d112926115c-host-kubelet\") pod \"ovnkube-node-grkdn\" (UID: \"d8e1cb0d-8f4b-4e00-91bc-9d112926115c\") " pod="openshift-ovn-kubernetes/ovnkube-node-grkdn"
Jul 27 17:01:29.357009 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.355510    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f9a42d19-2eff-4160-a5ec-950fffedb6a3-host-var-lib-cni-multus\") pod \"multus-7h9zp\" (UID: \"f9a42d19-2eff-4160-a5ec-950fffedb6a3\") " pod="openshift-multus/multus-7h9zp"
Jul 27 17:01:29.357597 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.355524    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d8e1cb0d-8f4b-4e00-91bc-9d112926115c-log-socket\") pod \"ovnkube-node-grkdn\" (UID: \"d8e1cb0d-8f4b-4e00-91bc-9d112926115c\") " pod="openshift-ovn-kubernetes/ovnkube-node-grkdn"
Jul 27 17:01:29.357597 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.355542    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7834bc12-869c-4364-b081-1c665ba26024-cni-binary-copy\") pod \"multus-additional-cni-plugins-vlzgx\" (UID: \"7834bc12-869c-4364-b081-1c665ba26024\") " pod="openshift-multus/multus-additional-cni-plugins-vlzgx"
Jul 27 17:01:29.357597 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.355564    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d8e1cb0d-8f4b-4e00-91bc-9d112926115c-log-socket\") pod \"ovnkube-node-grkdn\" (UID: \"d8e1cb0d-8f4b-4e00-91bc-9d112926115c\") " pod="openshift-ovn-kubernetes/ovnkube-node-grkdn"
Jul 27 17:01:29.357597 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.355525    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7834bc12-869c-4364-b081-1c665ba26024-system-cni-dir\") pod \"multus-additional-cni-plugins-vlzgx\" (UID: \"7834bc12-869c-4364-b081-1c665ba26024\") " pod="openshift-multus/multus-additional-cni-plugins-vlzgx"
Jul 27 17:01:29.357597 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.355570    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d8e1cb0d-8f4b-4e00-91bc-9d112926115c-host-cni-bin\") pod \"ovnkube-node-grkdn\" (UID: \"d8e1cb0d-8f4b-4e00-91bc-9d112926115c\") " pod="openshift-ovn-kubernetes/ovnkube-node-grkdn"
Jul 27 17:01:29.357597 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.355584    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d8e1cb0d-8f4b-4e00-91bc-9d112926115c-host-kubelet\") pod \"ovnkube-node-grkdn\" (UID: \"d8e1cb0d-8f4b-4e00-91bc-9d112926115c\") " pod="openshift-ovn-kubernetes/ovnkube-node-grkdn"
Jul 27 17:01:29.357597 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.355612    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d8e1cb0d-8f4b-4e00-91bc-9d112926115c-ovnkube-script-lib\") pod \"ovnkube-node-grkdn\" (UID: \"d8e1cb0d-8f4b-4e00-91bc-9d112926115c\") " pod="openshift-ovn-kubernetes/ovnkube-node-grkdn"
Jul 27 17:01:29.357597 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.355613    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d8e1cb0d-8f4b-4e00-91bc-9d112926115c-host-cni-bin\") pod \"ovnkube-node-grkdn\" (UID: \"d8e1cb0d-8f4b-4e00-91bc-9d112926115c\") " pod="openshift-ovn-kubernetes/ovnkube-node-grkdn"
Jul 27 17:01:29.357597 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.355692    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b162f98d-8b75-4f43-9e96-18587dae9d8d-registration-dir\") pod \"aws-ebs-csi-driver-node-8qwz2\" (UID: \"b162f98d-8b75-4f43-9e96-18587dae9d8d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8qwz2"
Jul 27 17:01:29.357597 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.355752    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d8e1cb0d-8f4b-4e00-91bc-9d112926115c-host-cni-netd\") pod \"ovnkube-node-grkdn\" (UID: \"d8e1cb0d-8f4b-4e00-91bc-9d112926115c\") " pod="openshift-ovn-kubernetes/ovnkube-node-grkdn"
Jul 27 17:01:29.357597 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.355820    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d8e1cb0d-8f4b-4e00-91bc-9d112926115c-host-cni-netd\") pod \"ovnkube-node-grkdn\" (UID: \"d8e1cb0d-8f4b-4e00-91bc-9d112926115c\") " pod="openshift-ovn-kubernetes/ovnkube-node-grkdn"
Jul 27 17:01:29.357597 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.355860    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b162f98d-8b75-4f43-9e96-18587dae9d8d-registration-dir\") pod \"aws-ebs-csi-driver-node-8qwz2\" (UID: \"b162f98d-8b75-4f43-9e96-18587dae9d8d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8qwz2"
Jul 27 17:01:29.357597 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.356168    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d8e1cb0d-8f4b-4e00-91bc-9d112926115c-ovnkube-script-lib\") pod \"ovnkube-node-grkdn\" (UID: \"d8e1cb0d-8f4b-4e00-91bc-9d112926115c\") " pod="openshift-ovn-kubernetes/ovnkube-node-grkdn"
Jul 27 17:01:29.357597 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.356447    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a5ae6ff9-02a8-4eac-abfc-5f113b100357-iptables-alerter-script\") pod \"iptables-alerter-4ksfn\" (UID: \"a5ae6ff9-02a8-4eac-abfc-5f113b100357\") " pod="openshift-network-operator/iptables-alerter-4ksfn"
Jul 27 17:01:29.357597 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.356540    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d8e1cb0d-8f4b-4e00-91bc-9d112926115c-ovn-node-metrics-cert\") pod \"ovnkube-node-grkdn\" (UID: \"d8e1cb0d-8f4b-4e00-91bc-9d112926115c\") " pod="openshift-ovn-kubernetes/ovnkube-node-grkdn"
Jul 27 17:01:29.375151 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:01:29.375097    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 17:01:29.375151 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:01:29.375119    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 17:01:29.375151 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:01:29.375132    2580 projected.go:196] Error preparing data for projected volume kube-api-access-l6kb9 for pod openshift-network-diagnostics/network-check-target-x5xw7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 17:01:29.375359 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:01:29.375215    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8789c3a3-c9f7-43f1-8ea2-b279c80fe9a7-kube-api-access-l6kb9 podName:8789c3a3-c9f7-43f1-8ea2-b279c80fe9a7 nodeName:}" failed. No retries permitted until 2026-07-27 17:01:29.875197599 +0000 UTC m=+3.071942401 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-l6kb9" (UniqueName: "kubernetes.io/projected/8789c3a3-c9f7-43f1-8ea2-b279c80fe9a7-kube-api-access-l6kb9") pod "network-check-target-x5xw7" (UID: "8789c3a3-c9f7-43f1-8ea2-b279c80fe9a7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 17:01:29.381952 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.381923    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-44pgh\" (UniqueName: \"kubernetes.io/projected/a5ae6ff9-02a8-4eac-abfc-5f113b100357-kube-api-access-44pgh\") pod \"iptables-alerter-4ksfn\" (UID: \"a5ae6ff9-02a8-4eac-abfc-5f113b100357\") " pod="openshift-network-operator/iptables-alerter-4ksfn"
Jul 27 17:01:29.382292 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.382268    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h845b\" (UniqueName: \"kubernetes.io/projected/f9a42d19-2eff-4160-a5ec-950fffedb6a3-kube-api-access-h845b\") pod \"multus-7h9zp\" (UID: \"f9a42d19-2eff-4160-a5ec-950fffedb6a3\") " pod="openshift-multus/multus-7h9zp"
Jul 27 17:01:29.382883 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.382847    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h94jc\" (UniqueName: \"kubernetes.io/projected/b162f98d-8b75-4f43-9e96-18587dae9d8d-kube-api-access-h94jc\") pod \"aws-ebs-csi-driver-node-8qwz2\" (UID: \"b162f98d-8b75-4f43-9e96-18587dae9d8d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8qwz2"
Jul 27 17:01:29.383525 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.383502    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-glpq8\" (UniqueName: \"kubernetes.io/projected/d8e1cb0d-8f4b-4e00-91bc-9d112926115c-kube-api-access-glpq8\") pod \"ovnkube-node-grkdn\" (UID: \"d8e1cb0d-8f4b-4e00-91bc-9d112926115c\") " pod="openshift-ovn-kubernetes/ovnkube-node-grkdn"
Jul 27 17:01:29.383846 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.383825    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gfs9\" (UniqueName: \"kubernetes.io/projected/7834bc12-869c-4364-b081-1c665ba26024-kube-api-access-2gfs9\") pod \"multus-additional-cni-plugins-vlzgx\" (UID: \"7834bc12-869c-4364-b081-1c665ba26024\") " pod="openshift-multus/multus-additional-cni-plugins-vlzgx"
Jul 27 17:01:29.403153 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.403135    2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 17:01:29.449039 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.449011    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-jv9gw"
Jul 27 17:01:29.456716 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.456696    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gdxlg"
Jul 27 17:01:29.465519 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.465502    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-kt2nr"
Jul 27 17:01:29.468538 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:29.468518    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48eef739_faf5_48db_a1ef_c47a4b6971bd.slice/crio-00d723d750638a1a846a3cf4ce2ba491818b1b6e055a8b39cd02ec875635f2f0 WatchSource:0}: Error finding container 00d723d750638a1a846a3cf4ce2ba491818b1b6e055a8b39cd02ec875635f2f0: Status 404 returned error can't find the container with id 00d723d750638a1a846a3cf4ce2ba491818b1b6e055a8b39cd02ec875635f2f0
Jul 27 17:01:29.470651 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.470634    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-dk4md"
Jul 27 17:01:29.477680 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:29.477659    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e5b6418_be32_4e11_88d2_929d0f6f52d6.slice/crio-cfb43fe456b0a438a7d0a0aacadbf5095e0dff93a84a692edc14eae5021def01 WatchSource:0}: Error finding container cfb43fe456b0a438a7d0a0aacadbf5095e0dff93a84a692edc14eae5021def01: Status 404 returned error can't find the container with id cfb43fe456b0a438a7d0a0aacadbf5095e0dff93a84a692edc14eae5021def01
Jul 27 17:01:29.479077 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:29.479056    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ed8e5dc_750b_42d0_86b3_7d1e6802c992.slice/crio-a6f387e5646ddc70e4dff72f0057642012e213caee396b2950c74f71ec0f179d WatchSource:0}: Error finding container a6f387e5646ddc70e4dff72f0057642012e213caee396b2950c74f71ec0f179d: Status 404 returned error can't find the container with id a6f387e5646ddc70e4dff72f0057642012e213caee396b2950c74f71ec0f179d
Jul 27 17:01:29.479933 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.479906    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4ksfn"
Jul 27 17:01:29.481424 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:29.481403    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0bb4594a_a23f_4e66_a579_087b20377307.slice/crio-7c93e3601ecddefa35d9523db856e1a7503c9765742dc9609cea22b14ac0e154 WatchSource:0}: Error finding container 7c93e3601ecddefa35d9523db856e1a7503c9765742dc9609cea22b14ac0e154: Status 404 returned error can't find the container with id 7c93e3601ecddefa35d9523db856e1a7503c9765742dc9609cea22b14ac0e154
Jul 27 17:01:29.487221 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.487069    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7h9zp"
Jul 27 17:01:29.489787 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:29.489761    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5ae6ff9_02a8_4eac_abfc_5f113b100357.slice/crio-a62a1d4d475fe12075eb3abd86c8d09230eb26cd955835e0c2d6ab493eeda2c2 WatchSource:0}: Error finding container a62a1d4d475fe12075eb3abd86c8d09230eb26cd955835e0c2d6ab493eeda2c2: Status 404 returned error can't find the container with id a62a1d4d475fe12075eb3abd86c8d09230eb26cd955835e0c2d6ab493eeda2c2
Jul 27 17:01:29.492685 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.492668    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-vlzgx"
Jul 27 17:01:29.496824 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:29.496802    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9a42d19_2eff_4160_a5ec_950fffedb6a3.slice/crio-a6242a7b7813b03444b1b81577f3d517221eae0eb7484634abc4f0fd4cf0efdf WatchSource:0}: Error finding container a6242a7b7813b03444b1b81577f3d517221eae0eb7484634abc4f0fd4cf0efdf: Status 404 returned error can't find the container with id a6242a7b7813b03444b1b81577f3d517221eae0eb7484634abc4f0fd4cf0efdf
Jul 27 17:01:29.500432 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.500416    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-grkdn"
Jul 27 17:01:29.503342 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:29.503323    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7834bc12_869c_4364_b081_1c665ba26024.slice/crio-c9d86c5823ea4aa19552a5f03454428e536309e87339875a2a1c4bba6752d143 WatchSource:0}: Error finding container c9d86c5823ea4aa19552a5f03454428e536309e87339875a2a1c4bba6752d143: Status 404 returned error can't find the container with id c9d86c5823ea4aa19552a5f03454428e536309e87339875a2a1c4bba6752d143
Jul 27 17:01:29.505887 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.505853    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8qwz2"
Jul 27 17:01:29.509450 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:29.509429    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8e1cb0d_8f4b_4e00_91bc_9d112926115c.slice/crio-b59362d2f6cd385f81035a0242cd82038c132f881d93c619ddf01fa4a360e245 WatchSource:0}: Error finding container b59362d2f6cd385f81035a0242cd82038c132f881d93c619ddf01fa4a360e245: Status 404 returned error can't find the container with id b59362d2f6cd385f81035a0242cd82038c132f881d93c619ddf01fa4a360e245
Jul 27 17:01:29.515399 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:29.515382    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb162f98d_8b75_4f43_9e96_18587dae9d8d.slice/crio-49309a43fcf71a2cfba6c44fdf2b2d3176c3705c37d7f3229a3558e8a5957799 WatchSource:0}: Error finding container 49309a43fcf71a2cfba6c44fdf2b2d3176c3705c37d7f3229a3558e8a5957799: Status 404 returned error can't find the container with id 49309a43fcf71a2cfba6c44fdf2b2d3176c3705c37d7f3229a3558e8a5957799
Jul 27 17:01:29.759080 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.759055    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d26abfd5-3102-42ec-a7e0-c5abe0e9dc85-metrics-certs\") pod \"network-metrics-daemon-s5bhd\" (UID: \"d26abfd5-3102-42ec-a7e0-c5abe0e9dc85\") " pod="openshift-multus/network-metrics-daemon-s5bhd"
Jul 27 17:01:29.759164 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.759123    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2b793cd9-1cc7-4f3b-b882-1999e673076d-original-pull-secret\") pod \"global-pull-secret-syncer-g6775\" (UID: \"2b793cd9-1cc7-4f3b-b882-1999e673076d\") " pod="kube-system/global-pull-secret-syncer-g6775"
Jul 27 17:01:29.759220 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:01:29.759206    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 17:01:29.759270 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:01:29.759261    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b793cd9-1cc7-4f3b-b882-1999e673076d-original-pull-secret podName:2b793cd9-1cc7-4f3b-b882-1999e673076d nodeName:}" failed. No retries permitted until 2026-07-27 17:01:30.759248138 +0000 UTC m=+3.955992935 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2b793cd9-1cc7-4f3b-b882-1999e673076d-original-pull-secret") pod "global-pull-secret-syncer-g6775" (UID: "2b793cd9-1cc7-4f3b-b882-1999e673076d") : object "kube-system"/"original-pull-secret" not registered
Jul 27 17:01:29.759314 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:01:29.759206    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 17:01:29.759344 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:01:29.759339    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d26abfd5-3102-42ec-a7e0-c5abe0e9dc85-metrics-certs podName:d26abfd5-3102-42ec-a7e0-c5abe0e9dc85 nodeName:}" failed. No retries permitted until 2026-07-27 17:01:30.75932648 +0000 UTC m=+3.956071275 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d26abfd5-3102-42ec-a7e0-c5abe0e9dc85-metrics-certs") pod "network-metrics-daemon-s5bhd" (UID: "d26abfd5-3102-42ec-a7e0-c5abe0e9dc85") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 17:01:29.960396 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:29.960235    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6kb9\" (UniqueName: \"kubernetes.io/projected/8789c3a3-c9f7-43f1-8ea2-b279c80fe9a7-kube-api-access-l6kb9\") pod \"network-check-target-x5xw7\" (UID: \"8789c3a3-c9f7-43f1-8ea2-b279c80fe9a7\") " pod="openshift-network-diagnostics/network-check-target-x5xw7"
Jul 27 17:01:29.960553 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:01:29.960440    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 17:01:29.960553 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:01:29.960465    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 17:01:29.960553 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:01:29.960478    2580 projected.go:196] Error preparing data for projected volume kube-api-access-l6kb9 for pod openshift-network-diagnostics/network-check-target-x5xw7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 17:01:29.960553 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:01:29.960542    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8789c3a3-c9f7-43f1-8ea2-b279c80fe9a7-kube-api-access-l6kb9 podName:8789c3a3-c9f7-43f1-8ea2-b279c80fe9a7 nodeName:}" failed. No retries permitted until 2026-07-27 17:01:30.960521393 +0000 UTC m=+4.157266192 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-l6kb9" (UniqueName: "kubernetes.io/projected/8789c3a3-c9f7-43f1-8ea2-b279c80fe9a7-kube-api-access-l6kb9") pod "network-check-target-x5xw7" (UID: "8789c3a3-c9f7-43f1-8ea2-b279c80fe9a7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 17:01:30.003015 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:30.002984    2580 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 17:01:30.194864 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:30.194787    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-26 16:56:29 +0000 UTC" deadline="2028-04-10 02:43:22.247783562 +0000 UTC"
Jul 27 17:01:30.195616 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:30.194862    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14937h41m52.052926167s"
Jul 27 17:01:30.265641 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:30.264945    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5xw7"
Jul 27 17:01:30.265641 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:01:30.265065    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x5xw7" podUID="8789c3a3-c9f7-43f1-8ea2-b279c80fe9a7"
Jul 27 17:01:30.265641 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:30.265462    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g6775"
Jul 27 17:01:30.265641 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:01:30.265563    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g6775" podUID="2b793cd9-1cc7-4f3b-b882-1999e673076d"
Jul 27 17:01:30.277589 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:30.277017    2580 generic.go:356] "Generic (PLEG): container finished" podID="33da85977499fd84717c6ccc4c4fa1cd" containerID="d078b68110601a9ee78dd03cd70a0de41d643a9c6f3af26990afa18e9fad4eaa" exitCode=0
Jul 27 17:01:30.277589 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:30.277269    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-134.ec2.internal" event={"ID":"33da85977499fd84717c6ccc4c4fa1cd","Type":"ContainerDied","Data":"d078b68110601a9ee78dd03cd70a0de41d643a9c6f3af26990afa18e9fad4eaa"}
Jul 27 17:01:30.280042 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:30.280019    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8qwz2" event={"ID":"b162f98d-8b75-4f43-9e96-18587dae9d8d","Type":"ContainerStarted","Data":"49309a43fcf71a2cfba6c44fdf2b2d3176c3705c37d7f3229a3558e8a5957799"}
Jul 27 17:01:30.286491 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:30.285494    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-kt2nr" event={"ID":"0ed8e5dc-750b-42d0-86b3-7d1e6802c992","Type":"ContainerStarted","Data":"a6f387e5646ddc70e4dff72f0057642012e213caee396b2950c74f71ec0f179d"}
Jul 27 17:01:30.289768 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:30.289665    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-jv9gw" event={"ID":"48eef739-faf5-48db-a1ef-c47a4b6971bd","Type":"ContainerStarted","Data":"00d723d750638a1a846a3cf4ce2ba491818b1b6e055a8b39cd02ec875635f2f0"}
Jul 27 17:01:30.291438 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:30.291303    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-grkdn" event={"ID":"d8e1cb0d-8f4b-4e00-91bc-9d112926115c","Type":"ContainerStarted","Data":"b59362d2f6cd385f81035a0242cd82038c132f881d93c619ddf01fa4a360e245"}
Jul 27 17:01:30.293706 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:30.293680    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vlzgx" event={"ID":"7834bc12-869c-4364-b081-1c665ba26024","Type":"ContainerStarted","Data":"c9d86c5823ea4aa19552a5f03454428e536309e87339875a2a1c4bba6752d143"}
Jul 27 17:01:30.296212 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:30.296187    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7h9zp" event={"ID":"f9a42d19-2eff-4160-a5ec-950fffedb6a3","Type":"ContainerStarted","Data":"a6242a7b7813b03444b1b81577f3d517221eae0eb7484634abc4f0fd4cf0efdf"}
Jul 27 17:01:30.299697 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:30.299674    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4ksfn" event={"ID":"a5ae6ff9-02a8-4eac-abfc-5f113b100357","Type":"ContainerStarted","Data":"a62a1d4d475fe12075eb3abd86c8d09230eb26cd955835e0c2d6ab493eeda2c2"}
Jul 27 17:01:30.301231 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:30.301206    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-dk4md" event={"ID":"0bb4594a-a23f-4e66-a579-087b20377307","Type":"ContainerStarted","Data":"7c93e3601ecddefa35d9523db856e1a7503c9765742dc9609cea22b14ac0e154"}
Jul 27 17:01:30.303357 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:30.303333    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gdxlg" event={"ID":"6e5b6418-be32-4e11-88d2-929d0f6f52d6","Type":"ContainerStarted","Data":"cfb43fe456b0a438a7d0a0aacadbf5095e0dff93a84a692edc14eae5021def01"}
Jul 27 17:01:30.539147 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:01:30.538924    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod083a17672f59f98418db0cff06013128.slice/crio-0b3007d6ff8dd6a8f93d3f080597a8d4d3b23fc5ac3c7753b08e60de89da09a9 WatchSource:0}: Error finding container 0b3007d6ff8dd6a8f93d3f080597a8d4d3b23fc5ac3c7753b08e60de89da09a9: Status 404 returned error can't find the container with id 0b3007d6ff8dd6a8f93d3f080597a8d4d3b23fc5ac3c7753b08e60de89da09a9
Jul 27 17:01:30.766937 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:30.766899    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d26abfd5-3102-42ec-a7e0-c5abe0e9dc85-metrics-certs\") pod \"network-metrics-daemon-s5bhd\" (UID: \"d26abfd5-3102-42ec-a7e0-c5abe0e9dc85\") " pod="openshift-multus/network-metrics-daemon-s5bhd"
Jul 27 17:01:30.767137 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:30.766991    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2b793cd9-1cc7-4f3b-b882-1999e673076d-original-pull-secret\") pod \"global-pull-secret-syncer-g6775\" (UID: \"2b793cd9-1cc7-4f3b-b882-1999e673076d\") " pod="kube-system/global-pull-secret-syncer-g6775"
Jul 27 17:01:30.767137 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:01:30.767110    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 17:01:30.767251 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:01:30.767170    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b793cd9-1cc7-4f3b-b882-1999e673076d-original-pull-secret podName:2b793cd9-1cc7-4f3b-b882-1999e673076d nodeName:}" failed. No retries permitted until 2026-07-27 17:01:32.767151468 +0000 UTC m=+5.963896252 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2b793cd9-1cc7-4f3b-b882-1999e673076d-original-pull-secret") pod "global-pull-secret-syncer-g6775" (UID: "2b793cd9-1cc7-4f3b-b882-1999e673076d") : object "kube-system"/"original-pull-secret" not registered
Jul 27 17:01:30.767775 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:01:30.767581    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 17:01:30.767775 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:01:30.767631    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d26abfd5-3102-42ec-a7e0-c5abe0e9dc85-metrics-certs podName:d26abfd5-3102-42ec-a7e0-c5abe0e9dc85 nodeName:}" failed. No retries permitted until 2026-07-27 17:01:32.767615587 +0000 UTC m=+5.964360372 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d26abfd5-3102-42ec-a7e0-c5abe0e9dc85-metrics-certs") pod "network-metrics-daemon-s5bhd" (UID: "d26abfd5-3102-42ec-a7e0-c5abe0e9dc85") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 17:01:30.968862 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:30.968763    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6kb9\" (UniqueName: \"kubernetes.io/projected/8789c3a3-c9f7-43f1-8ea2-b279c80fe9a7-kube-api-access-l6kb9\") pod \"network-check-target-x5xw7\" (UID: \"8789c3a3-c9f7-43f1-8ea2-b279c80fe9a7\") " pod="openshift-network-diagnostics/network-check-target-x5xw7"
Jul 27 17:01:30.969029 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:01:30.968959    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 17:01:30.969029 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:01:30.968983    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 17:01:30.969029 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:01:30.968996    2580 projected.go:196] Error preparing data for projected volume kube-api-access-l6kb9 for pod openshift-network-diagnostics/network-check-target-x5xw7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 17:01:30.969185 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:01:30.969054    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8789c3a3-c9f7-43f1-8ea2-b279c80fe9a7-kube-api-access-l6kb9 podName:8789c3a3-c9f7-43f1-8ea2-b279c80fe9a7 nodeName:}" failed. No retries permitted until 2026-07-27 17:01:32.96903669 +0000 UTC m=+6.165781484 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-l6kb9" (UniqueName: "kubernetes.io/projected/8789c3a3-c9f7-43f1-8ea2-b279c80fe9a7-kube-api-access-l6kb9") pod "network-check-target-x5xw7" (UID: "8789c3a3-c9f7-43f1-8ea2-b279c80fe9a7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 17:01:31.195843 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:31.195765    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-26 16:56:29 +0000 UTC" deadline="2028-02-02 01:50:21.567785522 +0000 UTC"
Jul 27 17:01:31.195843 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:31.195839    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13304h48m50.371962992s"
Jul 27 17:01:31.267256 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:31.267177    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s5bhd"
Jul 27 17:01:31.267401 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:01:31.267330    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s5bhd" podUID="d26abfd5-3102-42ec-a7e0-c5abe0e9dc85"
Jul 27 17:01:31.312434 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:31.312394    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-134.ec2.internal" event={"ID":"33da85977499fd84717c6ccc4c4fa1cd","Type":"ContainerStarted","Data":"c9d966d690f4f0d85b79c93f5d0e5fc162c94b00d1392188bb8acf6971e3817c"}
Jul 27 17:01:31.317976 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:31.317937    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-134.ec2.internal" event={"ID":"083a17672f59f98418db0cff06013128","Type":"ContainerStarted","Data":"0b3007d6ff8dd6a8f93d3f080597a8d4d3b23fc5ac3c7753b08e60de89da09a9"}
Jul 27 17:01:32.265952 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:32.265159    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g6775"
Jul 27 17:01:32.265952 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:01:32.265283    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g6775" podUID="2b793cd9-1cc7-4f3b-b882-1999e673076d"
Jul 27 17:01:32.265952 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:32.265358    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5xw7"
Jul 27 17:01:32.265952 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:01:32.265435    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x5xw7" podUID="8789c3a3-c9f7-43f1-8ea2-b279c80fe9a7"
Jul 27 17:01:32.784672 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:32.784638    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2b793cd9-1cc7-4f3b-b882-1999e673076d-original-pull-secret\") pod \"global-pull-secret-syncer-g6775\" (UID: \"2b793cd9-1cc7-4f3b-b882-1999e673076d\") " pod="kube-system/global-pull-secret-syncer-g6775"
Jul 27 17:01:32.784882 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:32.784708    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d26abfd5-3102-42ec-a7e0-c5abe0e9dc85-metrics-certs\") pod \"network-metrics-daemon-s5bhd\" (UID: \"d26abfd5-3102-42ec-a7e0-c5abe0e9dc85\") " pod="openshift-multus/network-metrics-daemon-s5bhd"
Jul 27 17:01:32.784882 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:01:32.784840    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 17:01:32.785014 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:01:32.784899    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d26abfd5-3102-42ec-a7e0-c5abe0e9dc85-metrics-certs podName:d26abfd5-3102-42ec-a7e0-c5abe0e9dc85 nodeName:}" failed. No retries permitted until 2026-07-27 17:01:36.784880746 +0000 UTC m=+9.981625541 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d26abfd5-3102-42ec-a7e0-c5abe0e9dc85-metrics-certs") pod "network-metrics-daemon-s5bhd" (UID: "d26abfd5-3102-42ec-a7e0-c5abe0e9dc85") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 17:01:32.785321 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:01:32.785301    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 17:01:32.785397 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:01:32.785359    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b793cd9-1cc7-4f3b-b882-1999e673076d-original-pull-secret podName:2b793cd9-1cc7-4f3b-b882-1999e673076d nodeName:}" failed. No retries permitted until 2026-07-27 17:01:36.78534356 +0000 UTC m=+9.982088366 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2b793cd9-1cc7-4f3b-b882-1999e673076d-original-pull-secret") pod "global-pull-secret-syncer-g6775" (UID: "2b793cd9-1cc7-4f3b-b882-1999e673076d") : object "kube-system"/"original-pull-secret" not registered
Jul 27 17:01:32.987577 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:32.986985    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6kb9\" (UniqueName: \"kubernetes.io/projected/8789c3a3-c9f7-43f1-8ea2-b279c80fe9a7-kube-api-access-l6kb9\") pod \"network-check-target-x5xw7\" (UID: \"8789c3a3-c9f7-43f1-8ea2-b279c80fe9a7\") " pod="openshift-network-diagnostics/network-check-target-x5xw7"
Jul 27 17:01:32.987577 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:01:32.987135    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 17:01:32.987577 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:01:32.987156    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 17:01:32.987577 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:01:32.987169    2580 projected.go:196] Error preparing data for projected volume kube-api-access-l6kb9 for pod openshift-network-diagnostics/network-check-target-x5xw7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 17:01:32.987577 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:01:32.987223    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8789c3a3-c9f7-43f1-8ea2-b279c80fe9a7-kube-api-access-l6kb9 podName:8789c3a3-c9f7-43f1-8ea2-b279c80fe9a7 nodeName:}" failed. No retries permitted until 2026-07-27 17:01:36.987205567 +0000 UTC m=+10.183950365 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-l6kb9" (UniqueName: "kubernetes.io/projected/8789c3a3-c9f7-43f1-8ea2-b279c80fe9a7-kube-api-access-l6kb9") pod "network-check-target-x5xw7" (UID: "8789c3a3-c9f7-43f1-8ea2-b279c80fe9a7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 17:01:33.268197 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:33.267630    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s5bhd"
Jul 27 17:01:33.268197 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:01:33.267772    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s5bhd" podUID="d26abfd5-3102-42ec-a7e0-c5abe0e9dc85"
Jul 27 17:01:34.264779 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:34.264748    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g6775"
Jul 27 17:01:34.264978 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:01:34.264907    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g6775" podUID="2b793cd9-1cc7-4f3b-b882-1999e673076d"
Jul 27 17:01:34.265061 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:34.264991    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5xw7"
Jul 27 17:01:34.265111 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:01:34.265097    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x5xw7" podUID="8789c3a3-c9f7-43f1-8ea2-b279c80fe9a7"
Jul 27 17:01:35.265872 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:35.265823    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s5bhd"
Jul 27 17:01:35.266289 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:01:35.265984    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s5bhd" podUID="d26abfd5-3102-42ec-a7e0-c5abe0e9dc85"
Jul 27 17:01:36.265702 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:36.265672    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g6775"
Jul 27 17:01:36.265891 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:36.265810    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5xw7"
Jul 27 17:01:36.266236 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:01:36.265925    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x5xw7" podUID="8789c3a3-c9f7-43f1-8ea2-b279c80fe9a7"
Jul 27 17:01:36.266319 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:01:36.266291    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g6775" podUID="2b793cd9-1cc7-4f3b-b882-1999e673076d"
Jul 27 17:01:36.822011 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:36.821232    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2b793cd9-1cc7-4f3b-b882-1999e673076d-original-pull-secret\") pod \"global-pull-secret-syncer-g6775\" (UID: \"2b793cd9-1cc7-4f3b-b882-1999e673076d\") " pod="kube-system/global-pull-secret-syncer-g6775"
Jul 27 17:01:36.822011 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:36.821296    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d26abfd5-3102-42ec-a7e0-c5abe0e9dc85-metrics-certs\") pod \"network-metrics-daemon-s5bhd\" (UID: \"d26abfd5-3102-42ec-a7e0-c5abe0e9dc85\") " pod="openshift-multus/network-metrics-daemon-s5bhd"
Jul 27 17:01:36.822011 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:01:36.821455    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 17:01:36.822011 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:01:36.821520    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d26abfd5-3102-42ec-a7e0-c5abe0e9dc85-metrics-certs podName:d26abfd5-3102-42ec-a7e0-c5abe0e9dc85 nodeName:}" failed. No retries permitted until 2026-07-27 17:01:44.821500715 +0000 UTC m=+18.018245498 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d26abfd5-3102-42ec-a7e0-c5abe0e9dc85-metrics-certs") pod "network-metrics-daemon-s5bhd" (UID: "d26abfd5-3102-42ec-a7e0-c5abe0e9dc85") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 17:01:36.822011 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:01:36.821933    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 17:01:36.822011 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:01:36.821986    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b793cd9-1cc7-4f3b-b882-1999e673076d-original-pull-secret podName:2b793cd9-1cc7-4f3b-b882-1999e673076d nodeName:}" failed. No retries permitted until 2026-07-27 17:01:44.821970938 +0000 UTC m=+18.018715724 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2b793cd9-1cc7-4f3b-b882-1999e673076d-original-pull-secret") pod "global-pull-secret-syncer-g6775" (UID: "2b793cd9-1cc7-4f3b-b882-1999e673076d") : object "kube-system"/"original-pull-secret" not registered
Jul 27 17:01:37.023787 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:37.023182    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6kb9\" (UniqueName: \"kubernetes.io/projected/8789c3a3-c9f7-43f1-8ea2-b279c80fe9a7-kube-api-access-l6kb9\") pod \"network-check-target-x5xw7\" (UID: \"8789c3a3-c9f7-43f1-8ea2-b279c80fe9a7\") " pod="openshift-network-diagnostics/network-check-target-x5xw7"
Jul 27 17:01:37.023787 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:01:37.023370    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 17:01:37.023787 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:01:37.023388    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 17:01:37.023787 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:01:37.023401    2580 projected.go:196] Error preparing data for projected volume kube-api-access-l6kb9 for pod openshift-network-diagnostics/network-check-target-x5xw7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 17:01:37.023787 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:01:37.023456    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8789c3a3-c9f7-43f1-8ea2-b279c80fe9a7-kube-api-access-l6kb9 podName:8789c3a3-c9f7-43f1-8ea2-b279c80fe9a7 nodeName:}" failed. No retries permitted until 2026-07-27 17:01:45.023438858 +0000 UTC m=+18.220183643 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-l6kb9" (UniqueName: "kubernetes.io/projected/8789c3a3-c9f7-43f1-8ea2-b279c80fe9a7-kube-api-access-l6kb9") pod "network-check-target-x5xw7" (UID: "8789c3a3-c9f7-43f1-8ea2-b279c80fe9a7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 17:01:37.266930 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:37.266228    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s5bhd"
Jul 27 17:01:37.266930 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:01:37.266353    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s5bhd" podUID="d26abfd5-3102-42ec-a7e0-c5abe0e9dc85"
Jul 27 17:01:38.265788 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:38.265749    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5xw7"
Jul 27 17:01:38.265788 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:38.265789    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g6775"
Jul 27 17:01:38.266095 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:01:38.265894    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x5xw7" podUID="8789c3a3-c9f7-43f1-8ea2-b279c80fe9a7"
Jul 27 17:01:38.266332 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:01:38.266308    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g6775" podUID="2b793cd9-1cc7-4f3b-b882-1999e673076d"
Jul 27 17:01:39.265297 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:39.265257    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s5bhd"
Jul 27 17:01:39.265759 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:01:39.265401    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s5bhd" podUID="d26abfd5-3102-42ec-a7e0-c5abe0e9dc85"
Jul 27 17:01:40.265497 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:40.265466    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g6775"
Jul 27 17:01:40.265497 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:40.265500    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5xw7"
Jul 27 17:01:40.265900 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:01:40.265576    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g6775" podUID="2b793cd9-1cc7-4f3b-b882-1999e673076d"
Jul 27 17:01:40.265900 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:01:40.265695    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x5xw7" podUID="8789c3a3-c9f7-43f1-8ea2-b279c80fe9a7"
Jul 27 17:01:41.265458 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:41.265380    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s5bhd"
Jul 27 17:01:41.265611 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:01:41.265520    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s5bhd" podUID="d26abfd5-3102-42ec-a7e0-c5abe0e9dc85"
Jul 27 17:01:42.265560 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:42.265528    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g6775"
Jul 27 17:01:42.265756 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:42.265529    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5xw7"
Jul 27 17:01:42.265756 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:01:42.265652    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g6775" podUID="2b793cd9-1cc7-4f3b-b882-1999e673076d"
Jul 27 17:01:42.265756 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:01:42.265734    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x5xw7" podUID="8789c3a3-c9f7-43f1-8ea2-b279c80fe9a7"
Jul 27 17:01:43.265862 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:43.265822    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s5bhd"
Jul 27 17:01:43.266292 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:01:43.265973    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s5bhd" podUID="d26abfd5-3102-42ec-a7e0-c5abe0e9dc85"
Jul 27 17:01:44.265455 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:44.265423    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5xw7"
Jul 27 17:01:44.265455 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:44.265434    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g6775"
Jul 27 17:01:44.265719 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:01:44.265533    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x5xw7" podUID="8789c3a3-c9f7-43f1-8ea2-b279c80fe9a7"
Jul 27 17:01:44.265719 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:01:44.265655    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g6775" podUID="2b793cd9-1cc7-4f3b-b882-1999e673076d"
Jul 27 17:01:44.886588 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:44.886549    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2b793cd9-1cc7-4f3b-b882-1999e673076d-original-pull-secret\") pod \"global-pull-secret-syncer-g6775\" (UID: \"2b793cd9-1cc7-4f3b-b882-1999e673076d\") " pod="kube-system/global-pull-secret-syncer-g6775"
Jul 27 17:01:44.887024 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:44.886596    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d26abfd5-3102-42ec-a7e0-c5abe0e9dc85-metrics-certs\") pod \"network-metrics-daemon-s5bhd\" (UID: \"d26abfd5-3102-42ec-a7e0-c5abe0e9dc85\") " pod="openshift-multus/network-metrics-daemon-s5bhd"
Jul 27 17:01:44.887024 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:01:44.886695    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 17:01:44.887024 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:01:44.886746    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d26abfd5-3102-42ec-a7e0-c5abe0e9dc85-metrics-certs podName:d26abfd5-3102-42ec-a7e0-c5abe0e9dc85 nodeName:}" failed. No retries permitted until 2026-07-27 17:02:00.886732607 +0000 UTC m=+34.083477387 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d26abfd5-3102-42ec-a7e0-c5abe0e9dc85-metrics-certs") pod "network-metrics-daemon-s5bhd" (UID: "d26abfd5-3102-42ec-a7e0-c5abe0e9dc85") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 17:01:44.887024 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:01:44.886695    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 17:01:44.887024 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:01:44.886812    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b793cd9-1cc7-4f3b-b882-1999e673076d-original-pull-secret podName:2b793cd9-1cc7-4f3b-b882-1999e673076d nodeName:}" failed. No retries permitted until 2026-07-27 17:02:00.886799531 +0000 UTC m=+34.083544326 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2b793cd9-1cc7-4f3b-b882-1999e673076d-original-pull-secret") pod "global-pull-secret-syncer-g6775" (UID: "2b793cd9-1cc7-4f3b-b882-1999e673076d") : object "kube-system"/"original-pull-secret" not registered
Jul 27 17:01:45.087552 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:45.087467    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6kb9\" (UniqueName: \"kubernetes.io/projected/8789c3a3-c9f7-43f1-8ea2-b279c80fe9a7-kube-api-access-l6kb9\") pod \"network-check-target-x5xw7\" (UID: \"8789c3a3-c9f7-43f1-8ea2-b279c80fe9a7\") " pod="openshift-network-diagnostics/network-check-target-x5xw7"
Jul 27 17:01:45.087709 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:01:45.087624    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 17:01:45.087709 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:01:45.087645    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 17:01:45.087709 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:01:45.087656    2580 projected.go:196] Error preparing data for projected volume kube-api-access-l6kb9 for pod openshift-network-diagnostics/network-check-target-x5xw7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 17:01:45.087875 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:01:45.087714    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8789c3a3-c9f7-43f1-8ea2-b279c80fe9a7-kube-api-access-l6kb9 podName:8789c3a3-c9f7-43f1-8ea2-b279c80fe9a7 nodeName:}" failed. No retries permitted until 2026-07-27 17:02:01.087694216 +0000 UTC m=+34.284439021 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-l6kb9" (UniqueName: "kubernetes.io/projected/8789c3a3-c9f7-43f1-8ea2-b279c80fe9a7-kube-api-access-l6kb9") pod "network-check-target-x5xw7" (UID: "8789c3a3-c9f7-43f1-8ea2-b279c80fe9a7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 17:01:45.265363 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:45.265328    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s5bhd"
Jul 27 17:01:45.265504 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:01:45.265474    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s5bhd" podUID="d26abfd5-3102-42ec-a7e0-c5abe0e9dc85"
Jul 27 17:01:46.265276 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:46.265239    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5xw7"
Jul 27 17:01:46.265276 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:46.265269    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g6775"
Jul 27 17:01:46.265694 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:01:46.265406    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g6775" podUID="2b793cd9-1cc7-4f3b-b882-1999e673076d"
Jul 27 17:01:46.265694 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:01:46.265498    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x5xw7" podUID="8789c3a3-c9f7-43f1-8ea2-b279c80fe9a7"
Jul 27 17:01:47.265822 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:47.265783    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s5bhd"
Jul 27 17:01:47.266299 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:01:47.265914    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s5bhd" podUID="d26abfd5-3102-42ec-a7e0-c5abe0e9dc85"
Jul 27 17:01:48.265821 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:48.265789    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g6775"
Jul 27 17:01:48.266022 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:48.265798    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5xw7"
Jul 27 17:01:48.266022 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:01:48.265946    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g6775" podUID="2b793cd9-1cc7-4f3b-b882-1999e673076d"
Jul 27 17:01:48.266022 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:01:48.265968    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x5xw7" podUID="8789c3a3-c9f7-43f1-8ea2-b279c80fe9a7"
Jul 27 17:01:49.265390 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:49.265090    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s5bhd"
Jul 27 17:01:49.265521 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:01:49.265483    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s5bhd" podUID="d26abfd5-3102-42ec-a7e0-c5abe0e9dc85"
Jul 27 17:01:49.358088 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:49.358055    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-grkdn" event={"ID":"d8e1cb0d-8f4b-4e00-91bc-9d112926115c","Type":"ContainerStarted","Data":"d047eae470162e63bd5c4232e22b05ead0a5f1737a23ff4c6cf7b729b477e0e6"}
Jul 27 17:01:49.358924 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:49.358179    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-grkdn" event={"ID":"d8e1cb0d-8f4b-4e00-91bc-9d112926115c","Type":"ContainerStarted","Data":"9a9df39c6652e45d52d5352ce292f778e3dd3136b38926173e6e9ba48f8352ce"}
Jul 27 17:01:49.358924 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:49.358218    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-grkdn" event={"ID":"d8e1cb0d-8f4b-4e00-91bc-9d112926115c","Type":"ContainerStarted","Data":"b83ded49eaf594ad92c4224b7fb062a6729a6a3e128399a1e93a9876e383c35e"}
Jul 27 17:01:49.359629 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:49.359609    2580 generic.go:356] "Generic (PLEG): container finished" podID="7834bc12-869c-4364-b081-1c665ba26024" containerID="d3d32e022083e71dcfd0a07143c74529d876a2f7e4f78bb5b74c6bcac8e201a5" exitCode=0
Jul 27 17:01:49.359726 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:49.359691    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vlzgx" event={"ID":"7834bc12-869c-4364-b081-1c665ba26024","Type":"ContainerDied","Data":"d3d32e022083e71dcfd0a07143c74529d876a2f7e4f78bb5b74c6bcac8e201a5"}
Jul 27 17:01:49.361205 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:49.361174    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7h9zp" event={"ID":"f9a42d19-2eff-4160-a5ec-950fffedb6a3","Type":"ContainerStarted","Data":"2499185d57731da89420f4039fc5a020257a59cc0bc01e85048eff2b59f2ed34"}
Jul 27 17:01:49.362520 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:49.362500    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-dk4md" event={"ID":"0bb4594a-a23f-4e66-a579-087b20377307","Type":"ContainerStarted","Data":"c208f3b2cff8d4b4619e27db458cf2ebcd8125420c85f31a8ff4ce9ba173e778"}
Jul 27 17:01:49.364051 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:49.364027    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gdxlg" event={"ID":"6e5b6418-be32-4e11-88d2-929d0f6f52d6","Type":"ContainerStarted","Data":"f824b7caf8d591ea5832172a498212f0ba48cbc489aca93643d3b346a57fa1f0"}
Jul 27 17:01:49.365486 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:49.365464    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8qwz2" event={"ID":"b162f98d-8b75-4f43-9e96-18587dae9d8d","Type":"ContainerStarted","Data":"4e6fc4e6ef81488971bf74a66510425b7935d1ac49ddfce607b20645ff2f06b2"}
Jul 27 17:01:49.366704 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:49.366686    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-kt2nr" event={"ID":"0ed8e5dc-750b-42d0-86b3-7d1e6802c992","Type":"ContainerStarted","Data":"2c0556768c426821e81008ceb0b9ca13170c601eab9548d9aa7d9e6388a1de7e"}
Jul 27 17:01:49.368156 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:49.368070    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-jv9gw" event={"ID":"48eef739-faf5-48db-a1ef-c47a4b6971bd","Type":"ContainerStarted","Data":"eb161e61adae95a0b3ec1bbc1b9ac44c584b87c64ed37f83390ccb3bcbe5e08c"}
Jul 27 17:01:49.369454 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:49.369430    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-134.ec2.internal" event={"ID":"083a17672f59f98418db0cff06013128","Type":"ContainerStarted","Data":"ec7adee65358771fdb2270e7b5eec4c278081d9d10a59ac65c9a7161909cae24"}
Jul 27 17:01:49.414188 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:49.414129    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-134.ec2.internal" podStartSLOduration=21.414115673 podStartE2EDuration="21.414115673s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 17:01:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:01:31.329068935 +0000 UTC m=+4.525813740" watchObservedRunningTime="2026-07-27 17:01:49.414115673 +0000 UTC m=+22.610860475"
Jul 27 17:01:49.438887 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:49.438849    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-jv9gw" podStartSLOduration=3.060283742 podStartE2EDuration="22.43881999s" totalImagesPullingTime="19.378536248s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 17:01:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:01:49.438433714 +0000 UTC m=+22.635178516" watchObservedRunningTime="2026-07-27 17:01:49.43881999 +0000 UTC m=+22.635564792"
Jul 27 17:01:49.482261 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:49.482224    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-gdxlg" podStartSLOduration=7.189774238 podStartE2EDuration="22.482209371s" totalImagesPullingTime="15.292435133s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:01:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:01:49.463410953 +0000 UTC m=+22.660155754" watchObservedRunningTime="2026-07-27 17:01:49.482209371 +0000 UTC m=+22.678954222"
Jul 27 17:01:49.482351 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:49.482296    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-kt2nr" podStartSLOduration=3.136871916 podStartE2EDuration="22.482291284s" totalImagesPullingTime="19.345419368s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 17:01:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:01:49.482059186 +0000 UTC m=+22.678803988" watchObservedRunningTime="2026-07-27 17:01:49.482291284 +0000 UTC m=+22.679036086"
Jul 27 17:01:49.535073 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:49.535027    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-dk4md" podStartSLOduration=3.223801828 podStartE2EDuration="22.535009594s" totalImagesPullingTime="19.311207766s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 17:01:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:01:49.534606441 +0000 UTC m=+22.731351250" watchObservedRunningTime="2026-07-27 17:01:49.535009594 +0000 UTC m=+22.731754397"
Jul 27 17:01:49.606485 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:49.606443    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-7h9zp" podStartSLOduration=3.1630748300000002 podStartE2EDuration="22.606429389s" totalImagesPullingTime="19.443354559s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 17:01:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:01:49.605929183 +0000 UTC m=+22.802673984" watchObservedRunningTime="2026-07-27 17:01:49.606429389 +0000 UTC m=+22.803174191"
Jul 27 17:01:49.622204 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:49.622126    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-134.ec2.internal" podStartSLOduration=21.622114054 podStartE2EDuration="21.622114054s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 17:01:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:01:49.621580995 +0000 UTC m=+22.818325797" watchObservedRunningTime="2026-07-27 17:01:49.622114054 +0000 UTC m=+22.818858855"
Jul 27 17:01:49.794239 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:49.794201    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:01:49.882038 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:49.881983    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:01:50.265027 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:50.264963    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5xw7"
Jul 27 17:01:50.265216 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:50.264963    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g6775"
Jul 27 17:01:50.265216 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:01:50.265061    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x5xw7" podUID="8789c3a3-c9f7-43f1-8ea2-b279c80fe9a7"
Jul 27 17:01:50.265216 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:01:50.265156    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g6775" podUID="2b793cd9-1cc7-4f3b-b882-1999e673076d"
Jul 27 17:01:50.375493 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:50.375365    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-grkdn" event={"ID":"d8e1cb0d-8f4b-4e00-91bc-9d112926115c","Type":"ContainerStarted","Data":"3bcf39d1f930bc676ec4a28f07a79c59d73ed4e745e47b708b7b00a3984ed734"}
Jul 27 17:01:50.375493 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:50.375441    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-grkdn" event={"ID":"d8e1cb0d-8f4b-4e00-91bc-9d112926115c","Type":"ContainerStarted","Data":"872117795c6975e7d50d75697d59bc37f2b04592eeb47af0d576959b17c52de7"}
Jul 27 17:01:50.375493 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:50.375486    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-grkdn" event={"ID":"d8e1cb0d-8f4b-4e00-91bc-9d112926115c","Type":"ContainerStarted","Data":"ef7004f8722c98041ae7ce2d141b3cc99aaf3c11647c1955420d821df115cc69"}
Jul 27 17:01:50.380167 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:50.380070    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4ksfn" event={"ID":"a5ae6ff9-02a8-4eac-abfc-5f113b100357","Type":"ContainerStarted","Data":"c6dbb5f923c7b72a732282ae3433fe6282d2727dc755c5d4a6db60726e875de3"}
Jul 27 17:01:50.397155 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:50.397117    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-4ksfn" podStartSLOduration=4.038472325 podStartE2EDuration="23.397106292s" totalImagesPullingTime="19.358633967s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 17:01:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:01:50.396993867 +0000 UTC m=+23.593738672" watchObservedRunningTime="2026-07-27 17:01:50.397106292 +0000 UTC m=+23.593851094"
Jul 27 17:01:50.549509 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:50.549438    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:01:50.646485 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:50.646452    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:01:51.030464 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:51.030437    2580 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 27 17:01:51.211491 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:51.211305    2580 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-27T17:01:51.030460815Z","UUID":"eaeb6bf4-a022-443d-b872-933a640a60c6","Handler":null,"Name":"","Endpoint":""}
Jul 27 17:01:51.212771 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:51.212752    2580 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 27 17:01:51.212891 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:51.212788    2580 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 27 17:01:51.265778 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:51.265753    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s5bhd"
Jul 27 17:01:51.265916 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:01:51.265868    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s5bhd" podUID="d26abfd5-3102-42ec-a7e0-c5abe0e9dc85"
Jul 27 17:01:51.383723 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:51.383677    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8qwz2" event={"ID":"b162f98d-8b75-4f43-9e96-18587dae9d8d","Type":"ContainerStarted","Data":"9baf41d367ddc96786bb12aa4829bfd4fb0d1175833c534d12193883661f801b"}
Jul 27 17:01:51.752982 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:51.752945    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-gdxlg"
Jul 27 17:01:51.753509 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:51.753492    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-gdxlg"
Jul 27 17:01:52.059752 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:52.059655    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:01:52.117880 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:52.117814    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:01:52.264955 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:52.264927    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5xw7"
Jul 27 17:01:52.265094 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:01:52.265034    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x5xw7" podUID="8789c3a3-c9f7-43f1-8ea2-b279c80fe9a7"
Jul 27 17:01:52.265154 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:52.265096    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g6775"
Jul 27 17:01:52.265212 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:01:52.265196    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g6775" podUID="2b793cd9-1cc7-4f3b-b882-1999e673076d"
Jul 27 17:01:52.389226 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:52.389151    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-grkdn" event={"ID":"d8e1cb0d-8f4b-4e00-91bc-9d112926115c","Type":"ContainerStarted","Data":"1bee7967393a0bebdef9d6101762dfa44cb08c242aac7782be759b42eacc06f8"}
Jul 27 17:01:52.389632 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:52.389428    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-gdxlg"
Jul 27 17:01:52.389925 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:52.389895    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-gdxlg"
Jul 27 17:01:52.456713 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:52.456683    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:01:53.267773 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:53.265044    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s5bhd"
Jul 27 17:01:53.267773 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:01:53.265656    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s5bhd" podUID="d26abfd5-3102-42ec-a7e0-c5abe0e9dc85"
Jul 27 17:01:54.112844 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:54.112804    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:01:54.228596 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:54.228560    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:01:54.265780 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:54.265752    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5xw7"
Jul 27 17:01:54.265780 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:54.265786    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g6775"
Jul 27 17:01:54.266008 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:01:54.265885    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x5xw7" podUID="8789c3a3-c9f7-43f1-8ea2-b279c80fe9a7"
Jul 27 17:01:54.266053 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:01:54.266003    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g6775" podUID="2b793cd9-1cc7-4f3b-b882-1999e673076d"
Jul 27 17:01:55.265447 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:55.265423    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s5bhd"
Jul 27 17:01:55.266270 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:01:55.265533    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s5bhd" podUID="d26abfd5-3102-42ec-a7e0-c5abe0e9dc85"
Jul 27 17:01:55.400359 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:55.400315    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-grkdn" event={"ID":"d8e1cb0d-8f4b-4e00-91bc-9d112926115c","Type":"ContainerStarted","Data":"e924995a4018046ca46f314ac3c2677190372bdc4700f53c8623be2d3ebef8cd"}
Jul 27 17:01:55.400933 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:55.400905    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-grkdn"
Jul 27 17:01:55.401062 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:55.400982    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-grkdn"
Jul 27 17:01:55.401062 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:55.401032    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-grkdn"
Jul 27 17:01:55.402663 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:55.402520    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vlzgx" event={"ID":"7834bc12-869c-4364-b081-1c665ba26024","Type":"ContainerStarted","Data":"f1f8ddb05cb023f1803d0153e465683561384da5c5e34ebc39486aa16edb2480"}
Jul 27 17:01:55.416594 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:55.416575    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-grkdn"
Jul 27 17:01:55.416709 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:55.416693    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-grkdn"
Jul 27 17:01:55.465661 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:55.465625    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-grkdn" podStartSLOduration=9.109471773 podStartE2EDuration="28.465612706s" totalImagesPullingTime="19.356140933s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 17:01:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:01:55.434482962 +0000 UTC m=+28.631227773" watchObservedRunningTime="2026-07-27 17:01:55.465612706 +0000 UTC m=+28.662357509"
Jul 27 17:01:55.744124 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:55.744037    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:01:55.843638 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:55.843618    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:01:56.265504 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:56.265475    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5xw7"
Jul 27 17:01:56.266008 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:01:56.265589    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x5xw7" podUID="8789c3a3-c9f7-43f1-8ea2-b279c80fe9a7"
Jul 27 17:01:56.266008 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:56.265646    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g6775"
Jul 27 17:01:56.266008 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:01:56.265777    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g6775" podUID="2b793cd9-1cc7-4f3b-b882-1999e673076d"
Jul 27 17:01:56.406228 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:56.406196    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8qwz2" event={"ID":"b162f98d-8b75-4f43-9e96-18587dae9d8d","Type":"ContainerStarted","Data":"a5ec7574a7b42d8f8f3df07441a755090f0e2bd4a835c0696f5ab15e6ccba815"}
Jul 27 17:01:56.407791 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:56.407763    2580 generic.go:356] "Generic (PLEG): container finished" podID="7834bc12-869c-4364-b081-1c665ba26024" containerID="f1f8ddb05cb023f1803d0153e465683561384da5c5e34ebc39486aa16edb2480" exitCode=0
Jul 27 17:01:56.407930 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:56.407842    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vlzgx" event={"ID":"7834bc12-869c-4364-b081-1c665ba26024","Type":"ContainerDied","Data":"f1f8ddb05cb023f1803d0153e465683561384da5c5e34ebc39486aa16edb2480"}
Jul 27 17:01:56.426944 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:56.426905    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8qwz2" podStartSLOduration=3.480894615 podStartE2EDuration="29.426892676s" totalImagesPullingTime="25.945998061s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 17:01:27 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:01:56.426290918 +0000 UTC m=+29.623035722" watchObservedRunningTime="2026-07-27 17:01:56.426892676 +0000 UTC m=+29.623637477"
Jul 27 17:01:56.811488 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:56.811457    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-g6775"]
Jul 27 17:01:56.811665 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:56.811578    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g6775"
Jul 27 17:01:56.811720 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:01:56.811690    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g6775" podUID="2b793cd9-1cc7-4f3b-b882-1999e673076d"
Jul 27 17:01:56.814265 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:56.814240    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-x5xw7"]
Jul 27 17:01:56.814427 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:56.814310    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5xw7"
Jul 27 17:01:56.814427 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:01:56.814389    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x5xw7" podUID="8789c3a3-c9f7-43f1-8ea2-b279c80fe9a7"
Jul 27 17:01:56.814862 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:56.814816    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-s5bhd"]
Jul 27 17:01:56.814971 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:56.814937    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s5bhd"
Jul 27 17:01:56.815065 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:01:56.815041    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s5bhd" podUID="d26abfd5-3102-42ec-a7e0-c5abe0e9dc85"
Jul 27 17:01:58.264947 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:58.264872    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g6775"
Jul 27 17:01:58.265331 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:58.264972    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s5bhd"
Jul 27 17:01:58.265331 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:01:58.264977    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g6775" podUID="2b793cd9-1cc7-4f3b-b882-1999e673076d"
Jul 27 17:01:58.265331 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:58.265019    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5xw7"
Jul 27 17:01:58.265331 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:01:58.265118    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s5bhd" podUID="d26abfd5-3102-42ec-a7e0-c5abe0e9dc85"
Jul 27 17:01:58.265331 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:01:58.265200    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x5xw7" podUID="8789c3a3-c9f7-43f1-8ea2-b279c80fe9a7"
Jul 27 17:01:58.412295 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:58.412252    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:01:58.413706 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:58.413683    2580 generic.go:356] "Generic (PLEG): container finished" podID="7834bc12-869c-4364-b081-1c665ba26024" containerID="be3b596fe8fd6bce618403f453e52101e33b37a0db58672a3d8bd8eb4efc9696" exitCode=0
Jul 27 17:01:58.413818 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:01:58.413733    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vlzgx" event={"ID":"7834bc12-869c-4364-b081-1c665ba26024","Type":"ContainerDied","Data":"be3b596fe8fd6bce618403f453e52101e33b37a0db58672a3d8bd8eb4efc9696"}
Jul 27 17:02:00.265046 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:00.264803    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s5bhd"
Jul 27 17:02:00.265562 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:00.264803    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5xw7"
Jul 27 17:02:00.265562 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:02:00.265110    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s5bhd" podUID="d26abfd5-3102-42ec-a7e0-c5abe0e9dc85"
Jul 27 17:02:00.265562 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:00.264866    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g6775"
Jul 27 17:02:00.265562 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:02:00.265173    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x5xw7" podUID="8789c3a3-c9f7-43f1-8ea2-b279c80fe9a7"
Jul 27 17:02:00.265562 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:02:00.265278    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g6775" podUID="2b793cd9-1cc7-4f3b-b882-1999e673076d"
Jul 27 17:02:00.421049 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:00.421013    2580 generic.go:356] "Generic (PLEG): container finished" podID="7834bc12-869c-4364-b081-1c665ba26024" containerID="8e05c1081508ea5fe676bc9d61d4cfb169b05008a6126f1bfbe0fd723eb37a5f" exitCode=0
Jul 27 17:02:00.421174 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:00.421071    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vlzgx" event={"ID":"7834bc12-869c-4364-b081-1c665ba26024","Type":"ContainerDied","Data":"8e05c1081508ea5fe676bc9d61d4cfb169b05008a6126f1bfbe0fd723eb37a5f"}
Jul 27 17:02:00.910868 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:00.910826    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d26abfd5-3102-42ec-a7e0-c5abe0e9dc85-metrics-certs\") pod \"network-metrics-daemon-s5bhd\" (UID: \"d26abfd5-3102-42ec-a7e0-c5abe0e9dc85\") " pod="openshift-multus/network-metrics-daemon-s5bhd"
Jul 27 17:02:00.911041 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:00.910910    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2b793cd9-1cc7-4f3b-b882-1999e673076d-original-pull-secret\") pod \"global-pull-secret-syncer-g6775\" (UID: \"2b793cd9-1cc7-4f3b-b882-1999e673076d\") " pod="kube-system/global-pull-secret-syncer-g6775"
Jul 27 17:02:00.911041 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:02:00.910964    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 17:02:00.911041 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:02:00.910988    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 17:02:00.911041 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:02:00.911020    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d26abfd5-3102-42ec-a7e0-c5abe0e9dc85-metrics-certs podName:d26abfd5-3102-42ec-a7e0-c5abe0e9dc85 nodeName:}" failed. No retries permitted until 2026-07-27 17:02:32.911004362 +0000 UTC m=+66.107749145 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d26abfd5-3102-42ec-a7e0-c5abe0e9dc85-metrics-certs") pod "network-metrics-daemon-s5bhd" (UID: "d26abfd5-3102-42ec-a7e0-c5abe0e9dc85") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 17:02:00.911041 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:02:00.911034    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b793cd9-1cc7-4f3b-b882-1999e673076d-original-pull-secret podName:2b793cd9-1cc7-4f3b-b882-1999e673076d nodeName:}" failed. No retries permitted until 2026-07-27 17:02:32.911027501 +0000 UTC m=+66.107772284 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2b793cd9-1cc7-4f3b-b882-1999e673076d-original-pull-secret") pod "global-pull-secret-syncer-g6775" (UID: "2b793cd9-1cc7-4f3b-b882-1999e673076d") : object "kube-system"/"original-pull-secret" not registered
Jul 27 17:02:01.112844 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:01.112807    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6kb9\" (UniqueName: \"kubernetes.io/projected/8789c3a3-c9f7-43f1-8ea2-b279c80fe9a7-kube-api-access-l6kb9\") pod \"network-check-target-x5xw7\" (UID: \"8789c3a3-c9f7-43f1-8ea2-b279c80fe9a7\") " pod="openshift-network-diagnostics/network-check-target-x5xw7"
Jul 27 17:02:01.112997 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:02:01.112960    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 17:02:01.112997 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:02:01.112978    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 17:02:01.112997 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:02:01.112987    2580 projected.go:196] Error preparing data for projected volume kube-api-access-l6kb9 for pod openshift-network-diagnostics/network-check-target-x5xw7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 17:02:01.113088 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:02:01.113034    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8789c3a3-c9f7-43f1-8ea2-b279c80fe9a7-kube-api-access-l6kb9 podName:8789c3a3-c9f7-43f1-8ea2-b279c80fe9a7 nodeName:}" failed. No retries permitted until 2026-07-27 17:02:33.113020274 +0000 UTC m=+66.309765054 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-l6kb9" (UniqueName: "kubernetes.io/projected/8789c3a3-c9f7-43f1-8ea2-b279c80fe9a7-kube-api-access-l6kb9") pod "network-check-target-x5xw7" (UID: "8789c3a3-c9f7-43f1-8ea2-b279c80fe9a7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 17:02:02.265748 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:02.265713    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s5bhd"
Jul 27 17:02:02.265748 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:02.265741    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g6775"
Jul 27 17:02:02.266372 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:02.265749    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5xw7"
Jul 27 17:02:02.266372 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:02:02.265864    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s5bhd" podUID="d26abfd5-3102-42ec-a7e0-c5abe0e9dc85"
Jul 27 17:02:02.266372 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:02:02.265995    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g6775" podUID="2b793cd9-1cc7-4f3b-b882-1999e673076d"
Jul 27 17:02:02.266372 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:02:02.266063    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x5xw7" podUID="8789c3a3-c9f7-43f1-8ea2-b279c80fe9a7"
Jul 27 17:02:02.625658 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:02.625632    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-134.ec2.internal" event="NodeReady"
Jul 27 17:02:02.625818 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:02.625741    2580 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 27 17:02:02.688195 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:02.688118    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-pvns7"]
Jul 27 17:02:02.690288 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:02.690263    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pvns7"
Jul 27 17:02:02.693199 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:02.693139    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 27 17:02:02.693315 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:02.693231    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5sbpw\""
Jul 27 17:02:02.693315 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:02.693273    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 27 17:02:02.702134 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:02.702112    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-9nm5r"]
Jul 27 17:02:02.704106 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:02.704088    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-9nm5r"
Jul 27 17:02:02.707014 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:02.706882    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 27 17:02:02.707014 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:02.706901    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 27 17:02:02.707014 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:02.706905    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 27 17:02:02.707970 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:02.707949    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-pvns7"]
Jul 27 17:02:02.709869 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:02.709672    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-dmcwl\""
Jul 27 17:02:02.715389 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:02.715368    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-9nm5r"]
Jul 27 17:02:02.785179 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:02.785149    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:02:02.824248 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:02.824210    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/07c213e5-4e80-4cba-984d-d6b344d8a17a-cert\") pod \"ingress-canary-9nm5r\" (UID: \"07c213e5-4e80-4cba-984d-d6b344d8a17a\") " pod="openshift-ingress-canary/ingress-canary-9nm5r"
Jul 27 17:02:02.824438 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:02.824279    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ad547374-9c50-4b13-8884-74ed191f077a-metrics-tls\") pod \"dns-default-pvns7\" (UID: \"ad547374-9c50-4b13-8884-74ed191f077a\") " pod="openshift-dns/dns-default-pvns7"
Jul 27 17:02:02.824438 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:02.824344    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzrhv\" (UniqueName: \"kubernetes.io/projected/07c213e5-4e80-4cba-984d-d6b344d8a17a-kube-api-access-bzrhv\") pod \"ingress-canary-9nm5r\" (UID: \"07c213e5-4e80-4cba-984d-d6b344d8a17a\") " pod="openshift-ingress-canary/ingress-canary-9nm5r"
Jul 27 17:02:02.824438 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:02.824382    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ad547374-9c50-4b13-8884-74ed191f077a-tmp-dir\") pod \"dns-default-pvns7\" (UID: \"ad547374-9c50-4b13-8884-74ed191f077a\") " pod="openshift-dns/dns-default-pvns7"
Jul 27 17:02:02.824573 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:02.824494    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v222g\" (UniqueName: \"kubernetes.io/projected/ad547374-9c50-4b13-8884-74ed191f077a-kube-api-access-v222g\") pod \"dns-default-pvns7\" (UID: \"ad547374-9c50-4b13-8884-74ed191f077a\") " pod="openshift-dns/dns-default-pvns7"
Jul 27 17:02:02.824573 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:02.824549    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ad547374-9c50-4b13-8884-74ed191f077a-config-volume\") pod \"dns-default-pvns7\" (UID: \"ad547374-9c50-4b13-8884-74ed191f077a\") " pod="openshift-dns/dns-default-pvns7"
Jul 27 17:02:02.885414 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:02.885335    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:02:02.924921 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:02.924890    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzrhv\" (UniqueName: \"kubernetes.io/projected/07c213e5-4e80-4cba-984d-d6b344d8a17a-kube-api-access-bzrhv\") pod \"ingress-canary-9nm5r\" (UID: \"07c213e5-4e80-4cba-984d-d6b344d8a17a\") " pod="openshift-ingress-canary/ingress-canary-9nm5r"
Jul 27 17:02:02.925090 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:02.924929    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ad547374-9c50-4b13-8884-74ed191f077a-tmp-dir\") pod \"dns-default-pvns7\" (UID: \"ad547374-9c50-4b13-8884-74ed191f077a\") " pod="openshift-dns/dns-default-pvns7"
Jul 27 17:02:02.925090 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:02.924955    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v222g\" (UniqueName: \"kubernetes.io/projected/ad547374-9c50-4b13-8884-74ed191f077a-kube-api-access-v222g\") pod \"dns-default-pvns7\" (UID: \"ad547374-9c50-4b13-8884-74ed191f077a\") " pod="openshift-dns/dns-default-pvns7"
Jul 27 17:02:02.925090 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:02.924993    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ad547374-9c50-4b13-8884-74ed191f077a-config-volume\") pod \"dns-default-pvns7\" (UID: \"ad547374-9c50-4b13-8884-74ed191f077a\") " pod="openshift-dns/dns-default-pvns7"
Jul 27 17:02:02.925090 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:02.925032    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/07c213e5-4e80-4cba-984d-d6b344d8a17a-cert\") pod \"ingress-canary-9nm5r\" (UID: \"07c213e5-4e80-4cba-984d-d6b344d8a17a\") " pod="openshift-ingress-canary/ingress-canary-9nm5r"
Jul 27 17:02:02.925090 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:02.925067    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ad547374-9c50-4b13-8884-74ed191f077a-metrics-tls\") pod \"dns-default-pvns7\" (UID: \"ad547374-9c50-4b13-8884-74ed191f077a\") " pod="openshift-dns/dns-default-pvns7"
Jul 27 17:02:02.925319 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:02:02.925173    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 17:02:02.925319 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:02:02.925224    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad547374-9c50-4b13-8884-74ed191f077a-metrics-tls podName:ad547374-9c50-4b13-8884-74ed191f077a nodeName:}" failed. No retries permitted until 2026-07-27 17:02:03.42520796 +0000 UTC m=+36.621952753 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ad547374-9c50-4b13-8884-74ed191f077a-metrics-tls") pod "dns-default-pvns7" (UID: "ad547374-9c50-4b13-8884-74ed191f077a") : secret "dns-default-metrics-tls" not found
Jul 27 17:02:02.925319 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:02.925286    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ad547374-9c50-4b13-8884-74ed191f077a-tmp-dir\") pod \"dns-default-pvns7\" (UID: \"ad547374-9c50-4b13-8884-74ed191f077a\") " pod="openshift-dns/dns-default-pvns7"
Jul 27 17:02:02.925722 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:02.925705    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ad547374-9c50-4b13-8884-74ed191f077a-config-volume\") pod \"dns-default-pvns7\" (UID: \"ad547374-9c50-4b13-8884-74ed191f077a\") " pod="openshift-dns/dns-default-pvns7"
Jul 27 17:02:02.929603 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:02.929585    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/07c213e5-4e80-4cba-984d-d6b344d8a17a-cert\") pod \"ingress-canary-9nm5r\" (UID: \"07c213e5-4e80-4cba-984d-d6b344d8a17a\") " pod="openshift-ingress-canary/ingress-canary-9nm5r"
Jul 27 17:02:02.933537 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:02.933511    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v222g\" (UniqueName: \"kubernetes.io/projected/ad547374-9c50-4b13-8884-74ed191f077a-kube-api-access-v222g\") pod \"dns-default-pvns7\" (UID: \"ad547374-9c50-4b13-8884-74ed191f077a\") " pod="openshift-dns/dns-default-pvns7"
Jul 27 17:02:02.933907 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:02.933882    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzrhv\" (UniqueName: \"kubernetes.io/projected/07c213e5-4e80-4cba-984d-d6b344d8a17a-kube-api-access-bzrhv\") pod \"ingress-canary-9nm5r\" (UID: \"07c213e5-4e80-4cba-984d-d6b344d8a17a\") " pod="openshift-ingress-canary/ingress-canary-9nm5r"
Jul 27 17:02:03.013808 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:03.013776    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-9nm5r"
Jul 27 17:02:03.167229 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:03.167150    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-9nm5r"]
Jul 27 17:02:03.172065 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:02:03.172035    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07c213e5_4e80_4cba_984d_d6b344d8a17a.slice/crio-8ea14cce29f3d3fe37a3f08d9c81b54fe0671992ee185308b867235df3342c6e WatchSource:0}: Error finding container 8ea14cce29f3d3fe37a3f08d9c81b54fe0671992ee185308b867235df3342c6e: Status 404 returned error can't find the container with id 8ea14cce29f3d3fe37a3f08d9c81b54fe0671992ee185308b867235df3342c6e
Jul 27 17:02:03.429793 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:03.429537    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ad547374-9c50-4b13-8884-74ed191f077a-metrics-tls\") pod \"dns-default-pvns7\" (UID: \"ad547374-9c50-4b13-8884-74ed191f077a\") " pod="openshift-dns/dns-default-pvns7"
Jul 27 17:02:03.430474 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:02:03.429674    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 17:02:03.430474 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:02:03.429868    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad547374-9c50-4b13-8884-74ed191f077a-metrics-tls podName:ad547374-9c50-4b13-8884-74ed191f077a nodeName:}" failed. No retries permitted until 2026-07-27 17:02:04.429850679 +0000 UTC m=+37.626595462 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ad547374-9c50-4b13-8884-74ed191f077a-metrics-tls") pod "dns-default-pvns7" (UID: "ad547374-9c50-4b13-8884-74ed191f077a") : secret "dns-default-metrics-tls" not found
Jul 27 17:02:03.430474 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:03.430421    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-9nm5r" event={"ID":"07c213e5-4e80-4cba-984d-d6b344d8a17a","Type":"ContainerStarted","Data":"8ea14cce29f3d3fe37a3f08d9c81b54fe0671992ee185308b867235df3342c6e"}
Jul 27 17:02:04.265669 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:04.265636    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s5bhd"
Jul 27 17:02:04.265669 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:04.265663    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5xw7"
Jul 27 17:02:04.265930 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:04.265664    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g6775"
Jul 27 17:02:04.269411 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:04.269388    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 27 17:02:04.269547 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:04.269478    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 27 17:02:04.269547 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:04.269515    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-c7drs\""
Jul 27 17:02:04.270465 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:04.270444    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 27 17:02:04.270569 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:04.270517    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-mxtqx\""
Jul 27 17:02:04.270645 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:04.270630    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 27 17:02:04.440669 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:04.440609    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ad547374-9c50-4b13-8884-74ed191f077a-metrics-tls\") pod \"dns-default-pvns7\" (UID: \"ad547374-9c50-4b13-8884-74ed191f077a\") " pod="openshift-dns/dns-default-pvns7"
Jul 27 17:02:04.441172 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:02:04.440731    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 17:02:04.441172 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:02:04.440790    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad547374-9c50-4b13-8884-74ed191f077a-metrics-tls podName:ad547374-9c50-4b13-8884-74ed191f077a nodeName:}" failed. No retries permitted until 2026-07-27 17:02:06.440772606 +0000 UTC m=+39.637517409 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ad547374-9c50-4b13-8884-74ed191f077a-metrics-tls") pod "dns-default-pvns7" (UID: "ad547374-9c50-4b13-8884-74ed191f077a") : secret "dns-default-metrics-tls" not found
Jul 27 17:02:05.969158 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:05.969114    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:02:06.085271 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:06.085238    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:02:06.441250 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:06.441220    2580 generic.go:356] "Generic (PLEG): container finished" podID="7834bc12-869c-4364-b081-1c665ba26024" containerID="f7d390b1fceac24b7903ea3fd42300bd4e893a8532983f071ba11caba4958a29" exitCode=0
Jul 27 17:02:06.441390 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:06.441267    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vlzgx" event={"ID":"7834bc12-869c-4364-b081-1c665ba26024","Type":"ContainerDied","Data":"f7d390b1fceac24b7903ea3fd42300bd4e893a8532983f071ba11caba4958a29"}
Jul 27 17:02:06.456220 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:06.456200    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ad547374-9c50-4b13-8884-74ed191f077a-metrics-tls\") pod \"dns-default-pvns7\" (UID: \"ad547374-9c50-4b13-8884-74ed191f077a\") " pod="openshift-dns/dns-default-pvns7"
Jul 27 17:02:06.456349 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:02:06.456300    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 17:02:06.456349 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:02:06.456346    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad547374-9c50-4b13-8884-74ed191f077a-metrics-tls podName:ad547374-9c50-4b13-8884-74ed191f077a nodeName:}" failed. No retries permitted until 2026-07-27 17:02:10.456334381 +0000 UTC m=+43.653079161 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ad547374-9c50-4b13-8884-74ed191f077a-metrics-tls") pod "dns-default-pvns7" (UID: "ad547374-9c50-4b13-8884-74ed191f077a") : secret "dns-default-metrics-tls" not found
Jul 27 17:02:07.446017 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:07.445989    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vlzgx" event={"ID":"7834bc12-869c-4364-b081-1c665ba26024","Type":"ContainerStarted","Data":"9dfce7bbed2e44c87026ebb56affac72ef6063d501907c0edffd24be6ed3dddf"}
Jul 27 17:02:08.450125 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:08.450091    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-9nm5r" event={"ID":"07c213e5-4e80-4cba-984d-d6b344d8a17a","Type":"ContainerStarted","Data":"9be952985dbba180751a62081bdb9c1f9fc7a8bb97d40cf0e88bb3862a95c2b8"}
Jul 27 17:02:08.452882 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:08.452850    2580 generic.go:356] "Generic (PLEG): container finished" podID="7834bc12-869c-4364-b081-1c665ba26024" containerID="9dfce7bbed2e44c87026ebb56affac72ef6063d501907c0edffd24be6ed3dddf" exitCode=0
Jul 27 17:02:08.452996 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:08.452890    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vlzgx" event={"ID":"7834bc12-869c-4364-b081-1c665ba26024","Type":"ContainerDied","Data":"9dfce7bbed2e44c87026ebb56affac72ef6063d501907c0edffd24be6ed3dddf"}
Jul 27 17:02:08.478812 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:08.478770    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-9nm5r" podStartSLOduration=2.1196536 podStartE2EDuration="6.478756467s" totalImagesPullingTime="4.359102867s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:02:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:02:08.476617117 +0000 UTC m=+41.673361919" watchObservedRunningTime="2026-07-27 17:02:08.478756467 +0000 UTC m=+41.675501268"
Jul 27 17:02:09.458753 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:09.458721    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vlzgx" event={"ID":"7834bc12-869c-4364-b081-1c665ba26024","Type":"ContainerStarted","Data":"ef78d7332be045d38b90402377398e98f2317ed9f50398149e7537759d5db066"}
Jul 27 17:02:09.488294 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:09.488252    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-vlzgx" podStartSLOduration=10.271737277 podStartE2EDuration="42.488236363s" totalImagesPullingTime="32.216499086s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 17:01:27 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:02:09.487506396 +0000 UTC m=+42.684251210" watchObservedRunningTime="2026-07-27 17:02:09.488236363 +0000 UTC m=+42.684981193"
Jul 27 17:02:09.619810 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:09.619774    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:02:09.723087 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:09.723013    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:02:10.220724 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:10.220700    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:02:10.294941 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:10.294914    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:02:10.364968 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:10.364939    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:02:10.483562 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:10.483490    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ad547374-9c50-4b13-8884-74ed191f077a-metrics-tls\") pod \"dns-default-pvns7\" (UID: \"ad547374-9c50-4b13-8884-74ed191f077a\") " pod="openshift-dns/dns-default-pvns7"
Jul 27 17:02:10.483987 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:02:10.483594    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 17:02:10.483987 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:02:10.483647    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad547374-9c50-4b13-8884-74ed191f077a-metrics-tls podName:ad547374-9c50-4b13-8884-74ed191f077a nodeName:}" failed. No retries permitted until 2026-07-27 17:02:18.48363397 +0000 UTC m=+51.680378749 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ad547374-9c50-4b13-8884-74ed191f077a-metrics-tls") pod "dns-default-pvns7" (UID: "ad547374-9c50-4b13-8884-74ed191f077a") : secret "dns-default-metrics-tls" not found
Jul 27 17:02:18.042713 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:18.042677    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-kj6ht"]
Jul 27 17:02:18.063193 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:18.063168    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-kj6ht"]
Jul 27 17:02:18.063315 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:18.063252    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-kj6ht"
Jul 27 17:02:18.065619 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:18.065600    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 27 17:02:18.065746 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:18.065725    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-xb47c\""
Jul 27 17:02:18.065818 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:18.065792    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 27 17:02:18.065893 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:18.065726    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 27 17:02:18.066519 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:18.066504    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 27 17:02:18.128731 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:18.128705    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/65a00fd9-7e2d-4bec-81b5-bd36362c3971-config\") pod \"service-ca-operator-5d6c75f84f-kj6ht\" (UID: \"65a00fd9-7e2d-4bec-81b5-bd36362c3971\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-kj6ht"
Jul 27 17:02:18.128854 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:18.128747    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/65a00fd9-7e2d-4bec-81b5-bd36362c3971-serving-cert\") pod \"service-ca-operator-5d6c75f84f-kj6ht\" (UID: \"65a00fd9-7e2d-4bec-81b5-bd36362c3971\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-kj6ht"
Jul 27 17:02:18.128922 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:18.128851    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4lmp7\" (UniqueName: \"kubernetes.io/projected/65a00fd9-7e2d-4bec-81b5-bd36362c3971-kube-api-access-4lmp7\") pod \"service-ca-operator-5d6c75f84f-kj6ht\" (UID: \"65a00fd9-7e2d-4bec-81b5-bd36362c3971\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-kj6ht"
Jul 27 17:02:18.140556 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:18.140538    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-jm6np"]
Jul 27 17:02:18.161277 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:18.161261    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-jm6np"
Jul 27 17:02:18.161277 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:18.161261    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-86cb48fc4-g7xdp"]
Jul 27 17:02:18.167194 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:18.167176    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 27 17:02:18.167310 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:18.167291    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 27 17:02:18.167476 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:18.167454    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 27 17:02:18.167571 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:18.167549    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-2tjrn\""
Jul 27 17:02:18.167658 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:18.167639    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 27 17:02:18.179777 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:18.179756    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-jm6np"]
Jul 27 17:02:18.179873 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:18.179785    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-86cb48fc4-g7xdp"]
Jul 27 17:02:18.179873 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:18.179862    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-86cb48fc4-g7xdp"
Jul 27 17:02:18.182189 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:18.182154    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-64scz\""
Jul 27 17:02:18.182288 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:18.182244    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 27 17:02:18.182355 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:18.182305    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 27 17:02:18.182413 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:18.182365    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 27 17:02:18.187042 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:18.187024    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 27 17:02:18.230035 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:18.230017    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fa7f3110-1af2-4201-ae03-cae4fb2e5a51-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-jm6np\" (UID: \"fa7f3110-1af2-4201-ae03-cae4fb2e5a51\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-jm6np"
Jul 27 17:02:18.230138 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:18.230046    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/65a00fd9-7e2d-4bec-81b5-bd36362c3971-config\") pod \"service-ca-operator-5d6c75f84f-kj6ht\" (UID: \"65a00fd9-7e2d-4bec-81b5-bd36362c3971\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-kj6ht"
Jul 27 17:02:18.230138 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:18.230067    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvhlv\" (UniqueName: \"kubernetes.io/projected/51786f74-c658-418d-a752-d19508a76f41-kube-api-access-zvhlv\") pod \"image-registry-86cb48fc4-g7xdp\" (UID: \"51786f74-c658-418d-a752-d19508a76f41\") " pod="openshift-image-registry/image-registry-86cb48fc4-g7xdp"
Jul 27 17:02:18.230138 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:18.230085    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/51786f74-c658-418d-a752-d19508a76f41-ca-trust-extracted\") pod \"image-registry-86cb48fc4-g7xdp\" (UID: \"51786f74-c658-418d-a752-d19508a76f41\") " pod="openshift-image-registry/image-registry-86cb48fc4-g7xdp"
Jul 27 17:02:18.230138 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:18.230123    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/65a00fd9-7e2d-4bec-81b5-bd36362c3971-serving-cert\") pod \"service-ca-operator-5d6c75f84f-kj6ht\" (UID: \"65a00fd9-7e2d-4bec-81b5-bd36362c3971\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-kj6ht"
Jul 27 17:02:18.230293 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:18.230204    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/51786f74-c658-418d-a752-d19508a76f41-image-registry-private-configuration\") pod \"image-registry-86cb48fc4-g7xdp\" (UID: \"51786f74-c658-418d-a752-d19508a76f41\") " pod="openshift-image-registry/image-registry-86cb48fc4-g7xdp"
Jul 27 17:02:18.230293 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:18.230261    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/51786f74-c658-418d-a752-d19508a76f41-installation-pull-secrets\") pod \"image-registry-86cb48fc4-g7xdp\" (UID: \"51786f74-c658-418d-a752-d19508a76f41\") " pod="openshift-image-registry/image-registry-86cb48fc4-g7xdp"
Jul 27 17:02:18.230368 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:18.230308    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/51786f74-c658-418d-a752-d19508a76f41-bound-sa-token\") pod \"image-registry-86cb48fc4-g7xdp\" (UID: \"51786f74-c658-418d-a752-d19508a76f41\") " pod="openshift-image-registry/image-registry-86cb48fc4-g7xdp"
Jul 27 17:02:18.230368 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:18.230334    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/51786f74-c658-418d-a752-d19508a76f41-trusted-ca\") pod \"image-registry-86cb48fc4-g7xdp\" (UID: \"51786f74-c658-418d-a752-d19508a76f41\") " pod="openshift-image-registry/image-registry-86cb48fc4-g7xdp"
Jul 27 17:02:18.230441 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:18.230382    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4lmp7\" (UniqueName: \"kubernetes.io/projected/65a00fd9-7e2d-4bec-81b5-bd36362c3971-kube-api-access-4lmp7\") pod \"service-ca-operator-5d6c75f84f-kj6ht\" (UID: \"65a00fd9-7e2d-4bec-81b5-bd36362c3971\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-kj6ht"
Jul 27 17:02:18.230441 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:18.230401    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vsnfv\" (UniqueName: \"kubernetes.io/projected/fa7f3110-1af2-4201-ae03-cae4fb2e5a51-kube-api-access-vsnfv\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-jm6np\" (UID: \"fa7f3110-1af2-4201-ae03-cae4fb2e5a51\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-jm6np"
Jul 27 17:02:18.230441 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:18.230425    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/51786f74-c658-418d-a752-d19508a76f41-registry-tls\") pod \"image-registry-86cb48fc4-g7xdp\" (UID: \"51786f74-c658-418d-a752-d19508a76f41\") " pod="openshift-image-registry/image-registry-86cb48fc4-g7xdp"
Jul 27 17:02:18.230541 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:18.230441    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/51786f74-c658-418d-a752-d19508a76f41-registry-certificates\") pod \"image-registry-86cb48fc4-g7xdp\" (UID: \"51786f74-c658-418d-a752-d19508a76f41\") " pod="openshift-image-registry/image-registry-86cb48fc4-g7xdp"
Jul 27 17:02:18.230541 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:18.230478    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fa7f3110-1af2-4201-ae03-cae4fb2e5a51-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-jm6np\" (UID: \"fa7f3110-1af2-4201-ae03-cae4fb2e5a51\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-jm6np"
Jul 27 17:02:18.230541 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:18.230490    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/65a00fd9-7e2d-4bec-81b5-bd36362c3971-config\") pod \"service-ca-operator-5d6c75f84f-kj6ht\" (UID: \"65a00fd9-7e2d-4bec-81b5-bd36362c3971\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-kj6ht"
Jul 27 17:02:18.233350 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:18.233329    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/65a00fd9-7e2d-4bec-81b5-bd36362c3971-serving-cert\") pod \"service-ca-operator-5d6c75f84f-kj6ht\" (UID: \"65a00fd9-7e2d-4bec-81b5-bd36362c3971\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-kj6ht"
Jul 27 17:02:18.236809 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:18.236779    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-888fz"]
Jul 27 17:02:18.255809 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:18.255786    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-888fz"
Jul 27 17:02:18.257858 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:18.257822    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4lmp7\" (UniqueName: \"kubernetes.io/projected/65a00fd9-7e2d-4bec-81b5-bd36362c3971-kube-api-access-4lmp7\") pod \"service-ca-operator-5d6c75f84f-kj6ht\" (UID: \"65a00fd9-7e2d-4bec-81b5-bd36362c3971\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-kj6ht"
Jul 27 17:02:18.258579 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:18.258564    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-qlx6l\""
Jul 27 17:02:18.271952 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:18.271931    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-888fz"]
Jul 27 17:02:18.331078 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:18.331028    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/51786f74-c658-418d-a752-d19508a76f41-installation-pull-secrets\") pod \"image-registry-86cb48fc4-g7xdp\" (UID: \"51786f74-c658-418d-a752-d19508a76f41\") " pod="openshift-image-registry/image-registry-86cb48fc4-g7xdp"
Jul 27 17:02:18.331078 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:18.331054    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/51786f74-c658-418d-a752-d19508a76f41-bound-sa-token\") pod \"image-registry-86cb48fc4-g7xdp\" (UID: \"51786f74-c658-418d-a752-d19508a76f41\") " pod="openshift-image-registry/image-registry-86cb48fc4-g7xdp"
Jul 27 17:02:18.331078 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:18.331071    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/51786f74-c658-418d-a752-d19508a76f41-trusted-ca\") pod \"image-registry-86cb48fc4-g7xdp\" (UID: \"51786f74-c658-418d-a752-d19508a76f41\") " pod="openshift-image-registry/image-registry-86cb48fc4-g7xdp"
Jul 27 17:02:18.331269 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:18.331101    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vsnfv\" (UniqueName: \"kubernetes.io/projected/fa7f3110-1af2-4201-ae03-cae4fb2e5a51-kube-api-access-vsnfv\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-jm6np\" (UID: \"fa7f3110-1af2-4201-ae03-cae4fb2e5a51\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-jm6np"
Jul 27 17:02:18.331269 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:18.331128    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/51786f74-c658-418d-a752-d19508a76f41-registry-tls\") pod \"image-registry-86cb48fc4-g7xdp\" (UID: \"51786f74-c658-418d-a752-d19508a76f41\") " pod="openshift-image-registry/image-registry-86cb48fc4-g7xdp"
Jul 27 17:02:18.331269 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:18.331151    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/51786f74-c658-418d-a752-d19508a76f41-registry-certificates\") pod \"image-registry-86cb48fc4-g7xdp\" (UID: \"51786f74-c658-418d-a752-d19508a76f41\") " pod="openshift-image-registry/image-registry-86cb48fc4-g7xdp"
Jul 27 17:02:18.331269 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:18.331200    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fa7f3110-1af2-4201-ae03-cae4fb2e5a51-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-jm6np\" (UID: \"fa7f3110-1af2-4201-ae03-cae4fb2e5a51\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-jm6np"
Jul 27 17:02:18.331269 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:18.331238    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fa7f3110-1af2-4201-ae03-cae4fb2e5a51-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-jm6np\" (UID: \"fa7f3110-1af2-4201-ae03-cae4fb2e5a51\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-jm6np"
Jul 27 17:02:18.331523 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:18.331270    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89dhd\" (UniqueName: \"kubernetes.io/projected/5ebba964-f3cb-4b38-8fb9-1f3568c57341-kube-api-access-89dhd\") pod \"network-check-source-7d88cb55d8-888fz\" (UID: \"5ebba964-f3cb-4b38-8fb9-1f3568c57341\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-888fz"
Jul 27 17:02:18.331523 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:02:18.331279    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 27 17:02:18.331523 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:02:18.331298    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-86cb48fc4-g7xdp: secret "image-registry-tls" not found
Jul 27 17:02:18.331523 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:18.331300    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvhlv\" (UniqueName: \"kubernetes.io/projected/51786f74-c658-418d-a752-d19508a76f41-kube-api-access-zvhlv\") pod \"image-registry-86cb48fc4-g7xdp\" (UID: \"51786f74-c658-418d-a752-d19508a76f41\") " pod="openshift-image-registry/image-registry-86cb48fc4-g7xdp"
Jul 27 17:02:18.331523 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:18.331330    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/51786f74-c658-418d-a752-d19508a76f41-ca-trust-extracted\") pod \"image-registry-86cb48fc4-g7xdp\" (UID: \"51786f74-c658-418d-a752-d19508a76f41\") " pod="openshift-image-registry/image-registry-86cb48fc4-g7xdp"
Jul 27 17:02:18.331523 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:02:18.331363    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/51786f74-c658-418d-a752-d19508a76f41-registry-tls podName:51786f74-c658-418d-a752-d19508a76f41 nodeName:}" failed. No retries permitted until 2026-07-27 17:02:18.831343478 +0000 UTC m=+52.028088272 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/51786f74-c658-418d-a752-d19508a76f41-registry-tls") pod "image-registry-86cb48fc4-g7xdp" (UID: "51786f74-c658-418d-a752-d19508a76f41") : secret "image-registry-tls" not found
Jul 27 17:02:18.331523 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:18.331427    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/51786f74-c658-418d-a752-d19508a76f41-image-registry-private-configuration\") pod \"image-registry-86cb48fc4-g7xdp\" (UID: \"51786f74-c658-418d-a752-d19508a76f41\") " pod="openshift-image-registry/image-registry-86cb48fc4-g7xdp"
Jul 27 17:02:18.331897 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:18.331753    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fa7f3110-1af2-4201-ae03-cae4fb2e5a51-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-jm6np\" (UID: \"fa7f3110-1af2-4201-ae03-cae4fb2e5a51\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-jm6np"
Jul 27 17:02:18.332120 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:18.332101    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/51786f74-c658-418d-a752-d19508a76f41-ca-trust-extracted\") pod \"image-registry-86cb48fc4-g7xdp\" (UID: \"51786f74-c658-418d-a752-d19508a76f41\") " pod="openshift-image-registry/image-registry-86cb48fc4-g7xdp"
Jul 27 17:02:18.332293 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:18.332274    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/51786f74-c658-418d-a752-d19508a76f41-trusted-ca\") pod \"image-registry-86cb48fc4-g7xdp\" (UID: \"51786f74-c658-418d-a752-d19508a76f41\") " pod="openshift-image-registry/image-registry-86cb48fc4-g7xdp"
Jul 27 17:02:18.332409 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:18.332390    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/51786f74-c658-418d-a752-d19508a76f41-registry-certificates\") pod \"image-registry-86cb48fc4-g7xdp\" (UID: \"51786f74-c658-418d-a752-d19508a76f41\") " pod="openshift-image-registry/image-registry-86cb48fc4-g7xdp"
Jul 27 17:02:18.333416 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:18.333401    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/51786f74-c658-418d-a752-d19508a76f41-installation-pull-secrets\") pod \"image-registry-86cb48fc4-g7xdp\" (UID: \"51786f74-c658-418d-a752-d19508a76f41\") " pod="openshift-image-registry/image-registry-86cb48fc4-g7xdp"
Jul 27 17:02:18.333416 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:18.333408    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fa7f3110-1af2-4201-ae03-cae4fb2e5a51-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-jm6np\" (UID: \"fa7f3110-1af2-4201-ae03-cae4fb2e5a51\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-jm6np"
Jul 27 17:02:18.333839 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:18.333809    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/51786f74-c658-418d-a752-d19508a76f41-image-registry-private-configuration\") pod \"image-registry-86cb48fc4-g7xdp\" (UID: \"51786f74-c658-418d-a752-d19508a76f41\") " pod="openshift-image-registry/image-registry-86cb48fc4-g7xdp"
Jul 27 17:02:18.340371 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:18.340352    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/51786f74-c658-418d-a752-d19508a76f41-bound-sa-token\") pod \"image-registry-86cb48fc4-g7xdp\" (UID: \"51786f74-c658-418d-a752-d19508a76f41\") " pod="openshift-image-registry/image-registry-86cb48fc4-g7xdp"
Jul 27 17:02:18.343306 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:18.343277    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvhlv\" (UniqueName: \"kubernetes.io/projected/51786f74-c658-418d-a752-d19508a76f41-kube-api-access-zvhlv\") pod \"image-registry-86cb48fc4-g7xdp\" (UID: \"51786f74-c658-418d-a752-d19508a76f41\") " pod="openshift-image-registry/image-registry-86cb48fc4-g7xdp"
Jul 27 17:02:18.343534 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:18.343517    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vsnfv\" (UniqueName: \"kubernetes.io/projected/fa7f3110-1af2-4201-ae03-cae4fb2e5a51-kube-api-access-vsnfv\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-jm6np\" (UID: \"fa7f3110-1af2-4201-ae03-cae4fb2e5a51\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-jm6np"
Jul 27 17:02:18.366225 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:18.366202    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:02:18.372103 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:18.372086    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-kj6ht"
Jul 27 17:02:18.432766 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:18.432734    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-89dhd\" (UniqueName: \"kubernetes.io/projected/5ebba964-f3cb-4b38-8fb9-1f3568c57341-kube-api-access-89dhd\") pod \"network-check-source-7d88cb55d8-888fz\" (UID: \"5ebba964-f3cb-4b38-8fb9-1f3568c57341\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-888fz"
Jul 27 17:02:18.442079 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:18.442029    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-89dhd\" (UniqueName: \"kubernetes.io/projected/5ebba964-f3cb-4b38-8fb9-1f3568c57341-kube-api-access-89dhd\") pod \"network-check-source-7d88cb55d8-888fz\" (UID: \"5ebba964-f3cb-4b38-8fb9-1f3568c57341\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-888fz"
Jul 27 17:02:18.471921 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:18.468479    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:02:18.471921 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:18.471537    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-jm6np"
Jul 27 17:02:18.535511 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:18.533796    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ad547374-9c50-4b13-8884-74ed191f077a-metrics-tls\") pod \"dns-default-pvns7\" (UID: \"ad547374-9c50-4b13-8884-74ed191f077a\") " pod="openshift-dns/dns-default-pvns7"
Jul 27 17:02:18.535511 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:02:18.533978    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 17:02:18.535511 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:02:18.534072    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad547374-9c50-4b13-8884-74ed191f077a-metrics-tls podName:ad547374-9c50-4b13-8884-74ed191f077a nodeName:}" failed. No retries permitted until 2026-07-27 17:02:34.534048784 +0000 UTC m=+67.730793584 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ad547374-9c50-4b13-8884-74ed191f077a-metrics-tls") pod "dns-default-pvns7" (UID: "ad547374-9c50-4b13-8884-74ed191f077a") : secret "dns-default-metrics-tls" not found
Jul 27 17:02:18.541701 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:18.541623    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-kj6ht"]
Jul 27 17:02:18.544587 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:02:18.544562    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65a00fd9_7e2d_4bec_81b5_bd36362c3971.slice/crio-755f87f3833b36e173b08fe193ed4e912773331d753e9fd7bb3887d932167ec6 WatchSource:0}: Error finding container 755f87f3833b36e173b08fe193ed4e912773331d753e9fd7bb3887d932167ec6: Status 404 returned error can't find the container with id 755f87f3833b36e173b08fe193ed4e912773331d753e9fd7bb3887d932167ec6
Jul 27 17:02:18.567882 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:18.567861    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-888fz"
Jul 27 17:02:18.626352 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:18.626317    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-jm6np"]
Jul 27 17:02:18.628875 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:02:18.628851    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa7f3110_1af2_4201_ae03_cae4fb2e5a51.slice/crio-fd4c4b0a8c0609b375bd2aba7b0287225ceea82cab252edd7bffaa77bb5bb5a6 WatchSource:0}: Error finding container fd4c4b0a8c0609b375bd2aba7b0287225ceea82cab252edd7bffaa77bb5bb5a6: Status 404 returned error can't find the container with id fd4c4b0a8c0609b375bd2aba7b0287225ceea82cab252edd7bffaa77bb5bb5a6
Jul 27 17:02:18.718211 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:18.718182    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-888fz"]
Jul 27 17:02:18.720803 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:02:18.720776    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ebba964_f3cb_4b38_8fb9_1f3568c57341.slice/crio-5910987280ecc0ad01bc16a6ff6c763b82d2ccb902e6a60fcb85cf211ed91595 WatchSource:0}: Error finding container 5910987280ecc0ad01bc16a6ff6c763b82d2ccb902e6a60fcb85cf211ed91595: Status 404 returned error can't find the container with id 5910987280ecc0ad01bc16a6ff6c763b82d2ccb902e6a60fcb85cf211ed91595
Jul 27 17:02:18.836889 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:18.836861    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/51786f74-c658-418d-a752-d19508a76f41-registry-tls\") pod \"image-registry-86cb48fc4-g7xdp\" (UID: \"51786f74-c658-418d-a752-d19508a76f41\") " pod="openshift-image-registry/image-registry-86cb48fc4-g7xdp"
Jul 27 17:02:18.837048 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:02:18.837011    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 27 17:02:18.837048 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:02:18.837029    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-86cb48fc4-g7xdp: secret "image-registry-tls" not found
Jul 27 17:02:18.837115 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:02:18.837081    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/51786f74-c658-418d-a752-d19508a76f41-registry-tls podName:51786f74-c658-418d-a752-d19508a76f41 nodeName:}" failed. No retries permitted until 2026-07-27 17:02:19.837066293 +0000 UTC m=+53.033811073 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/51786f74-c658-418d-a752-d19508a76f41-registry-tls") pod "image-registry-86cb48fc4-g7xdp" (UID: "51786f74-c658-418d-a752-d19508a76f41") : secret "image-registry-tls" not found
Jul 27 17:02:19.485736 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:19.485705    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-888fz" event={"ID":"5ebba964-f3cb-4b38-8fb9-1f3568c57341","Type":"ContainerStarted","Data":"5910987280ecc0ad01bc16a6ff6c763b82d2ccb902e6a60fcb85cf211ed91595"}
Jul 27 17:02:19.487043 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:19.487017    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-kj6ht" event={"ID":"65a00fd9-7e2d-4bec-81b5-bd36362c3971","Type":"ContainerStarted","Data":"755f87f3833b36e173b08fe193ed4e912773331d753e9fd7bb3887d932167ec6"}
Jul 27 17:02:19.488285 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:19.488262    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-jm6np" event={"ID":"fa7f3110-1af2-4201-ae03-cae4fb2e5a51","Type":"ContainerStarted","Data":"fd4c4b0a8c0609b375bd2aba7b0287225ceea82cab252edd7bffaa77bb5bb5a6"}
Jul 27 17:02:19.845381 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:19.845310    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/51786f74-c658-418d-a752-d19508a76f41-registry-tls\") pod \"image-registry-86cb48fc4-g7xdp\" (UID: \"51786f74-c658-418d-a752-d19508a76f41\") " pod="openshift-image-registry/image-registry-86cb48fc4-g7xdp"
Jul 27 17:02:19.845535 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:02:19.845501    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 27 17:02:19.845535 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:02:19.845523    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-86cb48fc4-g7xdp: secret "image-registry-tls" not found
Jul 27 17:02:19.845649 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:02:19.845581    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/51786f74-c658-418d-a752-d19508a76f41-registry-tls podName:51786f74-c658-418d-a752-d19508a76f41 nodeName:}" failed. No retries permitted until 2026-07-27 17:02:21.84556575 +0000 UTC m=+55.042310546 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/51786f74-c658-418d-a752-d19508a76f41-registry-tls") pod "image-registry-86cb48fc4-g7xdp" (UID: "51786f74-c658-418d-a752-d19508a76f41") : secret "image-registry-tls" not found
Jul 27 17:02:21.861929 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:21.861896    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/51786f74-c658-418d-a752-d19508a76f41-registry-tls\") pod \"image-registry-86cb48fc4-g7xdp\" (UID: \"51786f74-c658-418d-a752-d19508a76f41\") " pod="openshift-image-registry/image-registry-86cb48fc4-g7xdp"
Jul 27 17:02:21.862391 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:02:21.862006    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 27 17:02:21.862391 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:02:21.862017    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-86cb48fc4-g7xdp: secret "image-registry-tls" not found
Jul 27 17:02:21.862391 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:02:21.862066    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/51786f74-c658-418d-a752-d19508a76f41-registry-tls podName:51786f74-c658-418d-a752-d19508a76f41 nodeName:}" failed. No retries permitted until 2026-07-27 17:02:25.862052828 +0000 UTC m=+59.058797625 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/51786f74-c658-418d-a752-d19508a76f41-registry-tls") pod "image-registry-86cb48fc4-g7xdp" (UID: "51786f74-c658-418d-a752-d19508a76f41") : secret "image-registry-tls" not found
Jul 27 17:02:22.184106 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:22.184026    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-gjcfv"]
Jul 27 17:02:22.186562 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:22.186533    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-gjcfv"
Jul 27 17:02:22.189597 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:22.189435    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 27 17:02:22.189597 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:22.189464    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 27 17:02:22.190318 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:22.190279    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 27 17:02:22.190318 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:22.190302    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-hn8cb\""
Jul 27 17:02:22.190477 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:22.190336    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 27 17:02:22.210160 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:22.210135    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-gjcfv"]
Jul 27 17:02:22.240439 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:22.240359    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:02:22.265794 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:22.265771    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zd9c2\" (UniqueName: \"kubernetes.io/projected/68c7bd95-3782-462d-88dd-76fff9fbabed-kube-api-access-zd9c2\") pod \"insights-runtime-extractor-gjcfv\" (UID: \"68c7bd95-3782-462d-88dd-76fff9fbabed\") " pod="openshift-insights/insights-runtime-extractor-gjcfv"
Jul 27 17:02:22.265932 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:22.265805    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/68c7bd95-3782-462d-88dd-76fff9fbabed-data-volume\") pod \"insights-runtime-extractor-gjcfv\" (UID: \"68c7bd95-3782-462d-88dd-76fff9fbabed\") " pod="openshift-insights/insights-runtime-extractor-gjcfv"
Jul 27 17:02:22.265932 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:22.265855    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/68c7bd95-3782-462d-88dd-76fff9fbabed-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gjcfv\" (UID: \"68c7bd95-3782-462d-88dd-76fff9fbabed\") " pod="openshift-insights/insights-runtime-extractor-gjcfv"
Jul 27 17:02:22.266000 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:22.265959    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/68c7bd95-3782-462d-88dd-76fff9fbabed-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gjcfv\" (UID: \"68c7bd95-3782-462d-88dd-76fff9fbabed\") " pod="openshift-insights/insights-runtime-extractor-gjcfv"
Jul 27 17:02:22.266000 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:22.265986    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/68c7bd95-3782-462d-88dd-76fff9fbabed-crio-socket\") pod \"insights-runtime-extractor-gjcfv\" (UID: \"68c7bd95-3782-462d-88dd-76fff9fbabed\") " pod="openshift-insights/insights-runtime-extractor-gjcfv"
Jul 27 17:02:22.298330 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:22.298301    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:02:22.366912 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:22.366885    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zd9c2\" (UniqueName: \"kubernetes.io/projected/68c7bd95-3782-462d-88dd-76fff9fbabed-kube-api-access-zd9c2\") pod \"insights-runtime-extractor-gjcfv\" (UID: \"68c7bd95-3782-462d-88dd-76fff9fbabed\") " pod="openshift-insights/insights-runtime-extractor-gjcfv"
Jul 27 17:02:22.367019 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:22.366944    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/68c7bd95-3782-462d-88dd-76fff9fbabed-data-volume\") pod \"insights-runtime-extractor-gjcfv\" (UID: \"68c7bd95-3782-462d-88dd-76fff9fbabed\") " pod="openshift-insights/insights-runtime-extractor-gjcfv"
Jul 27 17:02:22.367019 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:22.366986    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/68c7bd95-3782-462d-88dd-76fff9fbabed-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gjcfv\" (UID: \"68c7bd95-3782-462d-88dd-76fff9fbabed\") " pod="openshift-insights/insights-runtime-extractor-gjcfv"
Jul 27 17:02:22.367146 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:02:22.367079    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 27 17:02:22.367146 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:22.367083    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/68c7bd95-3782-462d-88dd-76fff9fbabed-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gjcfv\" (UID: \"68c7bd95-3782-462d-88dd-76fff9fbabed\") " pod="openshift-insights/insights-runtime-extractor-gjcfv"
Jul 27 17:02:22.367146 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:02:22.367138    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/68c7bd95-3782-462d-88dd-76fff9fbabed-kube-rbac-proxy-cm podName:68c7bd95-3782-462d-88dd-76fff9fbabed nodeName:}" failed. No retries permitted until 2026-07-27 17:02:22.867121494 +0000 UTC m=+56.063866293 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/68c7bd95-3782-462d-88dd-76fff9fbabed-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gjcfv" (UID: "68c7bd95-3782-462d-88dd-76fff9fbabed") : configmap "kube-rbac-proxy" not found
Jul 27 17:02:22.367284 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:22.367156    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/68c7bd95-3782-462d-88dd-76fff9fbabed-crio-socket\") pod \"insights-runtime-extractor-gjcfv\" (UID: \"68c7bd95-3782-462d-88dd-76fff9fbabed\") " pod="openshift-insights/insights-runtime-extractor-gjcfv"
Jul 27 17:02:22.367284 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:02:22.367188    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 27 17:02:22.367284 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:02:22.367249    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68c7bd95-3782-462d-88dd-76fff9fbabed-insights-runtime-extractor-tls podName:68c7bd95-3782-462d-88dd-76fff9fbabed nodeName:}" failed. No retries permitted until 2026-07-27 17:02:22.867232645 +0000 UTC m=+56.063977428 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/68c7bd95-3782-462d-88dd-76fff9fbabed-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gjcfv" (UID: "68c7bd95-3782-462d-88dd-76fff9fbabed") : secret "insights-runtime-extractor-tls" not found
Jul 27 17:02:22.367426 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:22.367383    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/68c7bd95-3782-462d-88dd-76fff9fbabed-crio-socket\") pod \"insights-runtime-extractor-gjcfv\" (UID: \"68c7bd95-3782-462d-88dd-76fff9fbabed\") " pod="openshift-insights/insights-runtime-extractor-gjcfv"
Jul 27 17:02:22.367463 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:22.367429    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/68c7bd95-3782-462d-88dd-76fff9fbabed-data-volume\") pod \"insights-runtime-extractor-gjcfv\" (UID: \"68c7bd95-3782-462d-88dd-76fff9fbabed\") " pod="openshift-insights/insights-runtime-extractor-gjcfv"
Jul 27 17:02:22.375442 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:22.375413    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zd9c2\" (UniqueName: \"kubernetes.io/projected/68c7bd95-3782-462d-88dd-76fff9fbabed-kube-api-access-zd9c2\") pod \"insights-runtime-extractor-gjcfv\" (UID: \"68c7bd95-3782-462d-88dd-76fff9fbabed\") " pod="openshift-insights/insights-runtime-extractor-gjcfv"
Jul 27 17:02:22.872788 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:22.872746    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/68c7bd95-3782-462d-88dd-76fff9fbabed-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gjcfv\" (UID: \"68c7bd95-3782-462d-88dd-76fff9fbabed\") " pod="openshift-insights/insights-runtime-extractor-gjcfv"
Jul 27 17:02:22.873242 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:22.872818    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/68c7bd95-3782-462d-88dd-76fff9fbabed-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gjcfv\" (UID: \"68c7bd95-3782-462d-88dd-76fff9fbabed\") " pod="openshift-insights/insights-runtime-extractor-gjcfv"
Jul 27 17:02:22.873242 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:02:22.872944    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 27 17:02:22.873242 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:02:22.873004    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 27 17:02:22.873242 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:02:22.873018    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/68c7bd95-3782-462d-88dd-76fff9fbabed-kube-rbac-proxy-cm podName:68c7bd95-3782-462d-88dd-76fff9fbabed nodeName:}" failed. No retries permitted until 2026-07-27 17:02:23.872997335 +0000 UTC m=+57.069742120 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/68c7bd95-3782-462d-88dd-76fff9fbabed-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gjcfv" (UID: "68c7bd95-3782-462d-88dd-76fff9fbabed") : configmap "kube-rbac-proxy" not found
Jul 27 17:02:22.873242 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:02:22.873055    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68c7bd95-3782-462d-88dd-76fff9fbabed-insights-runtime-extractor-tls podName:68c7bd95-3782-462d-88dd-76fff9fbabed nodeName:}" failed. No retries permitted until 2026-07-27 17:02:23.873040381 +0000 UTC m=+57.069785184 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/68c7bd95-3782-462d-88dd-76fff9fbabed-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gjcfv" (UID: "68c7bd95-3782-462d-88dd-76fff9fbabed") : secret "insights-runtime-extractor-tls" not found
Jul 27 17:02:23.198720 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:23.198682    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:02:23.265898 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:23.265858    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:02:23.502281 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:23.502193    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-888fz" event={"ID":"5ebba964-f3cb-4b38-8fb9-1f3568c57341","Type":"ContainerStarted","Data":"69b6a41e78b5ff76d68e42a311dc264f7d9aa34c40e3b5a4c7d649250067733a"}
Jul 27 17:02:23.503765 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:23.503738    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-kj6ht" event={"ID":"65a00fd9-7e2d-4bec-81b5-bd36362c3971","Type":"ContainerStarted","Data":"bba119a179f6a0c64262f775cc7aa1e57c1e37d0b48d06c8d96783006d7a1f4d"}
Jul 27 17:02:23.505209 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:23.505186    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-jm6np" event={"ID":"fa7f3110-1af2-4201-ae03-cae4fb2e5a51","Type":"ContainerStarted","Data":"b75185afb222ca4ad27058ecabbfa55a6ef884532f40209ff1ddd472420c5dd7"}
Jul 27 17:02:23.518865 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:23.518799    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-888fz" podStartSLOduration=1.5201454079999999 podStartE2EDuration="5.518783197s" totalImagesPullingTime="3.998637789s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:02:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:02:23.517085698 +0000 UTC m=+56.713830503" watchObservedRunningTime="2026-07-27 17:02:23.518783197 +0000 UTC m=+56.715527997"
Jul 27 17:02:23.558785 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:23.558739    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-kj6ht" podStartSLOduration=1.37856987 podStartE2EDuration="5.558722164s" totalImagesPullingTime="4.180152294s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:02:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:02:23.557682107 +0000 UTC m=+56.754426910" watchObservedRunningTime="2026-07-27 17:02:23.558722164 +0000 UTC m=+56.755466967"
Jul 27 17:02:23.558923 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:23.558851    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-jm6np" podStartSLOduration=1.462775036 podStartE2EDuration="5.558843045s" totalImagesPullingTime="4.096068009s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:02:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:02:23.533220525 +0000 UTC m=+56.729965328" watchObservedRunningTime="2026-07-27 17:02:23.558843045 +0000 UTC m=+56.755587851"
Jul 27 17:02:23.880287 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:23.880245    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/68c7bd95-3782-462d-88dd-76fff9fbabed-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gjcfv\" (UID: \"68c7bd95-3782-462d-88dd-76fff9fbabed\") " pod="openshift-insights/insights-runtime-extractor-gjcfv"
Jul 27 17:02:23.880877 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:23.880851    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/68c7bd95-3782-462d-88dd-76fff9fbabed-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gjcfv\" (UID: \"68c7bd95-3782-462d-88dd-76fff9fbabed\") " pod="openshift-insights/insights-runtime-extractor-gjcfv"
Jul 27 17:02:23.881159 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:02:23.880555    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 27 17:02:23.881251 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:02:23.881214    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/68c7bd95-3782-462d-88dd-76fff9fbabed-kube-rbac-proxy-cm podName:68c7bd95-3782-462d-88dd-76fff9fbabed nodeName:}" failed. No retries permitted until 2026-07-27 17:02:25.881194278 +0000 UTC m=+59.077939083 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/68c7bd95-3782-462d-88dd-76fff9fbabed-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gjcfv" (UID: "68c7bd95-3782-462d-88dd-76fff9fbabed") : configmap "kube-rbac-proxy" not found
Jul 27 17:02:23.881251 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:02:23.881069    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 27 17:02:23.881365 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:02:23.881306    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68c7bd95-3782-462d-88dd-76fff9fbabed-insights-runtime-extractor-tls podName:68c7bd95-3782-462d-88dd-76fff9fbabed nodeName:}" failed. No retries permitted until 2026-07-27 17:02:25.881285914 +0000 UTC m=+59.078030699 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/68c7bd95-3782-462d-88dd-76fff9fbabed-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gjcfv" (UID: "68c7bd95-3782-462d-88dd-76fff9fbabed") : secret "insights-runtime-extractor-tls" not found
Jul 27 17:02:23.926608 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:23.926567    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:02:23.951266 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:23.951238    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-wgpdw"]
Jul 27 17:02:23.954143 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:23.954122    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-wgpdw"
Jul 27 17:02:23.959236 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:23.959211    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-hpr2s\""
Jul 27 17:02:23.959333 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:23.959220    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 27 17:02:23.959386 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:23.959340    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 27 17:02:23.966648 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:23.966628    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-wgpdw"]
Jul 27 17:02:23.981699 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:23.981677    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6g29l\" (UniqueName: \"kubernetes.io/projected/bd95eb69-1423-4fd1-8632-8795f287cd78-kube-api-access-6g29l\") pod \"migrator-6865c9967-wgpdw\" (UID: \"bd95eb69-1423-4fd1-8632-8795f287cd78\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-wgpdw"
Jul 27 17:02:24.082305 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:24.082267    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6g29l\" (UniqueName: \"kubernetes.io/projected/bd95eb69-1423-4fd1-8632-8795f287cd78-kube-api-access-6g29l\") pod \"migrator-6865c9967-wgpdw\" (UID: \"bd95eb69-1423-4fd1-8632-8795f287cd78\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-wgpdw"
Jul 27 17:02:24.091160 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:24.091127    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6g29l\" (UniqueName: \"kubernetes.io/projected/bd95eb69-1423-4fd1-8632-8795f287cd78-kube-api-access-6g29l\") pod \"migrator-6865c9967-wgpdw\" (UID: \"bd95eb69-1423-4fd1-8632-8795f287cd78\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-wgpdw"
Jul 27 17:02:24.263380 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:24.263311    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-wgpdw"
Jul 27 17:02:24.361182 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:24.361155    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-kt2nr_0ed8e5dc-750b-42d0-86b3-7d1e6802c992/dns-node-resolver/0.log"
Jul 27 17:02:24.396198 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:24.396169    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-wgpdw"]
Jul 27 17:02:24.399783 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:02:24.399752    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd95eb69_1423_4fd1_8632_8795f287cd78.slice/crio-48d43e8725ebad322a64b8375f84d82c8c534b408631be2ecc3bb1ef3ce7063a WatchSource:0}: Error finding container 48d43e8725ebad322a64b8375f84d82c8c534b408631be2ecc3bb1ef3ce7063a: Status 404 returned error can't find the container with id 48d43e8725ebad322a64b8375f84d82c8c534b408631be2ecc3bb1ef3ce7063a
Jul 27 17:02:24.508226 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:24.508203    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-wgpdw" event={"ID":"bd95eb69-1423-4fd1-8632-8795f287cd78","Type":"ContainerStarted","Data":"48d43e8725ebad322a64b8375f84d82c8c534b408631be2ecc3bb1ef3ce7063a"}
Jul 27 17:02:24.544052 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:24.543982    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:02:24.681522 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:24.681487    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:02:24.782692 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:24.782659    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:02:25.362482 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:25.362453    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-dk4md_0bb4594a-a23f-4e66-a579-087b20377307/node-ca/0.log"
Jul 27 17:02:25.897733 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:25.897703    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/68c7bd95-3782-462d-88dd-76fff9fbabed-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gjcfv\" (UID: \"68c7bd95-3782-462d-88dd-76fff9fbabed\") " pod="openshift-insights/insights-runtime-extractor-gjcfv"
Jul 27 17:02:25.897934 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:02:25.897895    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 27 17:02:25.897997 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:25.897892    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/51786f74-c658-418d-a752-d19508a76f41-registry-tls\") pod \"image-registry-86cb48fc4-g7xdp\" (UID: \"51786f74-c658-418d-a752-d19508a76f41\") " pod="openshift-image-registry/image-registry-86cb48fc4-g7xdp"
Jul 27 17:02:25.897997 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:02:25.897964    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68c7bd95-3782-462d-88dd-76fff9fbabed-insights-runtime-extractor-tls podName:68c7bd95-3782-462d-88dd-76fff9fbabed nodeName:}" failed. No retries permitted until 2026-07-27 17:02:29.897945767 +0000 UTC m=+63.094690564 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/68c7bd95-3782-462d-88dd-76fff9fbabed-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gjcfv" (UID: "68c7bd95-3782-462d-88dd-76fff9fbabed") : secret "insights-runtime-extractor-tls" not found
Jul 27 17:02:25.897997 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:02:25.897965    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 27 17:02:25.897997 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:02:25.897982    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-86cb48fc4-g7xdp: secret "image-registry-tls" not found
Jul 27 17:02:25.898164 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:02:25.898017    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/51786f74-c658-418d-a752-d19508a76f41-registry-tls podName:51786f74-c658-418d-a752-d19508a76f41 nodeName:}" failed. No retries permitted until 2026-07-27 17:02:33.898005861 +0000 UTC m=+67.094750652 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/51786f74-c658-418d-a752-d19508a76f41-registry-tls") pod "image-registry-86cb48fc4-g7xdp" (UID: "51786f74-c658-418d-a752-d19508a76f41") : secret "image-registry-tls" not found
Jul 27 17:02:25.898164 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:25.898044    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/68c7bd95-3782-462d-88dd-76fff9fbabed-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gjcfv\" (UID: \"68c7bd95-3782-462d-88dd-76fff9fbabed\") " pod="openshift-insights/insights-runtime-extractor-gjcfv"
Jul 27 17:02:25.898164 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:02:25.898120    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 27 17:02:25.898164 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:02:25.898164    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/68c7bd95-3782-462d-88dd-76fff9fbabed-kube-rbac-proxy-cm podName:68c7bd95-3782-462d-88dd-76fff9fbabed nodeName:}" failed. No retries permitted until 2026-07-27 17:02:29.898147723 +0000 UTC m=+63.094892507 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/68c7bd95-3782-462d-88dd-76fff9fbabed-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gjcfv" (UID: "68c7bd95-3782-462d-88dd-76fff9fbabed") : configmap "kube-rbac-proxy" not found
Jul 27 17:02:25.961139 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:25.961109    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-9nm5r_07c213e5-4e80-4cba-984d-d6b344d8a17a/serve-healthcheck-canary/0.log"
Jul 27 17:02:26.323449 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:26.323378    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:02:26.521117 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:26.521087    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-wgpdw" event={"ID":"bd95eb69-1423-4fd1-8632-8795f287cd78","Type":"ContainerStarted","Data":"4084a2b58663f0171223c190703ff39e1337be57dd2e6243c2913f4e71de41e7"}
Jul 27 17:02:26.521475 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:26.521162    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-wgpdw" event={"ID":"bd95eb69-1423-4fd1-8632-8795f287cd78","Type":"ContainerStarted","Data":"e0503af67dd24000f2d4b31e1cfb47a88c183898fdfbeee1482e76f1c28d9b27"}
Jul 27 17:02:26.540454 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:26.540411    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-wgpdw" podStartSLOduration=1.934071426 podStartE2EDuration="3.540397931s" totalImagesPullingTime="1.606326505s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:02:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:02:26.540258327 +0000 UTC m=+59.737003152" watchObservedRunningTime="2026-07-27 17:02:26.540397931 +0000 UTC m=+59.737142733"
Jul 27 17:02:26.639001 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:26.638969    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:02:26.740417 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:26.740382    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:02:27.419489 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:27.419461    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-grkdn"
Jul 27 17:02:28.488170 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:28.488134    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:02:29.924587 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:29.924558    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/68c7bd95-3782-462d-88dd-76fff9fbabed-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gjcfv\" (UID: \"68c7bd95-3782-462d-88dd-76fff9fbabed\") " pod="openshift-insights/insights-runtime-extractor-gjcfv"
Jul 27 17:02:29.924983 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:29.924602    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/68c7bd95-3782-462d-88dd-76fff9fbabed-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gjcfv\" (UID: \"68c7bd95-3782-462d-88dd-76fff9fbabed\") " pod="openshift-insights/insights-runtime-extractor-gjcfv"
Jul 27 17:02:29.924983 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:02:29.924684    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 27 17:02:29.924983 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:02:29.924743    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 27 17:02:29.924983 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:02:29.924745    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/68c7bd95-3782-462d-88dd-76fff9fbabed-kube-rbac-proxy-cm podName:68c7bd95-3782-462d-88dd-76fff9fbabed nodeName:}" failed. No retries permitted until 2026-07-27 17:02:37.924730726 +0000 UTC m=+71.121475529 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/68c7bd95-3782-462d-88dd-76fff9fbabed-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gjcfv" (UID: "68c7bd95-3782-462d-88dd-76fff9fbabed") : configmap "kube-rbac-proxy" not found
Jul 27 17:02:29.924983 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:02:29.924794    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68c7bd95-3782-462d-88dd-76fff9fbabed-insights-runtime-extractor-tls podName:68c7bd95-3782-462d-88dd-76fff9fbabed nodeName:}" failed. No retries permitted until 2026-07-27 17:02:37.924783401 +0000 UTC m=+71.121528182 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/68c7bd95-3782-462d-88dd-76fff9fbabed-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gjcfv" (UID: "68c7bd95-3782-462d-88dd-76fff9fbabed") : secret "insights-runtime-extractor-tls" not found
Jul 27 17:02:30.038152 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:30.038124    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:02:30.175740 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:30.175668    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:02:30.277203 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:30.277174    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:02:30.550718 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:30.550647    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:02:31.643871 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:31.643825    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:02:31.745466 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:31.745438    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:02:31.915624 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:31.915537    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:02:32.298106 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:32.298035    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:02:32.488366 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:32.488333    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:02:32.897876 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:32.897840    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:02:32.948011 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:32.947988    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2b793cd9-1cc7-4f3b-b882-1999e673076d-original-pull-secret\") pod \"global-pull-secret-syncer-g6775\" (UID: \"2b793cd9-1cc7-4f3b-b882-1999e673076d\") " pod="kube-system/global-pull-secret-syncer-g6775"
Jul 27 17:02:32.948080 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:32.948026    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d26abfd5-3102-42ec-a7e0-c5abe0e9dc85-metrics-certs\") pod \"network-metrics-daemon-s5bhd\" (UID: \"d26abfd5-3102-42ec-a7e0-c5abe0e9dc85\") " pod="openshift-multus/network-metrics-daemon-s5bhd"
Jul 27 17:02:32.950117 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:32.950103    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 27 17:02:32.950188 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:32.950168    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 27 17:02:32.958176 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:02:32.958156    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 27 17:02:32.958225 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:02:32.958211    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d26abfd5-3102-42ec-a7e0-c5abe0e9dc85-metrics-certs podName:d26abfd5-3102-42ec-a7e0-c5abe0e9dc85 nodeName:}" failed. No retries permitted until 2026-07-27 17:03:36.95819804 +0000 UTC m=+130.154942820 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d26abfd5-3102-42ec-a7e0-c5abe0e9dc85-metrics-certs") pod "network-metrics-daemon-s5bhd" (UID: "d26abfd5-3102-42ec-a7e0-c5abe0e9dc85") : secret "metrics-daemon-secret" not found
Jul 27 17:02:32.960236 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:32.960208    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2b793cd9-1cc7-4f3b-b882-1999e673076d-original-pull-secret\") pod \"global-pull-secret-syncer-g6775\" (UID: \"2b793cd9-1cc7-4f3b-b882-1999e673076d\") " pod="kube-system/global-pull-secret-syncer-g6775"
Jul 27 17:02:33.084977 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:33.084946    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g6775"
Jul 27 17:02:33.149558 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:33.149491    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6kb9\" (UniqueName: \"kubernetes.io/projected/8789c3a3-c9f7-43f1-8ea2-b279c80fe9a7-kube-api-access-l6kb9\") pod \"network-check-target-x5xw7\" (UID: \"8789c3a3-c9f7-43f1-8ea2-b279c80fe9a7\") " pod="openshift-network-diagnostics/network-check-target-x5xw7"
Jul 27 17:02:33.151755 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:33.151730    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6kb9\" (UniqueName: \"kubernetes.io/projected/8789c3a3-c9f7-43f1-8ea2-b279c80fe9a7-kube-api-access-l6kb9\") pod \"network-check-target-x5xw7\" (UID: \"8789c3a3-c9f7-43f1-8ea2-b279c80fe9a7\") " pod="openshift-network-diagnostics/network-check-target-x5xw7"
Jul 27 17:02:33.202621 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:33.202594    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-g6775"]
Jul 27 17:02:33.205566 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:02:33.205537    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b793cd9_1cc7_4f3b_b882_1999e673076d.slice/crio-355d430feda445a711b872c6ec0039f11a69c27d150f37df64632d0a5cec3de7 WatchSource:0}: Error finding container 355d430feda445a711b872c6ec0039f11a69c27d150f37df64632d0a5cec3de7: Status 404 returned error can't find the container with id 355d430feda445a711b872c6ec0039f11a69c27d150f37df64632d0a5cec3de7
Jul 27 17:02:33.391888 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:33.391825    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-c7drs\""
Jul 27 17:02:33.400104 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:33.400035    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5xw7"
Jul 27 17:02:33.515137 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:33.515107    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-x5xw7"]
Jul 27 17:02:33.517892 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:02:33.517868    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8789c3a3_c9f7_43f1_8ea2_b279c80fe9a7.slice/crio-adc5a32b4d4758592313f45faf0b0e937a784361427721aa73b21cb792a3b9af WatchSource:0}: Error finding container adc5a32b4d4758592313f45faf0b0e937a784361427721aa73b21cb792a3b9af: Status 404 returned error can't find the container with id adc5a32b4d4758592313f45faf0b0e937a784361427721aa73b21cb792a3b9af
Jul 27 17:02:33.542450 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:33.542422    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-g6775" event={"ID":"2b793cd9-1cc7-4f3b-b882-1999e673076d","Type":"ContainerStarted","Data":"355d430feda445a711b872c6ec0039f11a69c27d150f37df64632d0a5cec3de7"}
Jul 27 17:02:33.543369 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:33.543347    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-x5xw7" event={"ID":"8789c3a3-c9f7-43f1-8ea2-b279c80fe9a7","Type":"ContainerStarted","Data":"adc5a32b4d4758592313f45faf0b0e937a784361427721aa73b21cb792a3b9af"}
Jul 27 17:02:33.614292 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:33.614259    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:02:33.715348 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:33.715281    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:02:33.821431 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:33.821398    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:02:33.894434 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:33.894386    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:02:33.955922 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:33.955891    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/51786f74-c658-418d-a752-d19508a76f41-registry-tls\") pod \"image-registry-86cb48fc4-g7xdp\" (UID: \"51786f74-c658-418d-a752-d19508a76f41\") " pod="openshift-image-registry/image-registry-86cb48fc4-g7xdp"
Jul 27 17:02:33.958337 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:33.958316    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/51786f74-c658-418d-a752-d19508a76f41-registry-tls\") pod \"image-registry-86cb48fc4-g7xdp\" (UID: \"51786f74-c658-418d-a752-d19508a76f41\") " pod="openshift-image-registry/image-registry-86cb48fc4-g7xdp"
Jul 27 17:02:34.091208 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:34.091132    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-64scz\""
Jul 27 17:02:34.094122 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:34.094078    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:02:34.099896 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:34.099879    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-86cb48fc4-g7xdp"
Jul 27 17:02:34.240009 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:34.239972    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-86cb48fc4-g7xdp"]
Jul 27 17:02:34.243252 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:02:34.243222    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51786f74_c658_418d_a752_d19508a76f41.slice/crio-9748f10f7d1f3d25ad81d05d70007beea819841aa0be6930bc2a95578297e6ea WatchSource:0}: Error finding container 9748f10f7d1f3d25ad81d05d70007beea819841aa0be6930bc2a95578297e6ea: Status 404 returned error can't find the container with id 9748f10f7d1f3d25ad81d05d70007beea819841aa0be6930bc2a95578297e6ea
Jul 27 17:02:34.491382 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:34.491343    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:02:34.548912 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:34.548873    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-x5xw7" event={"ID":"8789c3a3-c9f7-43f1-8ea2-b279c80fe9a7","Type":"ContainerStarted","Data":"f7ff27f80ac5e75baf6c6fa560c6ac9f70837174ffc7f3ea27e58aaf068df378"}
Jul 27 17:02:34.549094 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:34.548961    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-x5xw7"
Jul 27 17:02:34.550369 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:34.550327    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:02:34.550728 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:34.550703    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-86cb48fc4-g7xdp" event={"ID":"51786f74-c658-418d-a752-d19508a76f41","Type":"ContainerStarted","Data":"7fcc712e7ba51464c4d0b34b4bc1e65e658bf6c269efc1735afc8760c4920906"}
Jul 27 17:02:34.550808 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:34.550746    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-86cb48fc4-g7xdp" event={"ID":"51786f74-c658-418d-a752-d19508a76f41","Type":"ContainerStarted","Data":"9748f10f7d1f3d25ad81d05d70007beea819841aa0be6930bc2a95578297e6ea"}
Jul 27 17:02:34.550808 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:34.550783    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-86cb48fc4-g7xdp"
Jul 27 17:02:34.561162 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:34.561136    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ad547374-9c50-4b13-8884-74ed191f077a-metrics-tls\") pod \"dns-default-pvns7\" (UID: \"ad547374-9c50-4b13-8884-74ed191f077a\") " pod="openshift-dns/dns-default-pvns7"
Jul 27 17:02:34.563667 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:34.563642    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ad547374-9c50-4b13-8884-74ed191f077a-metrics-tls\") pod \"dns-default-pvns7\" (UID: \"ad547374-9c50-4b13-8884-74ed191f077a\") " pod="openshift-dns/dns-default-pvns7"
Jul 27 17:02:34.563965 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:34.563718    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-x5xw7" podStartSLOduration=67.56370172 podStartE2EDuration="1m7.56370172s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:01:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:02:34.563410602 +0000 UTC m=+67.760155418" watchObservedRunningTime="2026-07-27 17:02:34.56370172 +0000 UTC m=+67.760446524"
Jul 27 17:02:34.584150 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:34.584108    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-86cb48fc4-g7xdp" podStartSLOduration=16.584094731 podStartE2EDuration="16.584094731s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:02:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:02:34.582452048 +0000 UTC m=+67.779196852" watchObservedRunningTime="2026-07-27 17:02:34.584094731 +0000 UTC m=+67.780839533"
Jul 27 17:02:34.806565 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:34.806489    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5sbpw\""
Jul 27 17:02:34.814674 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:34.814647    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pvns7"
Jul 27 17:02:34.951121 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:34.951021    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-pvns7"]
Jul 27 17:02:34.953509 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:02:34.953476    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad547374_9c50_4b13_8884_74ed191f077a.slice/crio-596c229ecf7229033b26c33bb4657e5e93c40a09b033f06df1b2934f3506e541 WatchSource:0}: Error finding container 596c229ecf7229033b26c33bb4657e5e93c40a09b033f06df1b2934f3506e541: Status 404 returned error can't find the container with id 596c229ecf7229033b26c33bb4657e5e93c40a09b033f06df1b2934f3506e541
Jul 27 17:02:35.303686 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:35.303634    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:02:35.405344 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:35.405314    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:02:35.505380 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:35.505331    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:02:35.557668 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:35.557069    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pvns7" event={"ID":"ad547374-9c50-4b13-8884-74ed191f077a","Type":"ContainerStarted","Data":"596c229ecf7229033b26c33bb4657e5e93c40a09b033f06df1b2934f3506e541"}
Jul 27 17:02:35.914520 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:35.914487    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:02:36.099518 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:36.099485    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:02:36.162622 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:36.162592    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:02:36.290718 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:36.290641    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:02:37.091550 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:37.091512    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:02:37.310754 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:37.310706    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:02:37.934899 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:37.934796    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:02:37.989060 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:37.989029    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/68c7bd95-3782-462d-88dd-76fff9fbabed-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gjcfv\" (UID: \"68c7bd95-3782-462d-88dd-76fff9fbabed\") " pod="openshift-insights/insights-runtime-extractor-gjcfv"
Jul 27 17:02:37.989167 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:37.989072    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/68c7bd95-3782-462d-88dd-76fff9fbabed-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gjcfv\" (UID: \"68c7bd95-3782-462d-88dd-76fff9fbabed\") " pod="openshift-insights/insights-runtime-extractor-gjcfv"
Jul 27 17:02:37.989221 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:02:37.989169    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 27 17:02:37.989221 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:02:37.989221    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68c7bd95-3782-462d-88dd-76fff9fbabed-insights-runtime-extractor-tls podName:68c7bd95-3782-462d-88dd-76fff9fbabed nodeName:}" failed. No retries permitted until 2026-07-27 17:02:53.989205649 +0000 UTC m=+87.185950431 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/68c7bd95-3782-462d-88dd-76fff9fbabed-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gjcfv" (UID: "68c7bd95-3782-462d-88dd-76fff9fbabed") : secret "insights-runtime-extractor-tls" not found
Jul 27 17:02:37.989584 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:37.989559    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/68c7bd95-3782-462d-88dd-76fff9fbabed-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gjcfv\" (UID: \"68c7bd95-3782-462d-88dd-76fff9fbabed\") " pod="openshift-insights/insights-runtime-extractor-gjcfv"
Jul 27 17:02:38.291944 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:38.291859    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:02:38.513354 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:38.513321    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:02:38.568409 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:38.568328    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-g6775" event={"ID":"2b793cd9-1cc7-4f3b-b882-1999e673076d","Type":"ContainerStarted","Data":"303385e4fcc4b7dd7980d0106a2d8077a9420714d4fb46140cad05e7638cc13e"}
Jul 27 17:02:38.570036 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:38.570010    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pvns7" event={"ID":"ad547374-9c50-4b13-8884-74ed191f077a","Type":"ContainerStarted","Data":"1360c47e0fc3a802d44cf7d9a9aef261e7af2b1e6bfc7baf685784c5a3b3adbc"}
Jul 27 17:02:38.570151 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:38.570051    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pvns7" event={"ID":"ad547374-9c50-4b13-8884-74ed191f077a","Type":"ContainerStarted","Data":"360de0642bdf5bd6214d72a125453978adfacf6ca044e8e666f2022c1c086984"}
Jul 27 17:02:38.570151 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:38.570140    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-pvns7"
Jul 27 17:02:38.589103 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:38.589058    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-g6775" podStartSLOduration=67.18093293 podStartE2EDuration="1m11.589040788s" totalImagesPullingTime="4.408107858s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 17:01:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:02:38.587573922 +0000 UTC m=+71.784318723" watchObservedRunningTime="2026-07-27 17:02:38.589040788 +0000 UTC m=+71.785785591"
Jul 27 17:02:38.608767 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:38.608719    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-pvns7" podStartSLOduration=33.955452186 podStartE2EDuration="36.60870067s" totalImagesPullingTime="2.653248484s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:02:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:02:38.607245566 +0000 UTC m=+71.803990368" watchObservedRunningTime="2026-07-27 17:02:38.60870067 +0000 UTC m=+71.805445489"
Jul 27 17:02:39.086688 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:39.086659    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:02:39.486307 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:39.486282    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:02:39.559177 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:39.559151    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:02:39.890863 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:39.890823    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:02:40.093458 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:40.093427    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:02:40.193043 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:40.192979    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:02:40.294363 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:40.294338    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:02:40.354329 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:40.354307    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:02:40.696058 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:40.696020    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:02:47.512709 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:47.512670    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-58fc64c998-8pjdc"]
Jul 27 17:02:47.515571 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:47.515553    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58fc64c998-8pjdc"
Jul 27 17:02:47.519286 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:47.519263    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 27 17:02:47.520533 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:47.520511    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 27 17:02:47.520642 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:47.520528    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 27 17:02:47.520642 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:47.520579    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 27 17:02:47.524997 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:47.524979    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-58fc64c998-8pjdc"]
Jul 27 17:02:47.542442 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:47.542418    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-86cb48fc4-g7xdp"]
Jul 27 17:02:47.601863 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:47.601807    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:02:47.612995 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:47.612970    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5f6478cfcf-8vjv8"]
Jul 27 17:02:47.615910 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:47.615891    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5f6478cfcf-8vjv8"
Jul 27 17:02:47.647542 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:47.647512    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5f6478cfcf-8vjv8"]
Jul 27 17:02:47.656794 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:47.656770    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-slvzt\" (UniqueName: \"kubernetes.io/projected/d3f65bab-3bc7-4247-96b0-3bbef8281266-kube-api-access-slvzt\") pod \"klusterlet-addon-workmgr-58fc64c998-8pjdc\" (UID: \"d3f65bab-3bc7-4247-96b0-3bbef8281266\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58fc64c998-8pjdc"
Jul 27 17:02:47.656925 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:47.656804    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d3f65bab-3bc7-4247-96b0-3bbef8281266-tmp\") pod \"klusterlet-addon-workmgr-58fc64c998-8pjdc\" (UID: \"d3f65bab-3bc7-4247-96b0-3bbef8281266\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58fc64c998-8pjdc"
Jul 27 17:02:47.656925 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:47.656875    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/d3f65bab-3bc7-4247-96b0-3bbef8281266-klusterlet-config\") pod \"klusterlet-addon-workmgr-58fc64c998-8pjdc\" (UID: \"d3f65bab-3bc7-4247-96b0-3bbef8281266\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58fc64c998-8pjdc"
Jul 27 17:02:47.708305 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:47.708273    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:02:47.757448 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:47.757411    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-slvzt\" (UniqueName: \"kubernetes.io/projected/d3f65bab-3bc7-4247-96b0-3bbef8281266-kube-api-access-slvzt\") pod \"klusterlet-addon-workmgr-58fc64c998-8pjdc\" (UID: \"d3f65bab-3bc7-4247-96b0-3bbef8281266\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58fc64c998-8pjdc"
Jul 27 17:02:47.757448 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:47.757450    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/794bcdd8-469e-45d8-90f7-36af8e118d22-bound-sa-token\") pod \"image-registry-5f6478cfcf-8vjv8\" (UID: \"794bcdd8-469e-45d8-90f7-36af8e118d22\") " pod="openshift-image-registry/image-registry-5f6478cfcf-8vjv8"
Jul 27 17:02:47.757697 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:47.757468    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/794bcdd8-469e-45d8-90f7-36af8e118d22-ca-trust-extracted\") pod \"image-registry-5f6478cfcf-8vjv8\" (UID: \"794bcdd8-469e-45d8-90f7-36af8e118d22\") " pod="openshift-image-registry/image-registry-5f6478cfcf-8vjv8"
Jul 27 17:02:47.757697 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:47.757484    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d3f65bab-3bc7-4247-96b0-3bbef8281266-tmp\") pod \"klusterlet-addon-workmgr-58fc64c998-8pjdc\" (UID: \"d3f65bab-3bc7-4247-96b0-3bbef8281266\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58fc64c998-8pjdc"
Jul 27 17:02:47.757697 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:47.757507    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/d3f65bab-3bc7-4247-96b0-3bbef8281266-klusterlet-config\") pod \"klusterlet-addon-workmgr-58fc64c998-8pjdc\" (UID: \"d3f65bab-3bc7-4247-96b0-3bbef8281266\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58fc64c998-8pjdc"
Jul 27 17:02:47.757697 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:47.757525    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/794bcdd8-469e-45d8-90f7-36af8e118d22-installation-pull-secrets\") pod \"image-registry-5f6478cfcf-8vjv8\" (UID: \"794bcdd8-469e-45d8-90f7-36af8e118d22\") " pod="openshift-image-registry/image-registry-5f6478cfcf-8vjv8"
Jul 27 17:02:47.757697 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:47.757544    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/794bcdd8-469e-45d8-90f7-36af8e118d22-trusted-ca\") pod \"image-registry-5f6478cfcf-8vjv8\" (UID: \"794bcdd8-469e-45d8-90f7-36af8e118d22\") " pod="openshift-image-registry/image-registry-5f6478cfcf-8vjv8"
Jul 27 17:02:47.757697 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:47.757570    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xh6zg\" (UniqueName: \"kubernetes.io/projected/794bcdd8-469e-45d8-90f7-36af8e118d22-kube-api-access-xh6zg\") pod \"image-registry-5f6478cfcf-8vjv8\" (UID: \"794bcdd8-469e-45d8-90f7-36af8e118d22\") " pod="openshift-image-registry/image-registry-5f6478cfcf-8vjv8"
Jul 27 17:02:47.757697 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:47.757665    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/794bcdd8-469e-45d8-90f7-36af8e118d22-registry-certificates\") pod \"image-registry-5f6478cfcf-8vjv8\" (UID: \"794bcdd8-469e-45d8-90f7-36af8e118d22\") " pod="openshift-image-registry/image-registry-5f6478cfcf-8vjv8"
Jul 27 17:02:47.757697 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:47.757700    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/794bcdd8-469e-45d8-90f7-36af8e118d22-image-registry-private-configuration\") pod \"image-registry-5f6478cfcf-8vjv8\" (UID: \"794bcdd8-469e-45d8-90f7-36af8e118d22\") " pod="openshift-image-registry/image-registry-5f6478cfcf-8vjv8"
Jul 27 17:02:47.758070 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:47.757721    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/794bcdd8-469e-45d8-90f7-36af8e118d22-registry-tls\") pod \"image-registry-5f6478cfcf-8vjv8\" (UID: \"794bcdd8-469e-45d8-90f7-36af8e118d22\") " pod="openshift-image-registry/image-registry-5f6478cfcf-8vjv8"
Jul 27 17:02:47.758070 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:47.757964    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d3f65bab-3bc7-4247-96b0-3bbef8281266-tmp\") pod \"klusterlet-addon-workmgr-58fc64c998-8pjdc\" (UID: \"d3f65bab-3bc7-4247-96b0-3bbef8281266\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58fc64c998-8pjdc"
Jul 27 17:02:47.759962 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:47.759942    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/d3f65bab-3bc7-4247-96b0-3bbef8281266-klusterlet-config\") pod \"klusterlet-addon-workmgr-58fc64c998-8pjdc\" (UID: \"d3f65bab-3bc7-4247-96b0-3bbef8281266\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58fc64c998-8pjdc"
Jul 27 17:02:47.767117 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:47.767064    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-slvzt\" (UniqueName: \"kubernetes.io/projected/d3f65bab-3bc7-4247-96b0-3bbef8281266-kube-api-access-slvzt\") pod \"klusterlet-addon-workmgr-58fc64c998-8pjdc\" (UID: \"d3f65bab-3bc7-4247-96b0-3bbef8281266\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58fc64c998-8pjdc"
Jul 27 17:02:47.825387 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:47.825354    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58fc64c998-8pjdc"
Jul 27 17:02:47.858658 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:47.858629    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/794bcdd8-469e-45d8-90f7-36af8e118d22-installation-pull-secrets\") pod \"image-registry-5f6478cfcf-8vjv8\" (UID: \"794bcdd8-469e-45d8-90f7-36af8e118d22\") " pod="openshift-image-registry/image-registry-5f6478cfcf-8vjv8"
Jul 27 17:02:47.858658 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:47.858662    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/794bcdd8-469e-45d8-90f7-36af8e118d22-trusted-ca\") pod \"image-registry-5f6478cfcf-8vjv8\" (UID: \"794bcdd8-469e-45d8-90f7-36af8e118d22\") " pod="openshift-image-registry/image-registry-5f6478cfcf-8vjv8"
Jul 27 17:02:47.858884 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:47.858683    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xh6zg\" (UniqueName: \"kubernetes.io/projected/794bcdd8-469e-45d8-90f7-36af8e118d22-kube-api-access-xh6zg\") pod \"image-registry-5f6478cfcf-8vjv8\" (UID: \"794bcdd8-469e-45d8-90f7-36af8e118d22\") " pod="openshift-image-registry/image-registry-5f6478cfcf-8vjv8"
Jul 27 17:02:47.858884 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:47.858708    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/794bcdd8-469e-45d8-90f7-36af8e118d22-registry-certificates\") pod \"image-registry-5f6478cfcf-8vjv8\" (UID: \"794bcdd8-469e-45d8-90f7-36af8e118d22\") " pod="openshift-image-registry/image-registry-5f6478cfcf-8vjv8"
Jul 27 17:02:47.858884 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:47.858743    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/794bcdd8-469e-45d8-90f7-36af8e118d22-image-registry-private-configuration\") pod \"image-registry-5f6478cfcf-8vjv8\" (UID: \"794bcdd8-469e-45d8-90f7-36af8e118d22\") " pod="openshift-image-registry/image-registry-5f6478cfcf-8vjv8"
Jul 27 17:02:47.858884 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:47.858768    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/794bcdd8-469e-45d8-90f7-36af8e118d22-registry-tls\") pod \"image-registry-5f6478cfcf-8vjv8\" (UID: \"794bcdd8-469e-45d8-90f7-36af8e118d22\") " pod="openshift-image-registry/image-registry-5f6478cfcf-8vjv8"
Jul 27 17:02:47.858884 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:47.858847    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/794bcdd8-469e-45d8-90f7-36af8e118d22-bound-sa-token\") pod \"image-registry-5f6478cfcf-8vjv8\" (UID: \"794bcdd8-469e-45d8-90f7-36af8e118d22\") " pod="openshift-image-registry/image-registry-5f6478cfcf-8vjv8"
Jul 27 17:02:47.858884 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:47.858873    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/794bcdd8-469e-45d8-90f7-36af8e118d22-ca-trust-extracted\") pod \"image-registry-5f6478cfcf-8vjv8\" (UID: \"794bcdd8-469e-45d8-90f7-36af8e118d22\") " pod="openshift-image-registry/image-registry-5f6478cfcf-8vjv8"
Jul 27 17:02:47.859423 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:47.859396    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/794bcdd8-469e-45d8-90f7-36af8e118d22-ca-trust-extracted\") pod \"image-registry-5f6478cfcf-8vjv8\" (UID: \"794bcdd8-469e-45d8-90f7-36af8e118d22\") " pod="openshift-image-registry/image-registry-5f6478cfcf-8vjv8"
Jul 27 17:02:47.859775 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:47.859750    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/794bcdd8-469e-45d8-90f7-36af8e118d22-trusted-ca\") pod \"image-registry-5f6478cfcf-8vjv8\" (UID: \"794bcdd8-469e-45d8-90f7-36af8e118d22\") " pod="openshift-image-registry/image-registry-5f6478cfcf-8vjv8"
Jul 27 17:02:47.859876 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:47.859817    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/794bcdd8-469e-45d8-90f7-36af8e118d22-registry-certificates\") pod \"image-registry-5f6478cfcf-8vjv8\" (UID: \"794bcdd8-469e-45d8-90f7-36af8e118d22\") " pod="openshift-image-registry/image-registry-5f6478cfcf-8vjv8"
Jul 27 17:02:47.861274 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:47.861249    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/794bcdd8-469e-45d8-90f7-36af8e118d22-image-registry-private-configuration\") pod \"image-registry-5f6478cfcf-8vjv8\" (UID: \"794bcdd8-469e-45d8-90f7-36af8e118d22\") " pod="openshift-image-registry/image-registry-5f6478cfcf-8vjv8"
Jul 27 17:02:47.861351 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:47.861330    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/794bcdd8-469e-45d8-90f7-36af8e118d22-registry-tls\") pod \"image-registry-5f6478cfcf-8vjv8\" (UID: \"794bcdd8-469e-45d8-90f7-36af8e118d22\") " pod="openshift-image-registry/image-registry-5f6478cfcf-8vjv8"
Jul 27 17:02:47.861698 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:47.861680    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/794bcdd8-469e-45d8-90f7-36af8e118d22-installation-pull-secrets\") pod \"image-registry-5f6478cfcf-8vjv8\" (UID: \"794bcdd8-469e-45d8-90f7-36af8e118d22\") " pod="openshift-image-registry/image-registry-5f6478cfcf-8vjv8"
Jul 27 17:02:47.869240 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:47.869213    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/794bcdd8-469e-45d8-90f7-36af8e118d22-bound-sa-token\") pod \"image-registry-5f6478cfcf-8vjv8\" (UID: \"794bcdd8-469e-45d8-90f7-36af8e118d22\") " pod="openshift-image-registry/image-registry-5f6478cfcf-8vjv8"
Jul 27 17:02:47.869918 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:47.869901    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xh6zg\" (UniqueName: \"kubernetes.io/projected/794bcdd8-469e-45d8-90f7-36af8e118d22-kube-api-access-xh6zg\") pod \"image-registry-5f6478cfcf-8vjv8\" (UID: \"794bcdd8-469e-45d8-90f7-36af8e118d22\") " pod="openshift-image-registry/image-registry-5f6478cfcf-8vjv8"
Jul 27 17:02:47.925475 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:47.925442    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5f6478cfcf-8vjv8"
Jul 27 17:02:47.949403 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:47.949378    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-58fc64c998-8pjdc"]
Jul 27 17:02:47.951541 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:02:47.951517    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3f65bab_3bc7_4247_96b0_3bbef8281266.slice/crio-d17b2002bc65cb3605b064f0c09537f85ffff6a1793ba85e460f23b574ef437b WatchSource:0}: Error finding container d17b2002bc65cb3605b064f0c09537f85ffff6a1793ba85e460f23b574ef437b: Status 404 returned error can't find the container with id d17b2002bc65cb3605b064f0c09537f85ffff6a1793ba85e460f23b574ef437b
Jul 27 17:02:48.050740 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:48.050668    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5f6478cfcf-8vjv8"]
Jul 27 17:02:48.053923 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:02:48.053895    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod794bcdd8_469e_45d8_90f7_36af8e118d22.slice/crio-e0cfe47d1ec36965e56ce538f4ae35e9e95d167e9823d08668b6c33370e4ee2d WatchSource:0}: Error finding container e0cfe47d1ec36965e56ce538f4ae35e9e95d167e9823d08668b6c33370e4ee2d: Status 404 returned error can't find the container with id e0cfe47d1ec36965e56ce538f4ae35e9e95d167e9823d08668b6c33370e4ee2d
Jul 27 17:02:48.575601 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:48.575573    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-pvns7"
Jul 27 17:02:48.601622 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:48.601587    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5f6478cfcf-8vjv8" event={"ID":"794bcdd8-469e-45d8-90f7-36af8e118d22","Type":"ContainerStarted","Data":"7beb31c97ca829040f3c602e68584ed9c4b5eb2118b21fea4c8aaf3cc2ee5473"}
Jul 27 17:02:48.601802 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:48.601645    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5f6478cfcf-8vjv8" event={"ID":"794bcdd8-469e-45d8-90f7-36af8e118d22","Type":"ContainerStarted","Data":"e0cfe47d1ec36965e56ce538f4ae35e9e95d167e9823d08668b6c33370e4ee2d"}
Jul 27 17:02:48.601802 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:48.601723    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5f6478cfcf-8vjv8"
Jul 27 17:02:48.603123 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:48.603096    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58fc64c998-8pjdc" event={"ID":"d3f65bab-3bc7-4247-96b0-3bbef8281266","Type":"ContainerStarted","Data":"d17b2002bc65cb3605b064f0c09537f85ffff6a1793ba85e460f23b574ef437b"}
Jul 27 17:02:49.009076 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:49.009045    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:02:51.333391 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:51.333351    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:02:52.458619 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:52.458587    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:02:52.618729 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:52.618692    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58fc64c998-8pjdc" event={"ID":"d3f65bab-3bc7-4247-96b0-3bbef8281266","Type":"ContainerStarted","Data":"9a7be88e286b13adf8d46e7a74e39e1a57b8d31c9abb4443ea379dae37a2ccd6"}
Jul 27 17:02:52.618928 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:52.618912    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58fc64c998-8pjdc"
Jul 27 17:02:52.620415 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:52.620395    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58fc64c998-8pjdc"
Jul 27 17:02:52.634519 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:52.634468    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58fc64c998-8pjdc" podStartSLOduration=1.9839831669999999 podStartE2EDuration="5.634456085s" totalImagesPullingTime="3.650472918s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:02:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:02:52.63371743 +0000 UTC m=+85.830462230" watchObservedRunningTime="2026-07-27 17:02:52.634456085 +0000 UTC m=+85.831200886"
Jul 27 17:02:52.634624 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:52.634551    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5f6478cfcf-8vjv8" podStartSLOduration=5.634544867 podStartE2EDuration="5.634544867s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:02:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:02:48.619245795 +0000 UTC m=+81.815990598" watchObservedRunningTime="2026-07-27 17:02:52.634544867 +0000 UTC m=+85.831289671"
Jul 27 17:02:53.315009 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:53.314949    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:02:53.414961 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:53.414934    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:02:53.482879 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:53.482854    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:02:54.006572 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:54.006535    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/68c7bd95-3782-462d-88dd-76fff9fbabed-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gjcfv\" (UID: \"68c7bd95-3782-462d-88dd-76fff9fbabed\") " pod="openshift-insights/insights-runtime-extractor-gjcfv"
Jul 27 17:02:54.008787 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:54.008766    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/68c7bd95-3782-462d-88dd-76fff9fbabed-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gjcfv\" (UID: \"68c7bd95-3782-462d-88dd-76fff9fbabed\") " pod="openshift-insights/insights-runtime-extractor-gjcfv"
Jul 27 17:02:54.137384 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:54.137346    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:02:54.300877 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:54.300780    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-hn8cb\""
Jul 27 17:02:54.308884 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:54.308856    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-gjcfv"
Jul 27 17:02:54.482348 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:54.482315    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-gjcfv"]
Jul 27 17:02:54.485489 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:02:54.485462    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68c7bd95_3782_462d_88dd_76fff9fbabed.slice/crio-64d69ef697389ebfda51123c20348041917cbaacc311dace29a6da51aa0b8453 WatchSource:0}: Error finding container 64d69ef697389ebfda51123c20348041917cbaacc311dace29a6da51aa0b8453: Status 404 returned error can't find the container with id 64d69ef697389ebfda51123c20348041917cbaacc311dace29a6da51aa0b8453
Jul 27 17:02:54.626433 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:54.626403    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gjcfv" event={"ID":"68c7bd95-3782-462d-88dd-76fff9fbabed","Type":"ContainerStarted","Data":"64d69ef697389ebfda51123c20348041917cbaacc311dace29a6da51aa0b8453"}
Jul 27 17:02:57.548893 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:57.548861    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-86cb48fc4-g7xdp"
Jul 27 17:02:57.868468 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:57.868437    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:02:57.929390 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:57.929297    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:02:58.157091 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:02:58.156978    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:03:00.648522 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:00.648491    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gjcfv" event={"ID":"68c7bd95-3782-462d-88dd-76fff9fbabed","Type":"ContainerStarted","Data":"fea9cb8ae4c747ba95b6ef435ca259b33cd4f7f7077df92d21bb22fb21bec9cb"}
Jul 27 17:03:01.018419 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:01.018288    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:03:01.072411 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:01.072375    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:03:03.393315 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:03.393268    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:03:03.660117 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:03.660045    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gjcfv" event={"ID":"68c7bd95-3782-462d-88dd-76fff9fbabed","Type":"ContainerStarted","Data":"63dc9912286d7c894b0f3fb79189dc13d4bd35ec6085444c2f5995f036398fca"}
Jul 27 17:03:05.560534 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:05.560499    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-x5xw7"
Jul 27 17:03:05.668049 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:05.668023    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:03:05.876883 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:05.876852    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:03:05.935019 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:05.934644    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-2ltcp"]
Jul 27 17:03:05.940000 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:05.939978    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-2ltcp"
Jul 27 17:03:05.942147 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:05.942124    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 27 17:03:05.942460 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:05.942418    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 27 17:03:05.942569 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:05.942526    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 27 17:03:05.942569 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:05.942561    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-7k878\""
Jul 27 17:03:05.943555 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:05.943521    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 27 17:03:05.943656 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:05.943622    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 27 17:03:05.943656 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:05.943622    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 27 17:03:05.946212 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:05.946194    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-jbxlh"]
Jul 27 17:03:05.949595 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:05.949579    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-jbxlh"
Jul 27 17:03:05.953750 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:05.953459    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-m4bj4\""
Jul 27 17:03:05.953750 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:05.953472    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 27 17:03:05.953935 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:05.953878    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 27 17:03:05.954077 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:05.954053    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-2ltcp"]
Jul 27 17:03:05.954457 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:05.954439    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 27 17:03:05.981467 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:05.981445    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:03:06.078295 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:06.078256    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:03:06.106460 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:06.106421    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7df45bbc-1f70-4a48-b344-8b7302a774a4-node-exporter-accelerators-collector-config\") pod \"node-exporter-jbxlh\" (UID: \"7df45bbc-1f70-4a48-b344-8b7302a774a4\") " pod="openshift-monitoring/node-exporter-jbxlh"
Jul 27 17:03:06.106641 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:06.106475    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/11b5826a-e337-4601-b61d-566151a3b95a-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-2ltcp\" (UID: \"11b5826a-e337-4601-b61d-566151a3b95a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-2ltcp"
Jul 27 17:03:06.106641 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:06.106500    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7df45bbc-1f70-4a48-b344-8b7302a774a4-sys\") pod \"node-exporter-jbxlh\" (UID: \"7df45bbc-1f70-4a48-b344-8b7302a774a4\") " pod="openshift-monitoring/node-exporter-jbxlh"
Jul 27 17:03:06.106641 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:06.106524    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrqkl\" (UniqueName: \"kubernetes.io/projected/7df45bbc-1f70-4a48-b344-8b7302a774a4-kube-api-access-jrqkl\") pod \"node-exporter-jbxlh\" (UID: \"7df45bbc-1f70-4a48-b344-8b7302a774a4\") " pod="openshift-monitoring/node-exporter-jbxlh"
Jul 27 17:03:06.106641 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:06.106558    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/11b5826a-e337-4601-b61d-566151a3b95a-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-2ltcp\" (UID: \"11b5826a-e337-4601-b61d-566151a3b95a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-2ltcp"
Jul 27 17:03:06.106864 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:06.106634    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7df45bbc-1f70-4a48-b344-8b7302a774a4-node-exporter-tls\") pod \"node-exporter-jbxlh\" (UID: \"7df45bbc-1f70-4a48-b344-8b7302a774a4\") " pod="openshift-monitoring/node-exporter-jbxlh"
Jul 27 17:03:06.106864 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:06.106674    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7df45bbc-1f70-4a48-b344-8b7302a774a4-root\") pod \"node-exporter-jbxlh\" (UID: \"7df45bbc-1f70-4a48-b344-8b7302a774a4\") " pod="openshift-monitoring/node-exporter-jbxlh"
Jul 27 17:03:06.106864 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:06.106706    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7df45bbc-1f70-4a48-b344-8b7302a774a4-node-exporter-textfile\") pod \"node-exporter-jbxlh\" (UID: \"7df45bbc-1f70-4a48-b344-8b7302a774a4\") " pod="openshift-monitoring/node-exporter-jbxlh"
Jul 27 17:03:06.106864 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:06.106733    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7df45bbc-1f70-4a48-b344-8b7302a774a4-node-exporter-wtmp\") pod \"node-exporter-jbxlh\" (UID: \"7df45bbc-1f70-4a48-b344-8b7302a774a4\") " pod="openshift-monitoring/node-exporter-jbxlh"
Jul 27 17:03:06.106864 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:06.106766    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7df45bbc-1f70-4a48-b344-8b7302a774a4-metrics-client-ca\") pod \"node-exporter-jbxlh\" (UID: \"7df45bbc-1f70-4a48-b344-8b7302a774a4\") " pod="openshift-monitoring/node-exporter-jbxlh"
Jul 27 17:03:06.106864 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:06.106792    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/11b5826a-e337-4601-b61d-566151a3b95a-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-2ltcp\" (UID: \"11b5826a-e337-4601-b61d-566151a3b95a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-2ltcp"
Jul 27 17:03:06.106864 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:06.106857    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7df45bbc-1f70-4a48-b344-8b7302a774a4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jbxlh\" (UID: \"7df45bbc-1f70-4a48-b344-8b7302a774a4\") " pod="openshift-monitoring/node-exporter-jbxlh"
Jul 27 17:03:06.107136 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:06.106890    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gj7dt\" (UniqueName: \"kubernetes.io/projected/11b5826a-e337-4601-b61d-566151a3b95a-kube-api-access-gj7dt\") pod \"kube-state-metrics-56d9f944b4-2ltcp\" (UID: \"11b5826a-e337-4601-b61d-566151a3b95a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-2ltcp"
Jul 27 17:03:06.107136 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:06.106918    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/11b5826a-e337-4601-b61d-566151a3b95a-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-2ltcp\" (UID: \"11b5826a-e337-4601-b61d-566151a3b95a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-2ltcp"
Jul 27 17:03:06.107136 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:06.106962    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/11b5826a-e337-4601-b61d-566151a3b95a-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-2ltcp\" (UID: \"11b5826a-e337-4601-b61d-566151a3b95a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-2ltcp"
Jul 27 17:03:06.174513 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:06.174432    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:03:06.208159 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:06.208130    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7df45bbc-1f70-4a48-b344-8b7302a774a4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jbxlh\" (UID: \"7df45bbc-1f70-4a48-b344-8b7302a774a4\") " pod="openshift-monitoring/node-exporter-jbxlh"
Jul 27 17:03:06.208318 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:06.208168    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gj7dt\" (UniqueName: \"kubernetes.io/projected/11b5826a-e337-4601-b61d-566151a3b95a-kube-api-access-gj7dt\") pod \"kube-state-metrics-56d9f944b4-2ltcp\" (UID: \"11b5826a-e337-4601-b61d-566151a3b95a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-2ltcp"
Jul 27 17:03:06.208318 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:06.208189    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/11b5826a-e337-4601-b61d-566151a3b95a-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-2ltcp\" (UID: \"11b5826a-e337-4601-b61d-566151a3b95a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-2ltcp"
Jul 27 17:03:06.208318 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:06.208226    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/11b5826a-e337-4601-b61d-566151a3b95a-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-2ltcp\" (UID: \"11b5826a-e337-4601-b61d-566151a3b95a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-2ltcp"
Jul 27 17:03:06.208318 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:06.208276    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7df45bbc-1f70-4a48-b344-8b7302a774a4-node-exporter-accelerators-collector-config\") pod \"node-exporter-jbxlh\" (UID: \"7df45bbc-1f70-4a48-b344-8b7302a774a4\") " pod="openshift-monitoring/node-exporter-jbxlh"
Jul 27 17:03:06.208318 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:06.208300    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/11b5826a-e337-4601-b61d-566151a3b95a-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-2ltcp\" (UID: \"11b5826a-e337-4601-b61d-566151a3b95a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-2ltcp"
Jul 27 17:03:06.208578 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:06.208325    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7df45bbc-1f70-4a48-b344-8b7302a774a4-sys\") pod \"node-exporter-jbxlh\" (UID: \"7df45bbc-1f70-4a48-b344-8b7302a774a4\") " pod="openshift-monitoring/node-exporter-jbxlh"
Jul 27 17:03:06.208578 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:06.208347    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrqkl\" (UniqueName: \"kubernetes.io/projected/7df45bbc-1f70-4a48-b344-8b7302a774a4-kube-api-access-jrqkl\") pod \"node-exporter-jbxlh\" (UID: \"7df45bbc-1f70-4a48-b344-8b7302a774a4\") " pod="openshift-monitoring/node-exporter-jbxlh"
Jul 27 17:03:06.208578 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:06.208376    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/11b5826a-e337-4601-b61d-566151a3b95a-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-2ltcp\" (UID: \"11b5826a-e337-4601-b61d-566151a3b95a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-2ltcp"
Jul 27 17:03:06.208578 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:06.208416    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7df45bbc-1f70-4a48-b344-8b7302a774a4-node-exporter-tls\") pod \"node-exporter-jbxlh\" (UID: \"7df45bbc-1f70-4a48-b344-8b7302a774a4\") " pod="openshift-monitoring/node-exporter-jbxlh"
Jul 27 17:03:06.208578 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:06.208441    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7df45bbc-1f70-4a48-b344-8b7302a774a4-root\") pod \"node-exporter-jbxlh\" (UID: \"7df45bbc-1f70-4a48-b344-8b7302a774a4\") " pod="openshift-monitoring/node-exporter-jbxlh"
Jul 27 17:03:06.208578 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:06.208466    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7df45bbc-1f70-4a48-b344-8b7302a774a4-node-exporter-textfile\") pod \"node-exporter-jbxlh\" (UID: \"7df45bbc-1f70-4a48-b344-8b7302a774a4\") " pod="openshift-monitoring/node-exporter-jbxlh"
Jul 27 17:03:06.208578 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:06.208490    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7df45bbc-1f70-4a48-b344-8b7302a774a4-node-exporter-wtmp\") pod \"node-exporter-jbxlh\" (UID: \"7df45bbc-1f70-4a48-b344-8b7302a774a4\") " pod="openshift-monitoring/node-exporter-jbxlh"
Jul 27 17:03:06.208578 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:06.208501    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7df45bbc-1f70-4a48-b344-8b7302a774a4-sys\") pod \"node-exporter-jbxlh\" (UID: \"7df45bbc-1f70-4a48-b344-8b7302a774a4\") " pod="openshift-monitoring/node-exporter-jbxlh"
Jul 27 17:03:06.208578 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:06.208520    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7df45bbc-1f70-4a48-b344-8b7302a774a4-metrics-client-ca\") pod \"node-exporter-jbxlh\" (UID: \"7df45bbc-1f70-4a48-b344-8b7302a774a4\") " pod="openshift-monitoring/node-exporter-jbxlh"
Jul 27 17:03:06.208578 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:06.208563    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/11b5826a-e337-4601-b61d-566151a3b95a-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-2ltcp\" (UID: \"11b5826a-e337-4601-b61d-566151a3b95a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-2ltcp"
Jul 27 17:03:06.209064 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:03:06.208643    2580 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 27 17:03:06.209064 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:03:06.208721    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7df45bbc-1f70-4a48-b344-8b7302a774a4-node-exporter-tls podName:7df45bbc-1f70-4a48-b344-8b7302a774a4 nodeName:}" failed. No retries permitted until 2026-07-27 17:03:06.708702331 +0000 UTC m=+99.905447127 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/7df45bbc-1f70-4a48-b344-8b7302a774a4-node-exporter-tls") pod "node-exporter-jbxlh" (UID: "7df45bbc-1f70-4a48-b344-8b7302a774a4") : secret "node-exporter-tls" not found
Jul 27 17:03:06.209064 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:03:06.208900    2580 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Jul 27 17:03:06.209064 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:03:06.208946    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11b5826a-e337-4601-b61d-566151a3b95a-kube-state-metrics-tls podName:11b5826a-e337-4601-b61d-566151a3b95a nodeName:}" failed. No retries permitted until 2026-07-27 17:03:06.708932098 +0000 UTC m=+99.905676877 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/11b5826a-e337-4601-b61d-566151a3b95a-kube-state-metrics-tls") pod "kube-state-metrics-56d9f944b4-2ltcp" (UID: "11b5826a-e337-4601-b61d-566151a3b95a") : secret "kube-state-metrics-tls" not found
Jul 27 17:03:06.209064 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:06.208973    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/11b5826a-e337-4601-b61d-566151a3b95a-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-2ltcp\" (UID: \"11b5826a-e337-4601-b61d-566151a3b95a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-2ltcp"
Jul 27 17:03:06.209064 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:06.208991    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/11b5826a-e337-4601-b61d-566151a3b95a-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-2ltcp\" (UID: \"11b5826a-e337-4601-b61d-566151a3b95a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-2ltcp"
Jul 27 17:03:06.209064 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:06.209040    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/11b5826a-e337-4601-b61d-566151a3b95a-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-2ltcp\" (UID: \"11b5826a-e337-4601-b61d-566151a3b95a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-2ltcp"
Jul 27 17:03:06.209064 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:06.209053    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7df45bbc-1f70-4a48-b344-8b7302a774a4-root\") pod \"node-exporter-jbxlh\" (UID: \"7df45bbc-1f70-4a48-b344-8b7302a774a4\") " pod="openshift-monitoring/node-exporter-jbxlh"
Jul 27 17:03:06.209064 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:06.209064    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7df45bbc-1f70-4a48-b344-8b7302a774a4-node-exporter-accelerators-collector-config\") pod \"node-exporter-jbxlh\" (UID: \"7df45bbc-1f70-4a48-b344-8b7302a774a4\") " pod="openshift-monitoring/node-exporter-jbxlh"
Jul 27 17:03:06.209401 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:06.209086    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7df45bbc-1f70-4a48-b344-8b7302a774a4-metrics-client-ca\") pod \"node-exporter-jbxlh\" (UID: \"7df45bbc-1f70-4a48-b344-8b7302a774a4\") " pod="openshift-monitoring/node-exporter-jbxlh"
Jul 27 17:03:06.209401 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:06.209121    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7df45bbc-1f70-4a48-b344-8b7302a774a4-node-exporter-wtmp\") pod \"node-exporter-jbxlh\" (UID: \"7df45bbc-1f70-4a48-b344-8b7302a774a4\") " pod="openshift-monitoring/node-exporter-jbxlh"
Jul 27 17:03:06.209401 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:06.209172    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7df45bbc-1f70-4a48-b344-8b7302a774a4-node-exporter-textfile\") pod \"node-exporter-jbxlh\" (UID: \"7df45bbc-1f70-4a48-b344-8b7302a774a4\") " pod="openshift-monitoring/node-exporter-jbxlh"
Jul 27 17:03:06.211365 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:06.211343    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7df45bbc-1f70-4a48-b344-8b7302a774a4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jbxlh\" (UID: \"7df45bbc-1f70-4a48-b344-8b7302a774a4\") " pod="openshift-monitoring/node-exporter-jbxlh"
Jul 27 17:03:06.211473 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:06.211342    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/11b5826a-e337-4601-b61d-566151a3b95a-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-2ltcp\" (UID: \"11b5826a-e337-4601-b61d-566151a3b95a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-2ltcp"
Jul 27 17:03:06.220057 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:06.219995    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gj7dt\" (UniqueName: \"kubernetes.io/projected/11b5826a-e337-4601-b61d-566151a3b95a-kube-api-access-gj7dt\") pod \"kube-state-metrics-56d9f944b4-2ltcp\" (UID: \"11b5826a-e337-4601-b61d-566151a3b95a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-2ltcp"
Jul 27 17:03:06.220269 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:06.220231    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrqkl\" (UniqueName: \"kubernetes.io/projected/7df45bbc-1f70-4a48-b344-8b7302a774a4-kube-api-access-jrqkl\") pod \"node-exporter-jbxlh\" (UID: \"7df45bbc-1f70-4a48-b344-8b7302a774a4\") " pod="openshift-monitoring/node-exporter-jbxlh"
Jul 27 17:03:06.276250 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:06.276219    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:03:06.375103 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:06.375069    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:03:06.475214 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:06.475132    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:03:06.579229 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:06.579201    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:03:06.714702 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:06.714675    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/11b5826a-e337-4601-b61d-566151a3b95a-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-2ltcp\" (UID: \"11b5826a-e337-4601-b61d-566151a3b95a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-2ltcp"
Jul 27 17:03:06.714876 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:06.714712    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7df45bbc-1f70-4a48-b344-8b7302a774a4-node-exporter-tls\") pod \"node-exporter-jbxlh\" (UID: \"7df45bbc-1f70-4a48-b344-8b7302a774a4\") " pod="openshift-monitoring/node-exporter-jbxlh"
Jul 27 17:03:06.717240 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:06.717213    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7df45bbc-1f70-4a48-b344-8b7302a774a4-node-exporter-tls\") pod \"node-exporter-jbxlh\" (UID: \"7df45bbc-1f70-4a48-b344-8b7302a774a4\") " pod="openshift-monitoring/node-exporter-jbxlh"
Jul 27 17:03:06.717346 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:06.717301    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/11b5826a-e337-4601-b61d-566151a3b95a-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-2ltcp\" (UID: \"11b5826a-e337-4601-b61d-566151a3b95a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-2ltcp"
Jul 27 17:03:06.770273 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:06.770205    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:03:06.850391 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:06.850356    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-2ltcp"
Jul 27 17:03:06.859536 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:06.859504    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-jbxlh"
Jul 27 17:03:06.877182 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:06.877136    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:03:06.985234 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:06.985206    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:03:07.090196 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:07.090172    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:03:07.259089 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:03:07.259061    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7df45bbc_1f70_4a48_b344_8b7302a774a4.slice/crio-796d249c14a934a64d6fec7dcf783803eebff6548f66b3a7fad428f8c402078a WatchSource:0}: Error finding container 796d249c14a934a64d6fec7dcf783803eebff6548f66b3a7fad428f8c402078a: Status 404 returned error can't find the container with id 796d249c14a934a64d6fec7dcf783803eebff6548f66b3a7fad428f8c402078a
Jul 27 17:03:07.301107 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:07.301083    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:03:07.372241 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:07.372211    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-2ltcp"]
Jul 27 17:03:07.376306 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:03:07.376278    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11b5826a_e337_4601_b61d_566151a3b95a.slice/crio-c530e28e27c106daac1a51393779ef0be50e77ef4e60a8967f8aca665f91e34f WatchSource:0}: Error finding container c530e28e27c106daac1a51393779ef0be50e77ef4e60a8967f8aca665f91e34f: Status 404 returned error can't find the container with id c530e28e27c106daac1a51393779ef0be50e77ef4e60a8967f8aca665f91e34f
Jul 27 17:03:07.675951 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:07.675926    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-2ltcp" event={"ID":"11b5826a-e337-4601-b61d-566151a3b95a","Type":"ContainerStarted","Data":"c530e28e27c106daac1a51393779ef0be50e77ef4e60a8967f8aca665f91e34f"}
Jul 27 17:03:07.677124 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:07.677102    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jbxlh" event={"ID":"7df45bbc-1f70-4a48-b344-8b7302a774a4","Type":"ContainerStarted","Data":"796d249c14a934a64d6fec7dcf783803eebff6548f66b3a7fad428f8c402078a"}
Jul 27 17:03:08.682190 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:08.682156    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gjcfv" event={"ID":"68c7bd95-3782-462d-88dd-76fff9fbabed","Type":"ContainerStarted","Data":"c60a20b57e3e85bb5fe03944453855d84f6e6c01d90b64ac25af7a97ccb4b610"}
Jul 27 17:03:08.704270 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:08.704226    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-gjcfv" podStartSLOduration=33.690284176 podStartE2EDuration="46.704211897s" totalImagesPullingTime="13.013927721s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 17:02:22 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:03:08.704044361 +0000 UTC m=+101.900789175" watchObservedRunningTime="2026-07-27 17:03:08.704211897 +0000 UTC m=+101.900956733"
Jul 27 17:03:08.941826 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:08.941764    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:03:09.041812 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:09.041787    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:03:09.144429 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:09.144406    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:03:09.245367 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:09.245310    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:03:09.345540 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:09.345515    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:03:09.410553 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:09.410522    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:03:09.612402 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:09.612373    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5f6478cfcf-8vjv8"
Jul 27 17:03:09.686774 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:09.686742    2580 generic.go:356] "Generic (PLEG): container finished" podID="7df45bbc-1f70-4a48-b344-8b7302a774a4" containerID="e6adfbc641ba71a85ba10c5f06a426f787c8c10c3bd21c18e249ca2bb0fb2cc9" exitCode=0
Jul 27 17:03:09.687241 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:09.686839    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jbxlh" event={"ID":"7df45bbc-1f70-4a48-b344-8b7302a774a4","Type":"ContainerDied","Data":"e6adfbc641ba71a85ba10c5f06a426f787c8c10c3bd21c18e249ca2bb0fb2cc9"}
Jul 27 17:03:09.772695 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:09.772673    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:03:09.876204 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:09.876099    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:03:10.109846 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:10.109799    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:03:10.209639 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:10.209511    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:03:10.307715 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:10.307680    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-67d88cc47d-fdgh8"]
Jul 27 17:03:10.309929 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:10.309906    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-67d88cc47d-fdgh8"
Jul 27 17:03:10.310864 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:10.310815    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:03:10.315489 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:10.315105    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 27 17:03:10.315489 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:10.315152    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 27 17:03:10.315489 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:10.315183    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-2dk87\""
Jul 27 17:03:10.315489 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:10.315107    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-d4tngp1r4de8n\""
Jul 27 17:03:10.315489 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:10.315253    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 27 17:03:10.315489 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:10.315354    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 27 17:03:10.332381 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:10.332360    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-67d88cc47d-fdgh8"]
Jul 27 17:03:10.443663 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:10.443633    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/584a4a01-9a97-42dd-b163-a6ea16b856bb-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-67d88cc47d-fdgh8\" (UID: \"584a4a01-9a97-42dd-b163-a6ea16b856bb\") " pod="openshift-monitoring/metrics-server-67d88cc47d-fdgh8"
Jul 27 17:03:10.443838 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:10.443695    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/584a4a01-9a97-42dd-b163-a6ea16b856bb-client-ca-bundle\") pod \"metrics-server-67d88cc47d-fdgh8\" (UID: \"584a4a01-9a97-42dd-b163-a6ea16b856bb\") " pod="openshift-monitoring/metrics-server-67d88cc47d-fdgh8"
Jul 27 17:03:10.443838 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:10.443756    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/584a4a01-9a97-42dd-b163-a6ea16b856bb-metrics-server-audit-profiles\") pod \"metrics-server-67d88cc47d-fdgh8\" (UID: \"584a4a01-9a97-42dd-b163-a6ea16b856bb\") " pod="openshift-monitoring/metrics-server-67d88cc47d-fdgh8"
Jul 27 17:03:10.443838 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:10.443784    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tn9sm\" (UniqueName: \"kubernetes.io/projected/584a4a01-9a97-42dd-b163-a6ea16b856bb-kube-api-access-tn9sm\") pod \"metrics-server-67d88cc47d-fdgh8\" (UID: \"584a4a01-9a97-42dd-b163-a6ea16b856bb\") " pod="openshift-monitoring/metrics-server-67d88cc47d-fdgh8"
Jul 27 17:03:10.443838 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:10.443811    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/584a4a01-9a97-42dd-b163-a6ea16b856bb-secret-metrics-server-client-certs\") pod \"metrics-server-67d88cc47d-fdgh8\" (UID: \"584a4a01-9a97-42dd-b163-a6ea16b856bb\") " pod="openshift-monitoring/metrics-server-67d88cc47d-fdgh8"
Jul 27 17:03:10.443988 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:10.443869    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/584a4a01-9a97-42dd-b163-a6ea16b856bb-secret-metrics-server-tls\") pod \"metrics-server-67d88cc47d-fdgh8\" (UID: \"584a4a01-9a97-42dd-b163-a6ea16b856bb\") " pod="openshift-monitoring/metrics-server-67d88cc47d-fdgh8"
Jul 27 17:03:10.443988 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:10.443889    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/584a4a01-9a97-42dd-b163-a6ea16b856bb-audit-log\") pod \"metrics-server-67d88cc47d-fdgh8\" (UID: \"584a4a01-9a97-42dd-b163-a6ea16b856bb\") " pod="openshift-monitoring/metrics-server-67d88cc47d-fdgh8"
Jul 27 17:03:10.544565 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:10.544531    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/584a4a01-9a97-42dd-b163-a6ea16b856bb-secret-metrics-server-tls\") pod \"metrics-server-67d88cc47d-fdgh8\" (UID: \"584a4a01-9a97-42dd-b163-a6ea16b856bb\") " pod="openshift-monitoring/metrics-server-67d88cc47d-fdgh8"
Jul 27 17:03:10.544672 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:10.544577    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/584a4a01-9a97-42dd-b163-a6ea16b856bb-audit-log\") pod \"metrics-server-67d88cc47d-fdgh8\" (UID: \"584a4a01-9a97-42dd-b163-a6ea16b856bb\") " pod="openshift-monitoring/metrics-server-67d88cc47d-fdgh8"
Jul 27 17:03:10.544672 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:10.544644    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/584a4a01-9a97-42dd-b163-a6ea16b856bb-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-67d88cc47d-fdgh8\" (UID: \"584a4a01-9a97-42dd-b163-a6ea16b856bb\") " pod="openshift-monitoring/metrics-server-67d88cc47d-fdgh8"
Jul 27 17:03:10.544786 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:10.544697    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/584a4a01-9a97-42dd-b163-a6ea16b856bb-client-ca-bundle\") pod \"metrics-server-67d88cc47d-fdgh8\" (UID: \"584a4a01-9a97-42dd-b163-a6ea16b856bb\") " pod="openshift-monitoring/metrics-server-67d88cc47d-fdgh8"
Jul 27 17:03:10.544786 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:10.544726    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/584a4a01-9a97-42dd-b163-a6ea16b856bb-metrics-server-audit-profiles\") pod \"metrics-server-67d88cc47d-fdgh8\" (UID: \"584a4a01-9a97-42dd-b163-a6ea16b856bb\") " pod="openshift-monitoring/metrics-server-67d88cc47d-fdgh8"
Jul 27 17:03:10.545039 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:10.544949    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tn9sm\" (UniqueName: \"kubernetes.io/projected/584a4a01-9a97-42dd-b163-a6ea16b856bb-kube-api-access-tn9sm\") pod \"metrics-server-67d88cc47d-fdgh8\" (UID: \"584a4a01-9a97-42dd-b163-a6ea16b856bb\") " pod="openshift-monitoring/metrics-server-67d88cc47d-fdgh8"
Jul 27 17:03:10.545039 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:10.545017    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/584a4a01-9a97-42dd-b163-a6ea16b856bb-secret-metrics-server-client-certs\") pod \"metrics-server-67d88cc47d-fdgh8\" (UID: \"584a4a01-9a97-42dd-b163-a6ea16b856bb\") " pod="openshift-monitoring/metrics-server-67d88cc47d-fdgh8"
Jul 27 17:03:10.545371 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:10.545343    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/584a4a01-9a97-42dd-b163-a6ea16b856bb-audit-log\") pod \"metrics-server-67d88cc47d-fdgh8\" (UID: \"584a4a01-9a97-42dd-b163-a6ea16b856bb\") " pod="openshift-monitoring/metrics-server-67d88cc47d-fdgh8"
Jul 27 17:03:10.546352 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:10.546308    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/584a4a01-9a97-42dd-b163-a6ea16b856bb-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-67d88cc47d-fdgh8\" (UID: \"584a4a01-9a97-42dd-b163-a6ea16b856bb\") " pod="openshift-monitoring/metrics-server-67d88cc47d-fdgh8"
Jul 27 17:03:10.547140 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:10.547120    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/584a4a01-9a97-42dd-b163-a6ea16b856bb-secret-metrics-server-tls\") pod \"metrics-server-67d88cc47d-fdgh8\" (UID: \"584a4a01-9a97-42dd-b163-a6ea16b856bb\") " pod="openshift-monitoring/metrics-server-67d88cc47d-fdgh8"
Jul 27 17:03:10.547309 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:10.547293    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/584a4a01-9a97-42dd-b163-a6ea16b856bb-metrics-server-audit-profiles\") pod \"metrics-server-67d88cc47d-fdgh8\" (UID: \"584a4a01-9a97-42dd-b163-a6ea16b856bb\") " pod="openshift-monitoring/metrics-server-67d88cc47d-fdgh8"
Jul 27 17:03:10.547506 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:10.547488    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/584a4a01-9a97-42dd-b163-a6ea16b856bb-client-ca-bundle\") pod \"metrics-server-67d88cc47d-fdgh8\" (UID: \"584a4a01-9a97-42dd-b163-a6ea16b856bb\") " pod="openshift-monitoring/metrics-server-67d88cc47d-fdgh8"
Jul 27 17:03:10.547671 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:10.547649    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/584a4a01-9a97-42dd-b163-a6ea16b856bb-secret-metrics-server-client-certs\") pod \"metrics-server-67d88cc47d-fdgh8\" (UID: \"584a4a01-9a97-42dd-b163-a6ea16b856bb\") " pod="openshift-monitoring/metrics-server-67d88cc47d-fdgh8"
Jul 27 17:03:10.553394 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:10.553332    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tn9sm\" (UniqueName: \"kubernetes.io/projected/584a4a01-9a97-42dd-b163-a6ea16b856bb-kube-api-access-tn9sm\") pod \"metrics-server-67d88cc47d-fdgh8\" (UID: \"584a4a01-9a97-42dd-b163-a6ea16b856bb\") " pod="openshift-monitoring/metrics-server-67d88cc47d-fdgh8"
Jul 27 17:03:10.621553 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:10.621508    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-67d88cc47d-fdgh8"
Jul 27 17:03:10.695125 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:10.694982    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-2ltcp" event={"ID":"11b5826a-e337-4601-b61d-566151a3b95a","Type":"ContainerStarted","Data":"f3cc5fa668d63b509d06f9bbca4c12ca2c8cc9bb38e673426f6d17fc30fe0a45"}
Jul 27 17:03:10.695125 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:10.695051    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-2ltcp" event={"ID":"11b5826a-e337-4601-b61d-566151a3b95a","Type":"ContainerStarted","Data":"ef6551b77be8b14343fb024b68d51f0b7570faeb5f7d858a7e5a9023b0c2f224"}
Jul 27 17:03:10.695125 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:10.695084    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-2ltcp" event={"ID":"11b5826a-e337-4601-b61d-566151a3b95a","Type":"ContainerStarted","Data":"fe5739e2cb98fbaa0925a9d5b5d177cf87f546b5519e9bcfa14280ca98012d0e"}
Jul 27 17:03:10.699644 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:10.699595    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jbxlh" event={"ID":"7df45bbc-1f70-4a48-b344-8b7302a774a4","Type":"ContainerStarted","Data":"8b344cef63a9f2f6829eb88367cdcd71b1dd63d9933a74a3603718262f3c3ddc"}
Jul 27 17:03:10.699791 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:10.699673    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jbxlh" event={"ID":"7df45bbc-1f70-4a48-b344-8b7302a774a4","Type":"ContainerStarted","Data":"ec6a8cda3c11ca40458b9d039525542463652ab1076f55e22067ef0a87c28371"}
Jul 27 17:03:10.727692 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:10.727254    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-st8bz"]
Jul 27 17:03:10.727913 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:10.727866    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-2ltcp" podStartSLOduration=2.636014006 podStartE2EDuration="5.727851756s" totalImagesPullingTime="3.09183775s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:03:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:03:10.726749503 +0000 UTC m=+103.923494307" watchObservedRunningTime="2026-07-27 17:03:10.727851756 +0000 UTC m=+103.924596556"
Jul 27 17:03:10.729824 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:10.729805    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-st8bz"
Jul 27 17:03:10.733626 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:10.733605    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-tzh5n\""
Jul 27 17:03:10.733726 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:10.733659    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 27 17:03:10.749176 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:10.749114    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-st8bz"]
Jul 27 17:03:10.759460 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:10.759411    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-jbxlh" podStartSLOduration=4.034011409 podStartE2EDuration="5.759390772s" totalImagesPullingTime="1.661886019s" totalInitContainerRuntime="63.493344ms" isStatefulPod=true podCreationTimestamp="2026-07-27 17:03:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:03:10.758734063 +0000 UTC m=+103.955478864" watchObservedRunningTime="2026-07-27 17:03:10.759390772 +0000 UTC m=+103.956135574"
Jul 27 17:03:10.775964 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:10.775932    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-67d88cc47d-fdgh8"]
Jul 27 17:03:10.781362 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:03:10.781338    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod584a4a01_9a97_42dd_b163_a6ea16b856bb.slice/crio-ecb78ecb3ad3c66660748aedea2c043eb3018170e06e989382d61c2dd248bfbb WatchSource:0}: Error finding container ecb78ecb3ad3c66660748aedea2c043eb3018170e06e989382d61c2dd248bfbb: Status 404 returned error can't find the container with id ecb78ecb3ad3c66660748aedea2c043eb3018170e06e989382d61c2dd248bfbb
Jul 27 17:03:10.848435 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:10.848409    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fwr5t\" (UniqueName: \"kubernetes.io/projected/78561ad9-f5ca-4e06-8491-9f2782579000-kube-api-access-fwr5t\") pod \"monitoring-plugin-68b7fc9574-st8bz\" (UID: \"78561ad9-f5ca-4e06-8491-9f2782579000\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-st8bz"
Jul 27 17:03:10.848649 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:10.848618    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/78561ad9-f5ca-4e06-8491-9f2782579000-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-st8bz\" (UID: \"78561ad9-f5ca-4e06-8491-9f2782579000\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-st8bz"
Jul 27 17:03:10.949613 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:10.949573    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fwr5t\" (UniqueName: \"kubernetes.io/projected/78561ad9-f5ca-4e06-8491-9f2782579000-kube-api-access-fwr5t\") pod \"monitoring-plugin-68b7fc9574-st8bz\" (UID: \"78561ad9-f5ca-4e06-8491-9f2782579000\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-st8bz"
Jul 27 17:03:10.949760 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:10.949633    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/78561ad9-f5ca-4e06-8491-9f2782579000-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-st8bz\" (UID: \"78561ad9-f5ca-4e06-8491-9f2782579000\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-st8bz"
Jul 27 17:03:10.951938 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:10.951915    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/78561ad9-f5ca-4e06-8491-9f2782579000-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-st8bz\" (UID: \"78561ad9-f5ca-4e06-8491-9f2782579000\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-st8bz"
Jul 27 17:03:10.958845 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:10.958802    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fwr5t\" (UniqueName: \"kubernetes.io/projected/78561ad9-f5ca-4e06-8491-9f2782579000-kube-api-access-fwr5t\") pod \"monitoring-plugin-68b7fc9574-st8bz\" (UID: \"78561ad9-f5ca-4e06-8491-9f2782579000\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-st8bz"
Jul 27 17:03:11.038980 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:11.038912    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-st8bz"
Jul 27 17:03:11.160419 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:11.160308    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-st8bz"]
Jul 27 17:03:11.162794 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:03:11.162765    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78561ad9_f5ca_4e06_8491_9f2782579000.slice/crio-58f33805e5954ae624f1872dd4b3b815dce40e374a12b7838b742498e7939493 WatchSource:0}: Error finding container 58f33805e5954ae624f1872dd4b3b815dce40e374a12b7838b742498e7939493: Status 404 returned error can't find the container with id 58f33805e5954ae624f1872dd4b3b815dce40e374a12b7838b742498e7939493
Jul 27 17:03:11.547629 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:11.547584    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:03:11.649464 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:11.649423    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:03:11.705239 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:11.705200    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-st8bz" event={"ID":"78561ad9-f5ca-4e06-8491-9f2782579000","Type":"ContainerStarted","Data":"58f33805e5954ae624f1872dd4b3b815dce40e374a12b7838b742498e7939493"}
Jul 27 17:03:11.706552 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:11.706520    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-67d88cc47d-fdgh8" event={"ID":"584a4a01-9a97-42dd-b163-a6ea16b856bb","Type":"ContainerStarted","Data":"ecb78ecb3ad3c66660748aedea2c043eb3018170e06e989382d61c2dd248bfbb"}
Jul 27 17:03:12.316080 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:12.316038    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:03:12.317453 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:12.317431    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 27 17:03:12.320179 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:12.320162    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:03:12.323113 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:12.322969    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 27 17:03:12.323113 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:12.322998    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 27 17:03:12.323113 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:12.323085    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 27 17:03:12.323280 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:12.323127    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 27 17:03:12.324282 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:12.324187    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-336rfrho426oq\""
Jul 27 17:03:12.324282 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:12.324199    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 27 17:03:12.324282 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:12.324233    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 27 17:03:12.324282 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:12.324246    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 27 17:03:12.324537 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:12.324247    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 27 17:03:12.324537 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:12.324188    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 27 17:03:12.324537 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:12.324532    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-8q29r\""
Jul 27 17:03:12.324820 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:12.324807    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 27 17:03:12.325574 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:12.325555    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 27 17:03:12.328380 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:12.328358    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 27 17:03:12.328489 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:12.328359    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 27 17:03:12.328543 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:12.328532    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 27 17:03:12.356460 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:12.356431    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 27 17:03:12.462667 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:12.462630    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5v48z\" (UniqueName: \"kubernetes.io/projected/579400af-4b06-45ec-af5d-071791925115-kube-api-access-5v48z\") pod \"prometheus-k8s-0\" (UID: \"579400af-4b06-45ec-af5d-071791925115\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:03:12.462667 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:12.462673    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/579400af-4b06-45ec-af5d-071791925115-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"579400af-4b06-45ec-af5d-071791925115\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:03:12.462945 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:12.462699    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/579400af-4b06-45ec-af5d-071791925115-config-out\") pod \"prometheus-k8s-0\" (UID: \"579400af-4b06-45ec-af5d-071791925115\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:03:12.462945 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:12.462724    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/579400af-4b06-45ec-af5d-071791925115-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"579400af-4b06-45ec-af5d-071791925115\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:03:12.462945 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:12.462749    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/579400af-4b06-45ec-af5d-071791925115-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"579400af-4b06-45ec-af5d-071791925115\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:03:12.462945 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:12.462780    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/579400af-4b06-45ec-af5d-071791925115-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"579400af-4b06-45ec-af5d-071791925115\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:03:12.462945 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:12.462797    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/579400af-4b06-45ec-af5d-071791925115-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"579400af-4b06-45ec-af5d-071791925115\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:03:12.462945 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:12.462812    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/579400af-4b06-45ec-af5d-071791925115-web-config\") pod \"prometheus-k8s-0\" (UID: \"579400af-4b06-45ec-af5d-071791925115\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:03:12.462945 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:12.462855    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/579400af-4b06-45ec-af5d-071791925115-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"579400af-4b06-45ec-af5d-071791925115\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:03:12.462945 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:12.462878    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/579400af-4b06-45ec-af5d-071791925115-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"579400af-4b06-45ec-af5d-071791925115\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:03:12.462945 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:12.462896    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/579400af-4b06-45ec-af5d-071791925115-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"579400af-4b06-45ec-af5d-071791925115\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:03:12.462945 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:12.462911    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/579400af-4b06-45ec-af5d-071791925115-config\") pod \"prometheus-k8s-0\" (UID: \"579400af-4b06-45ec-af5d-071791925115\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:03:12.462945 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:12.462931    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/579400af-4b06-45ec-af5d-071791925115-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"579400af-4b06-45ec-af5d-071791925115\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:03:12.463479 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:12.462974    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/579400af-4b06-45ec-af5d-071791925115-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"579400af-4b06-45ec-af5d-071791925115\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:03:12.463479 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:12.463075    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/579400af-4b06-45ec-af5d-071791925115-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"579400af-4b06-45ec-af5d-071791925115\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:03:12.463479 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:12.463114    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/579400af-4b06-45ec-af5d-071791925115-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"579400af-4b06-45ec-af5d-071791925115\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:03:12.463479 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:12.463134    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/579400af-4b06-45ec-af5d-071791925115-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"579400af-4b06-45ec-af5d-071791925115\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:03:12.463479 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:12.463148    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/579400af-4b06-45ec-af5d-071791925115-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"579400af-4b06-45ec-af5d-071791925115\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:03:12.463479 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:12.463165    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/579400af-4b06-45ec-af5d-071791925115-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"579400af-4b06-45ec-af5d-071791925115\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:03:12.463479 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:12.463181    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/579400af-4b06-45ec-af5d-071791925115-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"579400af-4b06-45ec-af5d-071791925115\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:03:12.495500 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:12.495467    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:03:12.560548 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:12.560460    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-86cb48fc4-g7xdp" podUID="51786f74-c658-418d-a752-d19508a76f41" containerName="registry" containerID="cri-o://7fcc712e7ba51464c4d0b34b4bc1e65e658bf6c269efc1735afc8760c4920906" gracePeriod=30
Jul 27 17:03:12.564195 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:12.564174    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/579400af-4b06-45ec-af5d-071791925115-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"579400af-4b06-45ec-af5d-071791925115\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:03:12.564276 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:12.564208    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/579400af-4b06-45ec-af5d-071791925115-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"579400af-4b06-45ec-af5d-071791925115\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:03:12.564276 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:12.564235    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/579400af-4b06-45ec-af5d-071791925115-web-config\") pod \"prometheus-k8s-0\" (UID: \"579400af-4b06-45ec-af5d-071791925115\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:03:12.564276 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:12.564264    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/579400af-4b06-45ec-af5d-071791925115-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"579400af-4b06-45ec-af5d-071791925115\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:03:12.564457 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:12.564286    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/579400af-4b06-45ec-af5d-071791925115-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"579400af-4b06-45ec-af5d-071791925115\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:03:12.564457 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:12.564316    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/579400af-4b06-45ec-af5d-071791925115-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"579400af-4b06-45ec-af5d-071791925115\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:03:12.564457 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:12.564338    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/579400af-4b06-45ec-af5d-071791925115-config\") pod \"prometheus-k8s-0\" (UID: \"579400af-4b06-45ec-af5d-071791925115\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:03:12.564457 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:12.564414    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/579400af-4b06-45ec-af5d-071791925115-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"579400af-4b06-45ec-af5d-071791925115\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:03:12.564457 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:12.564447    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/579400af-4b06-45ec-af5d-071791925115-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"579400af-4b06-45ec-af5d-071791925115\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:03:12.564684 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:12.564505    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/579400af-4b06-45ec-af5d-071791925115-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"579400af-4b06-45ec-af5d-071791925115\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:03:12.564684 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:12.564541    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/579400af-4b06-45ec-af5d-071791925115-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"579400af-4b06-45ec-af5d-071791925115\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:03:12.564684 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:12.564570    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/579400af-4b06-45ec-af5d-071791925115-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"579400af-4b06-45ec-af5d-071791925115\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:03:12.564684 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:12.564593    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/579400af-4b06-45ec-af5d-071791925115-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"579400af-4b06-45ec-af5d-071791925115\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:03:12.564684 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:12.564616    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/579400af-4b06-45ec-af5d-071791925115-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"579400af-4b06-45ec-af5d-071791925115\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:03:12.564684 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:12.564642    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/579400af-4b06-45ec-af5d-071791925115-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"579400af-4b06-45ec-af5d-071791925115\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:03:12.566131 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:12.564693    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5v48z\" (UniqueName: \"kubernetes.io/projected/579400af-4b06-45ec-af5d-071791925115-kube-api-access-5v48z\") pod \"prometheus-k8s-0\" (UID: \"579400af-4b06-45ec-af5d-071791925115\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:03:12.566131 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:12.564725    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/579400af-4b06-45ec-af5d-071791925115-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"579400af-4b06-45ec-af5d-071791925115\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:03:12.566131 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:12.564761    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/579400af-4b06-45ec-af5d-071791925115-config-out\") pod \"prometheus-k8s-0\" (UID: \"579400af-4b06-45ec-af5d-071791925115\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:03:12.566131 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:12.564786    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/579400af-4b06-45ec-af5d-071791925115-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"579400af-4b06-45ec-af5d-071791925115\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:03:12.566131 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:12.564815    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/579400af-4b06-45ec-af5d-071791925115-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"579400af-4b06-45ec-af5d-071791925115\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:03:12.566131 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:12.564965    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/579400af-4b06-45ec-af5d-071791925115-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"579400af-4b06-45ec-af5d-071791925115\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:03:12.566131 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:12.565025    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/579400af-4b06-45ec-af5d-071791925115-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"579400af-4b06-45ec-af5d-071791925115\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:03:12.566131 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:12.565433    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/579400af-4b06-45ec-af5d-071791925115-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"579400af-4b06-45ec-af5d-071791925115\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:03:12.566131 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:12.565475    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/579400af-4b06-45ec-af5d-071791925115-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"579400af-4b06-45ec-af5d-071791925115\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:03:12.566672 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:12.566183    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/579400af-4b06-45ec-af5d-071791925115-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"579400af-4b06-45ec-af5d-071791925115\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:03:12.566672 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:12.566413    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/579400af-4b06-45ec-af5d-071791925115-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"579400af-4b06-45ec-af5d-071791925115\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:03:12.567929 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:12.567277    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/579400af-4b06-45ec-af5d-071791925115-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"579400af-4b06-45ec-af5d-071791925115\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:03:12.568226 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:12.568168    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/579400af-4b06-45ec-af5d-071791925115-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"579400af-4b06-45ec-af5d-071791925115\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:03:12.568607 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:12.568569    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/579400af-4b06-45ec-af5d-071791925115-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"579400af-4b06-45ec-af5d-071791925115\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:03:12.572001 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:12.570086    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/579400af-4b06-45ec-af5d-071791925115-config\") pod \"prometheus-k8s-0\" (UID: \"579400af-4b06-45ec-af5d-071791925115\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:03:12.572001 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:12.570111    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/579400af-4b06-45ec-af5d-071791925115-web-config\") pod \"prometheus-k8s-0\" (UID: \"579400af-4b06-45ec-af5d-071791925115\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:03:12.572001 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:12.570141    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/579400af-4b06-45ec-af5d-071791925115-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"579400af-4b06-45ec-af5d-071791925115\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:03:12.572001 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:12.570995    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/579400af-4b06-45ec-af5d-071791925115-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"579400af-4b06-45ec-af5d-071791925115\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:03:12.572001 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:12.571377    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/579400af-4b06-45ec-af5d-071791925115-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"579400af-4b06-45ec-af5d-071791925115\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:03:12.572001 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:12.571844    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/579400af-4b06-45ec-af5d-071791925115-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"579400af-4b06-45ec-af5d-071791925115\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:03:12.572291 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:12.572070    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/579400af-4b06-45ec-af5d-071791925115-config-out\") pod \"prometheus-k8s-0\" (UID: \"579400af-4b06-45ec-af5d-071791925115\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:03:12.572441 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:12.572419    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/579400af-4b06-45ec-af5d-071791925115-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"579400af-4b06-45ec-af5d-071791925115\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:03:12.572545 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:12.572450    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/579400af-4b06-45ec-af5d-071791925115-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"579400af-4b06-45ec-af5d-071791925115\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:03:12.572750 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:12.572726    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/579400af-4b06-45ec-af5d-071791925115-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"579400af-4b06-45ec-af5d-071791925115\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:03:12.574755 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:12.574731    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5v48z\" (UniqueName: \"kubernetes.io/projected/579400af-4b06-45ec-af5d-071791925115-kube-api-access-5v48z\") pod \"prometheus-k8s-0\" (UID: \"579400af-4b06-45ec-af5d-071791925115\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:03:12.629648 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:12.629620    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:03:12.699060 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:12.699017    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:03:12.713053 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:12.713022    2580 generic.go:356] "Generic (PLEG): container finished" podID="51786f74-c658-418d-a752-d19508a76f41" containerID="7fcc712e7ba51464c4d0b34b4bc1e65e658bf6c269efc1735afc8760c4920906" exitCode=0
Jul 27 17:03:12.713465 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:12.713090    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-86cb48fc4-g7xdp" event={"ID":"51786f74-c658-418d-a752-d19508a76f41","Type":"ContainerDied","Data":"7fcc712e7ba51464c4d0b34b4bc1e65e658bf6c269efc1735afc8760c4920906"}
Jul 27 17:03:12.714646 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:12.714622    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-67d88cc47d-fdgh8" event={"ID":"584a4a01-9a97-42dd-b163-a6ea16b856bb","Type":"ContainerStarted","Data":"604071e457d26f84a926e065e80687e07508deb0fcacddf9a17466e39d5d7fce"}
Jul 27 17:03:12.733744 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:12.733627    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-67d88cc47d-fdgh8" podStartSLOduration=1.257289106 podStartE2EDuration="2.733610904s" totalImagesPullingTime="1.476321798s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:03:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:03:12.732867639 +0000 UTC m=+105.929612440" watchObservedRunningTime="2026-07-27 17:03:12.733610904 +0000 UTC m=+105.930355706"
Jul 27 17:03:12.783349 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:12.783317    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 27 17:03:12.786551 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:12.786520    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:03:12.787236 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:03:12.787205    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod579400af_4b06_45ec_af5d_071791925115.slice/crio-1c3f47bc95134ea34724b7c5efc8cae060b30d2115ee8a0e97f14ddfb7c369fa WatchSource:0}: Error finding container 1c3f47bc95134ea34724b7c5efc8cae060b30d2115ee8a0e97f14ddfb7c369fa: Status 404 returned error can't find the container with id 1c3f47bc95134ea34724b7c5efc8cae060b30d2115ee8a0e97f14ddfb7c369fa
Jul 27 17:03:12.819928 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:12.819877    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-86cb48fc4-g7xdp"
Jul 27 17:03:12.848899 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:12.848823    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:03:12.968335 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:12.968300    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/51786f74-c658-418d-a752-d19508a76f41-image-registry-private-configuration\") pod \"51786f74-c658-418d-a752-d19508a76f41\" (UID: \"51786f74-c658-418d-a752-d19508a76f41\") "
Jul 27 17:03:12.968335 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:12.968342    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/51786f74-c658-418d-a752-d19508a76f41-trusted-ca\") pod \"51786f74-c658-418d-a752-d19508a76f41\" (UID: \"51786f74-c658-418d-a752-d19508a76f41\") "
Jul 27 17:03:12.968577 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:12.968371    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/51786f74-c658-418d-a752-d19508a76f41-installation-pull-secrets\") pod \"51786f74-c658-418d-a752-d19508a76f41\" (UID: \"51786f74-c658-418d-a752-d19508a76f41\") "
Jul 27 17:03:12.968577 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:12.968397    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/51786f74-c658-418d-a752-d19508a76f41-registry-tls\") pod \"51786f74-c658-418d-a752-d19508a76f41\" (UID: \"51786f74-c658-418d-a752-d19508a76f41\") "
Jul 27 17:03:12.968577 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:12.968425    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/51786f74-c658-418d-a752-d19508a76f41-registry-certificates\") pod \"51786f74-c658-418d-a752-d19508a76f41\" (UID: \"51786f74-c658-418d-a752-d19508a76f41\") "
Jul 27 17:03:12.968577 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:12.968448    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zvhlv\" (UniqueName: \"kubernetes.io/projected/51786f74-c658-418d-a752-d19508a76f41-kube-api-access-zvhlv\") pod \"51786f74-c658-418d-a752-d19508a76f41\" (UID: \"51786f74-c658-418d-a752-d19508a76f41\") "
Jul 27 17:03:12.968577 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:12.968486    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/51786f74-c658-418d-a752-d19508a76f41-ca-trust-extracted\") pod \"51786f74-c658-418d-a752-d19508a76f41\" (UID: \"51786f74-c658-418d-a752-d19508a76f41\") "
Jul 27 17:03:12.968577 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:12.968507    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/51786f74-c658-418d-a752-d19508a76f41-bound-sa-token\") pod \"51786f74-c658-418d-a752-d19508a76f41\" (UID: \"51786f74-c658-418d-a752-d19508a76f41\") "
Jul 27 17:03:12.968883 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:12.968800    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/51786f74-c658-418d-a752-d19508a76f41-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "51786f74-c658-418d-a752-d19508a76f41" (UID: "51786f74-c658-418d-a752-d19508a76f41"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 17:03:12.968883 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:12.968862    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/51786f74-c658-418d-a752-d19508a76f41-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "51786f74-c658-418d-a752-d19508a76f41" (UID: "51786f74-c658-418d-a752-d19508a76f41"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 17:03:12.970973 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:12.970941    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/51786f74-c658-418d-a752-d19508a76f41-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "51786f74-c658-418d-a752-d19508a76f41" (UID: "51786f74-c658-418d-a752-d19508a76f41"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 17:03:12.971168 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:12.971142    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51786f74-c658-418d-a752-d19508a76f41-kube-api-access-zvhlv" (OuterVolumeSpecName: "kube-api-access-zvhlv") pod "51786f74-c658-418d-a752-d19508a76f41" (UID: "51786f74-c658-418d-a752-d19508a76f41"). InnerVolumeSpecName "kube-api-access-zvhlv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 17:03:12.971245 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:12.971191    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51786f74-c658-418d-a752-d19508a76f41-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "51786f74-c658-418d-a752-d19508a76f41" (UID: "51786f74-c658-418d-a752-d19508a76f41"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 17:03:12.971283 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:12.971259    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51786f74-c658-418d-a752-d19508a76f41-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "51786f74-c658-418d-a752-d19508a76f41" (UID: "51786f74-c658-418d-a752-d19508a76f41"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 17:03:12.971441 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:12.971420    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/51786f74-c658-418d-a752-d19508a76f41-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "51786f74-c658-418d-a752-d19508a76f41" (UID: "51786f74-c658-418d-a752-d19508a76f41"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 17:03:12.976946 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:12.976924    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51786f74-c658-418d-a752-d19508a76f41-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "51786f74-c658-418d-a752-d19508a76f41" (UID: "51786f74-c658-418d-a752-d19508a76f41"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 17:03:13.065707 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:13.065675    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:03:13.069891 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:13.069872    2580 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/51786f74-c658-418d-a752-d19508a76f41-installation-pull-secrets\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 27 17:03:13.069984 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:13.069893    2580 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/51786f74-c658-418d-a752-d19508a76f41-registry-tls\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 27 17:03:13.069984 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:13.069902    2580 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/51786f74-c658-418d-a752-d19508a76f41-registry-certificates\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 27 17:03:13.069984 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:13.069910    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zvhlv\" (UniqueName: \"kubernetes.io/projected/51786f74-c658-418d-a752-d19508a76f41-kube-api-access-zvhlv\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 27 17:03:13.069984 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:13.069918    2580 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/51786f74-c658-418d-a752-d19508a76f41-ca-trust-extracted\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 27 17:03:13.069984 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:13.069926    2580 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/51786f74-c658-418d-a752-d19508a76f41-bound-sa-token\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 27 17:03:13.069984 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:13.069934    2580 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/51786f74-c658-418d-a752-d19508a76f41-image-registry-private-configuration\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 27 17:03:13.069984 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:13.069942    2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/51786f74-c658-418d-a752-d19508a76f41-trusted-ca\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 27 17:03:13.156489 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:13.156444    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:03:13.432531 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:13.432504    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:03:13.720957 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:13.720887    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-86cb48fc4-g7xdp"
Jul 27 17:03:13.720957 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:13.720894    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-86cb48fc4-g7xdp" event={"ID":"51786f74-c658-418d-a752-d19508a76f41","Type":"ContainerDied","Data":"9748f10f7d1f3d25ad81d05d70007beea819841aa0be6930bc2a95578297e6ea"}
Jul 27 17:03:13.721461 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:13.720962    2580 scope.go:117] "RemoveContainer" containerID="7fcc712e7ba51464c4d0b34b4bc1e65e658bf6c269efc1735afc8760c4920906"
Jul 27 17:03:13.723204 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:13.722860    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"579400af-4b06-45ec-af5d-071791925115","Type":"ContainerStarted","Data":"1c3f47bc95134ea34724b7c5efc8cae060b30d2115ee8a0e97f14ddfb7c369fa"}
Jul 27 17:03:13.740316 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:13.740297    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-86cb48fc4-g7xdp"]
Jul 27 17:03:13.742527 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:13.742507    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-86cb48fc4-g7xdp"]
Jul 27 17:03:14.038621 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:14.038507    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:03:14.257340 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:14.257280    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:03:14.459866 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:14.459799    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:03:14.721464 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:14.721395    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:03:14.728108 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:14.728082    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-st8bz" event={"ID":"78561ad9-f5ca-4e06-8491-9f2782579000","Type":"ContainerStarted","Data":"cd8e66b6e356e8123d3e73a585979d861e8d70d6ceffdf2ba66b13300f1b64ec"}
Jul 27 17:03:14.728299 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:14.728274    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-st8bz"
Jul 27 17:03:14.733476 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:14.733456    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-st8bz"
Jul 27 17:03:14.745099 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:14.745058    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-st8bz" podStartSLOduration=1.518847125 podStartE2EDuration="4.745045306s" totalImagesPullingTime="3.226198181s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:03:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:03:14.743887556 +0000 UTC m=+107.940632359" watchObservedRunningTime="2026-07-27 17:03:14.745045306 +0000 UTC m=+107.941790108"
Jul 27 17:03:14.867382 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:14.867358    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:03:14.968297 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:14.968264    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:03:15.270157 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:15.270125    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="51786f74-c658-418d-a752-d19508a76f41" path="/var/lib/kubelet/pods/51786f74-c658-418d-a752-d19508a76f41/volumes"
Jul 27 17:03:15.733124 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:15.733091    2580 generic.go:356] "Generic (PLEG): container finished" podID="579400af-4b06-45ec-af5d-071791925115" containerID="81ee16e560fe5b89397ee1d01f3ea8191d8dbf3b22345f25697fcb389f530cbf" exitCode=0
Jul 27 17:03:15.733502 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:15.733182    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"579400af-4b06-45ec-af5d-071791925115","Type":"ContainerDied","Data":"81ee16e560fe5b89397ee1d01f3ea8191d8dbf3b22345f25697fcb389f530cbf"}
Jul 27 17:03:16.947698 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:16.947632    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:03:17.064210 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:17.064174    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:03:17.162275 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:17.162233    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:03:18.748098 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:18.748056    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"579400af-4b06-45ec-af5d-071791925115","Type":"ContainerStarted","Data":"9a2ea4ab39cefc84a0b65b76762c5b981f02b0128b9e9164ab9d022f293f40ea"}
Jul 27 17:03:18.748553 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:18.748150    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"579400af-4b06-45ec-af5d-071791925115","Type":"ContainerStarted","Data":"648d21095a8fb5c4236ecee298988a4b82712070491890ed7e1fbfedb67500e6"}
Jul 27 17:03:20.760957 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:20.760927    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"579400af-4b06-45ec-af5d-071791925115","Type":"ContainerStarted","Data":"3d7929b0ccf17f8289405e25a7c2b1bb8249aab1c7e312b2c1d54067a8cfbd07"}
Jul 27 17:03:20.761416 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:20.760990    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"579400af-4b06-45ec-af5d-071791925115","Type":"ContainerStarted","Data":"bd85bb1bbb031f9b064cb9619e2af3ab12bf6169faf98b3cb75b39e7124f7dc0"}
Jul 27 17:03:21.767260 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:21.767217    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"579400af-4b06-45ec-af5d-071791925115","Type":"ContainerStarted","Data":"c3964ed208cfee0979eb92ce987e344dab55eea488aba2431ee504585a80f8f4"}
Jul 27 17:03:21.767644 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:21.767297    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"579400af-4b06-45ec-af5d-071791925115","Type":"ContainerStarted","Data":"b19f826d4bdd0f0c7a81cc3cc02e025e3a006cb5cdb8cd1a735452c6c8acb5dc"}
Jul 27 17:03:21.796781 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:21.796717    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.055937011 podStartE2EDuration="9.79669988s" totalImagesPullingTime="6.722803472s" totalInitContainerRuntime="17.959397ms" isStatefulPod=false podCreationTimestamp="2026-07-27 17:03:12 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:03:21.79462072 +0000 UTC m=+114.991365522" watchObservedRunningTime="2026-07-27 17:03:21.79669988 +0000 UTC m=+114.993444682"
Jul 27 17:03:22.138194 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:22.138160    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:03:22.204488 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:22.204458    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:03:22.630117 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:22.630090    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:03:25.158677 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:25.158638    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:03:25.258669 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:25.258635    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:03:26.869801 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:26.869766    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:03:26.926459 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:26.926427    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:03:28.794737 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:28.794639    2580 generic.go:356] "Generic (PLEG): container finished" podID="65a00fd9-7e2d-4bec-81b5-bd36362c3971" containerID="bba119a179f6a0c64262f775cc7aa1e57c1e37d0b48d06c8d96783006d7a1f4d" exitCode=0
Jul 27 17:03:28.794737 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:28.794703    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-kj6ht" event={"ID":"65a00fd9-7e2d-4bec-81b5-bd36362c3971","Type":"ContainerDied","Data":"bba119a179f6a0c64262f775cc7aa1e57c1e37d0b48d06c8d96783006d7a1f4d"}
Jul 27 17:03:28.795245 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:28.795152    2580 scope.go:117] "RemoveContainer" containerID="bba119a179f6a0c64262f775cc7aa1e57c1e37d0b48d06c8d96783006d7a1f4d"
Jul 27 17:03:29.800690 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:29.800657    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-kj6ht" event={"ID":"65a00fd9-7e2d-4bec-81b5-bd36362c3971","Type":"ContainerStarted","Data":"e594c4fb1ddc0e2f20a22609663fbf9754a899430853c637aaca3b5e2897dd66"}
Jul 27 17:03:30.621891 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:30.621860    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-67d88cc47d-fdgh8"
Jul 27 17:03:30.622063 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:30.621911    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-67d88cc47d-fdgh8"
Jul 27 17:03:30.866093 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:30.866063    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:03:30.947049 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:30.946978    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:03:35.659521 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:35.659488    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:03:35.715153 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:35.715116    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:03:36.978778 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:36.978741    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d26abfd5-3102-42ec-a7e0-c5abe0e9dc85-metrics-certs\") pod \"network-metrics-daemon-s5bhd\" (UID: \"d26abfd5-3102-42ec-a7e0-c5abe0e9dc85\") " pod="openshift-multus/network-metrics-daemon-s5bhd"
Jul 27 17:03:36.980984 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:36.980956    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d26abfd5-3102-42ec-a7e0-c5abe0e9dc85-metrics-certs\") pod \"network-metrics-daemon-s5bhd\" (UID: \"d26abfd5-3102-42ec-a7e0-c5abe0e9dc85\") " pod="openshift-multus/network-metrics-daemon-s5bhd"
Jul 27 17:03:37.280246 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:37.280172    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-mxtqx\""
Jul 27 17:03:37.288353 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:37.288330    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s5bhd"
Jul 27 17:03:37.725434 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:37.725409    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-s5bhd"]
Jul 27 17:03:37.727875 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:03:37.727845    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd26abfd5_3102_42ec_a7e0_c5abe0e9dc85.slice/crio-751f8df67971729af73bdeaf96a277f5f6c8ff7cf9ef4cb81b4cf3949d12201d WatchSource:0}: Error finding container 751f8df67971729af73bdeaf96a277f5f6c8ff7cf9ef4cb81b4cf3949d12201d: Status 404 returned error can't find the container with id 751f8df67971729af73bdeaf96a277f5f6c8ff7cf9ef4cb81b4cf3949d12201d
Jul 27 17:03:37.830484 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:37.830452    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-s5bhd" event={"ID":"d26abfd5-3102-42ec-a7e0-c5abe0e9dc85","Type":"ContainerStarted","Data":"751f8df67971729af73bdeaf96a277f5f6c8ff7cf9ef4cb81b4cf3949d12201d"}
Jul 27 17:03:38.267672 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:38.267635    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:03:38.320623 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:38.320597    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:03:39.842760 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:39.842726    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-s5bhd" event={"ID":"d26abfd5-3102-42ec-a7e0-c5abe0e9dc85","Type":"ContainerStarted","Data":"4ee9f672837a31798c00b775a8295e8c23050ee44c46c266d90fc5422e8032e6"}
Jul 27 17:03:39.843137 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:39.842789    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-s5bhd" event={"ID":"d26abfd5-3102-42ec-a7e0-c5abe0e9dc85","Type":"ContainerStarted","Data":"a41e52ff5095e5cc0ba5d52af7c5e297b25d4b415ff7608f40b35ed622fce043"}
Jul 27 17:03:39.859997 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:39.859939    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-s5bhd" podStartSLOduration=131.653728998 podStartE2EDuration="2m12.859914309s" totalImagesPullingTime="1.206185311s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:01:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:03:39.859691856 +0000 UTC m=+133.056436661" watchObservedRunningTime="2026-07-27 17:03:39.859914309 +0000 UTC m=+133.056659111"
Jul 27 17:03:39.959435 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:39.959377    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:03:40.060338 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:40.060296    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:03:40.162205 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:40.162173    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:03:40.279021 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:40.278984    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:03:41.352951 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:41.352914    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:03:42.609506 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:42.609478    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:03:42.712184 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:42.712154    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:03:42.763975 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:42.763947    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:03:45.523429 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:45.523400    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:03:45.587017 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:45.586981    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:03:48.879313 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:48.879280    2580 generic.go:356] "Generic (PLEG): container finished" podID="fa7f3110-1af2-4201-ae03-cae4fb2e5a51" containerID="b75185afb222ca4ad27058ecabbfa55a6ef884532f40209ff1ddd472420c5dd7" exitCode=0
Jul 27 17:03:48.879786 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:48.879353    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-jm6np" event={"ID":"fa7f3110-1af2-4201-ae03-cae4fb2e5a51","Type":"ContainerDied","Data":"b75185afb222ca4ad27058ecabbfa55a6ef884532f40209ff1ddd472420c5dd7"}
Jul 27 17:03:48.879786 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:48.879737    2580 scope.go:117] "RemoveContainer" containerID="b75185afb222ca4ad27058ecabbfa55a6ef884532f40209ff1ddd472420c5dd7"
Jul 27 17:03:49.884525 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:49.884488    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-jm6np" event={"ID":"fa7f3110-1af2-4201-ae03-cae4fb2e5a51","Type":"ContainerStarted","Data":"48950ecfa5c18bee3f7addc7012e14d36929ff146d11b68ca2088aedd7330ac5"}
Jul 27 17:03:50.627569 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:50.627540    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-67d88cc47d-fdgh8"
Jul 27 17:03:50.631430 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:03:50.631403    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-67d88cc47d-fdgh8"
Jul 27 17:04:12.630050 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:12.630018    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:04:12.649332 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:12.649307    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:04:12.985274 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:12.985202    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:04:19.654736 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:19.654657    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:04:22.214451 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:22.214419    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:04:22.269950 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:22.269924    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:04:30.719437 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:30.719406    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 27 17:04:30.719910 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:30.719684    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="579400af-4b06-45ec-af5d-071791925115" containerName="prometheus" containerID="cri-o://648d21095a8fb5c4236ecee298988a4b82712070491890ed7e1fbfedb67500e6" gracePeriod=600
Jul 27 17:04:30.719910 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:30.719721    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="579400af-4b06-45ec-af5d-071791925115" containerName="thanos-sidecar" containerID="cri-o://bd85bb1bbb031f9b064cb9619e2af3ab12bf6169faf98b3cb75b39e7124f7dc0" gracePeriod=600
Jul 27 17:04:30.719910 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:30.719717    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="579400af-4b06-45ec-af5d-071791925115" containerName="kube-rbac-proxy" containerID="cri-o://b19f826d4bdd0f0c7a81cc3cc02e025e3a006cb5cdb8cd1a735452c6c8acb5dc" gracePeriod=600
Jul 27 17:04:30.719910 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:30.719781    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="579400af-4b06-45ec-af5d-071791925115" containerName="kube-rbac-proxy-thanos" containerID="cri-o://c3964ed208cfee0979eb92ce987e344dab55eea488aba2431ee504585a80f8f4" gracePeriod=600
Jul 27 17:04:30.719910 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:30.719791    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="579400af-4b06-45ec-af5d-071791925115" containerName="kube-rbac-proxy-web" containerID="cri-o://3d7929b0ccf17f8289405e25a7c2b1bb8249aab1c7e312b2c1d54067a8cfbd07" gracePeriod=600
Jul 27 17:04:30.719910 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:30.719797    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="579400af-4b06-45ec-af5d-071791925115" containerName="config-reloader" containerID="cri-o://9a2ea4ab39cefc84a0b65b76762c5b981f02b0128b9e9164ab9d022f293f40ea" gracePeriod=600
Jul 27 17:04:30.964776 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:30.964752    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:04:31.020654 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.020581    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/579400af-4b06-45ec-af5d-071791925115-tls-assets\") pod \"579400af-4b06-45ec-af5d-071791925115\" (UID: \"579400af-4b06-45ec-af5d-071791925115\") "
Jul 27 17:04:31.020654 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.020620    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/579400af-4b06-45ec-af5d-071791925115-configmap-kubelet-serving-ca-bundle\") pod \"579400af-4b06-45ec-af5d-071791925115\" (UID: \"579400af-4b06-45ec-af5d-071791925115\") "
Jul 27 17:04:31.020654 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.020646    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/579400af-4b06-45ec-af5d-071791925115-prometheus-trusted-ca-bundle\") pod \"579400af-4b06-45ec-af5d-071791925115\" (UID: \"579400af-4b06-45ec-af5d-071791925115\") "
Jul 27 17:04:31.020917 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.020793    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/579400af-4b06-45ec-af5d-071791925115-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"579400af-4b06-45ec-af5d-071791925115\" (UID: \"579400af-4b06-45ec-af5d-071791925115\") "
Jul 27 17:04:31.020917 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.020859    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/579400af-4b06-45ec-af5d-071791925115-secret-metrics-client-certs\") pod \"579400af-4b06-45ec-af5d-071791925115\" (UID: \"579400af-4b06-45ec-af5d-071791925115\") "
Jul 27 17:04:31.020917 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.020894    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/579400af-4b06-45ec-af5d-071791925115-secret-grpc-tls\") pod \"579400af-4b06-45ec-af5d-071791925115\" (UID: \"579400af-4b06-45ec-af5d-071791925115\") "
Jul 27 17:04:31.021069 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.020927    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/579400af-4b06-45ec-af5d-071791925115-prometheus-k8s-rulefiles-0\") pod \"579400af-4b06-45ec-af5d-071791925115\" (UID: \"579400af-4b06-45ec-af5d-071791925115\") "
Jul 27 17:04:31.021069 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.020984    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5v48z\" (UniqueName: \"kubernetes.io/projected/579400af-4b06-45ec-af5d-071791925115-kube-api-access-5v48z\") pod \"579400af-4b06-45ec-af5d-071791925115\" (UID: \"579400af-4b06-45ec-af5d-071791925115\") "
Jul 27 17:04:31.021069 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.021018    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/579400af-4b06-45ec-af5d-071791925115-secret-kube-rbac-proxy\") pod \"579400af-4b06-45ec-af5d-071791925115\" (UID: \"579400af-4b06-45ec-af5d-071791925115\") "
Jul 27 17:04:31.021069 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.021034    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/579400af-4b06-45ec-af5d-071791925115-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "579400af-4b06-45ec-af5d-071791925115" (UID: "579400af-4b06-45ec-af5d-071791925115"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 17:04:31.021069 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.021059    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/579400af-4b06-45ec-af5d-071791925115-config\") pod \"579400af-4b06-45ec-af5d-071791925115\" (UID: \"579400af-4b06-45ec-af5d-071791925115\") "
Jul 27 17:04:31.021301 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.021078    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/579400af-4b06-45ec-af5d-071791925115-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "579400af-4b06-45ec-af5d-071791925115" (UID: "579400af-4b06-45ec-af5d-071791925115"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 17:04:31.021301 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.021086    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/579400af-4b06-45ec-af5d-071791925115-prometheus-k8s-db\") pod \"579400af-4b06-45ec-af5d-071791925115\" (UID: \"579400af-4b06-45ec-af5d-071791925115\") "
Jul 27 17:04:31.021301 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.021144    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/579400af-4b06-45ec-af5d-071791925115-web-config\") pod \"579400af-4b06-45ec-af5d-071791925115\" (UID: \"579400af-4b06-45ec-af5d-071791925115\") "
Jul 27 17:04:31.021301 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.021176    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/579400af-4b06-45ec-af5d-071791925115-prometheus-k8s-rulefiles-2\") pod \"579400af-4b06-45ec-af5d-071791925115\" (UID: \"579400af-4b06-45ec-af5d-071791925115\") "
Jul 27 17:04:31.021301 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.021213    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/579400af-4b06-45ec-af5d-071791925115-thanos-prometheus-http-client-file\") pod \"579400af-4b06-45ec-af5d-071791925115\" (UID: \"579400af-4b06-45ec-af5d-071791925115\") "
Jul 27 17:04:31.021548 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.021340    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/579400af-4b06-45ec-af5d-071791925115-prometheus-k8s-rulefiles-1\") pod \"579400af-4b06-45ec-af5d-071791925115\" (UID: \"579400af-4b06-45ec-af5d-071791925115\") "
Jul 27 17:04:31.021548 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.021372    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/579400af-4b06-45ec-af5d-071791925115-config-out\") pod \"579400af-4b06-45ec-af5d-071791925115\" (UID: \"579400af-4b06-45ec-af5d-071791925115\") "
Jul 27 17:04:31.021548 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.021396    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/579400af-4b06-45ec-af5d-071791925115-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"579400af-4b06-45ec-af5d-071791925115\" (UID: \"579400af-4b06-45ec-af5d-071791925115\") "
Jul 27 17:04:31.021548 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.021425    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/579400af-4b06-45ec-af5d-071791925115-secret-prometheus-k8s-tls\") pod \"579400af-4b06-45ec-af5d-071791925115\" (UID: \"579400af-4b06-45ec-af5d-071791925115\") "
Jul 27 17:04:31.021548 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.021459    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/579400af-4b06-45ec-af5d-071791925115-configmap-metrics-client-ca\") pod \"579400af-4b06-45ec-af5d-071791925115\" (UID: \"579400af-4b06-45ec-af5d-071791925115\") "
Jul 27 17:04:31.021548 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.021489    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/579400af-4b06-45ec-af5d-071791925115-configmap-serving-certs-ca-bundle\") pod \"579400af-4b06-45ec-af5d-071791925115\" (UID: \"579400af-4b06-45ec-af5d-071791925115\") "
Jul 27 17:04:31.021816 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.021747    2580 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/579400af-4b06-45ec-af5d-071791925115-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 27 17:04:31.021816 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.021768    2580 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/579400af-4b06-45ec-af5d-071791925115-prometheus-trusted-ca-bundle\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 27 17:04:31.022508 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.022241    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/579400af-4b06-45ec-af5d-071791925115-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "579400af-4b06-45ec-af5d-071791925115" (UID: "579400af-4b06-45ec-af5d-071791925115"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 17:04:31.022973 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.022943    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/579400af-4b06-45ec-af5d-071791925115-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "579400af-4b06-45ec-af5d-071791925115" (UID: "579400af-4b06-45ec-af5d-071791925115"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 17:04:31.024077 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.023501    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/579400af-4b06-45ec-af5d-071791925115-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "579400af-4b06-45ec-af5d-071791925115" (UID: "579400af-4b06-45ec-af5d-071791925115"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 17:04:31.024077 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.023973    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/579400af-4b06-45ec-af5d-071791925115-kube-api-access-5v48z" (OuterVolumeSpecName: "kube-api-access-5v48z") pod "579400af-4b06-45ec-af5d-071791925115" (UID: "579400af-4b06-45ec-af5d-071791925115"). InnerVolumeSpecName "kube-api-access-5v48z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 17:04:31.024236 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.024029    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/579400af-4b06-45ec-af5d-071791925115-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "579400af-4b06-45ec-af5d-071791925115" (UID: "579400af-4b06-45ec-af5d-071791925115"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 17:04:31.024641 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.024415    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/579400af-4b06-45ec-af5d-071791925115-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "579400af-4b06-45ec-af5d-071791925115" (UID: "579400af-4b06-45ec-af5d-071791925115"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 17:04:31.024916 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.024882    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/579400af-4b06-45ec-af5d-071791925115-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "579400af-4b06-45ec-af5d-071791925115" (UID: "579400af-4b06-45ec-af5d-071791925115"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 17:04:31.025216 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.025182    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/579400af-4b06-45ec-af5d-071791925115-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "579400af-4b06-45ec-af5d-071791925115" (UID: "579400af-4b06-45ec-af5d-071791925115"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 17:04:31.025306 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.025239    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/579400af-4b06-45ec-af5d-071791925115-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "579400af-4b06-45ec-af5d-071791925115" (UID: "579400af-4b06-45ec-af5d-071791925115"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 17:04:31.025595 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.025518    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/579400af-4b06-45ec-af5d-071791925115-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "579400af-4b06-45ec-af5d-071791925115" (UID: "579400af-4b06-45ec-af5d-071791925115"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 17:04:31.026528 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.026491    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/579400af-4b06-45ec-af5d-071791925115-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "579400af-4b06-45ec-af5d-071791925115" (UID: "579400af-4b06-45ec-af5d-071791925115"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 17:04:31.026685 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.026549    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/579400af-4b06-45ec-af5d-071791925115-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "579400af-4b06-45ec-af5d-071791925115" (UID: "579400af-4b06-45ec-af5d-071791925115"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 17:04:31.026685 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.026635    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/579400af-4b06-45ec-af5d-071791925115-config" (OuterVolumeSpecName: "config") pod "579400af-4b06-45ec-af5d-071791925115" (UID: "579400af-4b06-45ec-af5d-071791925115"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 17:04:31.026821 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.026692    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/579400af-4b06-45ec-af5d-071791925115-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "579400af-4b06-45ec-af5d-071791925115" (UID: "579400af-4b06-45ec-af5d-071791925115"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 17:04:31.027079 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.027058    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/579400af-4b06-45ec-af5d-071791925115-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "579400af-4b06-45ec-af5d-071791925115" (UID: "579400af-4b06-45ec-af5d-071791925115"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 17:04:31.027150 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.027130    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/579400af-4b06-45ec-af5d-071791925115-config-out" (OuterVolumeSpecName: "config-out") pod "579400af-4b06-45ec-af5d-071791925115" (UID: "579400af-4b06-45ec-af5d-071791925115"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 17:04:31.027405 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.027373    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/579400af-4b06-45ec-af5d-071791925115-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "579400af-4b06-45ec-af5d-071791925115" (UID: "579400af-4b06-45ec-af5d-071791925115"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 17:04:31.039904 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.039870    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/579400af-4b06-45ec-af5d-071791925115-web-config" (OuterVolumeSpecName: "web-config") pod "579400af-4b06-45ec-af5d-071791925115" (UID: "579400af-4b06-45ec-af5d-071791925115"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 17:04:31.042666 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.042638    2580 generic.go:356] "Generic (PLEG): container finished" podID="579400af-4b06-45ec-af5d-071791925115" containerID="c3964ed208cfee0979eb92ce987e344dab55eea488aba2431ee504585a80f8f4" exitCode=0
Jul 27 17:04:31.042666 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.042666    2580 generic.go:356] "Generic (PLEG): container finished" podID="579400af-4b06-45ec-af5d-071791925115" containerID="b19f826d4bdd0f0c7a81cc3cc02e025e3a006cb5cdb8cd1a735452c6c8acb5dc" exitCode=0
Jul 27 17:04:31.042813 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.042676    2580 generic.go:356] "Generic (PLEG): container finished" podID="579400af-4b06-45ec-af5d-071791925115" containerID="3d7929b0ccf17f8289405e25a7c2b1bb8249aab1c7e312b2c1d54067a8cfbd07" exitCode=0
Jul 27 17:04:31.042813 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.042684    2580 generic.go:356] "Generic (PLEG): container finished" podID="579400af-4b06-45ec-af5d-071791925115" containerID="bd85bb1bbb031f9b064cb9619e2af3ab12bf6169faf98b3cb75b39e7124f7dc0" exitCode=0
Jul 27 17:04:31.042813 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.042692    2580 generic.go:356] "Generic (PLEG): container finished" podID="579400af-4b06-45ec-af5d-071791925115" containerID="9a2ea4ab39cefc84a0b65b76762c5b981f02b0128b9e9164ab9d022f293f40ea" exitCode=0
Jul 27 17:04:31.042813 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.042699    2580 generic.go:356] "Generic (PLEG): container finished" podID="579400af-4b06-45ec-af5d-071791925115" containerID="648d21095a8fb5c4236ecee298988a4b82712070491890ed7e1fbfedb67500e6" exitCode=0
Jul 27 17:04:31.042813 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.042717    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:04:31.042813 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.042723    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"579400af-4b06-45ec-af5d-071791925115","Type":"ContainerDied","Data":"c3964ed208cfee0979eb92ce987e344dab55eea488aba2431ee504585a80f8f4"}
Jul 27 17:04:31.043083 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.042847    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"579400af-4b06-45ec-af5d-071791925115","Type":"ContainerDied","Data":"b19f826d4bdd0f0c7a81cc3cc02e025e3a006cb5cdb8cd1a735452c6c8acb5dc"}
Jul 27 17:04:31.043083 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.042893    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"579400af-4b06-45ec-af5d-071791925115","Type":"ContainerDied","Data":"3d7929b0ccf17f8289405e25a7c2b1bb8249aab1c7e312b2c1d54067a8cfbd07"}
Jul 27 17:04:31.043083 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.042917    2580 scope.go:117] "RemoveContainer" containerID="c3964ed208cfee0979eb92ce987e344dab55eea488aba2431ee504585a80f8f4"
Jul 27 17:04:31.043083 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.042936    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"579400af-4b06-45ec-af5d-071791925115","Type":"ContainerDied","Data":"bd85bb1bbb031f9b064cb9619e2af3ab12bf6169faf98b3cb75b39e7124f7dc0"}
Jul 27 17:04:31.043083 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.042977    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"579400af-4b06-45ec-af5d-071791925115","Type":"ContainerDied","Data":"9a2ea4ab39cefc84a0b65b76762c5b981f02b0128b9e9164ab9d022f293f40ea"}
Jul 27 17:04:31.043083 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.043020    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"579400af-4b06-45ec-af5d-071791925115","Type":"ContainerDied","Data":"648d21095a8fb5c4236ecee298988a4b82712070491890ed7e1fbfedb67500e6"}
Jul 27 17:04:31.043083 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.043060    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"579400af-4b06-45ec-af5d-071791925115","Type":"ContainerDied","Data":"1c3f47bc95134ea34724b7c5efc8cae060b30d2115ee8a0e97f14ddfb7c369fa"}
Jul 27 17:04:31.050821 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.050769    2580 scope.go:117] "RemoveContainer" containerID="b19f826d4bdd0f0c7a81cc3cc02e025e3a006cb5cdb8cd1a735452c6c8acb5dc"
Jul 27 17:04:31.057266 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.057247    2580 scope.go:117] "RemoveContainer" containerID="3d7929b0ccf17f8289405e25a7c2b1bb8249aab1c7e312b2c1d54067a8cfbd07"
Jul 27 17:04:31.063558 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.063542    2580 scope.go:117] "RemoveContainer" containerID="bd85bb1bbb031f9b064cb9619e2af3ab12bf6169faf98b3cb75b39e7124f7dc0"
Jul 27 17:04:31.066270 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.066246    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 27 17:04:31.070419 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.070398    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 27 17:04:31.071196 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.071177    2580 scope.go:117] "RemoveContainer" containerID="9a2ea4ab39cefc84a0b65b76762c5b981f02b0128b9e9164ab9d022f293f40ea"
Jul 27 17:04:31.077332 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.077317    2580 scope.go:117] "RemoveContainer" containerID="648d21095a8fb5c4236ecee298988a4b82712070491890ed7e1fbfedb67500e6"
Jul 27 17:04:31.084084 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.084069    2580 scope.go:117] "RemoveContainer" containerID="81ee16e560fe5b89397ee1d01f3ea8191d8dbf3b22345f25697fcb389f530cbf"
Jul 27 17:04:31.090225 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.090210    2580 scope.go:117] "RemoveContainer" containerID="c3964ed208cfee0979eb92ce987e344dab55eea488aba2431ee504585a80f8f4"
Jul 27 17:04:31.090481 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:04:31.090461    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c3964ed208cfee0979eb92ce987e344dab55eea488aba2431ee504585a80f8f4\": container with ID starting with c3964ed208cfee0979eb92ce987e344dab55eea488aba2431ee504585a80f8f4 not found: ID does not exist" containerID="c3964ed208cfee0979eb92ce987e344dab55eea488aba2431ee504585a80f8f4"
Jul 27 17:04:31.090532 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.090488    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3964ed208cfee0979eb92ce987e344dab55eea488aba2431ee504585a80f8f4"} err="failed to get container status \"c3964ed208cfee0979eb92ce987e344dab55eea488aba2431ee504585a80f8f4\": rpc error: code = NotFound desc = could not find container \"c3964ed208cfee0979eb92ce987e344dab55eea488aba2431ee504585a80f8f4\": container with ID starting with c3964ed208cfee0979eb92ce987e344dab55eea488aba2431ee504585a80f8f4 not found: ID does not exist"
Jul 27 17:04:31.090532 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.090518    2580 scope.go:117] "RemoveContainer" containerID="b19f826d4bdd0f0c7a81cc3cc02e025e3a006cb5cdb8cd1a735452c6c8acb5dc"
Jul 27 17:04:31.090760 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:04:31.090744    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b19f826d4bdd0f0c7a81cc3cc02e025e3a006cb5cdb8cd1a735452c6c8acb5dc\": container with ID starting with b19f826d4bdd0f0c7a81cc3cc02e025e3a006cb5cdb8cd1a735452c6c8acb5dc not found: ID does not exist" containerID="b19f826d4bdd0f0c7a81cc3cc02e025e3a006cb5cdb8cd1a735452c6c8acb5dc"
Jul 27 17:04:31.090811 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.090762    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b19f826d4bdd0f0c7a81cc3cc02e025e3a006cb5cdb8cd1a735452c6c8acb5dc"} err="failed to get container status \"b19f826d4bdd0f0c7a81cc3cc02e025e3a006cb5cdb8cd1a735452c6c8acb5dc\": rpc error: code = NotFound desc = could not find container \"b19f826d4bdd0f0c7a81cc3cc02e025e3a006cb5cdb8cd1a735452c6c8acb5dc\": container with ID starting with b19f826d4bdd0f0c7a81cc3cc02e025e3a006cb5cdb8cd1a735452c6c8acb5dc not found: ID does not exist"
Jul 27 17:04:31.090811 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.090775    2580 scope.go:117] "RemoveContainer" containerID="3d7929b0ccf17f8289405e25a7c2b1bb8249aab1c7e312b2c1d54067a8cfbd07"
Jul 27 17:04:31.091023 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:04:31.091006    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d7929b0ccf17f8289405e25a7c2b1bb8249aab1c7e312b2c1d54067a8cfbd07\": container with ID starting with 3d7929b0ccf17f8289405e25a7c2b1bb8249aab1c7e312b2c1d54067a8cfbd07 not found: ID does not exist" containerID="3d7929b0ccf17f8289405e25a7c2b1bb8249aab1c7e312b2c1d54067a8cfbd07"
Jul 27 17:04:31.091067 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.091028    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d7929b0ccf17f8289405e25a7c2b1bb8249aab1c7e312b2c1d54067a8cfbd07"} err="failed to get container status \"3d7929b0ccf17f8289405e25a7c2b1bb8249aab1c7e312b2c1d54067a8cfbd07\": rpc error: code = NotFound desc = could not find container \"3d7929b0ccf17f8289405e25a7c2b1bb8249aab1c7e312b2c1d54067a8cfbd07\": container with ID starting with 3d7929b0ccf17f8289405e25a7c2b1bb8249aab1c7e312b2c1d54067a8cfbd07 not found: ID does not exist"
Jul 27 17:04:31.091067 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.091044    2580 scope.go:117] "RemoveContainer" containerID="bd85bb1bbb031f9b064cb9619e2af3ab12bf6169faf98b3cb75b39e7124f7dc0"
Jul 27 17:04:31.091286 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:04:31.091270    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd85bb1bbb031f9b064cb9619e2af3ab12bf6169faf98b3cb75b39e7124f7dc0\": container with ID starting with bd85bb1bbb031f9b064cb9619e2af3ab12bf6169faf98b3cb75b39e7124f7dc0 not found: ID does not exist" containerID="bd85bb1bbb031f9b064cb9619e2af3ab12bf6169faf98b3cb75b39e7124f7dc0"
Jul 27 17:04:31.091338 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.091288    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd85bb1bbb031f9b064cb9619e2af3ab12bf6169faf98b3cb75b39e7124f7dc0"} err="failed to get container status \"bd85bb1bbb031f9b064cb9619e2af3ab12bf6169faf98b3cb75b39e7124f7dc0\": rpc error: code = NotFound desc = could not find container \"bd85bb1bbb031f9b064cb9619e2af3ab12bf6169faf98b3cb75b39e7124f7dc0\": container with ID starting with bd85bb1bbb031f9b064cb9619e2af3ab12bf6169faf98b3cb75b39e7124f7dc0 not found: ID does not exist"
Jul 27 17:04:31.091338 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.091302    2580 scope.go:117] "RemoveContainer" containerID="9a2ea4ab39cefc84a0b65b76762c5b981f02b0128b9e9164ab9d022f293f40ea"
Jul 27 17:04:31.091519 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:04:31.091501    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a2ea4ab39cefc84a0b65b76762c5b981f02b0128b9e9164ab9d022f293f40ea\": container with ID starting with 9a2ea4ab39cefc84a0b65b76762c5b981f02b0128b9e9164ab9d022f293f40ea not found: ID does not exist" containerID="9a2ea4ab39cefc84a0b65b76762c5b981f02b0128b9e9164ab9d022f293f40ea"
Jul 27 17:04:31.091562 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.091524    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a2ea4ab39cefc84a0b65b76762c5b981f02b0128b9e9164ab9d022f293f40ea"} err="failed to get container status \"9a2ea4ab39cefc84a0b65b76762c5b981f02b0128b9e9164ab9d022f293f40ea\": rpc error: code = NotFound desc = could not find container \"9a2ea4ab39cefc84a0b65b76762c5b981f02b0128b9e9164ab9d022f293f40ea\": container with ID starting with 9a2ea4ab39cefc84a0b65b76762c5b981f02b0128b9e9164ab9d022f293f40ea not found: ID does not exist"
Jul 27 17:04:31.091562 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.091539    2580 scope.go:117] "RemoveContainer" containerID="648d21095a8fb5c4236ecee298988a4b82712070491890ed7e1fbfedb67500e6"
Jul 27 17:04:31.091762 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:04:31.091747    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"648d21095a8fb5c4236ecee298988a4b82712070491890ed7e1fbfedb67500e6\": container with ID starting with 648d21095a8fb5c4236ecee298988a4b82712070491890ed7e1fbfedb67500e6 not found: ID does not exist" containerID="648d21095a8fb5c4236ecee298988a4b82712070491890ed7e1fbfedb67500e6"
Jul 27 17:04:31.091800 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.091766    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"648d21095a8fb5c4236ecee298988a4b82712070491890ed7e1fbfedb67500e6"} err="failed to get container status \"648d21095a8fb5c4236ecee298988a4b82712070491890ed7e1fbfedb67500e6\": rpc error: code = NotFound desc = could not find container \"648d21095a8fb5c4236ecee298988a4b82712070491890ed7e1fbfedb67500e6\": container with ID starting with 648d21095a8fb5c4236ecee298988a4b82712070491890ed7e1fbfedb67500e6 not found: ID does not exist"
Jul 27 17:04:31.091800 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.091779    2580 scope.go:117] "RemoveContainer" containerID="81ee16e560fe5b89397ee1d01f3ea8191d8dbf3b22345f25697fcb389f530cbf"
Jul 27 17:04:31.091997 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:04:31.091982    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"81ee16e560fe5b89397ee1d01f3ea8191d8dbf3b22345f25697fcb389f530cbf\": container with ID starting with 81ee16e560fe5b89397ee1d01f3ea8191d8dbf3b22345f25697fcb389f530cbf not found: ID does not exist" containerID="81ee16e560fe5b89397ee1d01f3ea8191d8dbf3b22345f25697fcb389f530cbf"
Jul 27 17:04:31.092039 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.092000    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81ee16e560fe5b89397ee1d01f3ea8191d8dbf3b22345f25697fcb389f530cbf"} err="failed to get container status \"81ee16e560fe5b89397ee1d01f3ea8191d8dbf3b22345f25697fcb389f530cbf\": rpc error: code = NotFound desc = could not find container \"81ee16e560fe5b89397ee1d01f3ea8191d8dbf3b22345f25697fcb389f530cbf\": container with ID starting with 81ee16e560fe5b89397ee1d01f3ea8191d8dbf3b22345f25697fcb389f530cbf not found: ID does not exist"
Jul 27 17:04:31.092039 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.092012    2580 scope.go:117] "RemoveContainer" containerID="c3964ed208cfee0979eb92ce987e344dab55eea488aba2431ee504585a80f8f4"
Jul 27 17:04:31.092227 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.092211    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3964ed208cfee0979eb92ce987e344dab55eea488aba2431ee504585a80f8f4"} err="failed to get container status \"c3964ed208cfee0979eb92ce987e344dab55eea488aba2431ee504585a80f8f4\": rpc error: code = NotFound desc = could not find container \"c3964ed208cfee0979eb92ce987e344dab55eea488aba2431ee504585a80f8f4\": container with ID starting with c3964ed208cfee0979eb92ce987e344dab55eea488aba2431ee504585a80f8f4 not found: ID does not exist"
Jul 27 17:04:31.092266 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.092227    2580 scope.go:117] "RemoveContainer" containerID="b19f826d4bdd0f0c7a81cc3cc02e025e3a006cb5cdb8cd1a735452c6c8acb5dc"
Jul 27 17:04:31.092439 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.092423    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b19f826d4bdd0f0c7a81cc3cc02e025e3a006cb5cdb8cd1a735452c6c8acb5dc"} err="failed to get container status \"b19f826d4bdd0f0c7a81cc3cc02e025e3a006cb5cdb8cd1a735452c6c8acb5dc\": rpc error: code = NotFound desc = could not find container \"b19f826d4bdd0f0c7a81cc3cc02e025e3a006cb5cdb8cd1a735452c6c8acb5dc\": container with ID starting with b19f826d4bdd0f0c7a81cc3cc02e025e3a006cb5cdb8cd1a735452c6c8acb5dc not found: ID does not exist"
Jul 27 17:04:31.092439 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.092438    2580 scope.go:117] "RemoveContainer" containerID="3d7929b0ccf17f8289405e25a7c2b1bb8249aab1c7e312b2c1d54067a8cfbd07"
Jul 27 17:04:31.092603 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.092589    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d7929b0ccf17f8289405e25a7c2b1bb8249aab1c7e312b2c1d54067a8cfbd07"} err="failed to get container status \"3d7929b0ccf17f8289405e25a7c2b1bb8249aab1c7e312b2c1d54067a8cfbd07\": rpc error: code = NotFound desc = could not find container \"3d7929b0ccf17f8289405e25a7c2b1bb8249aab1c7e312b2c1d54067a8cfbd07\": container with ID starting with 3d7929b0ccf17f8289405e25a7c2b1bb8249aab1c7e312b2c1d54067a8cfbd07 not found: ID does not exist"
Jul 27 17:04:31.092645 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.092603    2580 scope.go:117] "RemoveContainer" containerID="bd85bb1bbb031f9b064cb9619e2af3ab12bf6169faf98b3cb75b39e7124f7dc0"
Jul 27 17:04:31.092765 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.092750    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd85bb1bbb031f9b064cb9619e2af3ab12bf6169faf98b3cb75b39e7124f7dc0"} err="failed to get container status \"bd85bb1bbb031f9b064cb9619e2af3ab12bf6169faf98b3cb75b39e7124f7dc0\": rpc error: code = NotFound desc = could not find container \"bd85bb1bbb031f9b064cb9619e2af3ab12bf6169faf98b3cb75b39e7124f7dc0\": container with ID starting with bd85bb1bbb031f9b064cb9619e2af3ab12bf6169faf98b3cb75b39e7124f7dc0 not found: ID does not exist"
Jul 27 17:04:31.092803 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.092765    2580 scope.go:117] "RemoveContainer" containerID="9a2ea4ab39cefc84a0b65b76762c5b981f02b0128b9e9164ab9d022f293f40ea"
Jul 27 17:04:31.092957 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.092941    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a2ea4ab39cefc84a0b65b76762c5b981f02b0128b9e9164ab9d022f293f40ea"} err="failed to get container status \"9a2ea4ab39cefc84a0b65b76762c5b981f02b0128b9e9164ab9d022f293f40ea\": rpc error: code = NotFound desc = could not find container \"9a2ea4ab39cefc84a0b65b76762c5b981f02b0128b9e9164ab9d022f293f40ea\": container with ID starting with 9a2ea4ab39cefc84a0b65b76762c5b981f02b0128b9e9164ab9d022f293f40ea not found: ID does not exist"
Jul 27 17:04:31.093021 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.092960    2580 scope.go:117] "RemoveContainer" containerID="648d21095a8fb5c4236ecee298988a4b82712070491890ed7e1fbfedb67500e6"
Jul 27 17:04:31.093112 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.093098    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"648d21095a8fb5c4236ecee298988a4b82712070491890ed7e1fbfedb67500e6"} err="failed to get container status \"648d21095a8fb5c4236ecee298988a4b82712070491890ed7e1fbfedb67500e6\": rpc error: code = NotFound desc = could not find container \"648d21095a8fb5c4236ecee298988a4b82712070491890ed7e1fbfedb67500e6\": container with ID starting with 648d21095a8fb5c4236ecee298988a4b82712070491890ed7e1fbfedb67500e6 not found: ID does not exist"
Jul 27 17:04:31.093154 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.093112    2580 scope.go:117] "RemoveContainer" containerID="81ee16e560fe5b89397ee1d01f3ea8191d8dbf3b22345f25697fcb389f530cbf"
Jul 27 17:04:31.093270 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.093256    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81ee16e560fe5b89397ee1d01f3ea8191d8dbf3b22345f25697fcb389f530cbf"} err="failed to get container status \"81ee16e560fe5b89397ee1d01f3ea8191d8dbf3b22345f25697fcb389f530cbf\": rpc error: code = NotFound desc = could not find container \"81ee16e560fe5b89397ee1d01f3ea8191d8dbf3b22345f25697fcb389f530cbf\": container with ID starting with 81ee16e560fe5b89397ee1d01f3ea8191d8dbf3b22345f25697fcb389f530cbf not found: ID does not exist"
Jul 27 17:04:31.093311 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.093271    2580 scope.go:117] "RemoveContainer" containerID="c3964ed208cfee0979eb92ce987e344dab55eea488aba2431ee504585a80f8f4"
Jul 27 17:04:31.093466 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.093447    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3964ed208cfee0979eb92ce987e344dab55eea488aba2431ee504585a80f8f4"} err="failed to get container status \"c3964ed208cfee0979eb92ce987e344dab55eea488aba2431ee504585a80f8f4\": rpc error: code = NotFound desc = could not find container \"c3964ed208cfee0979eb92ce987e344dab55eea488aba2431ee504585a80f8f4\": container with ID starting with c3964ed208cfee0979eb92ce987e344dab55eea488aba2431ee504585a80f8f4 not found: ID does not exist"
Jul 27 17:04:31.093516 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.093467    2580 scope.go:117] "RemoveContainer" containerID="b19f826d4bdd0f0c7a81cc3cc02e025e3a006cb5cdb8cd1a735452c6c8acb5dc"
Jul 27 17:04:31.093696 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.093681    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b19f826d4bdd0f0c7a81cc3cc02e025e3a006cb5cdb8cd1a735452c6c8acb5dc"} err="failed to get container status \"b19f826d4bdd0f0c7a81cc3cc02e025e3a006cb5cdb8cd1a735452c6c8acb5dc\": rpc error: code = NotFound desc = could not find container \"b19f826d4bdd0f0c7a81cc3cc02e025e3a006cb5cdb8cd1a735452c6c8acb5dc\": container with ID starting with b19f826d4bdd0f0c7a81cc3cc02e025e3a006cb5cdb8cd1a735452c6c8acb5dc not found: ID does not exist"
Jul 27 17:04:31.093696 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.093695    2580 scope.go:117] "RemoveContainer" containerID="3d7929b0ccf17f8289405e25a7c2b1bb8249aab1c7e312b2c1d54067a8cfbd07"
Jul 27 17:04:31.093938 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.093920    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d7929b0ccf17f8289405e25a7c2b1bb8249aab1c7e312b2c1d54067a8cfbd07"} err="failed to get container status \"3d7929b0ccf17f8289405e25a7c2b1bb8249aab1c7e312b2c1d54067a8cfbd07\": rpc error: code = NotFound desc = could not find container \"3d7929b0ccf17f8289405e25a7c2b1bb8249aab1c7e312b2c1d54067a8cfbd07\": container with ID starting with 3d7929b0ccf17f8289405e25a7c2b1bb8249aab1c7e312b2c1d54067a8cfbd07 not found: ID does not exist"
Jul 27 17:04:31.093938 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.093938    2580 scope.go:117] "RemoveContainer" containerID="bd85bb1bbb031f9b064cb9619e2af3ab12bf6169faf98b3cb75b39e7124f7dc0"
Jul 27 17:04:31.094126 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.094111    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd85bb1bbb031f9b064cb9619e2af3ab12bf6169faf98b3cb75b39e7124f7dc0"} err="failed to get container status \"bd85bb1bbb031f9b064cb9619e2af3ab12bf6169faf98b3cb75b39e7124f7dc0\": rpc error: code = NotFound desc = could not find container \"bd85bb1bbb031f9b064cb9619e2af3ab12bf6169faf98b3cb75b39e7124f7dc0\": container with ID starting with bd85bb1bbb031f9b064cb9619e2af3ab12bf6169faf98b3cb75b39e7124f7dc0 not found: ID does not exist"
Jul 27 17:04:31.094200 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.094126    2580 scope.go:117] "RemoveContainer" containerID="9a2ea4ab39cefc84a0b65b76762c5b981f02b0128b9e9164ab9d022f293f40ea"
Jul 27 17:04:31.094313 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.094294    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a2ea4ab39cefc84a0b65b76762c5b981f02b0128b9e9164ab9d022f293f40ea"} err="failed to get container status \"9a2ea4ab39cefc84a0b65b76762c5b981f02b0128b9e9164ab9d022f293f40ea\": rpc error: code = NotFound desc = could not find container \"9a2ea4ab39cefc84a0b65b76762c5b981f02b0128b9e9164ab9d022f293f40ea\": container with ID starting with 9a2ea4ab39cefc84a0b65b76762c5b981f02b0128b9e9164ab9d022f293f40ea not found: ID does not exist"
Jul 27 17:04:31.094361 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.094314    2580 scope.go:117] "RemoveContainer" containerID="648d21095a8fb5c4236ecee298988a4b82712070491890ed7e1fbfedb67500e6"
Jul 27 17:04:31.094493 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.094479    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"648d21095a8fb5c4236ecee298988a4b82712070491890ed7e1fbfedb67500e6"} err="failed to get container status \"648d21095a8fb5c4236ecee298988a4b82712070491890ed7e1fbfedb67500e6\": rpc error: code = NotFound desc = could not find container \"648d21095a8fb5c4236ecee298988a4b82712070491890ed7e1fbfedb67500e6\": container with ID starting with 648d21095a8fb5c4236ecee298988a4b82712070491890ed7e1fbfedb67500e6 not found: ID does not exist"
Jul 27 17:04:31.094531 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.094492    2580 scope.go:117] "RemoveContainer" containerID="81ee16e560fe5b89397ee1d01f3ea8191d8dbf3b22345f25697fcb389f530cbf"
Jul 27 17:04:31.094671 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.094652    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81ee16e560fe5b89397ee1d01f3ea8191d8dbf3b22345f25697fcb389f530cbf"} err="failed to get container status \"81ee16e560fe5b89397ee1d01f3ea8191d8dbf3b22345f25697fcb389f530cbf\": rpc error: code = NotFound desc = could not find container \"81ee16e560fe5b89397ee1d01f3ea8191d8dbf3b22345f25697fcb389f530cbf\": container with ID starting with 81ee16e560fe5b89397ee1d01f3ea8191d8dbf3b22345f25697fcb389f530cbf not found: ID does not exist"
Jul 27 17:04:31.094709 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.094673    2580 scope.go:117] "RemoveContainer" containerID="c3964ed208cfee0979eb92ce987e344dab55eea488aba2431ee504585a80f8f4"
Jul 27 17:04:31.094872 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.094859    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3964ed208cfee0979eb92ce987e344dab55eea488aba2431ee504585a80f8f4"} err="failed to get container status \"c3964ed208cfee0979eb92ce987e344dab55eea488aba2431ee504585a80f8f4\": rpc error: code = NotFound desc = could not find container \"c3964ed208cfee0979eb92ce987e344dab55eea488aba2431ee504585a80f8f4\": container with ID starting with c3964ed208cfee0979eb92ce987e344dab55eea488aba2431ee504585a80f8f4 not found: ID does not exist"
Jul 27 17:04:31.094872 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.094872    2580 scope.go:117] "RemoveContainer" containerID="b19f826d4bdd0f0c7a81cc3cc02e025e3a006cb5cdb8cd1a735452c6c8acb5dc"
Jul 27 17:04:31.095080 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.095063    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b19f826d4bdd0f0c7a81cc3cc02e025e3a006cb5cdb8cd1a735452c6c8acb5dc"} err="failed to get container status \"b19f826d4bdd0f0c7a81cc3cc02e025e3a006cb5cdb8cd1a735452c6c8acb5dc\": rpc error: code = NotFound desc = could not find container \"b19f826d4bdd0f0c7a81cc3cc02e025e3a006cb5cdb8cd1a735452c6c8acb5dc\": container with ID starting with b19f826d4bdd0f0c7a81cc3cc02e025e3a006cb5cdb8cd1a735452c6c8acb5dc not found: ID does not exist"
Jul 27 17:04:31.095117 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.095081    2580 scope.go:117] "RemoveContainer" containerID="3d7929b0ccf17f8289405e25a7c2b1bb8249aab1c7e312b2c1d54067a8cfbd07"
Jul 27 17:04:31.095247 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.095234    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d7929b0ccf17f8289405e25a7c2b1bb8249aab1c7e312b2c1d54067a8cfbd07"} err="failed to get container status \"3d7929b0ccf17f8289405e25a7c2b1bb8249aab1c7e312b2c1d54067a8cfbd07\": rpc error: code = NotFound desc = could not find container \"3d7929b0ccf17f8289405e25a7c2b1bb8249aab1c7e312b2c1d54067a8cfbd07\": container with ID starting with 3d7929b0ccf17f8289405e25a7c2b1bb8249aab1c7e312b2c1d54067a8cfbd07 not found: ID does not exist"
Jul 27 17:04:31.095289 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.095247    2580 scope.go:117] "RemoveContainer" containerID="bd85bb1bbb031f9b064cb9619e2af3ab12bf6169faf98b3cb75b39e7124f7dc0"
Jul 27 17:04:31.095452 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.095436    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd85bb1bbb031f9b064cb9619e2af3ab12bf6169faf98b3cb75b39e7124f7dc0"} err="failed to get container status \"bd85bb1bbb031f9b064cb9619e2af3ab12bf6169faf98b3cb75b39e7124f7dc0\": rpc error: code = NotFound desc = could not find container \"bd85bb1bbb031f9b064cb9619e2af3ab12bf6169faf98b3cb75b39e7124f7dc0\": container with ID starting with bd85bb1bbb031f9b064cb9619e2af3ab12bf6169faf98b3cb75b39e7124f7dc0 not found: ID does not exist"
Jul 27 17:04:31.095501 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.095452    2580 scope.go:117] "RemoveContainer" containerID="9a2ea4ab39cefc84a0b65b76762c5b981f02b0128b9e9164ab9d022f293f40ea"
Jul 27 17:04:31.095644 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.095629    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a2ea4ab39cefc84a0b65b76762c5b981f02b0128b9e9164ab9d022f293f40ea"} err="failed to get container status \"9a2ea4ab39cefc84a0b65b76762c5b981f02b0128b9e9164ab9d022f293f40ea\": rpc error: code = NotFound desc = could not find container \"9a2ea4ab39cefc84a0b65b76762c5b981f02b0128b9e9164ab9d022f293f40ea\": container with ID starting with 9a2ea4ab39cefc84a0b65b76762c5b981f02b0128b9e9164ab9d022f293f40ea not found: ID does not exist"
Jul 27 17:04:31.095696 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.095643    2580 scope.go:117] "RemoveContainer" containerID="648d21095a8fb5c4236ecee298988a4b82712070491890ed7e1fbfedb67500e6"
Jul 27 17:04:31.095929 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.095901    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"648d21095a8fb5c4236ecee298988a4b82712070491890ed7e1fbfedb67500e6"} err="failed to get container status \"648d21095a8fb5c4236ecee298988a4b82712070491890ed7e1fbfedb67500e6\": rpc error: code = NotFound desc = could not find container \"648d21095a8fb5c4236ecee298988a4b82712070491890ed7e1fbfedb67500e6\": container with ID starting with 648d21095a8fb5c4236ecee298988a4b82712070491890ed7e1fbfedb67500e6 not found: ID does not exist"
Jul 27 17:04:31.096024 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.095931    2580 scope.go:117] "RemoveContainer" containerID="81ee16e560fe5b89397ee1d01f3ea8191d8dbf3b22345f25697fcb389f530cbf"
Jul 27 17:04:31.096230 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.096200    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81ee16e560fe5b89397ee1d01f3ea8191d8dbf3b22345f25697fcb389f530cbf"} err="failed to get container status \"81ee16e560fe5b89397ee1d01f3ea8191d8dbf3b22345f25697fcb389f530cbf\": rpc error: code = NotFound desc = could not find container \"81ee16e560fe5b89397ee1d01f3ea8191d8dbf3b22345f25697fcb389f530cbf\": container with ID starting with 81ee16e560fe5b89397ee1d01f3ea8191d8dbf3b22345f25697fcb389f530cbf not found: ID does not exist"
Jul 27 17:04:31.096230 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.096229    2580 scope.go:117] "RemoveContainer" containerID="c3964ed208cfee0979eb92ce987e344dab55eea488aba2431ee504585a80f8f4"
Jul 27 17:04:31.096713 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.096687    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3964ed208cfee0979eb92ce987e344dab55eea488aba2431ee504585a80f8f4"} err="failed to get container status \"c3964ed208cfee0979eb92ce987e344dab55eea488aba2431ee504585a80f8f4\": rpc error: code = NotFound desc = could not find container \"c3964ed208cfee0979eb92ce987e344dab55eea488aba2431ee504585a80f8f4\": container with ID starting with c3964ed208cfee0979eb92ce987e344dab55eea488aba2431ee504585a80f8f4 not found: ID does not exist"
Jul 27 17:04:31.096713 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.096714    2580 scope.go:117] "RemoveContainer" containerID="b19f826d4bdd0f0c7a81cc3cc02e025e3a006cb5cdb8cd1a735452c6c8acb5dc"
Jul 27 17:04:31.097069 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.097039    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b19f826d4bdd0f0c7a81cc3cc02e025e3a006cb5cdb8cd1a735452c6c8acb5dc"} err="failed to get container status \"b19f826d4bdd0f0c7a81cc3cc02e025e3a006cb5cdb8cd1a735452c6c8acb5dc\": rpc error: code = NotFound desc = could not find container \"b19f826d4bdd0f0c7a81cc3cc02e025e3a006cb5cdb8cd1a735452c6c8acb5dc\": container with ID starting with b19f826d4bdd0f0c7a81cc3cc02e025e3a006cb5cdb8cd1a735452c6c8acb5dc not found: ID does not exist"
Jul 27 17:04:31.097069 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.097068    2580 scope.go:117] "RemoveContainer" containerID="3d7929b0ccf17f8289405e25a7c2b1bb8249aab1c7e312b2c1d54067a8cfbd07"
Jul 27 17:04:31.097318 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.097299    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d7929b0ccf17f8289405e25a7c2b1bb8249aab1c7e312b2c1d54067a8cfbd07"} err="failed to get container status \"3d7929b0ccf17f8289405e25a7c2b1bb8249aab1c7e312b2c1d54067a8cfbd07\": rpc error: code = NotFound desc = could not find container \"3d7929b0ccf17f8289405e25a7c2b1bb8249aab1c7e312b2c1d54067a8cfbd07\": container with ID starting with 3d7929b0ccf17f8289405e25a7c2b1bb8249aab1c7e312b2c1d54067a8cfbd07 not found: ID does not exist"
Jul 27 17:04:31.097366 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.097320    2580 scope.go:117] "RemoveContainer" containerID="bd85bb1bbb031f9b064cb9619e2af3ab12bf6169faf98b3cb75b39e7124f7dc0"
Jul 27 17:04:31.097593 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.097573    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd85bb1bbb031f9b064cb9619e2af3ab12bf6169faf98b3cb75b39e7124f7dc0"} err="failed to get container status \"bd85bb1bbb031f9b064cb9619e2af3ab12bf6169faf98b3cb75b39e7124f7dc0\": rpc error: code = NotFound desc = could not find container \"bd85bb1bbb031f9b064cb9619e2af3ab12bf6169faf98b3cb75b39e7124f7dc0\": container with ID starting with bd85bb1bbb031f9b064cb9619e2af3ab12bf6169faf98b3cb75b39e7124f7dc0 not found: ID does not exist"
Jul 27 17:04:31.097669 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.097594    2580 scope.go:117] "RemoveContainer" containerID="9a2ea4ab39cefc84a0b65b76762c5b981f02b0128b9e9164ab9d022f293f40ea"
Jul 27 17:04:31.097706 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.097666    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 27 17:04:31.097816 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.097798    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a2ea4ab39cefc84a0b65b76762c5b981f02b0128b9e9164ab9d022f293f40ea"} err="failed to get container status \"9a2ea4ab39cefc84a0b65b76762c5b981f02b0128b9e9164ab9d022f293f40ea\": rpc error: code = NotFound desc = could not find container \"9a2ea4ab39cefc84a0b65b76762c5b981f02b0128b9e9164ab9d022f293f40ea\": container with ID starting with 9a2ea4ab39cefc84a0b65b76762c5b981f02b0128b9e9164ab9d022f293f40ea not found: ID does not exist"
Jul 27 17:04:31.097915 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.097817    2580 scope.go:117] "RemoveContainer" containerID="648d21095a8fb5c4236ecee298988a4b82712070491890ed7e1fbfedb67500e6"
Jul 27 17:04:31.097969 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.097942    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="579400af-4b06-45ec-af5d-071791925115" containerName="config-reloader"
Jul 27 17:04:31.097969 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.097953    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="579400af-4b06-45ec-af5d-071791925115" containerName="config-reloader"
Jul 27 17:04:31.097969 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.097963    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51786f74-c658-418d-a752-d19508a76f41" containerName="registry"
Jul 27 17:04:31.097969 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.097968    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="51786f74-c658-418d-a752-d19508a76f41" containerName="registry"
Jul 27 17:04:31.098099 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.097981    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="579400af-4b06-45ec-af5d-071791925115" containerName="prometheus"
Jul 27 17:04:31.098099 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.097986    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="579400af-4b06-45ec-af5d-071791925115" containerName="prometheus"
Jul 27 17:04:31.098099 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.097993    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="579400af-4b06-45ec-af5d-071791925115" containerName="kube-rbac-proxy-thanos"
Jul 27 17:04:31.098099 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.097999    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="579400af-4b06-45ec-af5d-071791925115" containerName="kube-rbac-proxy-thanos"
Jul 27 17:04:31.098099 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.098007    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="579400af-4b06-45ec-af5d-071791925115" containerName="init-config-reloader"
Jul 27 17:04:31.098099 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.098015    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="579400af-4b06-45ec-af5d-071791925115" containerName="init-config-reloader"
Jul 27 17:04:31.098099 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.098025    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="579400af-4b06-45ec-af5d-071791925115" containerName="kube-rbac-proxy"
Jul 27 17:04:31.098099 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.098031    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="579400af-4b06-45ec-af5d-071791925115" containerName="kube-rbac-proxy"
Jul 27 17:04:31.098099 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.098041    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="579400af-4b06-45ec-af5d-071791925115" containerName="thanos-sidecar"
Jul 27 17:04:31.098099 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.098049    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="579400af-4b06-45ec-af5d-071791925115" containerName="thanos-sidecar"
Jul 27 17:04:31.098099 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.098057    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="579400af-4b06-45ec-af5d-071791925115" containerName="kube-rbac-proxy-web"
Jul 27 17:04:31.098099 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.098062    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="579400af-4b06-45ec-af5d-071791925115" containerName="kube-rbac-proxy-web"
Jul 27 17:04:31.098468 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.098110    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="579400af-4b06-45ec-af5d-071791925115" containerName="prometheus"
Jul 27 17:04:31.098468 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.098112    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"648d21095a8fb5c4236ecee298988a4b82712070491890ed7e1fbfedb67500e6"} err="failed to get container status \"648d21095a8fb5c4236ecee298988a4b82712070491890ed7e1fbfedb67500e6\": rpc error: code = NotFound desc = could not find container \"648d21095a8fb5c4236ecee298988a4b82712070491890ed7e1fbfedb67500e6\": container with ID starting with 648d21095a8fb5c4236ecee298988a4b82712070491890ed7e1fbfedb67500e6 not found: ID does not exist"
Jul 27 17:04:31.098468 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.098132    2580 scope.go:117] "RemoveContainer" containerID="81ee16e560fe5b89397ee1d01f3ea8191d8dbf3b22345f25697fcb389f530cbf"
Jul 27 17:04:31.098468 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.098120    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="579400af-4b06-45ec-af5d-071791925115" containerName="kube-rbac-proxy-thanos"
Jul 27 17:04:31.098468 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.098186    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="579400af-4b06-45ec-af5d-071791925115" containerName="config-reloader"
Jul 27 17:04:31.098468 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.098194    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="579400af-4b06-45ec-af5d-071791925115" containerName="thanos-sidecar"
Jul 27 17:04:31.098468 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.098201    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="579400af-4b06-45ec-af5d-071791925115" containerName="kube-rbac-proxy-web"
Jul 27 17:04:31.098468 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.098206    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="579400af-4b06-45ec-af5d-071791925115" containerName="kube-rbac-proxy"
Jul 27 17:04:31.098468 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.098213    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="51786f74-c658-418d-a752-d19508a76f41" containerName="registry"
Jul 27 17:04:31.098468 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.098309    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81ee16e560fe5b89397ee1d01f3ea8191d8dbf3b22345f25697fcb389f530cbf"} err="failed to get container status \"81ee16e560fe5b89397ee1d01f3ea8191d8dbf3b22345f25697fcb389f530cbf\": rpc error: code = NotFound desc = could not find container \"81ee16e560fe5b89397ee1d01f3ea8191d8dbf3b22345f25697fcb389f530cbf\": container with ID starting with 81ee16e560fe5b89397ee1d01f3ea8191d8dbf3b22345f25697fcb389f530cbf not found: ID does not exist"
Jul 27 17:04:31.098468 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.098328    2580 scope.go:117] "RemoveContainer" containerID="c3964ed208cfee0979eb92ce987e344dab55eea488aba2431ee504585a80f8f4"
Jul 27 17:04:31.098868 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.098541    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3964ed208cfee0979eb92ce987e344dab55eea488aba2431ee504585a80f8f4"} err="failed to get container status \"c3964ed208cfee0979eb92ce987e344dab55eea488aba2431ee504585a80f8f4\": rpc error: code = NotFound desc = could not find container \"c3964ed208cfee0979eb92ce987e344dab55eea488aba2431ee504585a80f8f4\": container with ID starting with c3964ed208cfee0979eb92ce987e344dab55eea488aba2431ee504585a80f8f4 not found: ID does not exist"
Jul 27 17:04:31.098868 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.098561    2580 scope.go:117] "RemoveContainer" containerID="b19f826d4bdd0f0c7a81cc3cc02e025e3a006cb5cdb8cd1a735452c6c8acb5dc"
Jul 27 17:04:31.098868 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.098801    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b19f826d4bdd0f0c7a81cc3cc02e025e3a006cb5cdb8cd1a735452c6c8acb5dc"} err="failed to get container status \"b19f826d4bdd0f0c7a81cc3cc02e025e3a006cb5cdb8cd1a735452c6c8acb5dc\": rpc error: code = NotFound desc = could not find container \"b19f826d4bdd0f0c7a81cc3cc02e025e3a006cb5cdb8cd1a735452c6c8acb5dc\": container with ID starting with b19f826d4bdd0f0c7a81cc3cc02e025e3a006cb5cdb8cd1a735452c6c8acb5dc not found: ID does not exist"
Jul 27 17:04:31.098868 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.098823    2580 scope.go:117] "RemoveContainer" containerID="3d7929b0ccf17f8289405e25a7c2b1bb8249aab1c7e312b2c1d54067a8cfbd07"
Jul 27 17:04:31.099094 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.099076    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d7929b0ccf17f8289405e25a7c2b1bb8249aab1c7e312b2c1d54067a8cfbd07"} err="failed to get container status \"3d7929b0ccf17f8289405e25a7c2b1bb8249aab1c7e312b2c1d54067a8cfbd07\": rpc error: code = NotFound desc = could not find container \"3d7929b0ccf17f8289405e25a7c2b1bb8249aab1c7e312b2c1d54067a8cfbd07\": container with ID starting with 3d7929b0ccf17f8289405e25a7c2b1bb8249aab1c7e312b2c1d54067a8cfbd07 not found: ID does not exist"
Jul 27 17:04:31.099141 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.099095    2580 scope.go:117] "RemoveContainer" containerID="bd85bb1bbb031f9b064cb9619e2af3ab12bf6169faf98b3cb75b39e7124f7dc0"
Jul 27 17:04:31.099302 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.099274    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd85bb1bbb031f9b064cb9619e2af3ab12bf6169faf98b3cb75b39e7124f7dc0"} err="failed to get container status \"bd85bb1bbb031f9b064cb9619e2af3ab12bf6169faf98b3cb75b39e7124f7dc0\": rpc error: code = NotFound desc = could not find container \"bd85bb1bbb031f9b064cb9619e2af3ab12bf6169faf98b3cb75b39e7124f7dc0\": container with ID starting with bd85bb1bbb031f9b064cb9619e2af3ab12bf6169faf98b3cb75b39e7124f7dc0 not found: ID does not exist"
Jul 27 17:04:31.099302 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.099292    2580 scope.go:117] "RemoveContainer" containerID="9a2ea4ab39cefc84a0b65b76762c5b981f02b0128b9e9164ab9d022f293f40ea"
Jul 27 17:04:31.099479 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.099464    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a2ea4ab39cefc84a0b65b76762c5b981f02b0128b9e9164ab9d022f293f40ea"} err="failed to get container status \"9a2ea4ab39cefc84a0b65b76762c5b981f02b0128b9e9164ab9d022f293f40ea\": rpc error: code = NotFound desc = could not find container \"9a2ea4ab39cefc84a0b65b76762c5b981f02b0128b9e9164ab9d022f293f40ea\": container with ID starting with 9a2ea4ab39cefc84a0b65b76762c5b981f02b0128b9e9164ab9d022f293f40ea not found: ID does not exist"
Jul 27 17:04:31.099479 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.099479    2580 scope.go:117] "RemoveContainer" containerID="648d21095a8fb5c4236ecee298988a4b82712070491890ed7e1fbfedb67500e6"
Jul 27 17:04:31.099678 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.099659    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"648d21095a8fb5c4236ecee298988a4b82712070491890ed7e1fbfedb67500e6"} err="failed to get container status \"648d21095a8fb5c4236ecee298988a4b82712070491890ed7e1fbfedb67500e6\": rpc error: code = NotFound desc = could not find container \"648d21095a8fb5c4236ecee298988a4b82712070491890ed7e1fbfedb67500e6\": container with ID starting with 648d21095a8fb5c4236ecee298988a4b82712070491890ed7e1fbfedb67500e6 not found: ID does not exist"
Jul 27 17:04:31.099744 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.099680    2580 scope.go:117] "RemoveContainer" containerID="81ee16e560fe5b89397ee1d01f3ea8191d8dbf3b22345f25697fcb389f530cbf"
Jul 27 17:04:31.099898 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.099882    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81ee16e560fe5b89397ee1d01f3ea8191d8dbf3b22345f25697fcb389f530cbf"} err="failed to get container status \"81ee16e560fe5b89397ee1d01f3ea8191d8dbf3b22345f25697fcb389f530cbf\": rpc error: code = NotFound desc = could not find container \"81ee16e560fe5b89397ee1d01f3ea8191d8dbf3b22345f25697fcb389f530cbf\": container with ID starting with 81ee16e560fe5b89397ee1d01f3ea8191d8dbf3b22345f25697fcb389f530cbf not found: ID does not exist"
Jul 27 17:04:31.103434 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.103418    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:04:31.105875 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.105858    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 27 17:04:31.105993 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.105893    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-336rfrho426oq\""
Jul 27 17:04:31.105993 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.105861    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 27 17:04:31.105993 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.105908    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 27 17:04:31.105993 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.105901    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 27 17:04:31.105993 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.105910    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-8q29r\""
Jul 27 17:04:31.105993 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.105897    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 27 17:04:31.106353 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.106331    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 27 17:04:31.106430 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.106415    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 27 17:04:31.106476 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.106444    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 27 17:04:31.106521 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.106478    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 27 17:04:31.106693 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.106672    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 27 17:04:31.106914 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.106894    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 27 17:04:31.106914 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.106901    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 27 17:04:31.109017 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.108999    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 27 17:04:31.111423 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.111405    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 27 17:04:31.117682 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.117653    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 27 17:04:31.122508 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.122478    2580 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/579400af-4b06-45ec-af5d-071791925115-secret-grpc-tls\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 27 17:04:31.122508 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.122510    2580 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/579400af-4b06-45ec-af5d-071791925115-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 27 17:04:31.122665 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.122557    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5v48z\" (UniqueName: \"kubernetes.io/projected/579400af-4b06-45ec-af5d-071791925115-kube-api-access-5v48z\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 27 17:04:31.122665 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.122574    2580 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/579400af-4b06-45ec-af5d-071791925115-secret-kube-rbac-proxy\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 27 17:04:31.122665 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.122587    2580 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/579400af-4b06-45ec-af5d-071791925115-config\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 27 17:04:31.122665 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.122602    2580 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/579400af-4b06-45ec-af5d-071791925115-prometheus-k8s-db\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 27 17:04:31.122665 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.122614    2580 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/579400af-4b06-45ec-af5d-071791925115-web-config\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 27 17:04:31.122665 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.122628    2580 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/579400af-4b06-45ec-af5d-071791925115-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 27 17:04:31.122665 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.122641    2580 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/579400af-4b06-45ec-af5d-071791925115-thanos-prometheus-http-client-file\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 27 17:04:31.122665 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.122655    2580 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/579400af-4b06-45ec-af5d-071791925115-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 27 17:04:31.122964 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.122669    2580 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/579400af-4b06-45ec-af5d-071791925115-config-out\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 27 17:04:31.122964 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.122682    2580 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/579400af-4b06-45ec-af5d-071791925115-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 27 17:04:31.122964 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.122696    2580 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/579400af-4b06-45ec-af5d-071791925115-secret-prometheus-k8s-tls\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 27 17:04:31.122964 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.122710    2580 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/579400af-4b06-45ec-af5d-071791925115-configmap-metrics-client-ca\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 27 17:04:31.122964 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.122723    2580 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/579400af-4b06-45ec-af5d-071791925115-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 27 17:04:31.122964 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.122737    2580 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/579400af-4b06-45ec-af5d-071791925115-tls-assets\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 27 17:04:31.122964 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.122750    2580 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/579400af-4b06-45ec-af5d-071791925115-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 27 17:04:31.122964 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.122764    2580 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/579400af-4b06-45ec-af5d-071791925115-secret-metrics-client-certs\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 27 17:04:31.223697 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.223668    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/03a486b4-3578-4a40-9076-3e1980944df1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"03a486b4-3578-4a40-9076-3e1980944df1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:04:31.223697 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.223700    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/03a486b4-3578-4a40-9076-3e1980944df1-config-out\") pod \"prometheus-k8s-0\" (UID: \"03a486b4-3578-4a40-9076-3e1980944df1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:04:31.223925 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.223720    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/03a486b4-3578-4a40-9076-3e1980944df1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"03a486b4-3578-4a40-9076-3e1980944df1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:04:31.223925 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.223738    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/03a486b4-3578-4a40-9076-3e1980944df1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"03a486b4-3578-4a40-9076-3e1980944df1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:04:31.223925 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.223789    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/03a486b4-3578-4a40-9076-3e1980944df1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"03a486b4-3578-4a40-9076-3e1980944df1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:04:31.223925 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.223825    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03a486b4-3578-4a40-9076-3e1980944df1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"03a486b4-3578-4a40-9076-3e1980944df1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:04:31.223925 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.223872    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/03a486b4-3578-4a40-9076-3e1980944df1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"03a486b4-3578-4a40-9076-3e1980944df1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:04:31.223925 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.223889    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/03a486b4-3578-4a40-9076-3e1980944df1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"03a486b4-3578-4a40-9076-3e1980944df1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:04:31.223925 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.223904    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/03a486b4-3578-4a40-9076-3e1980944df1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"03a486b4-3578-4a40-9076-3e1980944df1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:04:31.224135 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.223960    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03a486b4-3578-4a40-9076-3e1980944df1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"03a486b4-3578-4a40-9076-3e1980944df1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:04:31.224135 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.223984    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/03a486b4-3578-4a40-9076-3e1980944df1-web-config\") pod \"prometheus-k8s-0\" (UID: \"03a486b4-3578-4a40-9076-3e1980944df1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:04:31.224135 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.224014    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03a486b4-3578-4a40-9076-3e1980944df1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"03a486b4-3578-4a40-9076-3e1980944df1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:04:31.224135 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.224038    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/03a486b4-3578-4a40-9076-3e1980944df1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"03a486b4-3578-4a40-9076-3e1980944df1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:04:31.224135 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.224055    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/03a486b4-3578-4a40-9076-3e1980944df1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"03a486b4-3578-4a40-9076-3e1980944df1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:04:31.224135 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.224075    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xkdwr\" (UniqueName: \"kubernetes.io/projected/03a486b4-3578-4a40-9076-3e1980944df1-kube-api-access-xkdwr\") pod \"prometheus-k8s-0\" (UID: \"03a486b4-3578-4a40-9076-3e1980944df1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:04:31.224135 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.224107    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/03a486b4-3578-4a40-9076-3e1980944df1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"03a486b4-3578-4a40-9076-3e1980944df1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:04:31.224135 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.224123    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/03a486b4-3578-4a40-9076-3e1980944df1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"03a486b4-3578-4a40-9076-3e1980944df1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:04:31.224353 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.224141    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/03a486b4-3578-4a40-9076-3e1980944df1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"03a486b4-3578-4a40-9076-3e1980944df1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:04:31.224353 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.224173    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/03a486b4-3578-4a40-9076-3e1980944df1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"03a486b4-3578-4a40-9076-3e1980944df1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:04:31.224353 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.224191    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/03a486b4-3578-4a40-9076-3e1980944df1-config\") pod \"prometheus-k8s-0\" (UID: \"03a486b4-3578-4a40-9076-3e1980944df1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:04:31.269938 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.269914    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="579400af-4b06-45ec-af5d-071791925115" path="/var/lib/kubelet/pods/579400af-4b06-45ec-af5d-071791925115/volumes"
Jul 27 17:04:31.325250 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.325186    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03a486b4-3578-4a40-9076-3e1980944df1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"03a486b4-3578-4a40-9076-3e1980944df1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:04:31.325250 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.325216    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/03a486b4-3578-4a40-9076-3e1980944df1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"03a486b4-3578-4a40-9076-3e1980944df1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:04:31.325250 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.325235    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/03a486b4-3578-4a40-9076-3e1980944df1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"03a486b4-3578-4a40-9076-3e1980944df1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:04:31.325250 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.325250    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/03a486b4-3578-4a40-9076-3e1980944df1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"03a486b4-3578-4a40-9076-3e1980944df1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:04:31.325496 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.325464    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03a486b4-3578-4a40-9076-3e1980944df1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"03a486b4-3578-4a40-9076-3e1980944df1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:04:31.325550 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.325498    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/03a486b4-3578-4a40-9076-3e1980944df1-web-config\") pod \"prometheus-k8s-0\" (UID: \"03a486b4-3578-4a40-9076-3e1980944df1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:04:31.325871 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.325626    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03a486b4-3578-4a40-9076-3e1980944df1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"03a486b4-3578-4a40-9076-3e1980944df1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:04:31.325871 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.325665    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/03a486b4-3578-4a40-9076-3e1980944df1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"03a486b4-3578-4a40-9076-3e1980944df1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:04:31.325871 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.325699    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/03a486b4-3578-4a40-9076-3e1980944df1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"03a486b4-3578-4a40-9076-3e1980944df1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:04:31.325871 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.325726    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xkdwr\" (UniqueName: \"kubernetes.io/projected/03a486b4-3578-4a40-9076-3e1980944df1-kube-api-access-xkdwr\") pod \"prometheus-k8s-0\" (UID: \"03a486b4-3578-4a40-9076-3e1980944df1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:04:31.325871 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.325756    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/03a486b4-3578-4a40-9076-3e1980944df1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"03a486b4-3578-4a40-9076-3e1980944df1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:04:31.325871 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.325783    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/03a486b4-3578-4a40-9076-3e1980944df1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"03a486b4-3578-4a40-9076-3e1980944df1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:04:31.325871 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.325813    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/03a486b4-3578-4a40-9076-3e1980944df1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"03a486b4-3578-4a40-9076-3e1980944df1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:04:31.326253 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.325877    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/03a486b4-3578-4a40-9076-3e1980944df1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"03a486b4-3578-4a40-9076-3e1980944df1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:04:31.326253 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.325914    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/03a486b4-3578-4a40-9076-3e1980944df1-config\") pod \"prometheus-k8s-0\" (UID: \"03a486b4-3578-4a40-9076-3e1980944df1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:04:31.326253 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.325974    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/03a486b4-3578-4a40-9076-3e1980944df1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"03a486b4-3578-4a40-9076-3e1980944df1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:04:31.326253 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.325996    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/03a486b4-3578-4a40-9076-3e1980944df1-config-out\") pod \"prometheus-k8s-0\" (UID: \"03a486b4-3578-4a40-9076-3e1980944df1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:04:31.326253 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.326028    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/03a486b4-3578-4a40-9076-3e1980944df1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"03a486b4-3578-4a40-9076-3e1980944df1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:04:31.326253 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.326051    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/03a486b4-3578-4a40-9076-3e1980944df1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"03a486b4-3578-4a40-9076-3e1980944df1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:04:31.326253 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.326060    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/03a486b4-3578-4a40-9076-3e1980944df1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"03a486b4-3578-4a40-9076-3e1980944df1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:04:31.326253 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.326085    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/03a486b4-3578-4a40-9076-3e1980944df1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"03a486b4-3578-4a40-9076-3e1980944df1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:04:31.326253 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.326131    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/03a486b4-3578-4a40-9076-3e1980944df1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"03a486b4-3578-4a40-9076-3e1980944df1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:04:31.326698 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.326262    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03a486b4-3578-4a40-9076-3e1980944df1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"03a486b4-3578-4a40-9076-3e1980944df1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:04:31.326698 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.326276    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03a486b4-3578-4a40-9076-3e1980944df1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"03a486b4-3578-4a40-9076-3e1980944df1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:04:31.326698 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.326608    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/03a486b4-3578-4a40-9076-3e1980944df1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"03a486b4-3578-4a40-9076-3e1980944df1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:04:31.326870 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.326779    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03a486b4-3578-4a40-9076-3e1980944df1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"03a486b4-3578-4a40-9076-3e1980944df1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:04:31.328784 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.328461    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/03a486b4-3578-4a40-9076-3e1980944df1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"03a486b4-3578-4a40-9076-3e1980944df1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:04:31.328784 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.328568    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/03a486b4-3578-4a40-9076-3e1980944df1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"03a486b4-3578-4a40-9076-3e1980944df1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:04:31.328784 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.328612    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/03a486b4-3578-4a40-9076-3e1980944df1-config-out\") pod \"prometheus-k8s-0\" (UID: \"03a486b4-3578-4a40-9076-3e1980944df1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:04:31.329015 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.328951    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/03a486b4-3578-4a40-9076-3e1980944df1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"03a486b4-3578-4a40-9076-3e1980944df1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:04:31.329158 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.329061    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/03a486b4-3578-4a40-9076-3e1980944df1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"03a486b4-3578-4a40-9076-3e1980944df1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:04:31.329539 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.329413    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/03a486b4-3578-4a40-9076-3e1980944df1-config\") pod \"prometheus-k8s-0\" (UID: \"03a486b4-3578-4a40-9076-3e1980944df1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:04:31.329539 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.329433    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/03a486b4-3578-4a40-9076-3e1980944df1-web-config\") pod \"prometheus-k8s-0\" (UID: \"03a486b4-3578-4a40-9076-3e1980944df1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:04:31.329690 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.329595    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/03a486b4-3578-4a40-9076-3e1980944df1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"03a486b4-3578-4a40-9076-3e1980944df1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:04:31.329690 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.329675    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/03a486b4-3578-4a40-9076-3e1980944df1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"03a486b4-3578-4a40-9076-3e1980944df1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:04:31.330762 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.330740    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/03a486b4-3578-4a40-9076-3e1980944df1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"03a486b4-3578-4a40-9076-3e1980944df1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:04:31.330888 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.330871    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/03a486b4-3578-4a40-9076-3e1980944df1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"03a486b4-3578-4a40-9076-3e1980944df1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:04:31.331048 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.331030    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/03a486b4-3578-4a40-9076-3e1980944df1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"03a486b4-3578-4a40-9076-3e1980944df1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:04:31.332218 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.332202    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/03a486b4-3578-4a40-9076-3e1980944df1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"03a486b4-3578-4a40-9076-3e1980944df1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:04:31.334322 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.334305    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xkdwr\" (UniqueName: \"kubernetes.io/projected/03a486b4-3578-4a40-9076-3e1980944df1-kube-api-access-xkdwr\") pod \"prometheus-k8s-0\" (UID: \"03a486b4-3578-4a40-9076-3e1980944df1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:04:31.413294 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.413267    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:04:31.545181 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:31.545151    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 27 17:04:31.547871 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:04:31.547844    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03a486b4_3578_4a40_9076_3e1980944df1.slice/crio-24e466476df0eb1cb0308c5f7561af53822db1283a30077eca4a910ca5178db0 WatchSource:0}: Error finding container 24e466476df0eb1cb0308c5f7561af53822db1283a30077eca4a910ca5178db0: Status 404 returned error can't find the container with id 24e466476df0eb1cb0308c5f7561af53822db1283a30077eca4a910ca5178db0
Jul 27 17:04:32.047507 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:32.047472    2580 generic.go:356] "Generic (PLEG): container finished" podID="03a486b4-3578-4a40-9076-3e1980944df1" containerID="b0237495fd69f5c0b3b514ecea1bdc0d32b9c7094e4e8f4c533f6a8c2f0511eb" exitCode=0
Jul 27 17:04:32.047959 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:32.047568    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"03a486b4-3578-4a40-9076-3e1980944df1","Type":"ContainerDied","Data":"b0237495fd69f5c0b3b514ecea1bdc0d32b9c7094e4e8f4c533f6a8c2f0511eb"}
Jul 27 17:04:32.047959 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:32.047644    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"03a486b4-3578-4a40-9076-3e1980944df1","Type":"ContainerStarted","Data":"24e466476df0eb1cb0308c5f7561af53822db1283a30077eca4a910ca5178db0"}
Jul 27 17:04:33.055723 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:33.055690    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"03a486b4-3578-4a40-9076-3e1980944df1","Type":"ContainerStarted","Data":"0ad4771bdbbc9e815610ffb8247d15547f06efc2d881a961edf354cd0cea7d3f"}
Jul 27 17:04:33.056091 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:33.055777    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"03a486b4-3578-4a40-9076-3e1980944df1","Type":"ContainerStarted","Data":"a82266de181a986fed3c9b8d92360037cf53c93bb3a634eda69579718b1d2a42"}
Jul 27 17:04:33.056091 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:33.055806    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"03a486b4-3578-4a40-9076-3e1980944df1","Type":"ContainerStarted","Data":"d7437914d21e50ea35ee3eebbcfd5795b6920b134bf5d89c548e116225268a7c"}
Jul 27 17:04:33.056091 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:33.055847    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"03a486b4-3578-4a40-9076-3e1980944df1","Type":"ContainerStarted","Data":"f4039ac5ec1c453b86f1ae9f9857ac3055e1f303ab9b196d700e1d294bf47d3a"}
Jul 27 17:04:33.056091 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:33.055895    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"03a486b4-3578-4a40-9076-3e1980944df1","Type":"ContainerStarted","Data":"c4130d56af5f4dc37a3cc3a0385b8c6c94afa6dcba3d8823726ae84078980d99"}
Jul 27 17:04:33.056091 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:33.055921    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"03a486b4-3578-4a40-9076-3e1980944df1","Type":"ContainerStarted","Data":"3e1ede3f32e90d460680a824cb63b3e9076b4fa4531eb80b55be8545896320eb"}
Jul 27 17:04:33.083730 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:33.083639    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.061739785 podStartE2EDuration="2.083617584s" totalImagesPullingTime="0s" totalInitContainerRuntime="21.877799ms" isStatefulPod=false podCreationTimestamp="2026-07-27 17:04:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:04:33.082008316 +0000 UTC m=+186.278753119" watchObservedRunningTime="2026-07-27 17:04:33.083617584 +0000 UTC m=+186.280362392"
Jul 27 17:04:34.250797 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:34.250767    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:04:34.306850 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:34.306797    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:04:36.414128 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:36.414094    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:04:40.169519 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:40.169489    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:04:40.562137 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:40.562053    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:04:40.662410 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:40.662378    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:04:58.009044 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:58.009005    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:04:58.109606 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:04:58.109575    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:05:05.727033 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:05:05.727001    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:05:08.229150 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:05:08.229117    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:05:11.698853 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:05:11.698800    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:05:11.752502 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:05:11.752471    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:05:22.704284 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:05:22.704251    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:05:22.761794 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:05:22.761761    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:05:22.814609 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:05:22.814573    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:05:31.414455 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:05:31.414419    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:05:31.429879 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:05:31.429852    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:05:32.290021 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:05:32.289986    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:05:49.490947 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:05:49.490873    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:05:49.593493 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:05:49.593456    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:05:49.840799 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:05:49.840717    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:05:50.163514 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:05:50.163487    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:05:50.239195 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:05:50.239168    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:06:12.265180 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:06:12.265143    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:06:12.374116 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:06:12.374079    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:06:18.002954 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:06:18.002917    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:06:18.300555 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:06:18.300472    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:06:18.503496 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:06:18.503462    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:06:18.601471 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:06:18.601441    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:06:18.703887 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:06:18.703857    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:06:18.903439 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:06:18.903356    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:06:19.000927 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:06:19.000895    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:06:19.679354 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:06:19.679325    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:06:19.790844 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:06:19.790804    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:06:19.893948 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:06:19.893916    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:06:19.999853 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:06:19.999748    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:06:22.590569 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:06:22.590525    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:06:27.159985 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:06:27.159951    2580 kubelet.go:1648] "Image garbage collection succeeded"
Jul 27 17:06:53.624720 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:06:53.624680    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:06:55.387164 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:06:55.387132    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:07:37.484921 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:07:37.484778    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:07:37.561353 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:07:37.561298    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:07:37.636178 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:07:37.636147    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:07:37.695456 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:07:37.695403    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:07:37.806079 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:07:37.805978    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:07:38.689323 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:07:38.689288    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:07:38.848806 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:07:38.848775    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:08:21.294757 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:08:21.294726    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:08:21.361235 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:08:21.361207    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:08:26.535495 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:08:26.535446    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:08:26.609285 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:08:26.609251    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:08:26.668726 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:08:26.668683    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:08:27.264072 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:08:27.264037    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:08:27.321742 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:08:27.321713    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:08:31.567589 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:08:31.567546    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:08:32.255125 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:08:32.255088    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:08:34.481476 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:08:34.481431    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:08:34.662073 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:08:34.662042    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:08:35.172406 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:08:35.172370    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:08:35.272823 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:08:35.272778    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:08:37.626466 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:08:37.626424    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:08:37.726218 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:08:37.726178    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:08:37.830730 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:08:37.830688    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:08:37.937747 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:08:37.937668    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-pth7z"]
Jul 27 17:08:37.940653 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:08:37.940630    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-pth7z"
Jul 27 17:08:37.943126 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:08:37.943107    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-lthnl\""
Jul 27 17:08:37.944003 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:08:37.943984    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 27 17:08:37.944106 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:08:37.944027    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 27 17:08:37.955736 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:08:37.955711    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-pth7z"]
Jul 27 17:08:38.020260 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:08:38.020230    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/eeb18eaf-9193-481e-9dc7-217956e74a34-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-pth7z\" (UID: \"eeb18eaf-9193-481e-9dc7-217956e74a34\") " pod="cert-manager/cert-manager-webhook-6486ffd997-pth7z"
Jul 27 17:08:38.020433 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:08:38.020274    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49c4q\" (UniqueName: \"kubernetes.io/projected/eeb18eaf-9193-481e-9dc7-217956e74a34-kube-api-access-49c4q\") pod \"cert-manager-webhook-6486ffd997-pth7z\" (UID: \"eeb18eaf-9193-481e-9dc7-217956e74a34\") " pod="cert-manager/cert-manager-webhook-6486ffd997-pth7z"
Jul 27 17:08:38.035107 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:08:38.035080    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:08:38.121404 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:08:38.121368    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/eeb18eaf-9193-481e-9dc7-217956e74a34-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-pth7z\" (UID: \"eeb18eaf-9193-481e-9dc7-217956e74a34\") " pod="cert-manager/cert-manager-webhook-6486ffd997-pth7z"
Jul 27 17:08:38.121556 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:08:38.121428    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49c4q\" (UniqueName: \"kubernetes.io/projected/eeb18eaf-9193-481e-9dc7-217956e74a34-kube-api-access-49c4q\") pod \"cert-manager-webhook-6486ffd997-pth7z\" (UID: \"eeb18eaf-9193-481e-9dc7-217956e74a34\") " pod="cert-manager/cert-manager-webhook-6486ffd997-pth7z"
Jul 27 17:08:38.134960 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:08:38.134926    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/eeb18eaf-9193-481e-9dc7-217956e74a34-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-pth7z\" (UID: \"eeb18eaf-9193-481e-9dc7-217956e74a34\") " pod="cert-manager/cert-manager-webhook-6486ffd997-pth7z"
Jul 27 17:08:38.135104 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:08:38.134982    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-49c4q\" (UniqueName: \"kubernetes.io/projected/eeb18eaf-9193-481e-9dc7-217956e74a34-kube-api-access-49c4q\") pod \"cert-manager-webhook-6486ffd997-pth7z\" (UID: \"eeb18eaf-9193-481e-9dc7-217956e74a34\") " pod="cert-manager/cert-manager-webhook-6486ffd997-pth7z"
Jul 27 17:08:38.258792 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:08:38.258705    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-pth7z"
Jul 27 17:08:38.402306 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:08:38.402263    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-pth7z"]
Jul 27 17:08:38.404744 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:08:38.404716    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podeeb18eaf_9193_481e_9dc7_217956e74a34.slice/crio-50ea05c0e4e6ea13d7c7dc0b6dfa01daa01a132785d948a60fd14a86eea761b0 WatchSource:0}: Error finding container 50ea05c0e4e6ea13d7c7dc0b6dfa01daa01a132785d948a60fd14a86eea761b0: Status 404 returned error can't find the container with id 50ea05c0e4e6ea13d7c7dc0b6dfa01daa01a132785d948a60fd14a86eea761b0
Jul 27 17:08:38.407033 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:08:38.407018    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 17:08:38.946915 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:08:38.946864    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-pth7z" event={"ID":"eeb18eaf-9193-481e-9dc7-217956e74a34","Type":"ContainerStarted","Data":"50ea05c0e4e6ea13d7c7dc0b6dfa01daa01a132785d948a60fd14a86eea761b0"}
Jul 27 17:08:40.125266 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:08:40.125227    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:08:40.226978 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:08:40.226945    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:08:40.341398 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:08:40.341361    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:08:41.941990 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:08:41.941959    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:08:41.960093 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:08:41.960020    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-pth7z" event={"ID":"eeb18eaf-9193-481e-9dc7-217956e74a34","Type":"ContainerStarted","Data":"29d522a987c4a8afb6342c08bb0a6c558342994c5eab4b1ecb8dde11b0ba86f8"}
Jul 27 17:08:41.960093 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:08:41.960090    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-pth7z"
Jul 27 17:08:41.977600 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:08:41.977556    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-pth7z" podStartSLOduration=1.686837726 podStartE2EDuration="4.977540717s" totalImagesPullingTime="3.290702991s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:08:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:08:41.977172218 +0000 UTC m=+435.173917020" watchObservedRunningTime="2026-07-27 17:08:41.977540717 +0000 UTC m=+435.174285517"
Jul 27 17:08:42.038198 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:08:42.038162    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:08:42.140110 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:08:42.140062    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:08:46.097207 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:08:46.097172    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-5f65t"]
Jul 27 17:08:46.100671 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:08:46.100651    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-5f65t"
Jul 27 17:08:46.102912 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:08:46.102888    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-mlbn7\""
Jul 27 17:08:46.107475 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:08:46.107278    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-5f65t"]
Jul 27 17:08:46.191669 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:08:46.191630    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/16e91461-e744-4875-adfc-f1a47564e3f9-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-5f65t\" (UID: \"16e91461-e744-4875-adfc-f1a47564e3f9\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-5f65t"
Jul 27 17:08:46.191860 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:08:46.191736    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwdg6\" (UniqueName: \"kubernetes.io/projected/16e91461-e744-4875-adfc-f1a47564e3f9-kube-api-access-hwdg6\") pod \"cert-manager-cainjector-559cdd8c87-5f65t\" (UID: \"16e91461-e744-4875-adfc-f1a47564e3f9\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-5f65t"
Jul 27 17:08:46.292293 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:08:46.292261    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/16e91461-e744-4875-adfc-f1a47564e3f9-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-5f65t\" (UID: \"16e91461-e744-4875-adfc-f1a47564e3f9\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-5f65t"
Jul 27 17:08:46.292454 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:08:46.292326    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwdg6\" (UniqueName: \"kubernetes.io/projected/16e91461-e744-4875-adfc-f1a47564e3f9-kube-api-access-hwdg6\") pod \"cert-manager-cainjector-559cdd8c87-5f65t\" (UID: \"16e91461-e744-4875-adfc-f1a47564e3f9\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-5f65t"
Jul 27 17:08:46.300332 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:08:46.300297    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/16e91461-e744-4875-adfc-f1a47564e3f9-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-5f65t\" (UID: \"16e91461-e744-4875-adfc-f1a47564e3f9\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-5f65t"
Jul 27 17:08:46.300447 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:08:46.300389    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwdg6\" (UniqueName: \"kubernetes.io/projected/16e91461-e744-4875-adfc-f1a47564e3f9-kube-api-access-hwdg6\") pod \"cert-manager-cainjector-559cdd8c87-5f65t\" (UID: \"16e91461-e744-4875-adfc-f1a47564e3f9\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-5f65t"
Jul 27 17:08:46.409915 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:08:46.409886    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-5f65t"
Jul 27 17:08:46.532731 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:08:46.532698    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-5f65t"]
Jul 27 17:08:46.535571 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:08:46.535548    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod16e91461_e744_4875_adfc_f1a47564e3f9.slice/crio-3df48321e9f400e8ca08bc661d7575eab9f44707c337d19fd0e41ffb8b1285a5 WatchSource:0}: Error finding container 3df48321e9f400e8ca08bc661d7575eab9f44707c337d19fd0e41ffb8b1285a5: Status 404 returned error can't find the container with id 3df48321e9f400e8ca08bc661d7575eab9f44707c337d19fd0e41ffb8b1285a5
Jul 27 17:08:46.979373 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:08:46.979337    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-5f65t" event={"ID":"16e91461-e744-4875-adfc-f1a47564e3f9","Type":"ContainerStarted","Data":"d070e7bfbf2f84cf89a422a6fcec49aef065d5539c46268a8eeb9432b55b64f7"}
Jul 27 17:08:46.979558 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:08:46.979382    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-5f65t" event={"ID":"16e91461-e744-4875-adfc-f1a47564e3f9","Type":"ContainerStarted","Data":"3df48321e9f400e8ca08bc661d7575eab9f44707c337d19fd0e41ffb8b1285a5"}
Jul 27 17:08:46.994902 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:08:46.994855    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-5f65t" podStartSLOduration=0.994824331 podStartE2EDuration="994.824331ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:08:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:08:46.994016204 +0000 UTC m=+440.190761006" watchObservedRunningTime="2026-07-27 17:08:46.994824331 +0000 UTC m=+440.191569135"
Jul 27 17:08:47.334335 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:08:47.334201    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:08:47.624296 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:08:47.624257    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:08:47.683799 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:08:47.683770    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:08:47.966466 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:08:47.966393    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-pth7z"
Jul 27 17:08:53.584328 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:08:53.584233    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:08:53.682118 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:08:53.682090    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:08:55.816694 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:08:55.816659    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dqnrn"]
Jul 27 17:08:55.823325 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:08:55.823302    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dqnrn"
Jul 27 17:08:55.825578 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:08:55.825553    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 27 17:08:55.825678 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:08:55.825585    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-84vxh\""
Jul 27 17:08:55.826578 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:08:55.826554    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 27 17:08:55.828621 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:08:55.828595    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dqnrn"]
Jul 27 17:08:55.973695 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:08:55.973659    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5p6pb\" (UniqueName: \"kubernetes.io/projected/efed6a6a-1255-43b4-ad15-be9f171a36b9-kube-api-access-5p6pb\") pod \"openshift-lws-operator-fd8ccff4c-dqnrn\" (UID: \"efed6a6a-1255-43b4-ad15-be9f171a36b9\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dqnrn"
Jul 27 17:08:55.973889 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:08:55.973740    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/efed6a6a-1255-43b4-ad15-be9f171a36b9-tmp\") pod \"openshift-lws-operator-fd8ccff4c-dqnrn\" (UID: \"efed6a6a-1255-43b4-ad15-be9f171a36b9\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dqnrn"
Jul 27 17:08:56.075123 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:08:56.075031    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/efed6a6a-1255-43b4-ad15-be9f171a36b9-tmp\") pod \"openshift-lws-operator-fd8ccff4c-dqnrn\" (UID: \"efed6a6a-1255-43b4-ad15-be9f171a36b9\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dqnrn"
Jul 27 17:08:56.075123 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:08:56.075101    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5p6pb\" (UniqueName: \"kubernetes.io/projected/efed6a6a-1255-43b4-ad15-be9f171a36b9-kube-api-access-5p6pb\") pod \"openshift-lws-operator-fd8ccff4c-dqnrn\" (UID: \"efed6a6a-1255-43b4-ad15-be9f171a36b9\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dqnrn"
Jul 27 17:08:56.075434 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:08:56.075414    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/efed6a6a-1255-43b4-ad15-be9f171a36b9-tmp\") pod \"openshift-lws-operator-fd8ccff4c-dqnrn\" (UID: \"efed6a6a-1255-43b4-ad15-be9f171a36b9\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dqnrn"
Jul 27 17:08:56.083266 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:08:56.083243    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5p6pb\" (UniqueName: \"kubernetes.io/projected/efed6a6a-1255-43b4-ad15-be9f171a36b9-kube-api-access-5p6pb\") pod \"openshift-lws-operator-fd8ccff4c-dqnrn\" (UID: \"efed6a6a-1255-43b4-ad15-be9f171a36b9\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dqnrn"
Jul 27 17:08:56.134806 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:08:56.134773    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dqnrn"
Jul 27 17:08:56.260488 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:08:56.260464    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dqnrn"]
Jul 27 17:08:56.262730 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:08:56.262705    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podefed6a6a_1255_43b4_ad15_be9f171a36b9.slice/crio-f56bdf644d3e0f56cfa31fe0099423de45b3ba7ce6f25e3adc039708e99b9e89 WatchSource:0}: Error finding container f56bdf644d3e0f56cfa31fe0099423de45b3ba7ce6f25e3adc039708e99b9e89: Status 404 returned error can't find the container with id f56bdf644d3e0f56cfa31fe0099423de45b3ba7ce6f25e3adc039708e99b9e89
Jul 27 17:08:57.017262 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:08:57.017199    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dqnrn" event={"ID":"efed6a6a-1255-43b4-ad15-be9f171a36b9","Type":"ContainerStarted","Data":"f56bdf644d3e0f56cfa31fe0099423de45b3ba7ce6f25e3adc039708e99b9e89"}
Jul 27 17:08:59.026457 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:08:59.026416    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dqnrn" event={"ID":"efed6a6a-1255-43b4-ad15-be9f171a36b9","Type":"ContainerStarted","Data":"677b44e6a2c08d8b41ada9866a8109f49051c88f3b04f2c36c881312459a3cda"}
Jul 27 17:08:59.044781 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:08:59.044730    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dqnrn" podStartSLOduration=1.812583988 podStartE2EDuration="4.044716461s" totalImagesPullingTime="2.232132473s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:08:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:08:59.04361415 +0000 UTC m=+452.240358975" watchObservedRunningTime="2026-07-27 17:08:59.044716461 +0000 UTC m=+452.241461261"
Jul 27 17:09:05.358677 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:09:05.358643    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:09:10.411518 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:09:10.411474    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:09:10.483743 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:09:10.483711    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:09:11.364095 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:09:11.364063    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:09:15.672502 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:09:15.672469    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:09:15.775546 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:09:15.775500    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:09:19.055301 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:09:19.055271    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:09:19.145527 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:09:19.145497    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:09:22.670181 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:09:22.670131    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:09:24.555617 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:09:24.555578    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:09:24.656658 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:09:24.656613    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:09:26.208334 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:09:26.208302    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:09:26.262343 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:09:26.262310    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-58bd97cf4-7mprj"]
Jul 27 17:09:26.265425 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:09:26.265406    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-58bd97cf4-7mprj"
Jul 27 17:09:26.268779 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:09:26.268756    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 27 17:09:26.268903 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:09:26.268756    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 27 17:09:26.268903 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:09:26.268759    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-f9nmc\""
Jul 27 17:09:26.269009 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:09:26.268762    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 27 17:09:26.274960 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:09:26.274929    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-58bd97cf4-7mprj"]
Jul 27 17:09:26.293611 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:09:26.293584    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:09:26.323819 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:09:26.323790    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0a322f33-55cd-44a9-be2a-4d692181cee9-cert\") pod \"lws-controller-manager-58bd97cf4-7mprj\" (UID: \"0a322f33-55cd-44a9-be2a-4d692181cee9\") " pod="openshift-lws-operator/lws-controller-manager-58bd97cf4-7mprj"
Jul 27 17:09:26.323962 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:09:26.323865    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/0a322f33-55cd-44a9-be2a-4d692181cee9-metrics-cert\") pod \"lws-controller-manager-58bd97cf4-7mprj\" (UID: \"0a322f33-55cd-44a9-be2a-4d692181cee9\") " pod="openshift-lws-operator/lws-controller-manager-58bd97cf4-7mprj"
Jul 27 17:09:26.323962 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:09:26.323896    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lfdl8\" (UniqueName: \"kubernetes.io/projected/0a322f33-55cd-44a9-be2a-4d692181cee9-kube-api-access-lfdl8\") pod \"lws-controller-manager-58bd97cf4-7mprj\" (UID: \"0a322f33-55cd-44a9-be2a-4d692181cee9\") " pod="openshift-lws-operator/lws-controller-manager-58bd97cf4-7mprj"
Jul 27 17:09:26.323962 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:09:26.323931    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/0a322f33-55cd-44a9-be2a-4d692181cee9-manager-config\") pod \"lws-controller-manager-58bd97cf4-7mprj\" (UID: \"0a322f33-55cd-44a9-be2a-4d692181cee9\") " pod="openshift-lws-operator/lws-controller-manager-58bd97cf4-7mprj"
Jul 27 17:09:26.424659 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:09:26.424624    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0a322f33-55cd-44a9-be2a-4d692181cee9-cert\") pod \"lws-controller-manager-58bd97cf4-7mprj\" (UID: \"0a322f33-55cd-44a9-be2a-4d692181cee9\") " pod="openshift-lws-operator/lws-controller-manager-58bd97cf4-7mprj"
Jul 27 17:09:26.424864 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:09:26.424665    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/0a322f33-55cd-44a9-be2a-4d692181cee9-metrics-cert\") pod \"lws-controller-manager-58bd97cf4-7mprj\" (UID: \"0a322f33-55cd-44a9-be2a-4d692181cee9\") " pod="openshift-lws-operator/lws-controller-manager-58bd97cf4-7mprj"
Jul 27 17:09:26.424864 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:09:26.424691    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lfdl8\" (UniqueName: \"kubernetes.io/projected/0a322f33-55cd-44a9-be2a-4d692181cee9-kube-api-access-lfdl8\") pod \"lws-controller-manager-58bd97cf4-7mprj\" (UID: \"0a322f33-55cd-44a9-be2a-4d692181cee9\") " pod="openshift-lws-operator/lws-controller-manager-58bd97cf4-7mprj"
Jul 27 17:09:26.424864 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:09:26.424714    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/0a322f33-55cd-44a9-be2a-4d692181cee9-manager-config\") pod \"lws-controller-manager-58bd97cf4-7mprj\" (UID: \"0a322f33-55cd-44a9-be2a-4d692181cee9\") " pod="openshift-lws-operator/lws-controller-manager-58bd97cf4-7mprj"
Jul 27 17:09:26.425456 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:09:26.425432    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/0a322f33-55cd-44a9-be2a-4d692181cee9-manager-config\") pod \"lws-controller-manager-58bd97cf4-7mprj\" (UID: \"0a322f33-55cd-44a9-be2a-4d692181cee9\") " pod="openshift-lws-operator/lws-controller-manager-58bd97cf4-7mprj"
Jul 27 17:09:26.427295 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:09:26.427266    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/0a322f33-55cd-44a9-be2a-4d692181cee9-metrics-cert\") pod \"lws-controller-manager-58bd97cf4-7mprj\" (UID: \"0a322f33-55cd-44a9-be2a-4d692181cee9\") " pod="openshift-lws-operator/lws-controller-manager-58bd97cf4-7mprj"
Jul 27 17:09:26.427763 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:09:26.427740    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0a322f33-55cd-44a9-be2a-4d692181cee9-cert\") pod \"lws-controller-manager-58bd97cf4-7mprj\" (UID: \"0a322f33-55cd-44a9-be2a-4d692181cee9\") " pod="openshift-lws-operator/lws-controller-manager-58bd97cf4-7mprj"
Jul 27 17:09:26.437591 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:09:26.437560    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lfdl8\" (UniqueName: \"kubernetes.io/projected/0a322f33-55cd-44a9-be2a-4d692181cee9-kube-api-access-lfdl8\") pod \"lws-controller-manager-58bd97cf4-7mprj\" (UID: \"0a322f33-55cd-44a9-be2a-4d692181cee9\") " pod="openshift-lws-operator/lws-controller-manager-58bd97cf4-7mprj"
Jul 27 17:09:26.574726 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:09:26.574635    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-58bd97cf4-7mprj"
Jul 27 17:09:26.704610 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:09:26.704574    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-58bd97cf4-7mprj"]
Jul 27 17:09:26.707683 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:09:26.707656    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a322f33_55cd_44a9_be2a_4d692181cee9.slice/crio-ed23ad9c4143c2db3d5f023018135d7490535be34cce3ca48c68de0e98abacc3 WatchSource:0}: Error finding container ed23ad9c4143c2db3d5f023018135d7490535be34cce3ca48c68de0e98abacc3: Status 404 returned error can't find the container with id ed23ad9c4143c2db3d5f023018135d7490535be34cce3ca48c68de0e98abacc3
Jul 27 17:09:27.133592 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:09:27.133554    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-58bd97cf4-7mprj" event={"ID":"0a322f33-55cd-44a9-be2a-4d692181cee9","Type":"ContainerStarted","Data":"ed23ad9c4143c2db3d5f023018135d7490535be34cce3ca48c68de0e98abacc3"}
Jul 27 17:09:29.143380 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:09:29.143347    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-58bd97cf4-7mprj" event={"ID":"0a322f33-55cd-44a9-be2a-4d692181cee9","Type":"ContainerStarted","Data":"8d0e46422030442d01967d3c12292a66f648fe3de34466c538be8584519d3a02"}
Jul 27 17:09:29.143759 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:09:29.143471    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-58bd97cf4-7mprj"
Jul 27 17:09:29.159898 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:09:29.159851    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-58bd97cf4-7mprj" podStartSLOduration=1.606580098 podStartE2EDuration="3.159820217s" totalImagesPullingTime="1.553240119s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:09:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:09:29.158430373 +0000 UTC m=+482.355175175" watchObservedRunningTime="2026-07-27 17:09:29.159820217 +0000 UTC m=+482.356565018"
Jul 27 17:09:38.162973 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:09:38.162941    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:09:40.150218 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:09:40.150186    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-58bd97cf4-7mprj"
Jul 27 17:09:40.759032 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:09:40.759001    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:09:41.161910 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:09:41.161884    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:09:41.563477 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:09:41.563391    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:09:43.827383 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:09:43.827343    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:09:44.060950 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:09:44.060919    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:09:44.990233 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:09:44.990195    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:09:45.444067 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:09:45.444039    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:09:45.584080 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:09:45.584050    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:09:45.691132 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:09:45.691073    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:09:47.791457 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:09:47.791420    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:09:48.716003 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:09:48.715971    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:09:48.816324 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:09:48.816292    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:09:48.964633 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:09:48.964603    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:09:49.261490 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:09:49.261453    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:09:50.686330 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:09:50.686296    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-ccbdf686-qq5xn"]
Jul 27 17:09:50.688524 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:09:50.688506    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-ccbdf686-qq5xn"
Jul 27 17:09:50.690975 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:09:50.690956    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 27 17:09:50.691739 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:09:50.691720    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-kvb7q\""
Jul 27 17:09:50.691809 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:09:50.691742    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 27 17:09:50.691809 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:09:50.691747    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 27 17:09:50.700957 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:09:50.700937    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-ccbdf686-qq5xn"]
Jul 27 17:09:50.831846 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:09:50.831789    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d5k2r\" (UniqueName: \"kubernetes.io/projected/c4173255-8c4d-4e40-846b-5b77d9ee96eb-kube-api-access-d5k2r\") pod \"dns-operator-controller-manager-ccbdf686-qq5xn\" (UID: \"c4173255-8c4d-4e40-846b-5b77d9ee96eb\") " pod="kuadrant-system/dns-operator-controller-manager-ccbdf686-qq5xn"
Jul 27 17:09:50.933130 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:09:50.933087    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d5k2r\" (UniqueName: \"kubernetes.io/projected/c4173255-8c4d-4e40-846b-5b77d9ee96eb-kube-api-access-d5k2r\") pod \"dns-operator-controller-manager-ccbdf686-qq5xn\" (UID: \"c4173255-8c4d-4e40-846b-5b77d9ee96eb\") " pod="kuadrant-system/dns-operator-controller-manager-ccbdf686-qq5xn"
Jul 27 17:09:50.941223 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:09:50.941165    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d5k2r\" (UniqueName: \"kubernetes.io/projected/c4173255-8c4d-4e40-846b-5b77d9ee96eb-kube-api-access-d5k2r\") pod \"dns-operator-controller-manager-ccbdf686-qq5xn\" (UID: \"c4173255-8c4d-4e40-846b-5b77d9ee96eb\") " pod="kuadrant-system/dns-operator-controller-manager-ccbdf686-qq5xn"
Jul 27 17:09:50.999123 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:09:50.999084    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-ccbdf686-qq5xn"
Jul 27 17:09:51.129306 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:09:51.129280    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-ccbdf686-qq5xn"]
Jul 27 17:09:51.131233 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:09:51.131202    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4173255_8c4d_4e40_846b_5b77d9ee96eb.slice/crio-de00eedc2e2e3de56a30b5688671b3b1d5bdd2bfb0f11d928814a1a6a5bf0b8c WatchSource:0}: Error finding container de00eedc2e2e3de56a30b5688671b3b1d5bdd2bfb0f11d928814a1a6a5bf0b8c: Status 404 returned error can't find the container with id de00eedc2e2e3de56a30b5688671b3b1d5bdd2bfb0f11d928814a1a6a5bf0b8c
Jul 27 17:09:51.229279 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:09:51.229197    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-ccbdf686-qq5xn" event={"ID":"c4173255-8c4d-4e40-846b-5b77d9ee96eb","Type":"ContainerStarted","Data":"de00eedc2e2e3de56a30b5688671b3b1d5bdd2bfb0f11d928814a1a6a5bf0b8c"}
Jul 27 17:09:51.437984 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:09:51.437953    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:09:51.450172 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:09:51.450141    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-598f86468b-c5j4w"]
Jul 27 17:09:51.452901 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:09:51.452885    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-c5j4w"
Jul 27 17:09:51.455172 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:09:51.455141    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 27 17:09:51.455172 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:09:51.455140    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 27 17:09:51.455460 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:09:51.455447    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-vpspd\""
Jul 27 17:09:51.463007 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:09:51.462987    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-598f86468b-c5j4w"]
Jul 27 17:09:51.538374 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:09:51.538281    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/13cfa107-0eac-473c-b411-7e2bef8da192-plugin-serving-cert\") pod \"kuadrant-console-plugin-598f86468b-c5j4w\" (UID: \"13cfa107-0eac-473c-b411-7e2bef8da192\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-c5j4w"
Jul 27 17:09:51.538374 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:09:51.538338    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8dq48\" (UniqueName: \"kubernetes.io/projected/13cfa107-0eac-473c-b411-7e2bef8da192-kube-api-access-8dq48\") pod \"kuadrant-console-plugin-598f86468b-c5j4w\" (UID: \"13cfa107-0eac-473c-b411-7e2bef8da192\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-c5j4w"
Jul 27 17:09:51.538374 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:09:51.538371    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/13cfa107-0eac-473c-b411-7e2bef8da192-nginx-conf\") pod \"kuadrant-console-plugin-598f86468b-c5j4w\" (UID: \"13cfa107-0eac-473c-b411-7e2bef8da192\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-c5j4w"
Jul 27 17:09:51.624106 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:09:51.624056    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:09:51.639194 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:09:51.639169    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/13cfa107-0eac-473c-b411-7e2bef8da192-plugin-serving-cert\") pod \"kuadrant-console-plugin-598f86468b-c5j4w\" (UID: \"13cfa107-0eac-473c-b411-7e2bef8da192\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-c5j4w"
Jul 27 17:09:51.639309 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:09:51.639202    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8dq48\" (UniqueName: \"kubernetes.io/projected/13cfa107-0eac-473c-b411-7e2bef8da192-kube-api-access-8dq48\") pod \"kuadrant-console-plugin-598f86468b-c5j4w\" (UID: \"13cfa107-0eac-473c-b411-7e2bef8da192\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-c5j4w"
Jul 27 17:09:51.639309 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:09:51.639225    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/13cfa107-0eac-473c-b411-7e2bef8da192-nginx-conf\") pod \"kuadrant-console-plugin-598f86468b-c5j4w\" (UID: \"13cfa107-0eac-473c-b411-7e2bef8da192\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-c5j4w"
Jul 27 17:09:51.639888 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:09:51.639869    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/13cfa107-0eac-473c-b411-7e2bef8da192-nginx-conf\") pod \"kuadrant-console-plugin-598f86468b-c5j4w\" (UID: \"13cfa107-0eac-473c-b411-7e2bef8da192\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-c5j4w"
Jul 27 17:09:51.641575 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:09:51.641557    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/13cfa107-0eac-473c-b411-7e2bef8da192-plugin-serving-cert\") pod \"kuadrant-console-plugin-598f86468b-c5j4w\" (UID: \"13cfa107-0eac-473c-b411-7e2bef8da192\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-c5j4w"
Jul 27 17:09:51.650121 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:09:51.650096    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8dq48\" (UniqueName: \"kubernetes.io/projected/13cfa107-0eac-473c-b411-7e2bef8da192-kube-api-access-8dq48\") pod \"kuadrant-console-plugin-598f86468b-c5j4w\" (UID: \"13cfa107-0eac-473c-b411-7e2bef8da192\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-c5j4w"
Jul 27 17:09:51.762056 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:09:51.762020    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-c5j4w"
Jul 27 17:09:51.889511 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:09:51.889479    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-598f86468b-c5j4w"]
Jul 27 17:09:51.892486 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:09:51.892455    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod13cfa107_0eac_473c_b411_7e2bef8da192.slice/crio-cfa453c7205771386023593121b970b39739995a531797452b5d4aee1c3847c8 WatchSource:0}: Error finding container cfa453c7205771386023593121b970b39739995a531797452b5d4aee1c3847c8: Status 404 returned error can't find the container with id cfa453c7205771386023593121b970b39739995a531797452b5d4aee1c3847c8
Jul 27 17:09:52.002578 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:09:52.002541    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:09:52.099725 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:09:52.099652    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:09:52.235803 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:09:52.235767    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-c5j4w" event={"ID":"13cfa107-0eac-473c-b411-7e2bef8da192","Type":"ContainerStarted","Data":"cfa453c7205771386023593121b970b39739995a531797452b5d4aee1c3847c8"}
Jul 27 17:09:54.246430 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:09:54.246332    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-ccbdf686-qq5xn" event={"ID":"c4173255-8c4d-4e40-846b-5b77d9ee96eb","Type":"ContainerStarted","Data":"d03bb7322f00ab7e4d7bc75e96a3aa1ed94a61f32331f9a06cf958a59e7342c5"}
Jul 27 17:09:54.246895 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:09:54.246463    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-ccbdf686-qq5xn"
Jul 27 17:09:54.265798 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:09:54.265747    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-ccbdf686-qq5xn" podStartSLOduration=1.4185867810000001 podStartE2EDuration="4.26572975s" totalImagesPullingTime="2.847142969s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:09:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:09:54.263895103 +0000 UTC m=+507.460639907" watchObservedRunningTime="2026-07-27 17:09:54.26572975 +0000 UTC m=+507.462474552"
Jul 27 17:09:55.771589 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:09:55.771554    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:09:55.873415 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:09:55.873384    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:09:56.172262 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:09:56.172224    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:09:56.229264 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:09:56.229231    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:09:56.365117 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:09:56.365074    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:09:56.465906 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:09:56.465809    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:10:04.374176 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:10:04.374136    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:10:04.479430 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:10:04.479394    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:10:05.252881 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:10:05.252848    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-ccbdf686-qq5xn"
Jul 27 17:10:06.814520 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:10:06.814435    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:10:06.874213 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:10:06.874178    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:10:09.318190 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:10:09.318154    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-c5j4w" event={"ID":"13cfa107-0eac-473c-b411-7e2bef8da192","Type":"ContainerStarted","Data":"d5b1f6f3f6d009adecc890fcf290d07478327d0713f2e9add3698bdeee8ce965"}
Jul 27 17:10:09.332525 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:10:09.332476    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-c5j4w" podStartSLOduration=1.9800546190000001 podStartE2EDuration="18.332457567s" totalImagesPullingTime="16.352402948s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:09:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:10:09.331548091 +0000 UTC m=+522.528292896" watchObservedRunningTime="2026-07-27 17:10:09.332457567 +0000 UTC m=+522.529202371"
Jul 27 17:10:11.165173 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:10:11.165138    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:10:11.270796 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:10:11.270764    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:10:12.350527 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:10:12.350499    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:10:12.452338 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:10:12.452299    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:10:13.979578 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:10:13.979547    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:10:14.973142 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:10:14.973108    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:10:15.073568 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:10:15.073538    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:10:15.174454 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:10:15.174418    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:10:15.275717 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:10:15.275614    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:10:16.169973 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:10:16.169941    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:10:16.230971 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:10:16.230900    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:10:25.389043 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:10:25.388948    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:10:25.489040 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:10:25.489004    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:10:27.810920 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:10:27.810868    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:10:27.865553 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:10:27.865499    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:10:31.738680 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:10:31.738643    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:10:31.742041 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:10:31.742014    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-m7hrk"]
Jul 27 17:10:31.746529 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:10:31.746514    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-m7hrk"
Jul 27 17:10:31.748857 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:10:31.748823    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 27 17:10:31.755066 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:10:31.755044    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-m7hrk"]
Jul 27 17:10:31.840250 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:10:31.840210    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:10:31.840437 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:10:31.840366    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-m7hrk"]
Jul 27 17:10:31.892124 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:10:31.892091    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dm8nh\" (UniqueName: \"kubernetes.io/projected/f66b3290-b955-4944-a8b1-c3281dca82d9-kube-api-access-dm8nh\") pod \"limitador-limitador-859c4d96d6-m7hrk\" (UID: \"f66b3290-b955-4944-a8b1-c3281dca82d9\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-m7hrk"
Jul 27 17:10:31.892279 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:10:31.892150    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f66b3290-b955-4944-a8b1-c3281dca82d9-config-file\") pod \"limitador-limitador-859c4d96d6-m7hrk\" (UID: \"f66b3290-b955-4944-a8b1-c3281dca82d9\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-m7hrk"
Jul 27 17:10:31.944496 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:10:31.944456    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:10:31.992613 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:10:31.992523    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dm8nh\" (UniqueName: \"kubernetes.io/projected/f66b3290-b955-4944-a8b1-c3281dca82d9-kube-api-access-dm8nh\") pod \"limitador-limitador-859c4d96d6-m7hrk\" (UID: \"f66b3290-b955-4944-a8b1-c3281dca82d9\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-m7hrk"
Jul 27 17:10:31.992613 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:10:31.992603    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f66b3290-b955-4944-a8b1-c3281dca82d9-config-file\") pod \"limitador-limitador-859c4d96d6-m7hrk\" (UID: \"f66b3290-b955-4944-a8b1-c3281dca82d9\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-m7hrk"
Jul 27 17:10:31.993244 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:10:31.993225    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f66b3290-b955-4944-a8b1-c3281dca82d9-config-file\") pod \"limitador-limitador-859c4d96d6-m7hrk\" (UID: \"f66b3290-b955-4944-a8b1-c3281dca82d9\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-m7hrk"
Jul 27 17:10:32.000120 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:10:32.000095    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dm8nh\" (UniqueName: \"kubernetes.io/projected/f66b3290-b955-4944-a8b1-c3281dca82d9-kube-api-access-dm8nh\") pod \"limitador-limitador-859c4d96d6-m7hrk\" (UID: \"f66b3290-b955-4944-a8b1-c3281dca82d9\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-m7hrk"
Jul 27 17:10:32.056745 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:10:32.056708    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-m7hrk"
Jul 27 17:10:32.196426 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:10:32.196392    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-m7hrk"]
Jul 27 17:10:32.197483 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:10:32.197458    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf66b3290_b955_4944_a8b1_c3281dca82d9.slice/crio-ad264562c6b31ee1a153509b21b48621c325a0d8c72e7814db88b3513c7fed5c WatchSource:0}: Error finding container ad264562c6b31ee1a153509b21b48621c325a0d8c72e7814db88b3513c7fed5c: Status 404 returned error can't find the container with id ad264562c6b31ee1a153509b21b48621c325a0d8c72e7814db88b3513c7fed5c
Jul 27 17:10:32.415716 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:10:32.415682    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-m7hrk" event={"ID":"f66b3290-b955-4944-a8b1-c3281dca82d9","Type":"ContainerStarted","Data":"ad264562c6b31ee1a153509b21b48621c325a0d8c72e7814db88b3513c7fed5c"}
Jul 27 17:10:32.609065 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:10:32.609032    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:10:32.684693 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:10:32.684614    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:10:34.425946 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:10:34.425911    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-m7hrk" event={"ID":"f66b3290-b955-4944-a8b1-c3281dca82d9","Type":"ContainerStarted","Data":"c95a7bfc28cb2143b9563ea637afd66835c430626decee6a6fed748001589098"}
Jul 27 17:10:34.426342 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:10:34.426052    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-859c4d96d6-m7hrk"
Jul 27 17:10:34.443649 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:10:34.443604    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-859c4d96d6-m7hrk" podStartSLOduration=1.904855198 podStartE2EDuration="3.44358852s" totalImagesPullingTime="1.538733322s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:10:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:10:34.440978406 +0000 UTC m=+547.637723221" watchObservedRunningTime="2026-07-27 17:10:34.44358852 +0000 UTC m=+547.640333323"
Jul 27 17:10:45.437246 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:10:45.437215    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-859c4d96d6-m7hrk"
Jul 27 17:10:45.965179 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:10:45.965145    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-m7hrk"]
Jul 27 17:10:45.965365 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:10:45.965339    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-859c4d96d6-m7hrk" podUID="f66b3290-b955-4944-a8b1-c3281dca82d9" containerName="limitador" containerID="cri-o://c95a7bfc28cb2143b9563ea637afd66835c430626decee6a6fed748001589098" gracePeriod=30
Jul 27 17:10:46.479519 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:10:46.479484    2580 generic.go:356] "Generic (PLEG): container finished" podID="f66b3290-b955-4944-a8b1-c3281dca82d9" containerID="c95a7bfc28cb2143b9563ea637afd66835c430626decee6a6fed748001589098" exitCode=0
Jul 27 17:10:46.479888 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:10:46.479559    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-m7hrk" event={"ID":"f66b3290-b955-4944-a8b1-c3281dca82d9","Type":"ContainerDied","Data":"c95a7bfc28cb2143b9563ea637afd66835c430626decee6a6fed748001589098"}
Jul 27 17:10:46.503564 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:10:46.503541    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-m7hrk"
Jul 27 17:10:46.625718 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:10:46.625686    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f66b3290-b955-4944-a8b1-c3281dca82d9-config-file\") pod \"f66b3290-b955-4944-a8b1-c3281dca82d9\" (UID: \"f66b3290-b955-4944-a8b1-c3281dca82d9\") "
Jul 27 17:10:46.625907 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:10:46.625752    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dm8nh\" (UniqueName: \"kubernetes.io/projected/f66b3290-b955-4944-a8b1-c3281dca82d9-kube-api-access-dm8nh\") pod \"f66b3290-b955-4944-a8b1-c3281dca82d9\" (UID: \"f66b3290-b955-4944-a8b1-c3281dca82d9\") "
Jul 27 17:10:46.626154 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:10:46.626126    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f66b3290-b955-4944-a8b1-c3281dca82d9-config-file" (OuterVolumeSpecName: "config-file") pod "f66b3290-b955-4944-a8b1-c3281dca82d9" (UID: "f66b3290-b955-4944-a8b1-c3281dca82d9"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 17:10:46.627937 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:10:46.627912    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f66b3290-b955-4944-a8b1-c3281dca82d9-kube-api-access-dm8nh" (OuterVolumeSpecName: "kube-api-access-dm8nh") pod "f66b3290-b955-4944-a8b1-c3281dca82d9" (UID: "f66b3290-b955-4944-a8b1-c3281dca82d9"). InnerVolumeSpecName "kube-api-access-dm8nh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 17:10:46.726538 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:10:46.726500    2580 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f66b3290-b955-4944-a8b1-c3281dca82d9-config-file\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 27 17:10:46.726538 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:10:46.726531    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dm8nh\" (UniqueName: \"kubernetes.io/projected/f66b3290-b955-4944-a8b1-c3281dca82d9-kube-api-access-dm8nh\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 27 17:10:47.484638 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:10:47.484598    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-m7hrk" event={"ID":"f66b3290-b955-4944-a8b1-c3281dca82d9","Type":"ContainerDied","Data":"ad264562c6b31ee1a153509b21b48621c325a0d8c72e7814db88b3513c7fed5c"}
Jul 27 17:10:47.484638 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:10:47.484630    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-m7hrk"
Jul 27 17:10:47.485138 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:10:47.484677    2580 scope.go:117] "RemoveContainer" containerID="c95a7bfc28cb2143b9563ea637afd66835c430626decee6a6fed748001589098"
Jul 27 17:10:47.500089 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:10:47.500053    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-m7hrk"]
Jul 27 17:10:47.502316 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:10:47.502292    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-m7hrk"]
Jul 27 17:10:49.270794 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:10:49.270762    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f66b3290-b955-4944-a8b1-c3281dca82d9" path="/var/lib/kubelet/pods/f66b3290-b955-4944-a8b1-c3281dca82d9/volumes"
Jul 27 17:10:52.025420 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:10:52.025383    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:10:52.195482 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:10:52.195400    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:11:02.717579 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:11:02.717547    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:11:02.785592 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:11:02.785541    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:11:02.843872 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:11:02.843817    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["observability/jaeger-6bbd7d4c9d-pqfkp"]
Jul 27 17:11:02.844173 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:11:02.844159    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f66b3290-b955-4944-a8b1-c3281dca82d9" containerName="limitador"
Jul 27 17:11:02.844215 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:11:02.844175    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="f66b3290-b955-4944-a8b1-c3281dca82d9" containerName="limitador"
Jul 27 17:11:02.844249 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:11:02.844242    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="f66b3290-b955-4944-a8b1-c3281dca82d9" containerName="limitador"
Jul 27 17:11:02.846151 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:11:02.846132    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="observability/jaeger-6bbd7d4c9d-pqfkp"
Jul 27 17:11:02.851526 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:11:02.851479    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"observability\"/\"jaeger-dockercfg-6p7r4\""
Jul 27 17:11:02.851667 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:11:02.851483    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"observability\"/\"kube-root-ca.crt\""
Jul 27 17:11:02.854969 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:11:02.854945    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"observability\"/\"openshift-service-ca.crt\""
Jul 27 17:11:02.864327 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:11:02.864294    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["observability/jaeger-6bbd7d4c9d-pqfkp"]
Jul 27 17:11:02.927274 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:11:02.927232    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:11:02.970201 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:11:02.970124    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jp8hq\" (UniqueName: \"kubernetes.io/projected/b9c10c2a-e654-438a-bcbf-0253e560042e-kube-api-access-jp8hq\") pod \"jaeger-6bbd7d4c9d-pqfkp\" (UID: \"b9c10c2a-e654-438a-bcbf-0253e560042e\") " pod="observability/jaeger-6bbd7d4c9d-pqfkp"
Jul 27 17:11:03.071088 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:11:03.071048    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jp8hq\" (UniqueName: \"kubernetes.io/projected/b9c10c2a-e654-438a-bcbf-0253e560042e-kube-api-access-jp8hq\") pod \"jaeger-6bbd7d4c9d-pqfkp\" (UID: \"b9c10c2a-e654-438a-bcbf-0253e560042e\") " pod="observability/jaeger-6bbd7d4c9d-pqfkp"
Jul 27 17:11:03.078933 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:11:03.078898    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jp8hq\" (UniqueName: \"kubernetes.io/projected/b9c10c2a-e654-438a-bcbf-0253e560042e-kube-api-access-jp8hq\") pod \"jaeger-6bbd7d4c9d-pqfkp\" (UID: \"b9c10c2a-e654-438a-bcbf-0253e560042e\") " pod="observability/jaeger-6bbd7d4c9d-pqfkp"
Jul 27 17:11:03.154813 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:11:03.154779    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="observability/jaeger-6bbd7d4c9d-pqfkp"
Jul 27 17:11:03.290198 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:11:03.290151    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["observability/jaeger-6bbd7d4c9d-pqfkp"]
Jul 27 17:11:03.294919 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:11:03.294891    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb9c10c2a_e654_438a_bcbf_0253e560042e.slice/crio-1082cf74696d57304e49b8984e27e1812e531410bd6edcf0b73ae79780f78c8a WatchSource:0}: Error finding container 1082cf74696d57304e49b8984e27e1812e531410bd6edcf0b73ae79780f78c8a: Status 404 returned error can't find the container with id 1082cf74696d57304e49b8984e27e1812e531410bd6edcf0b73ae79780f78c8a
Jul 27 17:11:03.556523 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:11:03.556441    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="observability/jaeger-6bbd7d4c9d-pqfkp" event={"ID":"b9c10c2a-e654-438a-bcbf-0253e560042e","Type":"ContainerStarted","Data":"1082cf74696d57304e49b8984e27e1812e531410bd6edcf0b73ae79780f78c8a"}
Jul 27 17:11:05.566906 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:11:05.566799    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="observability/jaeger-6bbd7d4c9d-pqfkp" event={"ID":"b9c10c2a-e654-438a-bcbf-0253e560042e","Type":"ContainerStarted","Data":"3fba479f3a97a5d271f8140894813febc85788ec585a70c8f3bc7b21b886f8f5"}
Jul 27 17:11:05.566906 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:11:05.566876    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="observability/jaeger-6bbd7d4c9d-pqfkp"
Jul 27 17:11:05.582908 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:11:05.582818    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="observability/jaeger-6bbd7d4c9d-pqfkp" podStartSLOduration=1.724647598 podStartE2EDuration="3.582797177s" totalImagesPullingTime="1.858149579s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:11:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:11:05.582146515 +0000 UTC m=+578.778891318" watchObservedRunningTime="2026-07-27 17:11:05.582797177 +0000 UTC m=+578.779541979"
Jul 27 17:11:06.573381 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:11:06.573349    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="observability/jaeger-6bbd7d4c9d-pqfkp"
Jul 27 17:11:42.393382 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:11:42.393355    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:11:42.429367 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:11:42.429336    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/model-serving-api-7b954ffc95-gmv9t"]
Jul 27 17:11:42.435094 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:11:42.435071    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/model-serving-api-7b954ffc95-gmv9t"
Jul 27 17:11:42.437507 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:11:42.437488    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\""
Jul 27 17:11:42.437675 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:11:42.437648    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"model-serving-api-tls\""
Jul 27 17:11:42.437675 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:11:42.437659    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"model-serving-api-dockercfg-kp4hj\""
Jul 27 17:11:42.438505 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:11:42.438490    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\""
Jul 27 17:11:42.444037 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:11:42.444014    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/model-serving-api-7b954ffc95-gmv9t"]
Jul 27 17:11:42.447116 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:11:42.447098    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/odh-model-controller-75d9cdbddf-t5dhh"]
Jul 27 17:11:42.450918 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:11:42.450900    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/odh-model-controller-75d9cdbddf-t5dhh"
Jul 27 17:11:42.453131 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:11:42.453110    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"odh-model-controller-dockercfg-ntpd6\""
Jul 27 17:11:42.453223 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:11:42.453150    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"odh-model-controller-webhook-cert\""
Jul 27 17:11:42.459317 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:11:42.459294    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/odh-model-controller-75d9cdbddf-t5dhh"]
Jul 27 17:11:42.479073 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:11:42.479050    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:11:42.508671 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:11:42.508646    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-clr97\" (UniqueName: \"kubernetes.io/projected/144e70fb-3c86-4179-8116-7538daede502-kube-api-access-clr97\") pod \"odh-model-controller-75d9cdbddf-t5dhh\" (UID: \"144e70fb-3c86-4179-8116-7538daede502\") " pod="kserve/odh-model-controller-75d9cdbddf-t5dhh"
Jul 27 17:11:42.508770 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:11:42.508697    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/144e70fb-3c86-4179-8116-7538daede502-cert\") pod \"odh-model-controller-75d9cdbddf-t5dhh\" (UID: \"144e70fb-3c86-4179-8116-7538daede502\") " pod="kserve/odh-model-controller-75d9cdbddf-t5dhh"
Jul 27 17:11:42.508811 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:11:42.508767    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbdgm\" (UniqueName: \"kubernetes.io/projected/f54bd66b-92cc-4432-b896-e081e7c2da4e-kube-api-access-jbdgm\") pod \"model-serving-api-7b954ffc95-gmv9t\" (UID: \"f54bd66b-92cc-4432-b896-e081e7c2da4e\") " pod="kserve/model-serving-api-7b954ffc95-gmv9t"
Jul 27 17:11:42.508869 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:11:42.508823    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f54bd66b-92cc-4432-b896-e081e7c2da4e-tls-certs\") pod \"model-serving-api-7b954ffc95-gmv9t\" (UID: \"f54bd66b-92cc-4432-b896-e081e7c2da4e\") " pod="kserve/model-serving-api-7b954ffc95-gmv9t"
Jul 27 17:11:42.539065 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:11:42.539042    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:11:42.609154 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:11:42.609122    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbdgm\" (UniqueName: \"kubernetes.io/projected/f54bd66b-92cc-4432-b896-e081e7c2da4e-kube-api-access-jbdgm\") pod \"model-serving-api-7b954ffc95-gmv9t\" (UID: \"f54bd66b-92cc-4432-b896-e081e7c2da4e\") " pod="kserve/model-serving-api-7b954ffc95-gmv9t"
Jul 27 17:11:42.609320 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:11:42.609168    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f54bd66b-92cc-4432-b896-e081e7c2da4e-tls-certs\") pod \"model-serving-api-7b954ffc95-gmv9t\" (UID: \"f54bd66b-92cc-4432-b896-e081e7c2da4e\") " pod="kserve/model-serving-api-7b954ffc95-gmv9t"
Jul 27 17:11:42.609320 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:11:42.609187    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-clr97\" (UniqueName: \"kubernetes.io/projected/144e70fb-3c86-4179-8116-7538daede502-kube-api-access-clr97\") pod \"odh-model-controller-75d9cdbddf-t5dhh\" (UID: \"144e70fb-3c86-4179-8116-7538daede502\") " pod="kserve/odh-model-controller-75d9cdbddf-t5dhh"
Jul 27 17:11:42.609320 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:11:42.609233    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/144e70fb-3c86-4179-8116-7538daede502-cert\") pod \"odh-model-controller-75d9cdbddf-t5dhh\" (UID: \"144e70fb-3c86-4179-8116-7538daede502\") " pod="kserve/odh-model-controller-75d9cdbddf-t5dhh"
Jul 27 17:11:42.611711 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:11:42.611678    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f54bd66b-92cc-4432-b896-e081e7c2da4e-tls-certs\") pod \"model-serving-api-7b954ffc95-gmv9t\" (UID: \"f54bd66b-92cc-4432-b896-e081e7c2da4e\") " pod="kserve/model-serving-api-7b954ffc95-gmv9t"
Jul 27 17:11:42.611809 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:11:42.611678    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/144e70fb-3c86-4179-8116-7538daede502-cert\") pod \"odh-model-controller-75d9cdbddf-t5dhh\" (UID: \"144e70fb-3c86-4179-8116-7538daede502\") " pod="kserve/odh-model-controller-75d9cdbddf-t5dhh"
Jul 27 17:11:42.620150 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:11:42.620122    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbdgm\" (UniqueName: \"kubernetes.io/projected/f54bd66b-92cc-4432-b896-e081e7c2da4e-kube-api-access-jbdgm\") pod \"model-serving-api-7b954ffc95-gmv9t\" (UID: \"f54bd66b-92cc-4432-b896-e081e7c2da4e\") " pod="kserve/model-serving-api-7b954ffc95-gmv9t"
Jul 27 17:11:42.620257 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:11:42.620236    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-clr97\" (UniqueName: \"kubernetes.io/projected/144e70fb-3c86-4179-8116-7538daede502-kube-api-access-clr97\") pod \"odh-model-controller-75d9cdbddf-t5dhh\" (UID: \"144e70fb-3c86-4179-8116-7538daede502\") " pod="kserve/odh-model-controller-75d9cdbddf-t5dhh"
Jul 27 17:11:42.639345 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:11:42.639319    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:11:42.746230 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:11:42.746150    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/model-serving-api-7b954ffc95-gmv9t"
Jul 27 17:11:42.761847 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:11:42.761809    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/odh-model-controller-75d9cdbddf-t5dhh"
Jul 27 17:11:42.881822 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:11:42.881795    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/model-serving-api-7b954ffc95-gmv9t"]
Jul 27 17:11:42.886067 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:11:42.886036    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf54bd66b_92cc_4432_b896_e081e7c2da4e.slice/crio-52740fb496cfa7a3df99471f09d6a861784eab0eb886ed174ad50ad754c63860 WatchSource:0}: Error finding container 52740fb496cfa7a3df99471f09d6a861784eab0eb886ed174ad50ad754c63860: Status 404 returned error can't find the container with id 52740fb496cfa7a3df99471f09d6a861784eab0eb886ed174ad50ad754c63860
Jul 27 17:11:42.911439 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:11:42.911417    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/odh-model-controller-75d9cdbddf-t5dhh"]
Jul 27 17:11:42.913238 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:11:42.913217    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod144e70fb_3c86_4179_8116_7538daede502.slice/crio-3e55906d20e340f16156d8674b6c5b7fa0a219cf6b1da4c40303bc326f8c9ff9 WatchSource:0}: Error finding container 3e55906d20e340f16156d8674b6c5b7fa0a219cf6b1da4c40303bc326f8c9ff9: Status 404 returned error can't find the container with id 3e55906d20e340f16156d8674b6c5b7fa0a219cf6b1da4c40303bc326f8c9ff9
Jul 27 17:11:43.050056 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:11:43.049981    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:11:43.151063 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:11:43.151031    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:11:43.731847 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:11:43.731804    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/model-serving-api-7b954ffc95-gmv9t" event={"ID":"f54bd66b-92cc-4432-b896-e081e7c2da4e","Type":"ContainerStarted","Data":"52740fb496cfa7a3df99471f09d6a861784eab0eb886ed174ad50ad754c63860"}
Jul 27 17:11:43.733067 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:11:43.733035    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/odh-model-controller-75d9cdbddf-t5dhh" event={"ID":"144e70fb-3c86-4179-8116-7538daede502","Type":"ContainerStarted","Data":"3e55906d20e340f16156d8674b6c5b7fa0a219cf6b1da4c40303bc326f8c9ff9"}
Jul 27 17:11:47.760076 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:11:47.760028    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/model-serving-api-7b954ffc95-gmv9t" event={"ID":"f54bd66b-92cc-4432-b896-e081e7c2da4e","Type":"ContainerStarted","Data":"e55b7d7fff688d8760b4342b420f372890d3f6630998a494bd22af5b890b4872"}
Jul 27 17:11:47.760610 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:11:47.760180    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/model-serving-api-7b954ffc95-gmv9t"
Jul 27 17:11:47.762932 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:11:47.762880    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/odh-model-controller-75d9cdbddf-t5dhh" event={"ID":"144e70fb-3c86-4179-8116-7538daede502","Type":"ContainerStarted","Data":"bb5a5af22757561f78973d5e2880c76288a6f0fe99acb8d3307b4519ba1abfd7"}
Jul 27 17:11:47.763065 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:11:47.763001    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/odh-model-controller-75d9cdbddf-t5dhh"
Jul 27 17:11:47.775418 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:11:47.775377    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/model-serving-api-7b954ffc95-gmv9t" podStartSLOduration=1.946730301 podStartE2EDuration="5.77536457s" totalImagesPullingTime="3.828634269s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:11:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:11:47.774518866 +0000 UTC m=+620.971263671" watchObservedRunningTime="2026-07-27 17:11:47.77536457 +0000 UTC m=+620.972109372"
Jul 27 17:11:47.794690 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:11:47.794639    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/odh-model-controller-75d9cdbddf-t5dhh" podStartSLOduration=1.938263115 podStartE2EDuration="5.794620678s" totalImagesPullingTime="3.856357563s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:11:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:11:47.792083253 +0000 UTC m=+620.988828055" watchObservedRunningTime="2026-07-27 17:11:47.794620678 +0000 UTC m=+620.991365481"
Jul 27 17:11:58.769652 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:11:58.769624    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/odh-model-controller-75d9cdbddf-t5dhh"
Jul 27 17:11:58.772093 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:11:58.771484    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/model-serving-api-7b954ffc95-gmv9t"
Jul 27 17:13:20.376525 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:13:20.376450    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:13:23.442534 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:13:23.442500    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:13:36.939583 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:13:36.939549    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:13:40.037131 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:13:40.037101    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:13:40.226010 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:13:40.225976    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:13:53.613667 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:13:53.613616    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:13:53.957405 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:13:53.957336    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-test-flow-control-smoke-4f8df83c/fc-smoke-test-kserve-router-scheduler-5c5b577db-7x96m"]
Jul 27 17:13:53.960787 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:13:53.960768    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-flow-control-smoke-4f8df83c/fc-smoke-test-kserve-router-scheduler-5c5b577db-7x96m"
Jul 27 17:13:53.964244 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:13:53.964217    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-flow-control-smoke-4f8df83c\"/\"fc-smoke-test-kserve-self-signed-certs\""
Jul 27 17:13:53.964366 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:13:53.964254    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-flow-control-smoke-4f8df83c\"/\"kube-root-ca.crt\""
Jul 27 17:13:53.964366 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:13:53.964256    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-flow-control-smoke-4f8df83c\"/\"default-dockercfg-bxkk9\""
Jul 27 17:13:53.964366 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:13:53.964258    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-flow-control-smoke-4f8df83c\"/\"fc-smoke-test-epp-sa-dockercfg-qchpn\""
Jul 27 17:13:53.964533 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:13:53.964217    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-flow-control-smoke-4f8df83c\"/\"openshift-service-ca.crt\""
Jul 27 17:13:53.970471 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:13:53.970450    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-flow-control-smoke-4f8df83c/fc-smoke-test-kserve-router-scheduler-5c5b577db-7x96m"]
Jul 27 17:13:53.977959 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:13:53.977940    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:13:54.111025 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:13:54.110991    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e395d920-473b-420c-a994-87fcb45489b5-tls-certs\") pod \"fc-smoke-test-kserve-router-scheduler-5c5b577db-7x96m\" (UID: \"e395d920-473b-420c-a994-87fcb45489b5\") " pod="e2e-test-flow-control-smoke-4f8df83c/fc-smoke-test-kserve-router-scheduler-5c5b577db-7x96m"
Jul 27 17:13:54.111190 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:13:54.111071    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-df4xx\" (UniqueName: \"kubernetes.io/projected/e395d920-473b-420c-a994-87fcb45489b5-kube-api-access-df4xx\") pod \"fc-smoke-test-kserve-router-scheduler-5c5b577db-7x96m\" (UID: \"e395d920-473b-420c-a994-87fcb45489b5\") " pod="e2e-test-flow-control-smoke-4f8df83c/fc-smoke-test-kserve-router-scheduler-5c5b577db-7x96m"
Jul 27 17:13:54.212264 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:13:54.212176    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-df4xx\" (UniqueName: \"kubernetes.io/projected/e395d920-473b-420c-a994-87fcb45489b5-kube-api-access-df4xx\") pod \"fc-smoke-test-kserve-router-scheduler-5c5b577db-7x96m\" (UID: \"e395d920-473b-420c-a994-87fcb45489b5\") " pod="e2e-test-flow-control-smoke-4f8df83c/fc-smoke-test-kserve-router-scheduler-5c5b577db-7x96m"
Jul 27 17:13:54.212264 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:13:54.212240    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e395d920-473b-420c-a994-87fcb45489b5-tls-certs\") pod \"fc-smoke-test-kserve-router-scheduler-5c5b577db-7x96m\" (UID: \"e395d920-473b-420c-a994-87fcb45489b5\") " pod="e2e-test-flow-control-smoke-4f8df83c/fc-smoke-test-kserve-router-scheduler-5c5b577db-7x96m"
Jul 27 17:13:54.214761 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:13:54.214738    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e395d920-473b-420c-a994-87fcb45489b5-tls-certs\") pod \"fc-smoke-test-kserve-router-scheduler-5c5b577db-7x96m\" (UID: \"e395d920-473b-420c-a994-87fcb45489b5\") " pod="e2e-test-flow-control-smoke-4f8df83c/fc-smoke-test-kserve-router-scheduler-5c5b577db-7x96m"
Jul 27 17:13:54.220354 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:13:54.220332    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-df4xx\" (UniqueName: \"kubernetes.io/projected/e395d920-473b-420c-a994-87fcb45489b5-kube-api-access-df4xx\") pod \"fc-smoke-test-kserve-router-scheduler-5c5b577db-7x96m\" (UID: \"e395d920-473b-420c-a994-87fcb45489b5\") " pod="e2e-test-flow-control-smoke-4f8df83c/fc-smoke-test-kserve-router-scheduler-5c5b577db-7x96m"
Jul 27 17:13:54.271653 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:13:54.271619    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-flow-control-smoke-4f8df83c/fc-smoke-test-kserve-router-scheduler-5c5b577db-7x96m"
Jul 27 17:13:54.405511 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:13:54.405486    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-flow-control-smoke-4f8df83c/fc-smoke-test-kserve-router-scheduler-5c5b577db-7x96m"]
Jul 27 17:13:54.409337 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:13:54.409307    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode395d920_473b_420c_a994_87fcb45489b5.slice/crio-9365105b14ba2c78c3f978fd0ba9381c9d79c743aa4f5705593dcb12e58bac55 WatchSource:0}: Error finding container 9365105b14ba2c78c3f978fd0ba9381c9d79c743aa4f5705593dcb12e58bac55: Status 404 returned error can't find the container with id 9365105b14ba2c78c3f978fd0ba9381c9d79c743aa4f5705593dcb12e58bac55
Jul 27 17:13:54.411596 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:13:54.411576    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 17:13:55.323983 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:13:55.323953    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-flow-control-smoke-4f8df83c/fc-smoke-test-kserve-router-scheduler-5c5b577db-7x96m" event={"ID":"e395d920-473b-420c-a994-87fcb45489b5","Type":"ContainerStarted","Data":"9365105b14ba2c78c3f978fd0ba9381c9d79c743aa4f5705593dcb12e58bac55"}
Jul 27 17:13:58.344020 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:13:58.343986    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-flow-control-smoke-4f8df83c/fc-smoke-test-kserve-router-scheduler-5c5b577db-7x96m" event={"ID":"e395d920-473b-420c-a994-87fcb45489b5","Type":"ContainerStarted","Data":"0e57fe7425fcdc210ee7adec099c7a172adce4525e5c76651d8e1cc3519d4c26"}
Jul 27 17:13:58.344446 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:13:58.344062    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-flow-control-smoke-4f8df83c/fc-smoke-test-kserve-router-scheduler-5c5b577db-7x96m"
Jul 27 17:13:58.362820 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:13:58.362769    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-test-flow-control-smoke-4f8df83c/fc-smoke-test-kserve-router-scheduler-5c5b577db-7x96m" podStartSLOduration=2.458694086 podStartE2EDuration="5.362752454s" totalImagesPullingTime="2.904058368s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:13:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:13:58.361871215 +0000 UTC m=+751.558616017" watchObservedRunningTime="2026-07-27 17:13:58.362752454 +0000 UTC m=+751.559497253"
Jul 27 17:14:10.514714 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:14:10.514678    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:14:15.172259 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:14:15.172222    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:14:18.139286 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:14:18.139246    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:14:29.349644 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:14:29.349614    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-flow-control-smoke-4f8df83c/fc-smoke-test-kserve-router-scheduler-5c5b577db-7x96m"
Jul 27 17:14:36.070755 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:14:36.070718    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:14:36.076105 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:14:36.076074    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-flow-control-smoke-4f8df83c/fc-smoke-test-kserve-router-scheduler-5c5b577db-7x96m"]
Jul 27 17:14:36.167416 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:14:36.167383    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:14:39.350242 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:14:39.350199    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-flow-control-smoke-4f8df83c/fc-smoke-test-kserve-router-scheduler-5c5b577db-7x96m" podUID="e395d920-473b-420c-a994-87fcb45489b5" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Jul 27 17:14:42.612984 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:14:42.612949    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:14:49.349309 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:14:49.349230    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-flow-control-smoke-4f8df83c/fc-smoke-test-kserve-router-scheduler-5c5b577db-7x96m" podUID="e395d920-473b-420c-a994-87fcb45489b5" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Jul 27 17:14:51.095079 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:14:51.095039    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-test-flow-control-smoke-4f8df83c/fc-smoke-test-kserve-router-scheduler-5c5b577db-7x96m" podUID="e395d920-473b-420c-a994-87fcb45489b5" containerName="main" containerID="cri-o://0e57fe7425fcdc210ee7adec099c7a172adce4525e5c76651d8e1cc3519d4c26" gracePeriod=45
Jul 27 17:14:51.334989 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:14:51.334964    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-flow-control-smoke-4f8df83c/fc-smoke-test-kserve-router-scheduler-5c5b577db-7x96m"
Jul 27 17:14:51.417977 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:14:51.417950    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e395d920-473b-420c-a994-87fcb45489b5-tls-certs\") pod \"e395d920-473b-420c-a994-87fcb45489b5\" (UID: \"e395d920-473b-420c-a994-87fcb45489b5\") "
Jul 27 17:14:51.418125 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:14:51.417991    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-df4xx\" (UniqueName: \"kubernetes.io/projected/e395d920-473b-420c-a994-87fcb45489b5-kube-api-access-df4xx\") pod \"e395d920-473b-420c-a994-87fcb45489b5\" (UID: \"e395d920-473b-420c-a994-87fcb45489b5\") "
Jul 27 17:14:51.420081 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:14:51.420053    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e395d920-473b-420c-a994-87fcb45489b5-kube-api-access-df4xx" (OuterVolumeSpecName: "kube-api-access-df4xx") pod "e395d920-473b-420c-a994-87fcb45489b5" (UID: "e395d920-473b-420c-a994-87fcb45489b5"). InnerVolumeSpecName "kube-api-access-df4xx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 17:14:51.420188 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:14:51.420167    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e395d920-473b-420c-a994-87fcb45489b5-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "e395d920-473b-420c-a994-87fcb45489b5" (UID: "e395d920-473b-420c-a994-87fcb45489b5"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 17:14:51.518817 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:14:51.518787    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e395d920-473b-420c-a994-87fcb45489b5-tls-certs\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 27 17:14:51.518817 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:14:51.518813    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-df4xx\" (UniqueName: \"kubernetes.io/projected/e395d920-473b-420c-a994-87fcb45489b5-kube-api-access-df4xx\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 27 17:14:51.583560 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:14:51.583531    2580 generic.go:356] "Generic (PLEG): container finished" podID="e395d920-473b-420c-a994-87fcb45489b5" containerID="0e57fe7425fcdc210ee7adec099c7a172adce4525e5c76651d8e1cc3519d4c26" exitCode=0
Jul 27 17:14:51.583667 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:14:51.583576    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-flow-control-smoke-4f8df83c/fc-smoke-test-kserve-router-scheduler-5c5b577db-7x96m"
Jul 27 17:14:51.583667 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:14:51.583591    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-flow-control-smoke-4f8df83c/fc-smoke-test-kserve-router-scheduler-5c5b577db-7x96m" event={"ID":"e395d920-473b-420c-a994-87fcb45489b5","Type":"ContainerDied","Data":"0e57fe7425fcdc210ee7adec099c7a172adce4525e5c76651d8e1cc3519d4c26"}
Jul 27 17:14:51.583667 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:14:51.583634    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-flow-control-smoke-4f8df83c/fc-smoke-test-kserve-router-scheduler-5c5b577db-7x96m" event={"ID":"e395d920-473b-420c-a994-87fcb45489b5","Type":"ContainerDied","Data":"9365105b14ba2c78c3f978fd0ba9381c9d79c743aa4f5705593dcb12e58bac55"}
Jul 27 17:14:51.583667 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:14:51.583655    2580 scope.go:117] "RemoveContainer" containerID="0e57fe7425fcdc210ee7adec099c7a172adce4525e5c76651d8e1cc3519d4c26"
Jul 27 17:14:51.592627 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:14:51.592601    2580 scope.go:117] "RemoveContainer" containerID="0e57fe7425fcdc210ee7adec099c7a172adce4525e5c76651d8e1cc3519d4c26"
Jul 27 17:14:51.592882 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:14:51.592862    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0e57fe7425fcdc210ee7adec099c7a172adce4525e5c76651d8e1cc3519d4c26\": container with ID starting with 0e57fe7425fcdc210ee7adec099c7a172adce4525e5c76651d8e1cc3519d4c26 not found: ID does not exist" containerID="0e57fe7425fcdc210ee7adec099c7a172adce4525e5c76651d8e1cc3519d4c26"
Jul 27 17:14:51.592966 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:14:51.592889    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e57fe7425fcdc210ee7adec099c7a172adce4525e5c76651d8e1cc3519d4c26"} err="failed to get container status \"0e57fe7425fcdc210ee7adec099c7a172adce4525e5c76651d8e1cc3519d4c26\": rpc error: code = NotFound desc = could not find container \"0e57fe7425fcdc210ee7adec099c7a172adce4525e5c76651d8e1cc3519d4c26\": container with ID starting with 0e57fe7425fcdc210ee7adec099c7a172adce4525e5c76651d8e1cc3519d4c26 not found: ID does not exist"
Jul 27 17:14:51.604533 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:14:51.604514    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-flow-control-smoke-4f8df83c/fc-smoke-test-kserve-router-scheduler-5c5b577db-7x96m"]
Jul 27 17:14:51.607691 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:14:51.607672    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-test-flow-control-smoke-4f8df83c/fc-smoke-test-kserve-router-scheduler-5c5b577db-7x96m"]
Jul 27 17:14:52.631026 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:14:52.630993    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:14:52.731309 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:14:52.731276    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:14:53.270593 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:14:53.270559    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e395d920-473b-420c-a994-87fcb45489b5" path="/var/lib/kubelet/pods/e395d920-473b-420c-a994-87fcb45489b5/volumes"
Jul 27 17:14:56.103082 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:14:56.103045    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:14:57.807083 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:14:57.807047    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:15:02.111434 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:15:02.111404    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:15:07.601380 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:15:07.601349    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:15:07.702401 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:15:07.702366    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:15:29.670880 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:15:29.670825    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:15:33.387671 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:15:33.387630    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-b5d44467c-z9djg"]
Jul 27 17:15:33.388139 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:15:33.387976    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e395d920-473b-420c-a994-87fcb45489b5" containerName="main"
Jul 27 17:15:33.388139 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:15:33.387988    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="e395d920-473b-420c-a994-87fcb45489b5" containerName="main"
Jul 27 17:15:33.388139 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:15:33.388052    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="e395d920-473b-420c-a994-87fcb45489b5" containerName="main"
Jul 27 17:15:33.390775 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:15:33.390754    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-b5d44467c-z9djg"
Jul 27 17:15:33.394398 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:15:33.394373    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-flow-control-smoke-1e98f46d\"/\"openshift-service-ca.crt\""
Jul 27 17:15:33.394507 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:15:33.394376    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-flow-control-smoke-1e98f46d\"/\"kube-root-ca.crt\""
Jul 27 17:15:33.394507 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:15:33.394424    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-flow-control-smoke-1e98f46d\"/\"fc-concurrency-test-kserve-self-signed-certs\""
Jul 27 17:15:33.394507 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:15:33.394376    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-flow-control-smoke-1e98f46d\"/\"default-dockercfg-55wpx\""
Jul 27 17:15:33.401290 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:15:33.401265    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-b5d44467c-z9djg"]
Jul 27 17:15:33.422364 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:15:33.422324    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:15:33.490324 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:15:33.490289    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b23099d2-b17e-48c3-a96c-3432060f9bc6-home\") pod \"fc-concurrency-test-kserve-b5d44467c-z9djg\" (UID: \"b23099d2-b17e-48c3-a96c-3432060f9bc6\") " pod="e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-b5d44467c-z9djg"
Jul 27 17:15:33.490473 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:15:33.490336    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vklht\" (UniqueName: \"kubernetes.io/projected/b23099d2-b17e-48c3-a96c-3432060f9bc6-kube-api-access-vklht\") pod \"fc-concurrency-test-kserve-b5d44467c-z9djg\" (UID: \"b23099d2-b17e-48c3-a96c-3432060f9bc6\") " pod="e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-b5d44467c-z9djg"
Jul 27 17:15:33.490473 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:15:33.490387    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b23099d2-b17e-48c3-a96c-3432060f9bc6-tls-certs\") pod \"fc-concurrency-test-kserve-b5d44467c-z9djg\" (UID: \"b23099d2-b17e-48c3-a96c-3432060f9bc6\") " pod="e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-b5d44467c-z9djg"
Jul 27 17:15:33.490544 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:15:33.490483    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b23099d2-b17e-48c3-a96c-3432060f9bc6-tmp-dir\") pod \"fc-concurrency-test-kserve-b5d44467c-z9djg\" (UID: \"b23099d2-b17e-48c3-a96c-3432060f9bc6\") " pod="e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-b5d44467c-z9djg"
Jul 27 17:15:33.490544 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:15:33.490517    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b23099d2-b17e-48c3-a96c-3432060f9bc6-dshm\") pod \"fc-concurrency-test-kserve-b5d44467c-z9djg\" (UID: \"b23099d2-b17e-48c3-a96c-3432060f9bc6\") " pod="e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-b5d44467c-z9djg"
Jul 27 17:15:33.490611 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:15:33.490561    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b23099d2-b17e-48c3-a96c-3432060f9bc6-model-cache\") pod \"fc-concurrency-test-kserve-b5d44467c-z9djg\" (UID: \"b23099d2-b17e-48c3-a96c-3432060f9bc6\") " pod="e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-b5d44467c-z9djg"
Jul 27 17:15:33.591167 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:15:33.591132    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b23099d2-b17e-48c3-a96c-3432060f9bc6-dshm\") pod \"fc-concurrency-test-kserve-b5d44467c-z9djg\" (UID: \"b23099d2-b17e-48c3-a96c-3432060f9bc6\") " pod="e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-b5d44467c-z9djg"
Jul 27 17:15:33.591332 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:15:33.591192    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b23099d2-b17e-48c3-a96c-3432060f9bc6-model-cache\") pod \"fc-concurrency-test-kserve-b5d44467c-z9djg\" (UID: \"b23099d2-b17e-48c3-a96c-3432060f9bc6\") " pod="e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-b5d44467c-z9djg"
Jul 27 17:15:33.591332 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:15:33.591313    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b23099d2-b17e-48c3-a96c-3432060f9bc6-home\") pod \"fc-concurrency-test-kserve-b5d44467c-z9djg\" (UID: \"b23099d2-b17e-48c3-a96c-3432060f9bc6\") " pod="e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-b5d44467c-z9djg"
Jul 27 17:15:33.591735 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:15:33.591382    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vklht\" (UniqueName: \"kubernetes.io/projected/b23099d2-b17e-48c3-a96c-3432060f9bc6-kube-api-access-vklht\") pod \"fc-concurrency-test-kserve-b5d44467c-z9djg\" (UID: \"b23099d2-b17e-48c3-a96c-3432060f9bc6\") " pod="e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-b5d44467c-z9djg"
Jul 27 17:15:33.591735 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:15:33.591424    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b23099d2-b17e-48c3-a96c-3432060f9bc6-tls-certs\") pod \"fc-concurrency-test-kserve-b5d44467c-z9djg\" (UID: \"b23099d2-b17e-48c3-a96c-3432060f9bc6\") " pod="e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-b5d44467c-z9djg"
Jul 27 17:15:33.591735 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:15:33.591503    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b23099d2-b17e-48c3-a96c-3432060f9bc6-tmp-dir\") pod \"fc-concurrency-test-kserve-b5d44467c-z9djg\" (UID: \"b23099d2-b17e-48c3-a96c-3432060f9bc6\") " pod="e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-b5d44467c-z9djg"
Jul 27 17:15:33.591735 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:15:33.591541    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b23099d2-b17e-48c3-a96c-3432060f9bc6-model-cache\") pod \"fc-concurrency-test-kserve-b5d44467c-z9djg\" (UID: \"b23099d2-b17e-48c3-a96c-3432060f9bc6\") " pod="e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-b5d44467c-z9djg"
Jul 27 17:15:33.591735 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:15:33.591649    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b23099d2-b17e-48c3-a96c-3432060f9bc6-home\") pod \"fc-concurrency-test-kserve-b5d44467c-z9djg\" (UID: \"b23099d2-b17e-48c3-a96c-3432060f9bc6\") " pod="e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-b5d44467c-z9djg"
Jul 27 17:15:33.591983 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:15:33.591875    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b23099d2-b17e-48c3-a96c-3432060f9bc6-tmp-dir\") pod \"fc-concurrency-test-kserve-b5d44467c-z9djg\" (UID: \"b23099d2-b17e-48c3-a96c-3432060f9bc6\") " pod="e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-b5d44467c-z9djg"
Jul 27 17:15:33.593480 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:15:33.593457    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b23099d2-b17e-48c3-a96c-3432060f9bc6-dshm\") pod \"fc-concurrency-test-kserve-b5d44467c-z9djg\" (UID: \"b23099d2-b17e-48c3-a96c-3432060f9bc6\") " pod="e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-b5d44467c-z9djg"
Jul 27 17:15:33.593805 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:15:33.593785    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b23099d2-b17e-48c3-a96c-3432060f9bc6-tls-certs\") pod \"fc-concurrency-test-kserve-b5d44467c-z9djg\" (UID: \"b23099d2-b17e-48c3-a96c-3432060f9bc6\") " pod="e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-b5d44467c-z9djg"
Jul 27 17:15:33.600023 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:15:33.599997    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-router-scheduler-b455bf55c-88qkz"]
Jul 27 17:15:33.602699 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:15:33.602679    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-router-scheduler-b455bf55c-88qkz"
Jul 27 17:15:33.603444 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:15:33.603423    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vklht\" (UniqueName: \"kubernetes.io/projected/b23099d2-b17e-48c3-a96c-3432060f9bc6-kube-api-access-vklht\") pod \"fc-concurrency-test-kserve-b5d44467c-z9djg\" (UID: \"b23099d2-b17e-48c3-a96c-3432060f9bc6\") " pod="e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-b5d44467c-z9djg"
Jul 27 17:15:33.605235 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:15:33.605217    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-flow-control-smoke-1e98f46d\"/\"fc-concurrency-test-epp-sa-dockercfg-x6r42\""
Jul 27 17:15:33.613078 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:15:33.613048    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-router-scheduler-b455bf55c-88qkz"]
Jul 27 17:15:33.622655 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:15:33.622633    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:15:33.692902 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:15:33.692804    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f91b3f03-38ef-4d79-8b22-43e6b3475f82-tls-certs\") pod \"fc-concurrency-test-kserve-router-scheduler-b455bf55c-88qkz\" (UID: \"f91b3f03-38ef-4d79-8b22-43e6b3475f82\") " pod="e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-router-scheduler-b455bf55c-88qkz"
Jul 27 17:15:33.693070 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:15:33.692899    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qz2hm\" (UniqueName: \"kubernetes.io/projected/f91b3f03-38ef-4d79-8b22-43e6b3475f82-kube-api-access-qz2hm\") pod \"fc-concurrency-test-kserve-router-scheduler-b455bf55c-88qkz\" (UID: \"f91b3f03-38ef-4d79-8b22-43e6b3475f82\") " pod="e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-router-scheduler-b455bf55c-88qkz"
Jul 27 17:15:33.700892 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:15:33.700874    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-b5d44467c-z9djg"
Jul 27 17:15:33.794397 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:15:33.794361    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f91b3f03-38ef-4d79-8b22-43e6b3475f82-tls-certs\") pod \"fc-concurrency-test-kserve-router-scheduler-b455bf55c-88qkz\" (UID: \"f91b3f03-38ef-4d79-8b22-43e6b3475f82\") " pod="e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-router-scheduler-b455bf55c-88qkz"
Jul 27 17:15:33.794565 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:15:33.794414    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qz2hm\" (UniqueName: \"kubernetes.io/projected/f91b3f03-38ef-4d79-8b22-43e6b3475f82-kube-api-access-qz2hm\") pod \"fc-concurrency-test-kserve-router-scheduler-b455bf55c-88qkz\" (UID: \"f91b3f03-38ef-4d79-8b22-43e6b3475f82\") " pod="e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-router-scheduler-b455bf55c-88qkz"
Jul 27 17:15:33.797274 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:15:33.797245    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f91b3f03-38ef-4d79-8b22-43e6b3475f82-tls-certs\") pod \"fc-concurrency-test-kserve-router-scheduler-b455bf55c-88qkz\" (UID: \"f91b3f03-38ef-4d79-8b22-43e6b3475f82\") " pod="e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-router-scheduler-b455bf55c-88qkz"
Jul 27 17:15:33.803713 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:15:33.803683    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qz2hm\" (UniqueName: \"kubernetes.io/projected/f91b3f03-38ef-4d79-8b22-43e6b3475f82-kube-api-access-qz2hm\") pod \"fc-concurrency-test-kserve-router-scheduler-b455bf55c-88qkz\" (UID: \"f91b3f03-38ef-4d79-8b22-43e6b3475f82\") " pod="e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-router-scheduler-b455bf55c-88qkz"
Jul 27 17:15:33.836245 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:15:33.836214    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-b5d44467c-z9djg"]
Jul 27 17:15:33.839374 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:15:33.839346    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb23099d2_b17e_48c3_a96c_3432060f9bc6.slice/crio-e2557095bde4e088e6e894f4a7dc48d4c60855ca255efa40cc37c00dcc934b60 WatchSource:0}: Error finding container e2557095bde4e088e6e894f4a7dc48d4c60855ca255efa40cc37c00dcc934b60: Status 404 returned error can't find the container with id e2557095bde4e088e6e894f4a7dc48d4c60855ca255efa40cc37c00dcc934b60
Jul 27 17:15:33.925618 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:15:33.925587    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-router-scheduler-b455bf55c-88qkz"
Jul 27 17:15:34.053685 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:15:34.053657    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-router-scheduler-b455bf55c-88qkz"]
Jul 27 17:15:34.056092 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:15:34.056064    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf91b3f03_38ef_4d79_8b22_43e6b3475f82.slice/crio-ad2884646f30f1a20e8656e69ad4eb93d75591be08692a679d49b08461c6fdd6 WatchSource:0}: Error finding container ad2884646f30f1a20e8656e69ad4eb93d75591be08692a679d49b08461c6fdd6: Status 404 returned error can't find the container with id ad2884646f30f1a20e8656e69ad4eb93d75591be08692a679d49b08461c6fdd6
Jul 27 17:15:34.785440 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:15:34.785396    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-b5d44467c-z9djg" event={"ID":"b23099d2-b17e-48c3-a96c-3432060f9bc6","Type":"ContainerStarted","Data":"e2557095bde4e088e6e894f4a7dc48d4c60855ca255efa40cc37c00dcc934b60"}
Jul 27 17:15:34.786926 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:15:34.786904    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-router-scheduler-b455bf55c-88qkz" event={"ID":"f91b3f03-38ef-4d79-8b22-43e6b3475f82","Type":"ContainerStarted","Data":"e607c6799b3c4cbfad955028ccebebc4f017be0e47bdde6f23b182549bc1db1d"}
Jul 27 17:15:34.787033 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:15:34.786949    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-router-scheduler-b455bf55c-88qkz" event={"ID":"f91b3f03-38ef-4d79-8b22-43e6b3475f82","Type":"ContainerStarted","Data":"ad2884646f30f1a20e8656e69ad4eb93d75591be08692a679d49b08461c6fdd6"}
Jul 27 17:15:34.787033 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:15:34.787019    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-router-scheduler-b455bf55c-88qkz"
Jul 27 17:15:34.803845 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:15:34.803794    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-router-scheduler-b455bf55c-88qkz" podStartSLOduration=1.803778533 podStartE2EDuration="1.803778533s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:15:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:15:34.802167073 +0000 UTC m=+847.998911886" watchObservedRunningTime="2026-07-27 17:15:34.803778533 +0000 UTC m=+848.000523335"
Jul 27 17:15:37.805018 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:15:37.804927    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-b5d44467c-z9djg" event={"ID":"b23099d2-b17e-48c3-a96c-3432060f9bc6","Type":"ContainerStarted","Data":"dc33a6556a8aac1406a319536a12af8f9609a63af89b42b75bf150447426db51"}
Jul 27 17:15:37.835447 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:15:37.835392    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-b5d44467c-z9djg" podStartSLOduration=1.310215641 podStartE2EDuration="4.835375713s" totalImagesPullingTime="3.525160072s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:15:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:15:37.833917513 +0000 UTC m=+851.030662326" watchObservedRunningTime="2026-07-27 17:15:37.835375713 +0000 UTC m=+851.032120515"
Jul 27 17:15:38.701421 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:15:38.701375    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-b5d44467c-z9djg"
Jul 27 17:15:41.951105 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:15:41.951075    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:15:42.038407 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:15:42.038372    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:15:42.836824 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:15:42.836793    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:15:42.937271 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:15:42.937242    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:15:43.701746 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:15:43.701707    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-b5d44467c-z9djg"
Jul 27 17:15:43.714235 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:15:43.714211    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-b5d44467c-z9djg"
Jul 27 17:15:43.842237 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:15:43.842210    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-b5d44467c-z9djg"
Jul 27 17:15:45.714672 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:15:45.714642    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:15:52.329734 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:15:52.329695    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:16:05.796705 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:16:05.796675    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-router-scheduler-b455bf55c-88qkz"
Jul 27 17:16:12.386062 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:16:12.386027    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:16:15.315102 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:16:15.315067    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:16:15.418813 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:16:15.418785    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:16:15.518532 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:16:15.518497    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:16:15.622140 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:16:15.622110    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:16:16.173615 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:16:16.173586    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:16:18.640055 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:16:18.640015    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:16:20.441115 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:16:20.441084    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:16:25.445276 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:16:25.445247    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:16:25.545676 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:16:25.545640    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:16:27.133199 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:16:27.133117    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:16:32.154699 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:16:32.154637    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:16:33.038550 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:16:33.038516    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:16:39.430020 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:16:39.429987    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:16:39.582591 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:16:39.582562    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:16:39.706685 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:16:39.706610    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:16:39.842913 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:16:39.842876    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-test-llm-inference-service-63a03ef4/llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-sche6h6wj"]
Jul 27 17:16:39.846432 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:16:39.846408    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-63a03ef4/llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-sche6h6wj"
Jul 27 17:16:39.850147 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:16:39.850127    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-63a03ef4\"/\"kube-root-ca.crt\""
Jul 27 17:16:39.850275 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:16:39.850171    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-63a03ef4\"/\"openshift-service-ca.crt\""
Jul 27 17:16:39.850275 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:16:39.850218    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-63a03ef4\"/\"llmisv32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-self-signed-certs\""
Jul 27 17:16:39.850275 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:16:39.850218    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-63a03ef4\"/\"llmisvc-model-fb-opt-125m-route-dc21cb14-epp-sa-dockercfg-79rnj\""
Jul 27 17:16:39.850432 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:16:39.850290    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-63a03ef4\"/\"default-dockercfg-tzkd5\""
Jul 27 17:16:39.854471 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:16:39.854447    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-63a03ef4/llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-sche6h6wj"]
Jul 27 17:16:39.870107 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:16:39.870084    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:16:39.978495 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:16:39.978409    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ffs2f\" (UniqueName: \"kubernetes.io/projected/dbfd40bf-b63c-4e27-aa9f-3e6f2a9b142b-kube-api-access-ffs2f\") pod \"llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-sche6h6wj\" (UID: \"dbfd40bf-b63c-4e27-aa9f-3e6f2a9b142b\") " pod="e2e-test-llm-inference-service-63a03ef4/llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-sche6h6wj"
Jul 27 17:16:39.978636 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:16:39.978493    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dbfd40bf-b63c-4e27-aa9f-3e6f2a9b142b-tls-certs\") pod \"llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-sche6h6wj\" (UID: \"dbfd40bf-b63c-4e27-aa9f-3e6f2a9b142b\") " pod="e2e-test-llm-inference-service-63a03ef4/llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-sche6h6wj"
Jul 27 17:16:40.079429 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:16:40.079397    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dbfd40bf-b63c-4e27-aa9f-3e6f2a9b142b-tls-certs\") pod \"llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-sche6h6wj\" (UID: \"dbfd40bf-b63c-4e27-aa9f-3e6f2a9b142b\") " pod="e2e-test-llm-inference-service-63a03ef4/llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-sche6h6wj"
Jul 27 17:16:40.079583 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:16:40.079441    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ffs2f\" (UniqueName: \"kubernetes.io/projected/dbfd40bf-b63c-4e27-aa9f-3e6f2a9b142b-kube-api-access-ffs2f\") pod \"llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-sche6h6wj\" (UID: \"dbfd40bf-b63c-4e27-aa9f-3e6f2a9b142b\") " pod="e2e-test-llm-inference-service-63a03ef4/llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-sche6h6wj"
Jul 27 17:16:40.081888 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:16:40.081869    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dbfd40bf-b63c-4e27-aa9f-3e6f2a9b142b-tls-certs\") pod \"llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-sche6h6wj\" (UID: \"dbfd40bf-b63c-4e27-aa9f-3e6f2a9b142b\") " pod="e2e-test-llm-inference-service-63a03ef4/llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-sche6h6wj"
Jul 27 17:16:40.087637 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:16:40.087610    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ffs2f\" (UniqueName: \"kubernetes.io/projected/dbfd40bf-b63c-4e27-aa9f-3e6f2a9b142b-kube-api-access-ffs2f\") pod \"llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-sche6h6wj\" (UID: \"dbfd40bf-b63c-4e27-aa9f-3e6f2a9b142b\") " pod="e2e-test-llm-inference-service-63a03ef4/llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-sche6h6wj"
Jul 27 17:16:40.158755 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:16:40.158732    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-63a03ef4/llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-sche6h6wj"
Jul 27 17:16:40.289781 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:16:40.289757    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-63a03ef4/llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-sche6h6wj"]
Jul 27 17:16:40.292171 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:16:40.292145    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbfd40bf_b63c_4e27_aa9f_3e6f2a9b142b.slice/crio-d18b3fdbca6c77875bf1153b8c0a107e6c2be56e9fb45d7b15941c3ec66fb138 WatchSource:0}: Error finding container d18b3fdbca6c77875bf1153b8c0a107e6c2be56e9fb45d7b15941c3ec66fb138: Status 404 returned error can't find the container with id d18b3fdbca6c77875bf1153b8c0a107e6c2be56e9fb45d7b15941c3ec66fb138
Jul 27 17:16:41.091907 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:16:41.091873    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-63a03ef4/llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-sche6h6wj" event={"ID":"dbfd40bf-b63c-4e27-aa9f-3e6f2a9b142b","Type":"ContainerStarted","Data":"338f6f13947004cff6531a408c79f1314c0f5ea8ea94856b60657f05c379b345"}
Jul 27 17:16:41.092421 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:16:41.091956    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-63a03ef4/llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-sche6h6wj" event={"ID":"dbfd40bf-b63c-4e27-aa9f-3e6f2a9b142b","Type":"ContainerStarted","Data":"d18b3fdbca6c77875bf1153b8c0a107e6c2be56e9fb45d7b15941c3ec66fb138"}
Jul 27 17:16:41.092421 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:16:41.092012    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-63a03ef4/llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-sche6h6wj"
Jul 27 17:16:41.108344 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:16:41.108302    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-test-llm-inference-service-63a03ef4/llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-sche6h6wj" podStartSLOduration=2.108287342 podStartE2EDuration="2.108287342s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:16:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:16:41.107454508 +0000 UTC m=+914.304199309" watchObservedRunningTime="2026-07-27 17:16:41.108287342 +0000 UTC m=+914.305032143"
Jul 27 17:16:56.250765 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:16:56.250725    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:16:56.318622 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:16:56.318590    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:17:03.088999 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:17:03.088969    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:17:06.858643 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:17:06.858599    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:17:07.289159 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:17:07.289079    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:17:11.509260 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:17:11.509226    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:17:12.098416 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:17:12.098384    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-inference-service-63a03ef4/llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-sche6h6wj"
Jul 27 17:17:12.445646 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:17:12.445612    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:17:15.816071 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:17:15.816033    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:17:18.459695 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:17:18.459634    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:17:18.560128 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:17:18.560082    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:17:19.174470 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:17:19.174437    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:17:19.275163 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:17:19.275134    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:17:24.121588 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:17:24.121555    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:17:24.740986 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:17:24.740950    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:17:29.726037 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:17:29.726006    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:17:30.148222 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:17:30.148186    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-test-llm-auth-enabled-requires-token-d4ed2c08/auth-enabled-test-kserve-router-scheduler-6664595b9b-qzq2f"]
Jul 27 17:17:30.151559 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:17:30.151538    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-auth-enabled-requires-token-d4ed2c08/auth-enabled-test-kserve-router-scheduler-6664595b9b-qzq2f"
Jul 27 17:17:30.157969 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:17:30.157948    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-auth-enabled-requires-token-d4ed2c08\"/\"openshift-service-ca.crt\""
Jul 27 17:17:30.158941 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:17:30.158923    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-auth-enabled-requires-token-d4ed2c08\"/\"auth-enabled-test-kserve-self-signed-certs\""
Jul 27 17:17:30.159069 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:17:30.159039    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-auth-enabled-requires-token-d4ed2c08\"/\"kube-root-ca.crt\""
Jul 27 17:17:30.159137 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:17:30.159113    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-auth-enabled-requires-token-d4ed2c08\"/\"auth-enabled-test-epp-sa-dockercfg-vxhxg\""
Jul 27 17:17:30.159228 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:17:30.159202    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-auth-enabled-requires-token-d4ed2c08\"/\"default-dockercfg-d7h8x\""
Jul 27 17:17:30.165029 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:17:30.165006    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-auth-enabled-requires-token-d4ed2c08/auth-enabled-test-kserve-router-scheduler-6664595b9b-qzq2f"]
Jul 27 17:17:30.217915 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:17:30.217882    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0183d53-a665-486c-8b60-0ad7f03398e0-tls-certs\") pod \"auth-enabled-test-kserve-router-scheduler-6664595b9b-qzq2f\" (UID: \"f0183d53-a665-486c-8b60-0ad7f03398e0\") " pod="e2e-test-llm-auth-enabled-requires-token-d4ed2c08/auth-enabled-test-kserve-router-scheduler-6664595b9b-qzq2f"
Jul 27 17:17:30.218087 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:17:30.217922    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8nvx\" (UniqueName: \"kubernetes.io/projected/f0183d53-a665-486c-8b60-0ad7f03398e0-kube-api-access-k8nvx\") pod \"auth-enabled-test-kserve-router-scheduler-6664595b9b-qzq2f\" (UID: \"f0183d53-a665-486c-8b60-0ad7f03398e0\") " pod="e2e-test-llm-auth-enabled-requires-token-d4ed2c08/auth-enabled-test-kserve-router-scheduler-6664595b9b-qzq2f"
Jul 27 17:17:30.319227 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:17:30.319193    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0183d53-a665-486c-8b60-0ad7f03398e0-tls-certs\") pod \"auth-enabled-test-kserve-router-scheduler-6664595b9b-qzq2f\" (UID: \"f0183d53-a665-486c-8b60-0ad7f03398e0\") " pod="e2e-test-llm-auth-enabled-requires-token-d4ed2c08/auth-enabled-test-kserve-router-scheduler-6664595b9b-qzq2f"
Jul 27 17:17:30.319227 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:17:30.319229    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8nvx\" (UniqueName: \"kubernetes.io/projected/f0183d53-a665-486c-8b60-0ad7f03398e0-kube-api-access-k8nvx\") pod \"auth-enabled-test-kserve-router-scheduler-6664595b9b-qzq2f\" (UID: \"f0183d53-a665-486c-8b60-0ad7f03398e0\") " pod="e2e-test-llm-auth-enabled-requires-token-d4ed2c08/auth-enabled-test-kserve-router-scheduler-6664595b9b-qzq2f"
Jul 27 17:17:30.321732 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:17:30.321705    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0183d53-a665-486c-8b60-0ad7f03398e0-tls-certs\") pod \"auth-enabled-test-kserve-router-scheduler-6664595b9b-qzq2f\" (UID: \"f0183d53-a665-486c-8b60-0ad7f03398e0\") " pod="e2e-test-llm-auth-enabled-requires-token-d4ed2c08/auth-enabled-test-kserve-router-scheduler-6664595b9b-qzq2f"
Jul 27 17:17:30.327678 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:17:30.327651    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8nvx\" (UniqueName: \"kubernetes.io/projected/f0183d53-a665-486c-8b60-0ad7f03398e0-kube-api-access-k8nvx\") pod \"auth-enabled-test-kserve-router-scheduler-6664595b9b-qzq2f\" (UID: \"f0183d53-a665-486c-8b60-0ad7f03398e0\") " pod="e2e-test-llm-auth-enabled-requires-token-d4ed2c08/auth-enabled-test-kserve-router-scheduler-6664595b9b-qzq2f"
Jul 27 17:17:30.380066 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:17:30.380032    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:17:30.462350 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:17:30.462256    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-auth-enabled-requires-token-d4ed2c08/auth-enabled-test-kserve-router-scheduler-6664595b9b-qzq2f"
Jul 27 17:17:30.600190 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:17:30.600166    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-auth-enabled-requires-token-d4ed2c08/auth-enabled-test-kserve-router-scheduler-6664595b9b-qzq2f"]
Jul 27 17:17:30.602479 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:17:30.602451    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0183d53_a665_486c_8b60_0ad7f03398e0.slice/crio-a8cce94952b9621fa381f09bcb58963d45cce2a872565688d41d1d8db077e943 WatchSource:0}: Error finding container a8cce94952b9621fa381f09bcb58963d45cce2a872565688d41d1d8db077e943: Status 404 returned error can't find the container with id a8cce94952b9621fa381f09bcb58963d45cce2a872565688d41d1d8db077e943
Jul 27 17:17:30.840328 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:17:30.840244    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:17:31.318652 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:17:31.318611    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-auth-enabled-requires-token-d4ed2c08/auth-enabled-test-kserve-router-scheduler-6664595b9b-qzq2f" event={"ID":"f0183d53-a665-486c-8b60-0ad7f03398e0","Type":"ContainerStarted","Data":"d670c86f8f4baf8af93a5515d0ccef9567c3cdf5c2e2c0ec8cae20b7364e4724"}
Jul 27 17:17:31.318873 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:17:31.318665    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-auth-enabled-requires-token-d4ed2c08/auth-enabled-test-kserve-router-scheduler-6664595b9b-qzq2f" event={"ID":"f0183d53-a665-486c-8b60-0ad7f03398e0","Type":"ContainerStarted","Data":"a8cce94952b9621fa381f09bcb58963d45cce2a872565688d41d1d8db077e943"}
Jul 27 17:17:31.318873 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:17:31.318741    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-auth-enabled-requires-token-d4ed2c08/auth-enabled-test-kserve-router-scheduler-6664595b9b-qzq2f"
Jul 27 17:17:31.336238 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:17:31.336188    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-test-llm-auth-enabled-requires-token-d4ed2c08/auth-enabled-test-kserve-router-scheduler-6664595b9b-qzq2f" podStartSLOduration=1.336170875 podStartE2EDuration="1.336170875s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:17:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:17:31.335498335 +0000 UTC m=+964.532243139" watchObservedRunningTime="2026-07-27 17:17:31.336170875 +0000 UTC m=+964.532915679"
Jul 27 17:18:02.325948 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:18:02.325917    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-auth-enabled-requires-token-d4ed2c08/auth-enabled-test-kserve-router-scheduler-6664595b9b-qzq2f"
Jul 27 17:18:12.717941 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:18:12.717905    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:18:29.674397 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:18:29.674362    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:18:33.446622 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:18:33.446586    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:18:33.546685 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:18:33.546650    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:19:54.934533 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:19:54.934494    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-auth-enabled-requires-token-d4ed2c08/auth-enabled-test-kserve-router-scheduler-6664595b9b-qzq2f"]
Jul 27 17:19:54.943771 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:19:54.943745    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:19:55.011674 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:19:55.011639    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:19:57.180383 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:19:57.180347    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:20:01.828687 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:20:01.827250    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-63a03ef4/llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-sche6h6wj"]
Jul 27 17:20:01.830539 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:20:01.830498    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:20:01.912965 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:20:01.912925    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:20:02.098593 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:20:02.098513    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-63a03ef4/llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-sche6h6wj" podUID="dbfd40bf-b63c-4e27-aa9f-3e6f2a9b142b" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Jul 27 17:20:02.325883 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:20:02.325815    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-auth-enabled-requires-token-d4ed2c08/auth-enabled-test-kserve-router-scheduler-6664595b9b-qzq2f" podUID="f0183d53-a665-486c-8b60-0ad7f03398e0" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Jul 27 17:20:09.955066 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:20:09.955003    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-test-llm-auth-enabled-requires-token-d4ed2c08/auth-enabled-test-kserve-router-scheduler-6664595b9b-qzq2f" podUID="f0183d53-a665-486c-8b60-0ad7f03398e0" containerName="main" containerID="cri-o://d670c86f8f4baf8af93a5515d0ccef9567c3cdf5c2e2c0ec8cae20b7364e4724" gracePeriod=45
Jul 27 17:20:10.073400 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:20:10.073361    2580 generic.go:356] "Generic (PLEG): container finished" podID="f0183d53-a665-486c-8b60-0ad7f03398e0" containerID="d670c86f8f4baf8af93a5515d0ccef9567c3cdf5c2e2c0ec8cae20b7364e4724" exitCode=0
Jul 27 17:20:10.073510 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:20:10.073430    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-auth-enabled-requires-token-d4ed2c08/auth-enabled-test-kserve-router-scheduler-6664595b9b-qzq2f" event={"ID":"f0183d53-a665-486c-8b60-0ad7f03398e0","Type":"ContainerDied","Data":"d670c86f8f4baf8af93a5515d0ccef9567c3cdf5c2e2c0ec8cae20b7364e4724"}
Jul 27 17:20:10.216580 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:20:10.216528    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-auth-enabled-requires-token-d4ed2c08/auth-enabled-test-kserve-router-scheduler-6664595b9b-qzq2f"
Jul 27 17:20:10.367974 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:20:10.367942    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k8nvx\" (UniqueName: \"kubernetes.io/projected/f0183d53-a665-486c-8b60-0ad7f03398e0-kube-api-access-k8nvx\") pod \"f0183d53-a665-486c-8b60-0ad7f03398e0\" (UID: \"f0183d53-a665-486c-8b60-0ad7f03398e0\") "
Jul 27 17:20:10.368159 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:20:10.368007    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0183d53-a665-486c-8b60-0ad7f03398e0-tls-certs\") pod \"f0183d53-a665-486c-8b60-0ad7f03398e0\" (UID: \"f0183d53-a665-486c-8b60-0ad7f03398e0\") "
Jul 27 17:20:10.370176 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:20:10.370148    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0183d53-a665-486c-8b60-0ad7f03398e0-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f0183d53-a665-486c-8b60-0ad7f03398e0" (UID: "f0183d53-a665-486c-8b60-0ad7f03398e0"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 17:20:10.370313 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:20:10.370186    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0183d53-a665-486c-8b60-0ad7f03398e0-kube-api-access-k8nvx" (OuterVolumeSpecName: "kube-api-access-k8nvx") pod "f0183d53-a665-486c-8b60-0ad7f03398e0" (UID: "f0183d53-a665-486c-8b60-0ad7f03398e0"). InnerVolumeSpecName "kube-api-access-k8nvx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 17:20:10.469737 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:20:10.469661    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0183d53-a665-486c-8b60-0ad7f03398e0-tls-certs\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 27 17:20:10.469737 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:20:10.469690    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k8nvx\" (UniqueName: \"kubernetes.io/projected/f0183d53-a665-486c-8b60-0ad7f03398e0-kube-api-access-k8nvx\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 27 17:20:11.079502 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:20:11.079474    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-auth-enabled-requires-token-d4ed2c08/auth-enabled-test-kserve-router-scheduler-6664595b9b-qzq2f"
Jul 27 17:20:11.079502 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:20:11.079489    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-auth-enabled-requires-token-d4ed2c08/auth-enabled-test-kserve-router-scheduler-6664595b9b-qzq2f" event={"ID":"f0183d53-a665-486c-8b60-0ad7f03398e0","Type":"ContainerDied","Data":"a8cce94952b9621fa381f09bcb58963d45cce2a872565688d41d1d8db077e943"}
Jul 27 17:20:11.079999 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:20:11.079552    2580 scope.go:117] "RemoveContainer" containerID="d670c86f8f4baf8af93a5515d0ccef9567c3cdf5c2e2c0ec8cae20b7364e4724"
Jul 27 17:20:11.101305 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:20:11.101280    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-auth-enabled-requires-token-d4ed2c08/auth-enabled-test-kserve-router-scheduler-6664595b9b-qzq2f"]
Jul 27 17:20:11.103748 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:20:11.103724    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-auth-enabled-requires-token-d4ed2c08/auth-enabled-test-kserve-router-scheduler-6664595b9b-qzq2f"]
Jul 27 17:20:11.272020 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:20:11.271989    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f0183d53-a665-486c-8b60-0ad7f03398e0" path="/var/lib/kubelet/pods/f0183d53-a665-486c-8b60-0ad7f03398e0/volumes"
Jul 27 17:20:12.098215 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:20:12.098176    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-63a03ef4/llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-sche6h6wj" podUID="dbfd40bf-b63c-4e27-aa9f-3e6f2a9b142b" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Jul 27 17:20:14.921922 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:20:14.921877    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:20:15.023450 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:20:15.023418    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:20:16.853536 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:20:16.853494    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-test-llm-inference-service-63a03ef4/llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-sche6h6wj" podUID="dbfd40bf-b63c-4e27-aa9f-3e6f2a9b142b" containerName="main" containerID="cri-o://338f6f13947004cff6531a408c79f1314c0f5ea8ea94856b60657f05c379b345" gracePeriod=45
Jul 27 17:20:17.111459 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:20:17.111402    2580 generic.go:356] "Generic (PLEG): container finished" podID="dbfd40bf-b63c-4e27-aa9f-3e6f2a9b142b" containerID="338f6f13947004cff6531a408c79f1314c0f5ea8ea94856b60657f05c379b345" exitCode=0
Jul 27 17:20:17.111569 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:20:17.111475    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-63a03ef4/llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-sche6h6wj" event={"ID":"dbfd40bf-b63c-4e27-aa9f-3e6f2a9b142b","Type":"ContainerDied","Data":"338f6f13947004cff6531a408c79f1314c0f5ea8ea94856b60657f05c379b345"}
Jul 27 17:20:17.111569 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:20:17.111520    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-63a03ef4/llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-sche6h6wj" event={"ID":"dbfd40bf-b63c-4e27-aa9f-3e6f2a9b142b","Type":"ContainerDied","Data":"d18b3fdbca6c77875bf1153b8c0a107e6c2be56e9fb45d7b15941c3ec66fb138"}
Jul 27 17:20:17.111569 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:20:17.111536    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d18b3fdbca6c77875bf1153b8c0a107e6c2be56e9fb45d7b15941c3ec66fb138"
Jul 27 17:20:17.112737 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:20:17.112724    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-63a03ef4/llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-sche6h6wj"
Jul 27 17:20:17.117048 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:20:17.117024    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ffs2f\" (UniqueName: \"kubernetes.io/projected/dbfd40bf-b63c-4e27-aa9f-3e6f2a9b142b-kube-api-access-ffs2f\") pod \"dbfd40bf-b63c-4e27-aa9f-3e6f2a9b142b\" (UID: \"dbfd40bf-b63c-4e27-aa9f-3e6f2a9b142b\") "
Jul 27 17:20:17.117156 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:20:17.117064    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dbfd40bf-b63c-4e27-aa9f-3e6f2a9b142b-tls-certs\") pod \"dbfd40bf-b63c-4e27-aa9f-3e6f2a9b142b\" (UID: \"dbfd40bf-b63c-4e27-aa9f-3e6f2a9b142b\") "
Jul 27 17:20:17.119232 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:20:17.119203    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dbfd40bf-b63c-4e27-aa9f-3e6f2a9b142b-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "dbfd40bf-b63c-4e27-aa9f-3e6f2a9b142b" (UID: "dbfd40bf-b63c-4e27-aa9f-3e6f2a9b142b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 17:20:17.119232 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:20:17.119214    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dbfd40bf-b63c-4e27-aa9f-3e6f2a9b142b-kube-api-access-ffs2f" (OuterVolumeSpecName: "kube-api-access-ffs2f") pod "dbfd40bf-b63c-4e27-aa9f-3e6f2a9b142b" (UID: "dbfd40bf-b63c-4e27-aa9f-3e6f2a9b142b"). InnerVolumeSpecName "kube-api-access-ffs2f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 17:20:17.218212 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:20:17.218182    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dbfd40bf-b63c-4e27-aa9f-3e6f2a9b142b-tls-certs\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 27 17:20:17.218212 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:20:17.218208    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ffs2f\" (UniqueName: \"kubernetes.io/projected/dbfd40bf-b63c-4e27-aa9f-3e6f2a9b142b-kube-api-access-ffs2f\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 27 17:20:18.116084 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:20:18.116051    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-63a03ef4/llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-sche6h6wj"
Jul 27 17:20:18.133116 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:20:18.133083    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-63a03ef4/llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-sche6h6wj"]
Jul 27 17:20:18.134643 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:20:18.134620    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-inference-service-63a03ef4/llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-sche6h6wj"]
Jul 27 17:20:19.271300 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:20:19.271267    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dbfd40bf-b63c-4e27-aa9f-3e6f2a9b142b" path="/var/lib/kubelet/pods/dbfd40bf-b63c-4e27-aa9f-3e6f2a9b142b/volumes"
Jul 27 17:20:21.045062 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:20:21.045026    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:20:26.563653 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:20:26.563621    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:20:26.657692 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:20:26.657652    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:20:31.539812 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:20:31.539773    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-router-scheduler-6c898f97bct5k5m"]
Jul 27 17:20:31.540193 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:20:31.540135    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0183d53-a665-486c-8b60-0ad7f03398e0" containerName="main"
Jul 27 17:20:31.540193 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:20:31.540147    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0183d53-a665-486c-8b60-0ad7f03398e0" containerName="main"
Jul 27 17:20:31.540193 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:20:31.540158    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbfd40bf-b63c-4e27-aa9f-3e6f2a9b142b" containerName="main"
Jul 27 17:20:31.540193 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:20:31.540164    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbfd40bf-b63c-4e27-aa9f-3e6f2a9b142b" containerName="main"
Jul 27 17:20:31.540340 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:20:31.540238    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="f0183d53-a665-486c-8b60-0ad7f03398e0" containerName="main"
Jul 27 17:20:31.540340 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:20:31.540248    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="dbfd40bf-b63c-4e27-aa9f-3e6f2a9b142b" containerName="main"
Jul 27 17:20:31.544528 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:20:31.544506    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-router-scheduler-6c898f97bct5k5m"
Jul 27 17:20:31.547476 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:20:31.547452    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6\"/\"openshift-service-ca.crt\""
Jul 27 17:20:31.547624 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:20:31.547581    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6\"/\"auth-invalid-token-test-kserve-self-signed-certs\""
Jul 27 17:20:31.547706 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:20:31.547631    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6\"/\"kube-root-ca.crt\""
Jul 27 17:20:31.548401 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:20:31.548377    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6\"/\"auth-invalid-token-test-epp-sa-dockercfg-v9shg\""
Jul 27 17:20:31.548401 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:20:31.548383    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6\"/\"default-dockercfg-7ptbw\""
Jul 27 17:20:31.552957 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:20:31.552935    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-router-scheduler-6c898f97bct5k5m"]
Jul 27 17:20:31.644348 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:20:31.644309    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7fb4b291-c422-486a-bff8-0e0f4046c728-tls-certs\") pod \"auth-invalid-token-test-kserve-router-scheduler-6c898f97bct5k5m\" (UID: \"7fb4b291-c422-486a-bff8-0e0f4046c728\") " pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-router-scheduler-6c898f97bct5k5m"
Jul 27 17:20:31.644524 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:20:31.644360    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w52jl\" (UniqueName: \"kubernetes.io/projected/7fb4b291-c422-486a-bff8-0e0f4046c728-kube-api-access-w52jl\") pod \"auth-invalid-token-test-kserve-router-scheduler-6c898f97bct5k5m\" (UID: \"7fb4b291-c422-486a-bff8-0e0f4046c728\") " pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-router-scheduler-6c898f97bct5k5m"
Jul 27 17:20:31.655505 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:20:31.655475    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:20:31.719198 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:20:31.719164    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:20:31.745493 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:20:31.745456    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7fb4b291-c422-486a-bff8-0e0f4046c728-tls-certs\") pod \"auth-invalid-token-test-kserve-router-scheduler-6c898f97bct5k5m\" (UID: \"7fb4b291-c422-486a-bff8-0e0f4046c728\") " pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-router-scheduler-6c898f97bct5k5m"
Jul 27 17:20:31.745635 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:20:31.745504    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w52jl\" (UniqueName: \"kubernetes.io/projected/7fb4b291-c422-486a-bff8-0e0f4046c728-kube-api-access-w52jl\") pod \"auth-invalid-token-test-kserve-router-scheduler-6c898f97bct5k5m\" (UID: \"7fb4b291-c422-486a-bff8-0e0f4046c728\") " pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-router-scheduler-6c898f97bct5k5m"
Jul 27 17:20:31.747965 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:20:31.747944    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7fb4b291-c422-486a-bff8-0e0f4046c728-tls-certs\") pod \"auth-invalid-token-test-kserve-router-scheduler-6c898f97bct5k5m\" (UID: \"7fb4b291-c422-486a-bff8-0e0f4046c728\") " pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-router-scheduler-6c898f97bct5k5m"
Jul 27 17:20:31.755652 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:20:31.755620    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w52jl\" (UniqueName: \"kubernetes.io/projected/7fb4b291-c422-486a-bff8-0e0f4046c728-kube-api-access-w52jl\") pod \"auth-invalid-token-test-kserve-router-scheduler-6c898f97bct5k5m\" (UID: \"7fb4b291-c422-486a-bff8-0e0f4046c728\") " pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-router-scheduler-6c898f97bct5k5m"
Jul 27 17:20:31.856377 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:20:31.856347    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-router-scheduler-6c898f97bct5k5m"
Jul 27 17:20:31.986130 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:20:31.986064    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-router-scheduler-6c898f97bct5k5m"]
Jul 27 17:20:31.988544 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:20:31.988516    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7fb4b291_c422_486a_bff8_0e0f4046c728.slice/crio-0ecb789789825abc192a7b332f0e389f07c281e6c41b256eed7eef5722cf4a1b WatchSource:0}: Error finding container 0ecb789789825abc192a7b332f0e389f07c281e6c41b256eed7eef5722cf4a1b: Status 404 returned error can't find the container with id 0ecb789789825abc192a7b332f0e389f07c281e6c41b256eed7eef5722cf4a1b
Jul 27 17:20:32.187176 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:20:32.187084    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-router-scheduler-6c898f97bct5k5m" event={"ID":"7fb4b291-c422-486a-bff8-0e0f4046c728","Type":"ContainerStarted","Data":"9a12dce748ec58ee7a1f390c810408bfb367318112fd274d33103baa04ceca76"}
Jul 27 17:20:32.187176 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:20:32.187142    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-router-scheduler-6c898f97bct5k5m" event={"ID":"7fb4b291-c422-486a-bff8-0e0f4046c728","Type":"ContainerStarted","Data":"0ecb789789825abc192a7b332f0e389f07c281e6c41b256eed7eef5722cf4a1b"}
Jul 27 17:20:32.187176 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:20:32.187169    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-router-scheduler-6c898f97bct5k5m"
Jul 27 17:20:32.203858 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:20:32.203795    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-router-scheduler-6c898f97bct5k5m" podStartSLOduration=1.203779808 podStartE2EDuration="1.203779808s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:20:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:20:32.202537758 +0000 UTC m=+1145.399282561" watchObservedRunningTime="2026-07-27 17:20:32.203779808 +0000 UTC m=+1145.400524610"
Jul 27 17:20:36.958046 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:20:36.958009    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:20:37.048478 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:20:37.048437    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:20:43.396712 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:20:43.396675    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:20:44.855375 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:20:44.855334    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:20:49.125727 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:20:49.125649    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:20:49.193820 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:20:49.193769    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:20:50.427164 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:20:50.427130    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:20:50.683761 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:20:50.683673    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:21:03.193955 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:21:03.193927    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-router-scheduler-6c898f97bct5k5m"
Jul 27 17:21:13.804699 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:21:13.804665    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:21:26.559481 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:21:26.559442    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:21:26.632279 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:21:26.632242    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:21:46.620595 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:21:46.620558    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:21:46.720477 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:21:46.720443    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:21:48.876975 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:21:48.876941    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:21:49.144872 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:21:49.144763    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:21:52.187017 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:21:52.186987    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:21:57.723696 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:21:57.723661    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:21:57.787607 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:21:57.787572    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:22:01.399051 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:22:01.399016    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:22:22.505271 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:22:22.505184    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:22:22.573348 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:22:22.573321    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:22:33.194482 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:22:33.194444    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-router-scheduler-6c898f97bct5k5m" podUID="7fb4b291-c422-486a-bff8-0e0f4046c728" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Jul 27 17:22:33.217514 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:22:33.217483    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-router-scheduler-6c898f97bct5k5m"]
Jul 27 17:22:33.229928 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:22:33.229818    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:22:33.289274 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:22:33.289235    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:22:42.110570 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:22:42.110531    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:22:42.208610 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:22:42.208573    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:22:43.193519 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:22:43.193479    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-router-scheduler-6c898f97bct5k5m" podUID="7fb4b291-c422-486a-bff8-0e0f4046c728" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Jul 27 17:22:48.000717 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:22:48.000674    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:22:48.238068 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:22:48.238032    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-router-scheduler-6c898f97bct5k5m" podUID="7fb4b291-c422-486a-bff8-0e0f4046c728" containerName="main" containerID="cri-o://9a12dce748ec58ee7a1f390c810408bfb367318112fd274d33103baa04ceca76" gracePeriod=45
Jul 27 17:22:48.502627 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:22:48.502559    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-router-scheduler-6c898f97bct5k5m"
Jul 27 17:22:48.524867 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:22:48.524809    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:22:48.573485 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:22:48.573452    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7fb4b291-c422-486a-bff8-0e0f4046c728-tls-certs\") pod \"7fb4b291-c422-486a-bff8-0e0f4046c728\" (UID: \"7fb4b291-c422-486a-bff8-0e0f4046c728\") "
Jul 27 17:22:48.573653 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:22:48.573564    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w52jl\" (UniqueName: \"kubernetes.io/projected/7fb4b291-c422-486a-bff8-0e0f4046c728-kube-api-access-w52jl\") pod \"7fb4b291-c422-486a-bff8-0e0f4046c728\" (UID: \"7fb4b291-c422-486a-bff8-0e0f4046c728\") "
Jul 27 17:22:48.575792 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:22:48.575765    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7fb4b291-c422-486a-bff8-0e0f4046c728-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "7fb4b291-c422-486a-bff8-0e0f4046c728" (UID: "7fb4b291-c422-486a-bff8-0e0f4046c728"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 17:22:48.575933 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:22:48.575768    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7fb4b291-c422-486a-bff8-0e0f4046c728-kube-api-access-w52jl" (OuterVolumeSpecName: "kube-api-access-w52jl") pod "7fb4b291-c422-486a-bff8-0e0f4046c728" (UID: "7fb4b291-c422-486a-bff8-0e0f4046c728"). InnerVolumeSpecName "kube-api-access-w52jl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 17:22:48.674429 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:22:48.674390    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w52jl\" (UniqueName: \"kubernetes.io/projected/7fb4b291-c422-486a-bff8-0e0f4046c728-kube-api-access-w52jl\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 27 17:22:48.674429 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:22:48.674422    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7fb4b291-c422-486a-bff8-0e0f4046c728-tls-certs\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 27 17:22:48.731630 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:22:48.731573    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:22:48.825755 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:22:48.825664    2580 generic.go:356] "Generic (PLEG): container finished" podID="7fb4b291-c422-486a-bff8-0e0f4046c728" containerID="9a12dce748ec58ee7a1f390c810408bfb367318112fd274d33103baa04ceca76" exitCode=0
Jul 27 17:22:48.825755 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:22:48.825718    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-router-scheduler-6c898f97bct5k5m"
Jul 27 17:22:48.825755 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:22:48.825731    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-router-scheduler-6c898f97bct5k5m" event={"ID":"7fb4b291-c422-486a-bff8-0e0f4046c728","Type":"ContainerDied","Data":"9a12dce748ec58ee7a1f390c810408bfb367318112fd274d33103baa04ceca76"}
Jul 27 17:22:48.826052 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:22:48.825794    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-router-scheduler-6c898f97bct5k5m" event={"ID":"7fb4b291-c422-486a-bff8-0e0f4046c728","Type":"ContainerDied","Data":"0ecb789789825abc192a7b332f0e389f07c281e6c41b256eed7eef5722cf4a1b"}
Jul 27 17:22:48.826052 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:22:48.825859    2580 scope.go:117] "RemoveContainer" containerID="9a12dce748ec58ee7a1f390c810408bfb367318112fd274d33103baa04ceca76"
Jul 27 17:22:48.834898 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:22:48.834876    2580 scope.go:117] "RemoveContainer" containerID="9a12dce748ec58ee7a1f390c810408bfb367318112fd274d33103baa04ceca76"
Jul 27 17:22:48.835188 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:22:48.835164    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a12dce748ec58ee7a1f390c810408bfb367318112fd274d33103baa04ceca76\": container with ID starting with 9a12dce748ec58ee7a1f390c810408bfb367318112fd274d33103baa04ceca76 not found: ID does not exist" containerID="9a12dce748ec58ee7a1f390c810408bfb367318112fd274d33103baa04ceca76"
Jul 27 17:22:48.835259 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:22:48.835198    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a12dce748ec58ee7a1f390c810408bfb367318112fd274d33103baa04ceca76"} err="failed to get container status \"9a12dce748ec58ee7a1f390c810408bfb367318112fd274d33103baa04ceca76\": rpc error: code = NotFound desc = could not find container \"9a12dce748ec58ee7a1f390c810408bfb367318112fd274d33103baa04ceca76\": container with ID starting with 9a12dce748ec58ee7a1f390c810408bfb367318112fd274d33103baa04ceca76 not found: ID does not exist"
Jul 27 17:22:48.846719 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:22:48.846694    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-router-scheduler-6c898f97bct5k5m"]
Jul 27 17:22:48.849047 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:22:48.849024    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-router-scheduler-6c898f97bct5k5m"]
Jul 27 17:22:49.271371 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:22:49.271339    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7fb4b291-c422-486a-bff8-0e0f4046c728" path="/var/lib/kubelet/pods/7fb4b291-c422-486a-bff8-0e0f4046c728/volumes"
Jul 27 17:22:53.034540 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:22:53.034494    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:22:53.504194 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:22:53.504156    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:22:53.667097 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:22:53.667063    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:22:59.340313 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:22:59.340273    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:23:02.831532 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:23:02.831495    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:23:05.177970 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:23:05.177932    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:23:05.278190 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:23:05.278156    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:23:12.464435 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:23:12.464400    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:23:12.626411 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:23:12.626364    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-test-llm-auth-disabled-no-token-required-396e4821/auth-disabled-test-kserve-router-scheduler-5d9b95c655-24vts"]
Jul 27 17:23:12.626914 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:23:12.626895    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7fb4b291-c422-486a-bff8-0e0f4046c728" containerName="main"
Jul 27 17:23:12.626993 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:23:12.626917    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="7fb4b291-c422-486a-bff8-0e0f4046c728" containerName="main"
Jul 27 17:23:12.627036 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:23:12.627002    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="7fb4b291-c422-486a-bff8-0e0f4046c728" containerName="main"
Jul 27 17:23:12.629995 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:23:12.629978    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-auth-disabled-no-token-required-396e4821/auth-disabled-test-kserve-router-scheduler-5d9b95c655-24vts"
Jul 27 17:23:12.632373 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:23:12.632351    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-auth-disabled-no-token-required-396e4821\"/\"kube-root-ca.crt\""
Jul 27 17:23:12.632479 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:23:12.632357    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-auth-disabled-no-token-required-396e4821\"/\"openshift-service-ca.crt\""
Jul 27 17:23:12.633475 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:23:12.633456    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-auth-disabled-no-token-required-396e4821\"/\"auth-disabled-test-kserve-self-signed-certs\""
Jul 27 17:23:12.633642 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:23:12.633501    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-auth-disabled-no-token-required-396e4821\"/\"auth-disabled-test-epp-sa-dockercfg-94scg\""
Jul 27 17:23:12.633642 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:23:12.633501    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-auth-disabled-no-token-required-396e4821\"/\"default-dockercfg-f9mmq\""
Jul 27 17:23:12.639267 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:23:12.639247    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-auth-disabled-no-token-required-396e4821/auth-disabled-test-kserve-router-scheduler-5d9b95c655-24vts"]
Jul 27 17:23:12.667009 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:23:12.666984    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:23:12.692170 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:23:12.692146    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chjjb\" (UniqueName: \"kubernetes.io/projected/484c20a8-2add-4bde-a12b-a495f651d8ce-kube-api-access-chjjb\") pod \"auth-disabled-test-kserve-router-scheduler-5d9b95c655-24vts\" (UID: \"484c20a8-2add-4bde-a12b-a495f651d8ce\") " pod="e2e-test-llm-auth-disabled-no-token-required-396e4821/auth-disabled-test-kserve-router-scheduler-5d9b95c655-24vts"
Jul 27 17:23:12.692267 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:23:12.692225    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/484c20a8-2add-4bde-a12b-a495f651d8ce-tls-certs\") pod \"auth-disabled-test-kserve-router-scheduler-5d9b95c655-24vts\" (UID: \"484c20a8-2add-4bde-a12b-a495f651d8ce\") " pod="e2e-test-llm-auth-disabled-no-token-required-396e4821/auth-disabled-test-kserve-router-scheduler-5d9b95c655-24vts"
Jul 27 17:23:12.792987 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:23:12.792909    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/484c20a8-2add-4bde-a12b-a495f651d8ce-tls-certs\") pod \"auth-disabled-test-kserve-router-scheduler-5d9b95c655-24vts\" (UID: \"484c20a8-2add-4bde-a12b-a495f651d8ce\") " pod="e2e-test-llm-auth-disabled-no-token-required-396e4821/auth-disabled-test-kserve-router-scheduler-5d9b95c655-24vts"
Jul 27 17:23:12.792987 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:23:12.792951    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chjjb\" (UniqueName: \"kubernetes.io/projected/484c20a8-2add-4bde-a12b-a495f651d8ce-kube-api-access-chjjb\") pod \"auth-disabled-test-kserve-router-scheduler-5d9b95c655-24vts\" (UID: \"484c20a8-2add-4bde-a12b-a495f651d8ce\") " pod="e2e-test-llm-auth-disabled-no-token-required-396e4821/auth-disabled-test-kserve-router-scheduler-5d9b95c655-24vts"
Jul 27 17:23:12.795374 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:23:12.795355    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/484c20a8-2add-4bde-a12b-a495f651d8ce-tls-certs\") pod \"auth-disabled-test-kserve-router-scheduler-5d9b95c655-24vts\" (UID: \"484c20a8-2add-4bde-a12b-a495f651d8ce\") " pod="e2e-test-llm-auth-disabled-no-token-required-396e4821/auth-disabled-test-kserve-router-scheduler-5d9b95c655-24vts"
Jul 27 17:23:12.801081 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:23:12.801060    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-chjjb\" (UniqueName: \"kubernetes.io/projected/484c20a8-2add-4bde-a12b-a495f651d8ce-kube-api-access-chjjb\") pod \"auth-disabled-test-kserve-router-scheduler-5d9b95c655-24vts\" (UID: \"484c20a8-2add-4bde-a12b-a495f651d8ce\") " pod="e2e-test-llm-auth-disabled-no-token-required-396e4821/auth-disabled-test-kserve-router-scheduler-5d9b95c655-24vts"
Jul 27 17:23:12.942238 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:23:12.942206    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-auth-disabled-no-token-required-396e4821/auth-disabled-test-kserve-router-scheduler-5d9b95c655-24vts"
Jul 27 17:23:13.074226 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:23:13.074198    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-auth-disabled-no-token-required-396e4821/auth-disabled-test-kserve-router-scheduler-5d9b95c655-24vts"]
Jul 27 17:23:13.076038 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:23:13.076013    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod484c20a8_2add_4bde_a12b_a495f651d8ce.slice/crio-7337affab9367cd45e2e7d96973be8a7dd9b61fbe72f40e57f85784483468176 WatchSource:0}: Error finding container 7337affab9367cd45e2e7d96973be8a7dd9b61fbe72f40e57f85784483468176: Status 404 returned error can't find the container with id 7337affab9367cd45e2e7d96973be8a7dd9b61fbe72f40e57f85784483468176
Jul 27 17:23:13.944610 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:23:13.944574    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-auth-disabled-no-token-required-396e4821/auth-disabled-test-kserve-router-scheduler-5d9b95c655-24vts" event={"ID":"484c20a8-2add-4bde-a12b-a495f651d8ce","Type":"ContainerStarted","Data":"79156bf2bbb0541f79df7c86a3a4a5f5104255fa90fdf95052fef8945c4a5657"}
Jul 27 17:23:13.944994 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:23:13.944619    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-auth-disabled-no-token-required-396e4821/auth-disabled-test-kserve-router-scheduler-5d9b95c655-24vts" event={"ID":"484c20a8-2add-4bde-a12b-a495f651d8ce","Type":"ContainerStarted","Data":"7337affab9367cd45e2e7d96973be8a7dd9b61fbe72f40e57f85784483468176"}
Jul 27 17:23:13.944994 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:23:13.944646    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-auth-disabled-no-token-required-396e4821/auth-disabled-test-kserve-router-scheduler-5d9b95c655-24vts"
Jul 27 17:23:13.962200 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:23:13.962157    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-test-llm-auth-disabled-no-token-required-396e4821/auth-disabled-test-kserve-router-scheduler-5d9b95c655-24vts" podStartSLOduration=1.962143458 podStartE2EDuration="1.962143458s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:23:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:23:13.961007022 +0000 UTC m=+1307.157751824" watchObservedRunningTime="2026-07-27 17:23:13.962143458 +0000 UTC m=+1307.158888259"
Jul 27 17:23:16.783383 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:23:16.783347    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:23:21.754088 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:23:21.754047    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:23:25.632385 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:23:25.632350    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:23:25.730875 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:23:25.730807    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:23:27.284496 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:23:27.284466    2580 scope.go:117] "RemoveContainer" containerID="338f6f13947004cff6531a408c79f1314c0f5ea8ea94856b60657f05c379b345"
Jul 27 17:23:44.950374 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:23:44.950343    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-auth-disabled-no-token-required-396e4821/auth-disabled-test-kserve-router-scheduler-5d9b95c655-24vts"
Jul 27 17:23:45.045276 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:23:45.045246    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:23:46.416859 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:23:46.416807    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:23:50.027794 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:23:50.027713    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:23:50.296427 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:23:50.296339    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:23:51.959354 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:23:51.959316    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:23:57.520844 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:23:57.520794    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:23:57.620990 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:23:57.620956    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:24:04.891119 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:24:04.891078    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:24:23.825814 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:24:23.825778    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:24:23.893684 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:24:23.893655    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:24:43.368868 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:24:43.368810    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:24:43.466399 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:24:43.466367    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:24:49.481477 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:24:49.481446    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:24:55.060439 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:24:55.060403    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:24:55.160305 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:24:55.160261    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:24:55.354710 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:24:55.354677    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:24:55.430771 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:24:55.430739    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:24:56.810519 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:24:56.810486    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:25:17.485718 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:25:17.485676    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:25:28.296772 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:25:28.296697    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:25:28.356240 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:25:28.356203    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:25:38.032908 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:25:38.032877    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:25:38.046478 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:25:38.046445    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-auth-disabled-no-token-required-396e4821/auth-disabled-test-kserve-router-scheduler-5d9b95c655-24vts"]
Jul 27 17:25:38.238512 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:25:38.238480    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:25:44.950659 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:25:44.950621    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-auth-disabled-no-token-required-396e4821/auth-disabled-test-kserve-router-scheduler-5d9b95c655-24vts" podUID="484c20a8-2add-4bde-a12b-a495f651d8ce" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Jul 27 17:25:47.844848 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:25:47.844807    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:25:47.946742 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:25:47.946692    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:25:53.067105 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:25:53.067043    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-test-llm-auth-disabled-no-token-required-396e4821/auth-disabled-test-kserve-router-scheduler-5d9b95c655-24vts" podUID="484c20a8-2add-4bde-a12b-a495f651d8ce" containerName="main" containerID="cri-o://79156bf2bbb0541f79df7c86a3a4a5f5104255fa90fdf95052fef8945c4a5657" gracePeriod=45
Jul 27 17:25:53.320053 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:25:53.319989    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-auth-disabled-no-token-required-396e4821/auth-disabled-test-kserve-router-scheduler-5d9b95c655-24vts"
Jul 27 17:25:53.424136 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:25:53.424099    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/484c20a8-2add-4bde-a12b-a495f651d8ce-tls-certs\") pod \"484c20a8-2add-4bde-a12b-a495f651d8ce\" (UID: \"484c20a8-2add-4bde-a12b-a495f651d8ce\") "
Jul 27 17:25:53.424308 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:25:53.424147    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-chjjb\" (UniqueName: \"kubernetes.io/projected/484c20a8-2add-4bde-a12b-a495f651d8ce-kube-api-access-chjjb\") pod \"484c20a8-2add-4bde-a12b-a495f651d8ce\" (UID: \"484c20a8-2add-4bde-a12b-a495f651d8ce\") "
Jul 27 17:25:53.426411 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:25:53.426382    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/484c20a8-2add-4bde-a12b-a495f651d8ce-kube-api-access-chjjb" (OuterVolumeSpecName: "kube-api-access-chjjb") pod "484c20a8-2add-4bde-a12b-a495f651d8ce" (UID: "484c20a8-2add-4bde-a12b-a495f651d8ce"). InnerVolumeSpecName "kube-api-access-chjjb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 17:25:53.426526 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:25:53.426381    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/484c20a8-2add-4bde-a12b-a495f651d8ce-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "484c20a8-2add-4bde-a12b-a495f651d8ce" (UID: "484c20a8-2add-4bde-a12b-a495f651d8ce"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 17:25:53.525785 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:25:53.525754    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/484c20a8-2add-4bde-a12b-a495f651d8ce-tls-certs\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 27 17:25:53.525785 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:25:53.525789    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-chjjb\" (UniqueName: \"kubernetes.io/projected/484c20a8-2add-4bde-a12b-a495f651d8ce-kube-api-access-chjjb\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 27 17:25:53.679809 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:25:53.679774    2580 generic.go:356] "Generic (PLEG): container finished" podID="484c20a8-2add-4bde-a12b-a495f651d8ce" containerID="79156bf2bbb0541f79df7c86a3a4a5f5104255fa90fdf95052fef8945c4a5657" exitCode=0
Jul 27 17:25:53.679969 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:25:53.679859    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-auth-disabled-no-token-required-396e4821/auth-disabled-test-kserve-router-scheduler-5d9b95c655-24vts" event={"ID":"484c20a8-2add-4bde-a12b-a495f651d8ce","Type":"ContainerDied","Data":"79156bf2bbb0541f79df7c86a3a4a5f5104255fa90fdf95052fef8945c4a5657"}
Jul 27 17:25:53.679969 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:25:53.679866    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-auth-disabled-no-token-required-396e4821/auth-disabled-test-kserve-router-scheduler-5d9b95c655-24vts"
Jul 27 17:25:53.679969 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:25:53.679930    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-auth-disabled-no-token-required-396e4821/auth-disabled-test-kserve-router-scheduler-5d9b95c655-24vts" event={"ID":"484c20a8-2add-4bde-a12b-a495f651d8ce","Type":"ContainerDied","Data":"7337affab9367cd45e2e7d96973be8a7dd9b61fbe72f40e57f85784483468176"}
Jul 27 17:25:53.679969 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:25:53.679952    2580 scope.go:117] "RemoveContainer" containerID="79156bf2bbb0541f79df7c86a3a4a5f5104255fa90fdf95052fef8945c4a5657"
Jul 27 17:25:53.688597 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:25:53.688579    2580 scope.go:117] "RemoveContainer" containerID="79156bf2bbb0541f79df7c86a3a4a5f5104255fa90fdf95052fef8945c4a5657"
Jul 27 17:25:53.688914 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:25:53.688890    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"79156bf2bbb0541f79df7c86a3a4a5f5104255fa90fdf95052fef8945c4a5657\": container with ID starting with 79156bf2bbb0541f79df7c86a3a4a5f5104255fa90fdf95052fef8945c4a5657 not found: ID does not exist" containerID="79156bf2bbb0541f79df7c86a3a4a5f5104255fa90fdf95052fef8945c4a5657"
Jul 27 17:25:53.688997 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:25:53.688923    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79156bf2bbb0541f79df7c86a3a4a5f5104255fa90fdf95052fef8945c4a5657"} err="failed to get container status \"79156bf2bbb0541f79df7c86a3a4a5f5104255fa90fdf95052fef8945c4a5657\": rpc error: code = NotFound desc = could not find container \"79156bf2bbb0541f79df7c86a3a4a5f5104255fa90fdf95052fef8945c4a5657\": container with ID starting with 79156bf2bbb0541f79df7c86a3a4a5f5104255fa90fdf95052fef8945c4a5657 not found: ID does not exist"
Jul 27 17:25:53.700267 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:25:53.700240    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-auth-disabled-no-token-required-396e4821/auth-disabled-test-kserve-router-scheduler-5d9b95c655-24vts"]
Jul 27 17:25:53.703738 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:25:53.703713    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-auth-disabled-no-token-required-396e4821/auth-disabled-test-kserve-router-scheduler-5d9b95c655-24vts"]
Jul 27 17:25:53.814209 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:25:53.814175    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:25:55.271870 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:25:55.271817    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="484c20a8-2add-4bde-a12b-a495f651d8ce" path="/var/lib/kubelet/pods/484c20a8-2add-4bde-a12b-a495f651d8ce/volumes"
Jul 27 17:25:55.863630 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:25:55.863597    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:25:56.040741 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:25:56.040708    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-router-scheduler-655sm79"]
Jul 27 17:25:56.041157 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:25:56.041131    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="484c20a8-2add-4bde-a12b-a495f651d8ce" containerName="main"
Jul 27 17:25:56.041157 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:25:56.041154    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="484c20a8-2add-4bde-a12b-a495f651d8ce" containerName="main"
Jul 27 17:25:56.041361 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:25:56.041235    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="484c20a8-2add-4bde-a12b-a495f651d8ce" containerName="main"
Jul 27 17:25:56.045538 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:25:56.045515    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-router-scheduler-655sm79"
Jul 27 17:25:56.048022 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:25:56.047998    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-9c386aa9\"/\"scheduler-v06-pd-migration-test-kserve-self-signed-certs\""
Jul 27 17:25:56.048948 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:25:56.048928    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-9c386aa9\"/\"openshift-service-ca.crt\""
Jul 27 17:25:56.049045 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:25:56.048928    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-9c386aa9\"/\"default-dockercfg-gn825\""
Jul 27 17:25:56.049045 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:25:56.048931    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-9c386aa9\"/\"kube-root-ca.crt\""
Jul 27 17:25:56.049045 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:25:56.048960    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-9c386aa9\"/\"scheduler-v06-pd-migration-test-epp-sa-dockercfg-7n7t9\""
Jul 27 17:25:56.052925 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:25:56.052901    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-router-scheduler-655sm79"]
Jul 27 17:25:56.073120 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:25:56.073094    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:25:56.150282 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:25:56.150177    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tcx4s\" (UniqueName: \"kubernetes.io/projected/7d69a282-86d1-4fb6-9965-8742506781ab-kube-api-access-tcx4s\") pod \"scheduler-v06-pd-migration-test-kserve-router-scheduler-655sm79\" (UID: \"7d69a282-86d1-4fb6-9965-8742506781ab\") " pod="e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-router-scheduler-655sm79"
Jul 27 17:25:56.150282 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:25:56.150255    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7d69a282-86d1-4fb6-9965-8742506781ab-tls-certs\") pod \"scheduler-v06-pd-migration-test-kserve-router-scheduler-655sm79\" (UID: \"7d69a282-86d1-4fb6-9965-8742506781ab\") " pod="e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-router-scheduler-655sm79"
Jul 27 17:25:56.251624 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:25:56.251572    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tcx4s\" (UniqueName: \"kubernetes.io/projected/7d69a282-86d1-4fb6-9965-8742506781ab-kube-api-access-tcx4s\") pod \"scheduler-v06-pd-migration-test-kserve-router-scheduler-655sm79\" (UID: \"7d69a282-86d1-4fb6-9965-8742506781ab\") " pod="e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-router-scheduler-655sm79"
Jul 27 17:25:56.251808 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:25:56.251678    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7d69a282-86d1-4fb6-9965-8742506781ab-tls-certs\") pod \"scheduler-v06-pd-migration-test-kserve-router-scheduler-655sm79\" (UID: \"7d69a282-86d1-4fb6-9965-8742506781ab\") " pod="e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-router-scheduler-655sm79"
Jul 27 17:25:56.254164 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:25:56.254142    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7d69a282-86d1-4fb6-9965-8742506781ab-tls-certs\") pod \"scheduler-v06-pd-migration-test-kserve-router-scheduler-655sm79\" (UID: \"7d69a282-86d1-4fb6-9965-8742506781ab\") " pod="e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-router-scheduler-655sm79"
Jul 27 17:25:56.261213 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:25:56.261188    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tcx4s\" (UniqueName: \"kubernetes.io/projected/7d69a282-86d1-4fb6-9965-8742506781ab-kube-api-access-tcx4s\") pod \"scheduler-v06-pd-migration-test-kserve-router-scheduler-655sm79\" (UID: \"7d69a282-86d1-4fb6-9965-8742506781ab\") " pod="e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-router-scheduler-655sm79"
Jul 27 17:25:56.357198 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:25:56.357162    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-router-scheduler-655sm79"
Jul 27 17:25:56.495352 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:25:56.495191    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-router-scheduler-655sm79"]
Jul 27 17:25:56.497929 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:25:56.497900    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d69a282_86d1_4fb6_9965_8742506781ab.slice/crio-0dde815b7122dc0570f97f2e1dd6c2960cc3b44f99b31669a9458483391d6bc7 WatchSource:0}: Error finding container 0dde815b7122dc0570f97f2e1dd6c2960cc3b44f99b31669a9458483391d6bc7: Status 404 returned error can't find the container with id 0dde815b7122dc0570f97f2e1dd6c2960cc3b44f99b31669a9458483391d6bc7
Jul 27 17:25:56.695179 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:25:56.695089    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-router-scheduler-655sm79" event={"ID":"7d69a282-86d1-4fb6-9965-8742506781ab","Type":"ContainerStarted","Data":"7d8512d6d1460dde2bb76ab12391dccf4d498a54c37fbe1cfe792985816b01a8"}
Jul 27 17:25:56.695179 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:25:56.695141    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-router-scheduler-655sm79" event={"ID":"7d69a282-86d1-4fb6-9965-8742506781ab","Type":"ContainerStarted","Data":"0dde815b7122dc0570f97f2e1dd6c2960cc3b44f99b31669a9458483391d6bc7"}
Jul 27 17:25:56.695179 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:25:56.695167    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-router-scheduler-655sm79"
Jul 27 17:25:56.712569 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:25:56.712502    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-router-scheduler-655sm79" podStartSLOduration=0.712486861 podStartE2EDuration="712.486861ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:25:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:25:56.710072008 +0000 UTC m=+1469.906816816" watchObservedRunningTime="2026-07-27 17:25:56.712486861 +0000 UTC m=+1469.909231663"
Jul 27 17:25:58.182474 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:25:58.182440    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:25:58.282611 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:25:58.282577    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:26:00.164259 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:26:00.164229    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:26:00.264542 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:26:00.264509    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:26:04.748007 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:26:04.747971    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:26:10.393169 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:26:10.393137    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:26:10.509519 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:26:10.509478    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:26:11.736991 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:26:11.736953    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:26:27.701326 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:26:27.701294    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-router-scheduler-655sm79"
Jul 27 17:26:28.806040 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:26:28.806005    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:26:29.102762 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:26:29.102726    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-test-llm-autoscaling-hpa-deployment-9ba6f3f4/autoscale-hpa-deploy-kserve-router-scheduler-94df769b6-d6x2d"]
Jul 27 17:26:29.106355 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:26:29.106335    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-autoscaling-hpa-deployment-9ba6f3f4/autoscale-hpa-deploy-kserve-router-scheduler-94df769b6-d6x2d"
Jul 27 17:26:29.110133 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:26:29.110054    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-autoscaling-hpa-deployment-9ba6f3f4\"/\"default-dockercfg-2cwvx\""
Jul 27 17:26:29.110133 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:26:29.110080    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-autoscaling-hpa-deployment-9ba6f3f4\"/\"autoscale-hpa-deploy-epp-sa-dockercfg-2pndj\""
Jul 27 17:26:29.110133 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:26:29.110060    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-autoscaling-hpa-deployment-9ba6f3f4\"/\"kube-root-ca.crt\""
Jul 27 17:26:29.110133 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:26:29.110121    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-autoscaling-hpa-deployment-9ba6f3f4\"/\"openshift-service-ca.crt\""
Jul 27 17:26:29.110461 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:26:29.110054    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-autoscaling-hpa-deployment-9ba6f3f4\"/\"autoscale-hpa-deploy-kserve-self-signed-certs\""
Jul 27 17:26:29.114929 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:26:29.114903    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-autoscaling-hpa-deployment-9ba6f3f4/autoscale-hpa-deploy-kserve-router-scheduler-94df769b6-d6x2d"]
Jul 27 17:26:29.240031 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:26:29.239998    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9197ee24-45bf-42f5-873c-4f3a6e60351c-tls-certs\") pod \"autoscale-hpa-deploy-kserve-router-scheduler-94df769b6-d6x2d\" (UID: \"9197ee24-45bf-42f5-873c-4f3a6e60351c\") " pod="e2e-test-llm-autoscaling-hpa-deployment-9ba6f3f4/autoscale-hpa-deploy-kserve-router-scheduler-94df769b6-d6x2d"
Jul 27 17:26:29.240181 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:26:29.240128    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z54tj\" (UniqueName: \"kubernetes.io/projected/9197ee24-45bf-42f5-873c-4f3a6e60351c-kube-api-access-z54tj\") pod \"autoscale-hpa-deploy-kserve-router-scheduler-94df769b6-d6x2d\" (UID: \"9197ee24-45bf-42f5-873c-4f3a6e60351c\") " pod="e2e-test-llm-autoscaling-hpa-deployment-9ba6f3f4/autoscale-hpa-deploy-kserve-router-scheduler-94df769b6-d6x2d"
Jul 27 17:26:29.274491 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:26:29.274455    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:26:29.341074 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:26:29.341042    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9197ee24-45bf-42f5-873c-4f3a6e60351c-tls-certs\") pod \"autoscale-hpa-deploy-kserve-router-scheduler-94df769b6-d6x2d\" (UID: \"9197ee24-45bf-42f5-873c-4f3a6e60351c\") " pod="e2e-test-llm-autoscaling-hpa-deployment-9ba6f3f4/autoscale-hpa-deploy-kserve-router-scheduler-94df769b6-d6x2d"
Jul 27 17:26:29.341222 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:26:29.341154    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z54tj\" (UniqueName: \"kubernetes.io/projected/9197ee24-45bf-42f5-873c-4f3a6e60351c-kube-api-access-z54tj\") pod \"autoscale-hpa-deploy-kserve-router-scheduler-94df769b6-d6x2d\" (UID: \"9197ee24-45bf-42f5-873c-4f3a6e60351c\") " pod="e2e-test-llm-autoscaling-hpa-deployment-9ba6f3f4/autoscale-hpa-deploy-kserve-router-scheduler-94df769b6-d6x2d"
Jul 27 17:26:29.343589 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:26:29.343564    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9197ee24-45bf-42f5-873c-4f3a6e60351c-tls-certs\") pod \"autoscale-hpa-deploy-kserve-router-scheduler-94df769b6-d6x2d\" (UID: \"9197ee24-45bf-42f5-873c-4f3a6e60351c\") " pod="e2e-test-llm-autoscaling-hpa-deployment-9ba6f3f4/autoscale-hpa-deploy-kserve-router-scheduler-94df769b6-d6x2d"
Jul 27 17:26:29.349533 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:26:29.349514    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z54tj\" (UniqueName: \"kubernetes.io/projected/9197ee24-45bf-42f5-873c-4f3a6e60351c-kube-api-access-z54tj\") pod \"autoscale-hpa-deploy-kserve-router-scheduler-94df769b6-d6x2d\" (UID: \"9197ee24-45bf-42f5-873c-4f3a6e60351c\") " pod="e2e-test-llm-autoscaling-hpa-deployment-9ba6f3f4/autoscale-hpa-deploy-kserve-router-scheduler-94df769b6-d6x2d"
Jul 27 17:26:29.417673 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:26:29.417612    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-autoscaling-hpa-deployment-9ba6f3f4/autoscale-hpa-deploy-kserve-router-scheduler-94df769b6-d6x2d"
Jul 27 17:26:29.548795 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:26:29.548769    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-autoscaling-hpa-deployment-9ba6f3f4/autoscale-hpa-deploy-kserve-router-scheduler-94df769b6-d6x2d"]
Jul 27 17:26:29.551313 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:26:29.551285    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9197ee24_45bf_42f5_873c_4f3a6e60351c.slice/crio-001e3f2d6ccec4a48aee6bfcd94fe061ae6dd13cea4a8087cbfcce869378a3bf WatchSource:0}: Error finding container 001e3f2d6ccec4a48aee6bfcd94fe061ae6dd13cea4a8087cbfcce869378a3bf: Status 404 returned error can't find the container with id 001e3f2d6ccec4a48aee6bfcd94fe061ae6dd13cea4a8087cbfcce869378a3bf
Jul 27 17:26:29.858028 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:26:29.857994    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-autoscaling-hpa-deployment-9ba6f3f4/autoscale-hpa-deploy-kserve-router-scheduler-94df769b6-d6x2d" event={"ID":"9197ee24-45bf-42f5-873c-4f3a6e60351c","Type":"ContainerStarted","Data":"d2224f2839401ea4721a77deb88eab0fe5d861d2cdb050550abbf0760c4c2546"}
Jul 27 17:26:29.858425 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:26:29.858045    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-autoscaling-hpa-deployment-9ba6f3f4/autoscale-hpa-deploy-kserve-router-scheduler-94df769b6-d6x2d" event={"ID":"9197ee24-45bf-42f5-873c-4f3a6e60351c","Type":"ContainerStarted","Data":"001e3f2d6ccec4a48aee6bfcd94fe061ae6dd13cea4a8087cbfcce869378a3bf"}
Jul 27 17:26:29.858425 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:26:29.858073    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-autoscaling-hpa-deployment-9ba6f3f4/autoscale-hpa-deploy-kserve-router-scheduler-94df769b6-d6x2d"
Jul 27 17:26:29.875684 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:26:29.875641    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-test-llm-autoscaling-hpa-deployment-9ba6f3f4/autoscale-hpa-deploy-kserve-router-scheduler-94df769b6-d6x2d" podStartSLOduration=0.875625932 podStartE2EDuration="875.625932ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:26:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:26:29.873364998 +0000 UTC m=+1503.070109821" watchObservedRunningTime="2026-07-27 17:26:29.875625932 +0000 UTC m=+1503.072370732"
Jul 27 17:26:32.524008 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:26:32.523975    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:26:32.624951 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:26:32.624921    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:26:38.589118 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:26:38.589088    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:27:00.864119 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:27:00.864089    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-autoscaling-hpa-deployment-9ba6f3f4/autoscale-hpa-deploy-kserve-router-scheduler-94df769b6-d6x2d"
Jul 27 17:27:07.603311 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:27:07.603281    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:27:35.510233 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:27:35.510187    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-router-scheduler-655sm79"]
Jul 27 17:27:35.533062 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:27:35.533028    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:27:36.576054 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:27:36.576023    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:27:37.701943 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:27:37.701907    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-router-scheduler-655sm79" podUID="7d69a282-86d1-4fb6-9965-8742506781ab" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Jul 27 17:27:47.701608 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:27:47.701570    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-router-scheduler-655sm79" podUID="7d69a282-86d1-4fb6-9965-8742506781ab" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Jul 27 17:27:51.119156 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:27:51.119117    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:27:51.172507 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:27:51.172470    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-router-scheduler-655sm79" podUID="7d69a282-86d1-4fb6-9965-8742506781ab" containerName="main" containerID="cri-o://7d8512d6d1460dde2bb76ab12391dccf4d498a54c37fbe1cfe792985816b01a8" gracePeriod=45
Jul 27 17:27:51.429608 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:27:51.429585    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-router-scheduler-655sm79"
Jul 27 17:27:51.570147 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:27:51.570111    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tcx4s\" (UniqueName: \"kubernetes.io/projected/7d69a282-86d1-4fb6-9965-8742506781ab-kube-api-access-tcx4s\") pod \"7d69a282-86d1-4fb6-9965-8742506781ab\" (UID: \"7d69a282-86d1-4fb6-9965-8742506781ab\") "
Jul 27 17:27:51.570335 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:27:51.570155    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7d69a282-86d1-4fb6-9965-8742506781ab-tls-certs\") pod \"7d69a282-86d1-4fb6-9965-8742506781ab\" (UID: \"7d69a282-86d1-4fb6-9965-8742506781ab\") "
Jul 27 17:27:51.572276 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:27:51.572244    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d69a282-86d1-4fb6-9965-8742506781ab-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "7d69a282-86d1-4fb6-9965-8742506781ab" (UID: "7d69a282-86d1-4fb6-9965-8742506781ab"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 17:27:51.572383 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:27:51.572348    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d69a282-86d1-4fb6-9965-8742506781ab-kube-api-access-tcx4s" (OuterVolumeSpecName: "kube-api-access-tcx4s") pod "7d69a282-86d1-4fb6-9965-8742506781ab" (UID: "7d69a282-86d1-4fb6-9965-8742506781ab"). InnerVolumeSpecName "kube-api-access-tcx4s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 17:27:51.670663 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:27:51.670606    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tcx4s\" (UniqueName: \"kubernetes.io/projected/7d69a282-86d1-4fb6-9965-8742506781ab-kube-api-access-tcx4s\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 27 17:27:51.670663 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:27:51.670627    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7d69a282-86d1-4fb6-9965-8742506781ab-tls-certs\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 27 17:27:52.227657 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:27:52.227622    2580 generic.go:356] "Generic (PLEG): container finished" podID="7d69a282-86d1-4fb6-9965-8742506781ab" containerID="7d8512d6d1460dde2bb76ab12391dccf4d498a54c37fbe1cfe792985816b01a8" exitCode=0
Jul 27 17:27:52.228097 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:27:52.227667    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-router-scheduler-655sm79"
Jul 27 17:27:52.228097 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:27:52.227706    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-router-scheduler-655sm79" event={"ID":"7d69a282-86d1-4fb6-9965-8742506781ab","Type":"ContainerDied","Data":"7d8512d6d1460dde2bb76ab12391dccf4d498a54c37fbe1cfe792985816b01a8"}
Jul 27 17:27:52.228097 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:27:52.227756    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-router-scheduler-655sm79" event={"ID":"7d69a282-86d1-4fb6-9965-8742506781ab","Type":"ContainerDied","Data":"0dde815b7122dc0570f97f2e1dd6c2960cc3b44f99b31669a9458483391d6bc7"}
Jul 27 17:27:52.228097 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:27:52.227779    2580 scope.go:117] "RemoveContainer" containerID="7d8512d6d1460dde2bb76ab12391dccf4d498a54c37fbe1cfe792985816b01a8"
Jul 27 17:27:52.236386 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:27:52.236369    2580 scope.go:117] "RemoveContainer" containerID="7d8512d6d1460dde2bb76ab12391dccf4d498a54c37fbe1cfe792985816b01a8"
Jul 27 17:27:52.236629 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:27:52.236611    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d8512d6d1460dde2bb76ab12391dccf4d498a54c37fbe1cfe792985816b01a8\": container with ID starting with 7d8512d6d1460dde2bb76ab12391dccf4d498a54c37fbe1cfe792985816b01a8 not found: ID does not exist" containerID="7d8512d6d1460dde2bb76ab12391dccf4d498a54c37fbe1cfe792985816b01a8"
Jul 27 17:27:52.236698 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:27:52.236642    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d8512d6d1460dde2bb76ab12391dccf4d498a54c37fbe1cfe792985816b01a8"} err="failed to get container status \"7d8512d6d1460dde2bb76ab12391dccf4d498a54c37fbe1cfe792985816b01a8\": rpc error: code = NotFound desc = could not find container \"7d8512d6d1460dde2bb76ab12391dccf4d498a54c37fbe1cfe792985816b01a8\": container with ID starting with 7d8512d6d1460dde2bb76ab12391dccf4d498a54c37fbe1cfe792985816b01a8 not found: ID does not exist"
Jul 27 17:27:52.249186 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:27:52.249161    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-router-scheduler-655sm79"]
Jul 27 17:27:52.250777 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:27:52.250755    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-inference-service-9c386aa9/scheduler-v06-pd-migration-test-kserve-router-scheduler-655sm79"]
Jul 27 17:27:53.271029 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:27:53.270993    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7d69a282-86d1-4fb6-9965-8742506781ab" path="/var/lib/kubelet/pods/7d69a282-86d1-4fb6-9965-8742506781ab/volumes"
Jul 27 17:27:55.523042 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:27:55.523009    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:27:55.622018 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:27:55.621982    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:28:01.078714 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:28:01.078677    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:28:01.253927 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:28:01.253896    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-router-schedttr7j"]
Jul 27 17:28:01.254294 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:28:01.254273    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d69a282-86d1-4fb6-9965-8742506781ab" containerName="main"
Jul 27 17:28:01.254343 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:28:01.254296    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d69a282-86d1-4fb6-9965-8742506781ab" containerName="main"
Jul 27 17:28:01.254379 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:28:01.254366    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d69a282-86d1-4fb6-9965-8742506781ab" containerName="main"
Jul 27 17:28:01.257359 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:28:01.257338    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-router-schedttr7j"
Jul 27 17:28:01.261039 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:28:01.261014    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-40b85f95\"/\"openshift-service-ca.crt\""
Jul 27 17:28:01.261039 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:28:01.261029    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-40b85f95\"/\"scheduler-v06-threshold-migration-test-epp-sa-dockercfg-6j8w2\""
Jul 27 17:28:01.261204 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:28:01.261036    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-40b85f95\"/\"scheduler-v06-threshold-migration-test-kserve-self-signed-certs\""
Jul 27 17:28:01.261204 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:28:01.261089    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-40b85f95\"/\"kube-root-ca.crt\""
Jul 27 17:28:01.261329 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:28:01.261310    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-40b85f95\"/\"default-dockercfg-95l2n\""
Jul 27 17:28:01.273150 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:28:01.273130    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-router-schedttr7j"]
Jul 27 17:28:01.297318 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:28:01.297297    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:28:01.362546 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:28:01.362513    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/75fda2fd-2773-431a-af74-6648f2e54ac0-tls-certs\") pod \"scheduler-v06-threshold-migration-test-kserve-router-schedttr7j\" (UID: \"75fda2fd-2773-431a-af74-6648f2e54ac0\") " pod="e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-router-schedttr7j"
Jul 27 17:28:01.362711 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:28:01.362591    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6p444\" (UniqueName: \"kubernetes.io/projected/75fda2fd-2773-431a-af74-6648f2e54ac0-kube-api-access-6p444\") pod \"scheduler-v06-threshold-migration-test-kserve-router-schedttr7j\" (UID: \"75fda2fd-2773-431a-af74-6648f2e54ac0\") " pod="e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-router-schedttr7j"
Jul 27 17:28:01.463540 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:28:01.463513    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6p444\" (UniqueName: \"kubernetes.io/projected/75fda2fd-2773-431a-af74-6648f2e54ac0-kube-api-access-6p444\") pod \"scheduler-v06-threshold-migration-test-kserve-router-schedttr7j\" (UID: \"75fda2fd-2773-431a-af74-6648f2e54ac0\") " pod="e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-router-schedttr7j"
Jul 27 17:28:01.463688 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:28:01.463585    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/75fda2fd-2773-431a-af74-6648f2e54ac0-tls-certs\") pod \"scheduler-v06-threshold-migration-test-kserve-router-schedttr7j\" (UID: \"75fda2fd-2773-431a-af74-6648f2e54ac0\") " pod="e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-router-schedttr7j"
Jul 27 17:28:01.465845 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:28:01.465806    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/75fda2fd-2773-431a-af74-6648f2e54ac0-tls-certs\") pod \"scheduler-v06-threshold-migration-test-kserve-router-schedttr7j\" (UID: \"75fda2fd-2773-431a-af74-6648f2e54ac0\") " pod="e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-router-schedttr7j"
Jul 27 17:28:01.471212 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:28:01.471191    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6p444\" (UniqueName: \"kubernetes.io/projected/75fda2fd-2773-431a-af74-6648f2e54ac0-kube-api-access-6p444\") pod \"scheduler-v06-threshold-migration-test-kserve-router-schedttr7j\" (UID: \"75fda2fd-2773-431a-af74-6648f2e54ac0\") " pod="e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-router-schedttr7j"
Jul 27 17:28:01.571365 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:28:01.571322    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-router-schedttr7j"
Jul 27 17:28:01.701203 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:28:01.701178    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-router-schedttr7j"]
Jul 27 17:28:01.703354 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:28:01.703324    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75fda2fd_2773_431a_af74_6648f2e54ac0.slice/crio-0f56399def63d37e0c0c2d1c1788d8cdab88be2fe8abada96c632a64242476f6 WatchSource:0}: Error finding container 0f56399def63d37e0c0c2d1c1788d8cdab88be2fe8abada96c632a64242476f6: Status 404 returned error can't find the container with id 0f56399def63d37e0c0c2d1c1788d8cdab88be2fe8abada96c632a64242476f6
Jul 27 17:28:02.062060 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:28:02.061979    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:28:02.279515 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:28:02.279479    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-router-schedttr7j" event={"ID":"75fda2fd-2773-431a-af74-6648f2e54ac0","Type":"ContainerStarted","Data":"c8912ed89f405a23c577997791d06937789e19b27dcbbe0d9f5ed07c596b0098"}
Jul 27 17:28:02.279917 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:28:02.279543    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-router-schedttr7j" event={"ID":"75fda2fd-2773-431a-af74-6648f2e54ac0","Type":"ContainerStarted","Data":"0f56399def63d37e0c0c2d1c1788d8cdab88be2fe8abada96c632a64242476f6"}
Jul 27 17:28:02.279917 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:28:02.279663    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-router-schedttr7j"
Jul 27 17:28:02.297064 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:28:02.296785    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-router-schedttr7j" podStartSLOduration=1.2967642750000001 podStartE2EDuration="1.296764275s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:28:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:28:02.296522089 +0000 UTC m=+1595.493266895" watchObservedRunningTime="2026-07-27 17:28:02.296764275 +0000 UTC m=+1595.493509074"
Jul 27 17:28:07.570359 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:28:07.570325    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:28:07.670669 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:28:07.670632    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:28:17.038210 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:28:17.038170    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:28:27.528289 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:28:27.528258    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:28:33.284865 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:28:33.284814    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-router-schedttr7j"
Jul 27 17:28:34.821628 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:28:34.821595    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:28:34.835175 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:28:34.835146    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-router-schedttr7j"]
Jul 27 17:28:34.916392 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:28:34.916361    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:28:43.285518 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:28:43.285472    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-router-schedttr7j" podUID="75fda2fd-2773-431a-af74-6648f2e54ac0" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Jul 27 17:28:49.857427 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:28:49.857365    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-router-schedttr7j" podUID="75fda2fd-2773-431a-af74-6648f2e54ac0" containerName="main" containerID="cri-o://c8912ed89f405a23c577997791d06937789e19b27dcbbe0d9f5ed07c596b0098" gracePeriod=45
Jul 27 17:28:50.113555 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:28:50.113498    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-router-schedttr7j"
Jul 27 17:28:50.289869 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:28:50.289817    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6p444\" (UniqueName: \"kubernetes.io/projected/75fda2fd-2773-431a-af74-6648f2e54ac0-kube-api-access-6p444\") pod \"75fda2fd-2773-431a-af74-6648f2e54ac0\" (UID: \"75fda2fd-2773-431a-af74-6648f2e54ac0\") "
Jul 27 17:28:50.290045 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:28:50.289948    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/75fda2fd-2773-431a-af74-6648f2e54ac0-tls-certs\") pod \"75fda2fd-2773-431a-af74-6648f2e54ac0\" (UID: \"75fda2fd-2773-431a-af74-6648f2e54ac0\") "
Jul 27 17:28:50.292093 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:28:50.292059    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75fda2fd-2773-431a-af74-6648f2e54ac0-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "75fda2fd-2773-431a-af74-6648f2e54ac0" (UID: "75fda2fd-2773-431a-af74-6648f2e54ac0"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 17:28:50.292197 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:28:50.292068    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75fda2fd-2773-431a-af74-6648f2e54ac0-kube-api-access-6p444" (OuterVolumeSpecName: "kube-api-access-6p444") pod "75fda2fd-2773-431a-af74-6648f2e54ac0" (UID: "75fda2fd-2773-431a-af74-6648f2e54ac0"). InnerVolumeSpecName "kube-api-access-6p444". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 17:28:50.390521 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:28:50.390437    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/75fda2fd-2773-431a-af74-6648f2e54ac0-tls-certs\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 27 17:28:50.390521 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:28:50.390466    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6p444\" (UniqueName: \"kubernetes.io/projected/75fda2fd-2773-431a-af74-6648f2e54ac0-kube-api-access-6p444\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 27 17:28:50.498706 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:28:50.498669    2580 generic.go:356] "Generic (PLEG): container finished" podID="75fda2fd-2773-431a-af74-6648f2e54ac0" containerID="c8912ed89f405a23c577997791d06937789e19b27dcbbe0d9f5ed07c596b0098" exitCode=0
Jul 27 17:28:50.498890 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:28:50.498715    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-router-schedttr7j"
Jul 27 17:28:50.498890 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:28:50.498752    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-router-schedttr7j" event={"ID":"75fda2fd-2773-431a-af74-6648f2e54ac0","Type":"ContainerDied","Data":"c8912ed89f405a23c577997791d06937789e19b27dcbbe0d9f5ed07c596b0098"}
Jul 27 17:28:50.498890 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:28:50.498807    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-router-schedttr7j" event={"ID":"75fda2fd-2773-431a-af74-6648f2e54ac0","Type":"ContainerDied","Data":"0f56399def63d37e0c0c2d1c1788d8cdab88be2fe8abada96c632a64242476f6"}
Jul 27 17:28:50.498890 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:28:50.498842    2580 scope.go:117] "RemoveContainer" containerID="c8912ed89f405a23c577997791d06937789e19b27dcbbe0d9f5ed07c596b0098"
Jul 27 17:28:50.509509 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:28:50.509482    2580 scope.go:117] "RemoveContainer" containerID="c8912ed89f405a23c577997791d06937789e19b27dcbbe0d9f5ed07c596b0098"
Jul 27 17:28:50.509780 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:28:50.509756    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c8912ed89f405a23c577997791d06937789e19b27dcbbe0d9f5ed07c596b0098\": container with ID starting with c8912ed89f405a23c577997791d06937789e19b27dcbbe0d9f5ed07c596b0098 not found: ID does not exist" containerID="c8912ed89f405a23c577997791d06937789e19b27dcbbe0d9f5ed07c596b0098"
Jul 27 17:28:50.509900 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:28:50.509786    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c8912ed89f405a23c577997791d06937789e19b27dcbbe0d9f5ed07c596b0098"} err="failed to get container status \"c8912ed89f405a23c577997791d06937789e19b27dcbbe0d9f5ed07c596b0098\": rpc error: code = NotFound desc = could not find container \"c8912ed89f405a23c577997791d06937789e19b27dcbbe0d9f5ed07c596b0098\": container with ID starting with c8912ed89f405a23c577997791d06937789e19b27dcbbe0d9f5ed07c596b0098 not found: ID does not exist"
Jul 27 17:28:50.520889 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:28:50.520866    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-router-schedttr7j"]
Jul 27 17:28:50.526229 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:28:50.526209    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-inference-service-40b85f95/scheduler-v06-threshold-migration-test-kserve-router-schedttr7j"]
Jul 27 17:28:51.270866 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:28:51.270811    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="75fda2fd-2773-431a-af74-6648f2e54ac0" path="/var/lib/kubelet/pods/75fda2fd-2773-431a-af74-6648f2e54ac0/volumes"
Jul 27 17:28:54.855162 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:28:54.855128    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:28:56.227193 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:28:56.227151    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:29:01.028216 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:29:01.028183    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:29:06.474877 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:29:06.474825    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:29:06.580615 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:29:06.580580    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:29:06.797896 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:29:06.797804    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:29:07.045043 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:29:07.045013    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:29:07.105497 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:29:07.105470    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:29:34.508863 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:29:34.508804    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:30:28.575783 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:30:28.575750    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:30:28.673482 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:30:28.673449    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:30:48.475009 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:30:48.474975    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:30:48.567403 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:30:48.567377    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:30:54.475103 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:30:54.475067    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:30:59.914079 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:30:59.914049    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:30:59.974281 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:30:59.974249    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:31:07.765567 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:31:07.765536    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:31:07.984631 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:31:07.984588    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:31:08.049561 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:31:08.049494    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:31:19.135497 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:31:19.135418    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:31:29.941318 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:31:29.941263    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:31:51.024661 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:31:51.024629    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:31:51.122158 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:31:51.122125    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:32:11.052867 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:32:11.052818    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:32:11.209090 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:32:11.209055    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:32:17.194781 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:32:17.194747    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:32:22.319326 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:32:22.319294    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:32:22.518650 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:32:22.518619    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:32:23.488665 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:32:23.488637    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:32:23.594153 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:32:23.594120    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:32:35.225587 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:32:35.225550    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:32:56.219656 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:32:56.219622    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:32:56.320469 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:32:56.320435    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:33:16.254367 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:33:16.254329    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:33:16.353134 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:33:16.353098    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:33:22.165527 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:33:22.165493    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:33:23.221172 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:33:23.221141    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:33:23.420228 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:33:23.420189    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:33:27.748483 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:33:27.748447    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:33:27.836907 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:33:27.836876    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:33:33.386853 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:33:33.386806    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:34:07.725520 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:34:07.725482    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:34:07.900925 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:34:07.900890    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schedkds8"]
Jul 27 17:34:07.901249 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:34:07.901237    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75fda2fd-2773-431a-af74-6648f2e54ac0" containerName="main"
Jul 27 17:34:07.901294 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:34:07.901251    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="75fda2fd-2773-431a-af74-6648f2e54ac0" containerName="main"
Jul 27 17:34:07.901328 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:34:07.901310    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="75fda2fd-2773-431a-af74-6648f2e54ac0" containerName="main"
Jul 27 17:34:07.904353 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:34:07.904333    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schedkds8"
Jul 27 17:34:07.906985 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:34:07.906963    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-84370a53\"/\"kube-root-ca.crt\""
Jul 27 17:34:07.907854 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:34:07.907820    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-84370a53\"/\"openshift-service-ca.crt\""
Jul 27 17:34:07.907973 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:34:07.907866    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-84370a53\"/\"llmisvb11a9c9832b99b016bc8f8e0ea095712-kserve-self-signed-certs\""
Jul 27 17:34:07.907973 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:34:07.907891    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-84370a53\"/\"llmisvc-model-qwen2-5-0-5b-rout-a50492e9-epp-sa-dockercfg-vhr4x\""
Jul 27 17:34:07.907973 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:34:07.907876    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-84370a53\"/\"default-dockercfg-9lqrd\""
Jul 27 17:34:07.912727 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:34:07.912708    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schedkds8"]
Jul 27 17:34:07.993771 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:34:07.993703    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7gg6\" (UniqueName: \"kubernetes.io/projected/d01b4902-a23c-4b04-bad9-04d92b0f903f-kube-api-access-x7gg6\") pod \"llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schedkds8\" (UID: \"d01b4902-a23c-4b04-bad9-04d92b0f903f\") " pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schedkds8"
Jul 27 17:34:07.993771 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:34:07.993739    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d01b4902-a23c-4b04-bad9-04d92b0f903f-tls-certs\") pod \"llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schedkds8\" (UID: \"d01b4902-a23c-4b04-bad9-04d92b0f903f\") " pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schedkds8"
Jul 27 17:34:08.094972 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:34:08.094939    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7gg6\" (UniqueName: \"kubernetes.io/projected/d01b4902-a23c-4b04-bad9-04d92b0f903f-kube-api-access-x7gg6\") pod \"llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schedkds8\" (UID: \"d01b4902-a23c-4b04-bad9-04d92b0f903f\") " pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schedkds8"
Jul 27 17:34:08.095121 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:34:08.094980    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d01b4902-a23c-4b04-bad9-04d92b0f903f-tls-certs\") pod \"llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schedkds8\" (UID: \"d01b4902-a23c-4b04-bad9-04d92b0f903f\") " pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schedkds8"
Jul 27 17:34:08.097440 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:34:08.097421    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d01b4902-a23c-4b04-bad9-04d92b0f903f-tls-certs\") pod \"llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schedkds8\" (UID: \"d01b4902-a23c-4b04-bad9-04d92b0f903f\") " pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schedkds8"
Jul 27 17:34:08.103694 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:34:08.103670    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7gg6\" (UniqueName: \"kubernetes.io/projected/d01b4902-a23c-4b04-bad9-04d92b0f903f-kube-api-access-x7gg6\") pod \"llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schedkds8\" (UID: \"d01b4902-a23c-4b04-bad9-04d92b0f903f\") " pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schedkds8"
Jul 27 17:34:08.215852 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:34:08.215808    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schedkds8"
Jul 27 17:34:08.344450 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:34:08.344427    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schedkds8"]
Jul 27 17:34:08.346334 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:34:08.346308    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd01b4902_a23c_4b04_bad9_04d92b0f903f.slice/crio-74dec783a00147165695f951934b8cb6e0150cbec97f8992981242d8616f300d WatchSource:0}: Error finding container 74dec783a00147165695f951934b8cb6e0150cbec97f8992981242d8616f300d: Status 404 returned error can't find the container with id 74dec783a00147165695f951934b8cb6e0150cbec97f8992981242d8616f300d
Jul 27 17:34:08.960109 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:34:08.960075    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schedkds8" event={"ID":"d01b4902-a23c-4b04-bad9-04d92b0f903f","Type":"ContainerStarted","Data":"ab0297fdad7d31aa9116e701f88b018132a6e8f9df865fb12e3fc302967ade6b"}
Jul 27 17:34:08.960523 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:34:08.960149    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schedkds8" event={"ID":"d01b4902-a23c-4b04-bad9-04d92b0f903f","Type":"ContainerStarted","Data":"74dec783a00147165695f951934b8cb6e0150cbec97f8992981242d8616f300d"}
Jul 27 17:34:08.960523 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:34:08.960178    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schedkds8"
Jul 27 17:34:08.978377 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:34:08.978331    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schedkds8" podStartSLOduration=1.978311151 podStartE2EDuration="1.978311151s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:34:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:34:08.976413547 +0000 UTC m=+1962.173158350" watchObservedRunningTime="2026-07-27 17:34:08.978311151 +0000 UTC m=+1962.175055949"
Jul 27 17:34:09.623049 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:34:09.623014    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:34:18.685501 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:34:18.685467    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:34:39.966345 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:34:39.966317    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schedkds8"
Jul 27 17:34:41.217715 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:34:41.217676    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schedkds8"]
Jul 27 17:34:41.310471 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:34:41.310435    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:34:42.199546 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:34:42.199515    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:34:49.966706 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:34:49.966668    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schedkds8" podUID="d01b4902-a23c-4b04-bad9-04d92b0f903f" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Jul 27 17:34:56.239304 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:34:56.239257    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schedkds8" podUID="d01b4902-a23c-4b04-bad9-04d92b0f903f" containerName="main" containerID="cri-o://ab0297fdad7d31aa9116e701f88b018132a6e8f9df865fb12e3fc302967ade6b" gracePeriod=45
Jul 27 17:34:56.495478 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:34:56.495419    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schedkds8"
Jul 27 17:34:56.614129 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:34:56.614100    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d01b4902-a23c-4b04-bad9-04d92b0f903f-tls-certs\") pod \"d01b4902-a23c-4b04-bad9-04d92b0f903f\" (UID: \"d01b4902-a23c-4b04-bad9-04d92b0f903f\") "
Jul 27 17:34:56.614331 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:34:56.614170    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x7gg6\" (UniqueName: \"kubernetes.io/projected/d01b4902-a23c-4b04-bad9-04d92b0f903f-kube-api-access-x7gg6\") pod \"d01b4902-a23c-4b04-bad9-04d92b0f903f\" (UID: \"d01b4902-a23c-4b04-bad9-04d92b0f903f\") "
Jul 27 17:34:56.616379 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:34:56.616349    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d01b4902-a23c-4b04-bad9-04d92b0f903f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d01b4902-a23c-4b04-bad9-04d92b0f903f" (UID: "d01b4902-a23c-4b04-bad9-04d92b0f903f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 17:34:56.616492 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:34:56.616349    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d01b4902-a23c-4b04-bad9-04d92b0f903f-kube-api-access-x7gg6" (OuterVolumeSpecName: "kube-api-access-x7gg6") pod "d01b4902-a23c-4b04-bad9-04d92b0f903f" (UID: "d01b4902-a23c-4b04-bad9-04d92b0f903f"). InnerVolumeSpecName "kube-api-access-x7gg6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 17:34:56.715141 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:34:56.715115    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d01b4902-a23c-4b04-bad9-04d92b0f903f-tls-certs\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 27 17:34:56.715141 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:34:56.715140    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x7gg6\" (UniqueName: \"kubernetes.io/projected/d01b4902-a23c-4b04-bad9-04d92b0f903f-kube-api-access-x7gg6\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 27 17:34:56.793022 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:34:56.792946    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:34:57.182473 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:34:57.182439    2580 generic.go:356] "Generic (PLEG): container finished" podID="d01b4902-a23c-4b04-bad9-04d92b0f903f" containerID="ab0297fdad7d31aa9116e701f88b018132a6e8f9df865fb12e3fc302967ade6b" exitCode=0
Jul 27 17:34:57.182672 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:34:57.182493    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schedkds8"
Jul 27 17:34:57.182672 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:34:57.182530    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schedkds8" event={"ID":"d01b4902-a23c-4b04-bad9-04d92b0f903f","Type":"ContainerDied","Data":"ab0297fdad7d31aa9116e701f88b018132a6e8f9df865fb12e3fc302967ade6b"}
Jul 27 17:34:57.182672 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:34:57.182584    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schedkds8" event={"ID":"d01b4902-a23c-4b04-bad9-04d92b0f903f","Type":"ContainerDied","Data":"74dec783a00147165695f951934b8cb6e0150cbec97f8992981242d8616f300d"}
Jul 27 17:34:57.182672 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:34:57.182606    2580 scope.go:117] "RemoveContainer" containerID="ab0297fdad7d31aa9116e701f88b018132a6e8f9df865fb12e3fc302967ade6b"
Jul 27 17:34:57.192212 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:34:57.192184    2580 scope.go:117] "RemoveContainer" containerID="ab0297fdad7d31aa9116e701f88b018132a6e8f9df865fb12e3fc302967ade6b"
Jul 27 17:34:57.192559 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:34:57.192531    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ab0297fdad7d31aa9116e701f88b018132a6e8f9df865fb12e3fc302967ade6b\": container with ID starting with ab0297fdad7d31aa9116e701f88b018132a6e8f9df865fb12e3fc302967ade6b not found: ID does not exist" containerID="ab0297fdad7d31aa9116e701f88b018132a6e8f9df865fb12e3fc302967ade6b"
Jul 27 17:34:57.192663 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:34:57.192568    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab0297fdad7d31aa9116e701f88b018132a6e8f9df865fb12e3fc302967ade6b"} err="failed to get container status \"ab0297fdad7d31aa9116e701f88b018132a6e8f9df865fb12e3fc302967ade6b\": rpc error: code = NotFound desc = could not find container \"ab0297fdad7d31aa9116e701f88b018132a6e8f9df865fb12e3fc302967ade6b\": container with ID starting with ab0297fdad7d31aa9116e701f88b018132a6e8f9df865fb12e3fc302967ade6b not found: ID does not exist"
Jul 27 17:34:57.204608 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:34:57.204586    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schedkds8"]
Jul 27 17:34:57.209406 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:34:57.209385    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schedkds8"]
Jul 27 17:34:57.270825 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:34:57.270800    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d01b4902-a23c-4b04-bad9-04d92b0f903f" path="/var/lib/kubelet/pods/d01b4902-a23c-4b04-bad9-04d92b0f903f/volumes"
Jul 27 17:35:01.367095 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:35:01.367059    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:35:01.427977 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:35:01.427950    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:35:21.443989 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:35:21.443959    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:35:21.537871 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:35:21.537826    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:35:27.504237 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:35:27.504198    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:35:33.101748 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:35:33.101689    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:35:33.311404 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:35:33.311367    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:35:40.877471 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:35:40.877431    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:35:41.761787 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:35:41.761751    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:35:52.587704 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:35:52.587613    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:36:24.626383 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:36:24.626349    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:36:24.827704 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:36:24.827672    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schesqmd4"]
Jul 27 17:36:24.828116 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:36:24.828097    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d01b4902-a23c-4b04-bad9-04d92b0f903f" containerName="main"
Jul 27 17:36:24.828116 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:36:24.828117    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="d01b4902-a23c-4b04-bad9-04d92b0f903f" containerName="main"
Jul 27 17:36:24.828278 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:36:24.828228    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="d01b4902-a23c-4b04-bad9-04d92b0f903f" containerName="main"
Jul 27 17:36:24.831275 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:36:24.831254    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schesqmd4"
Jul 27 17:36:24.834763 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:36:24.834740    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-62fead0b\"/\"default-dockercfg-cstzn\""
Jul 27 17:36:24.834902 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:36:24.834740    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-62fead0b\"/\"llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-epp-sa-dockercfg-dtpzq\""
Jul 27 17:36:24.834902 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:36:24.834784    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-62fead0b\"/\"llmisv08544b88a8d963ffd553cc1f3ed82d16-kserve-self-signed-certs\""
Jul 27 17:36:24.834902 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:36:24.834785    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-62fead0b\"/\"openshift-service-ca.crt\""
Jul 27 17:36:24.834902 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:36:24.834873    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-62fead0b\"/\"kube-root-ca.crt\""
Jul 27 17:36:24.840076 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:36:24.840057    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schesqmd4"]
Jul 27 17:36:24.852535 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:36:24.852510    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:36:24.870809 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:36:24.870788    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/32866324-5edd-4d6d-9e5c-aa5d088c5a97-tls-certs\") pod \"llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schesqmd4\" (UID: \"32866324-5edd-4d6d-9e5c-aa5d088c5a97\") " pod="e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schesqmd4"
Jul 27 17:36:24.870927 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:36:24.870874    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmwph\" (UniqueName: \"kubernetes.io/projected/32866324-5edd-4d6d-9e5c-aa5d088c5a97-kube-api-access-jmwph\") pod \"llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schesqmd4\" (UID: \"32866324-5edd-4d6d-9e5c-aa5d088c5a97\") " pod="e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schesqmd4"
Jul 27 17:36:24.971912 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:36:24.971810    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/32866324-5edd-4d6d-9e5c-aa5d088c5a97-tls-certs\") pod \"llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schesqmd4\" (UID: \"32866324-5edd-4d6d-9e5c-aa5d088c5a97\") " pod="e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schesqmd4"
Jul 27 17:36:24.971912 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:36:24.971901    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jmwph\" (UniqueName: \"kubernetes.io/projected/32866324-5edd-4d6d-9e5c-aa5d088c5a97-kube-api-access-jmwph\") pod \"llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schesqmd4\" (UID: \"32866324-5edd-4d6d-9e5c-aa5d088c5a97\") " pod="e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schesqmd4"
Jul 27 17:36:24.974484 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:36:24.974461    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/32866324-5edd-4d6d-9e5c-aa5d088c5a97-tls-certs\") pod \"llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schesqmd4\" (UID: \"32866324-5edd-4d6d-9e5c-aa5d088c5a97\") " pod="e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schesqmd4"
Jul 27 17:36:24.979529 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:36:24.979506    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmwph\" (UniqueName: \"kubernetes.io/projected/32866324-5edd-4d6d-9e5c-aa5d088c5a97-kube-api-access-jmwph\") pod \"llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schesqmd4\" (UID: \"32866324-5edd-4d6d-9e5c-aa5d088c5a97\") " pod="e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schesqmd4"
Jul 27 17:36:25.142260 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:36:25.142230    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schesqmd4"
Jul 27 17:36:25.272068 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:36:25.272047    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schesqmd4"]
Jul 27 17:36:25.274050 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:36:25.274021    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32866324_5edd_4d6d_9e5c_aa5d088c5a97.slice/crio-cffec814eb41655bdac325fa07862dd7acf9620f13f21fd661c00206508aad18 WatchSource:0}: Error finding container cffec814eb41655bdac325fa07862dd7acf9620f13f21fd661c00206508aad18: Status 404 returned error can't find the container with id cffec814eb41655bdac325fa07862dd7acf9620f13f21fd661c00206508aad18
Jul 27 17:36:25.590132 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:36:25.590047    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schesqmd4" event={"ID":"32866324-5edd-4d6d-9e5c-aa5d088c5a97","Type":"ContainerStarted","Data":"d74c0ab524a932c99161a7e786acbb4c1a616e664ba1defca5eab770bc483d1a"}
Jul 27 17:36:25.590132 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:36:25.590100    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schesqmd4" event={"ID":"32866324-5edd-4d6d-9e5c-aa5d088c5a97","Type":"ContainerStarted","Data":"cffec814eb41655bdac325fa07862dd7acf9620f13f21fd661c00206508aad18"}
Jul 27 17:36:25.590331 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:36:25.590173    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schesqmd4"
Jul 27 17:36:25.605954 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:36:25.605901    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schesqmd4" podStartSLOduration=1.605886248 podStartE2EDuration="1.605886248s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:36:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:36:25.605152611 +0000 UTC m=+2098.801897426" watchObservedRunningTime="2026-07-27 17:36:25.605886248 +0000 UTC m=+2098.802631050"
Jul 27 17:36:28.694013 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:36:28.693975    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:36:34.768426 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:36:34.768368    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:36:56.596468 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:36:56.596437    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schesqmd4"
Jul 27 17:36:57.997048 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:36:57.997015    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schesqmd4"]
Jul 27 17:36:58.001438 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:36:58.001406    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:36:58.061226 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:36:58.061185    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:37:06.596424 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:37:06.596385    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schesqmd4" podUID="32866324-5edd-4d6d-9e5c-aa5d088c5a97" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Jul 27 17:37:13.016982 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:37:13.016906    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schesqmd4" podUID="32866324-5edd-4d6d-9e5c-aa5d088c5a97" containerName="main" containerID="cri-o://d74c0ab524a932c99161a7e786acbb4c1a616e664ba1defca5eab770bc483d1a" gracePeriod=45
Jul 27 17:37:13.267417 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:37:13.267357    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schesqmd4"
Jul 27 17:37:13.300637 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:37:13.300607    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/32866324-5edd-4d6d-9e5c-aa5d088c5a97-tls-certs\") pod \"32866324-5edd-4d6d-9e5c-aa5d088c5a97\" (UID: \"32866324-5edd-4d6d-9e5c-aa5d088c5a97\") "
Jul 27 17:37:13.300779 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:37:13.300677    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jmwph\" (UniqueName: \"kubernetes.io/projected/32866324-5edd-4d6d-9e5c-aa5d088c5a97-kube-api-access-jmwph\") pod \"32866324-5edd-4d6d-9e5c-aa5d088c5a97\" (UID: \"32866324-5edd-4d6d-9e5c-aa5d088c5a97\") "
Jul 27 17:37:13.302874 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:37:13.302823    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/32866324-5edd-4d6d-9e5c-aa5d088c5a97-kube-api-access-jmwph" (OuterVolumeSpecName: "kube-api-access-jmwph") pod "32866324-5edd-4d6d-9e5c-aa5d088c5a97" (UID: "32866324-5edd-4d6d-9e5c-aa5d088c5a97"). InnerVolumeSpecName "kube-api-access-jmwph". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 17:37:13.302874 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:37:13.302858    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/32866324-5edd-4d6d-9e5c-aa5d088c5a97-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "32866324-5edd-4d6d-9e5c-aa5d088c5a97" (UID: "32866324-5edd-4d6d-9e5c-aa5d088c5a97"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 17:37:13.401815 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:37:13.401769    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/32866324-5edd-4d6d-9e5c-aa5d088c5a97-tls-certs\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 27 17:37:13.401815 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:37:13.401809    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jmwph\" (UniqueName: \"kubernetes.io/projected/32866324-5edd-4d6d-9e5c-aa5d088c5a97-kube-api-access-jmwph\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 27 17:37:13.816746 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:37:13.816710    2580 generic.go:356] "Generic (PLEG): container finished" podID="32866324-5edd-4d6d-9e5c-aa5d088c5a97" containerID="d74c0ab524a932c99161a7e786acbb4c1a616e664ba1defca5eab770bc483d1a" exitCode=0
Jul 27 17:37:13.816945 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:37:13.816752    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schesqmd4"
Jul 27 17:37:13.816945 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:37:13.816786    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schesqmd4" event={"ID":"32866324-5edd-4d6d-9e5c-aa5d088c5a97","Type":"ContainerDied","Data":"d74c0ab524a932c99161a7e786acbb4c1a616e664ba1defca5eab770bc483d1a"}
Jul 27 17:37:13.816945 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:37:13.816856    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schesqmd4" event={"ID":"32866324-5edd-4d6d-9e5c-aa5d088c5a97","Type":"ContainerDied","Data":"cffec814eb41655bdac325fa07862dd7acf9620f13f21fd661c00206508aad18"}
Jul 27 17:37:13.816945 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:37:13.816879    2580 scope.go:117] "RemoveContainer" containerID="d74c0ab524a932c99161a7e786acbb4c1a616e664ba1defca5eab770bc483d1a"
Jul 27 17:37:13.825692 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:37:13.825679    2580 scope.go:117] "RemoveContainer" containerID="d74c0ab524a932c99161a7e786acbb4c1a616e664ba1defca5eab770bc483d1a"
Jul 27 17:37:13.825977 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:37:13.825957    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d74c0ab524a932c99161a7e786acbb4c1a616e664ba1defca5eab770bc483d1a\": container with ID starting with d74c0ab524a932c99161a7e786acbb4c1a616e664ba1defca5eab770bc483d1a not found: ID does not exist" containerID="d74c0ab524a932c99161a7e786acbb4c1a616e664ba1defca5eab770bc483d1a"
Jul 27 17:37:13.826033 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:37:13.825984    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d74c0ab524a932c99161a7e786acbb4c1a616e664ba1defca5eab770bc483d1a"} err="failed to get container status \"d74c0ab524a932c99161a7e786acbb4c1a616e664ba1defca5eab770bc483d1a\": rpc error: code = NotFound desc = could not find container \"d74c0ab524a932c99161a7e786acbb4c1a616e664ba1defca5eab770bc483d1a\": container with ID starting with d74c0ab524a932c99161a7e786acbb4c1a616e664ba1defca5eab770bc483d1a not found: ID does not exist"
Jul 27 17:37:13.838397 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:37:13.838374    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schesqmd4"]
Jul 27 17:37:13.840811 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:37:13.840792    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schesqmd4"]
Jul 27 17:37:15.270658 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:37:15.270617    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="32866324-5edd-4d6d-9e5c-aa5d088c5a97" path="/var/lib/kubelet/pods/32866324-5edd-4d6d-9e5c-aa5d088c5a97/volumes"
Jul 27 17:37:18.133079 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:37:18.133045    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:37:18.191995 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:37:18.191962    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:37:38.208739 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:37:38.208706    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:37:38.301901 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:37:38.301869    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:37:41.430932 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:37:41.430900    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:37:41.649794 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:37:41.649761    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:37:44.803389 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:37:44.803355    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:37:48.713227 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:37:48.713191    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:37:50.347531 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:37:50.347496    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:37:50.445117 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:37:50.445086    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:38:10.616558 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:38:10.616522    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:39:37.650531 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:39:37.650490    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:39:57.600105 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:39:57.600068    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:39:57.709697 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:39:57.709646    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:40:03.652686 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:40:03.652636    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:40:05.046175 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:40:05.046143    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:40:05.332381 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:40:05.332289    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:40:10.469474 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:40:10.469439    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:40:10.570146 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:40:10.570109    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:40:15.206087 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:40:15.206045    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:40:25.244774 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:40:25.244699    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:41:00.028982 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:41:00.028947    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-autoscaling-hpa-deployment-9ba6f3f4/autoscale-hpa-deploy-kserve-router-scheduler-94df769b6-d6x2d"]
Jul 27 17:41:00.048434 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:41:00.048399    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:41:00.111020 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:41:00.110985    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:41:00.864438 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:41:00.864403    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-autoscaling-hpa-deployment-9ba6f3f4/autoscale-hpa-deploy-kserve-router-scheduler-94df769b6-d6x2d" podUID="9197ee24-45bf-42f5-873c-4f3a6e60351c" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Jul 27 17:41:10.864220 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:41:10.864181    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-autoscaling-hpa-deployment-9ba6f3f4/autoscale-hpa-deploy-kserve-router-scheduler-94df769b6-d6x2d" podUID="9197ee24-45bf-42f5-873c-4f3a6e60351c" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Jul 27 17:41:15.049819 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:41:15.049764    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-test-llm-autoscaling-hpa-deployment-9ba6f3f4/autoscale-hpa-deploy-kserve-router-scheduler-94df769b6-d6x2d" podUID="9197ee24-45bf-42f5-873c-4f3a6e60351c" containerName="main" containerID="cri-o://d2224f2839401ea4721a77deb88eab0fe5d861d2cdb050550abbf0760c4c2546" gracePeriod=45
Jul 27 17:41:15.310759 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:41:15.310687    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-autoscaling-hpa-deployment-9ba6f3f4/autoscale-hpa-deploy-kserve-router-scheduler-94df769b6-d6x2d"
Jul 27 17:41:15.438193 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:41:15.438159    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9197ee24-45bf-42f5-873c-4f3a6e60351c-tls-certs\") pod \"9197ee24-45bf-42f5-873c-4f3a6e60351c\" (UID: \"9197ee24-45bf-42f5-873c-4f3a6e60351c\") "
Jul 27 17:41:15.438371 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:41:15.438244    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z54tj\" (UniqueName: \"kubernetes.io/projected/9197ee24-45bf-42f5-873c-4f3a6e60351c-kube-api-access-z54tj\") pod \"9197ee24-45bf-42f5-873c-4f3a6e60351c\" (UID: \"9197ee24-45bf-42f5-873c-4f3a6e60351c\") "
Jul 27 17:41:15.440348 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:41:15.440319    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9197ee24-45bf-42f5-873c-4f3a6e60351c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "9197ee24-45bf-42f5-873c-4f3a6e60351c" (UID: "9197ee24-45bf-42f5-873c-4f3a6e60351c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 17:41:15.440488 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:41:15.440467    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9197ee24-45bf-42f5-873c-4f3a6e60351c-kube-api-access-z54tj" (OuterVolumeSpecName: "kube-api-access-z54tj") pod "9197ee24-45bf-42f5-873c-4f3a6e60351c" (UID: "9197ee24-45bf-42f5-873c-4f3a6e60351c"). InnerVolumeSpecName "kube-api-access-z54tj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 17:41:15.539148 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:41:15.539113    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z54tj\" (UniqueName: \"kubernetes.io/projected/9197ee24-45bf-42f5-873c-4f3a6e60351c-kube-api-access-z54tj\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 27 17:41:15.539148 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:41:15.539146    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9197ee24-45bf-42f5-873c-4f3a6e60351c-tls-certs\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 27 17:41:15.933447 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:41:15.933414    2580 generic.go:356] "Generic (PLEG): container finished" podID="9197ee24-45bf-42f5-873c-4f3a6e60351c" containerID="d2224f2839401ea4721a77deb88eab0fe5d861d2cdb050550abbf0760c4c2546" exitCode=0
Jul 27 17:41:15.933618 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:41:15.933460    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-autoscaling-hpa-deployment-9ba6f3f4/autoscale-hpa-deploy-kserve-router-scheduler-94df769b6-d6x2d"
Jul 27 17:41:15.933618 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:41:15.933469    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-autoscaling-hpa-deployment-9ba6f3f4/autoscale-hpa-deploy-kserve-router-scheduler-94df769b6-d6x2d" event={"ID":"9197ee24-45bf-42f5-873c-4f3a6e60351c","Type":"ContainerDied","Data":"d2224f2839401ea4721a77deb88eab0fe5d861d2cdb050550abbf0760c4c2546"}
Jul 27 17:41:15.933618 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:41:15.933511    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-autoscaling-hpa-deployment-9ba6f3f4/autoscale-hpa-deploy-kserve-router-scheduler-94df769b6-d6x2d" event={"ID":"9197ee24-45bf-42f5-873c-4f3a6e60351c","Type":"ContainerDied","Data":"001e3f2d6ccec4a48aee6bfcd94fe061ae6dd13cea4a8087cbfcce869378a3bf"}
Jul 27 17:41:15.933618 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:41:15.933532    2580 scope.go:117] "RemoveContainer" containerID="d2224f2839401ea4721a77deb88eab0fe5d861d2cdb050550abbf0760c4c2546"
Jul 27 17:41:15.944325 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:41:15.944307    2580 scope.go:117] "RemoveContainer" containerID="d2224f2839401ea4721a77deb88eab0fe5d861d2cdb050550abbf0760c4c2546"
Jul 27 17:41:15.944607 ip-10-0-137-134 kubenswrapper[2580]: E0727 17:41:15.944585    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d2224f2839401ea4721a77deb88eab0fe5d861d2cdb050550abbf0760c4c2546\": container with ID starting with d2224f2839401ea4721a77deb88eab0fe5d861d2cdb050550abbf0760c4c2546 not found: ID does not exist" containerID="d2224f2839401ea4721a77deb88eab0fe5d861d2cdb050550abbf0760c4c2546"
Jul 27 17:41:15.944701 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:41:15.944614    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2224f2839401ea4721a77deb88eab0fe5d861d2cdb050550abbf0760c4c2546"} err="failed to get container status \"d2224f2839401ea4721a77deb88eab0fe5d861d2cdb050550abbf0760c4c2546\": rpc error: code = NotFound desc = could not find container \"d2224f2839401ea4721a77deb88eab0fe5d861d2cdb050550abbf0760c4c2546\": container with ID starting with d2224f2839401ea4721a77deb88eab0fe5d861d2cdb050550abbf0760c4c2546 not found: ID does not exist"
Jul 27 17:41:15.956981 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:41:15.956954    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-autoscaling-hpa-deployment-9ba6f3f4/autoscale-hpa-deploy-kserve-router-scheduler-94df769b6-d6x2d"]
Jul 27 17:41:15.960718 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:41:15.960694    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-autoscaling-hpa-deployment-9ba6f3f4/autoscale-hpa-deploy-kserve-router-scheduler-94df769b6-d6x2d"]
Jul 27 17:41:17.278054 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:41:17.278017    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9197ee24-45bf-42f5-873c-4f3a6e60351c" path="/var/lib/kubelet/pods/9197ee24-45bf-42f5-873c-4f3a6e60351c/volumes"
Jul 27 17:41:20.085680 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:41:20.085649    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:41:20.198107 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:41:20.198070    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:41:35.117631 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:41:35.117593    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:41:39.821931 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:41:39.821892    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:41:40.252455 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:41:40.252422    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-test-llm-autoscaling-keda-deployment-b2150d0b/autoscale-keda-deploy-kserve-router-scheduler-6499b6dbcf-r59fd"]
Jul 27 17:41:40.252782 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:41:40.252770    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32866324-5edd-4d6d-9e5c-aa5d088c5a97" containerName="main"
Jul 27 17:41:40.252852 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:41:40.252784    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="32866324-5edd-4d6d-9e5c-aa5d088c5a97" containerName="main"
Jul 27 17:41:40.252852 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:41:40.252795    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9197ee24-45bf-42f5-873c-4f3a6e60351c" containerName="main"
Jul 27 17:41:40.252852 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:41:40.252800    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="9197ee24-45bf-42f5-873c-4f3a6e60351c" containerName="main"
Jul 27 17:41:40.252955 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:41:40.252879    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="9197ee24-45bf-42f5-873c-4f3a6e60351c" containerName="main"
Jul 27 17:41:40.252955 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:41:40.252888    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="32866324-5edd-4d6d-9e5c-aa5d088c5a97" containerName="main"
Jul 27 17:41:40.255767 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:41:40.255750    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-autoscaling-keda-deployment-b2150d0b/autoscale-keda-deploy-kserve-router-scheduler-6499b6dbcf-r59fd"
Jul 27 17:41:40.258096 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:41:40.258072    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-autoscaling-keda-deployment-b2150d0b\"/\"default-dockercfg-bv4z2\""
Jul 27 17:41:40.258096 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:41:40.258056    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-autoscaling-keda-deployment-b2150d0b\"/\"kube-root-ca.crt\""
Jul 27 17:41:40.259038 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:41:40.259018    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-autoscaling-keda-deployment-b2150d0b\"/\"openshift-service-ca.crt\""
Jul 27 17:41:40.259115 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:41:40.259061    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-autoscaling-keda-deployment-b2150d0b\"/\"autoscale-keda-deploy-epp-sa-dockercfg-nt5kh\""
Jul 27 17:41:40.259115 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:41:40.259076    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-autoscaling-keda-deployment-b2150d0b\"/\"autoscale-keda-deploy-kserve-self-signed-certs\""
Jul 27 17:41:40.264090 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:41:40.264069    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-autoscaling-keda-deployment-b2150d0b/autoscale-keda-deploy-kserve-router-scheduler-6499b6dbcf-r59fd"]
Jul 27 17:41:40.280392 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:41:40.280359    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:41:40.338969 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:41:40.338931    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1430134d-1ef4-439b-bb24-31828d7c5e93-tls-certs\") pod \"autoscale-keda-deploy-kserve-router-scheduler-6499b6dbcf-r59fd\" (UID: \"1430134d-1ef4-439b-bb24-31828d7c5e93\") " pod="e2e-test-llm-autoscaling-keda-deployment-b2150d0b/autoscale-keda-deploy-kserve-router-scheduler-6499b6dbcf-r59fd"
Jul 27 17:41:40.339133 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:41:40.339045    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8v2rx\" (UniqueName: \"kubernetes.io/projected/1430134d-1ef4-439b-bb24-31828d7c5e93-kube-api-access-8v2rx\") pod \"autoscale-keda-deploy-kserve-router-scheduler-6499b6dbcf-r59fd\" (UID: \"1430134d-1ef4-439b-bb24-31828d7c5e93\") " pod="e2e-test-llm-autoscaling-keda-deployment-b2150d0b/autoscale-keda-deploy-kserve-router-scheduler-6499b6dbcf-r59fd"
Jul 27 17:41:40.440407 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:41:40.440369    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8v2rx\" (UniqueName: \"kubernetes.io/projected/1430134d-1ef4-439b-bb24-31828d7c5e93-kube-api-access-8v2rx\") pod \"autoscale-keda-deploy-kserve-router-scheduler-6499b6dbcf-r59fd\" (UID: \"1430134d-1ef4-439b-bb24-31828d7c5e93\") " pod="e2e-test-llm-autoscaling-keda-deployment-b2150d0b/autoscale-keda-deploy-kserve-router-scheduler-6499b6dbcf-r59fd"
Jul 27 17:41:40.440610 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:41:40.440524    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1430134d-1ef4-439b-bb24-31828d7c5e93-tls-certs\") pod \"autoscale-keda-deploy-kserve-router-scheduler-6499b6dbcf-r59fd\" (UID: \"1430134d-1ef4-439b-bb24-31828d7c5e93\") " pod="e2e-test-llm-autoscaling-keda-deployment-b2150d0b/autoscale-keda-deploy-kserve-router-scheduler-6499b6dbcf-r59fd"
Jul 27 17:41:40.443341 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:41:40.443314    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1430134d-1ef4-439b-bb24-31828d7c5e93-tls-certs\") pod \"autoscale-keda-deploy-kserve-router-scheduler-6499b6dbcf-r59fd\" (UID: \"1430134d-1ef4-439b-bb24-31828d7c5e93\") " pod="e2e-test-llm-autoscaling-keda-deployment-b2150d0b/autoscale-keda-deploy-kserve-router-scheduler-6499b6dbcf-r59fd"
Jul 27 17:41:40.448790 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:41:40.448761    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8v2rx\" (UniqueName: \"kubernetes.io/projected/1430134d-1ef4-439b-bb24-31828d7c5e93-kube-api-access-8v2rx\") pod \"autoscale-keda-deploy-kserve-router-scheduler-6499b6dbcf-r59fd\" (UID: \"1430134d-1ef4-439b-bb24-31828d7c5e93\") " pod="e2e-test-llm-autoscaling-keda-deployment-b2150d0b/autoscale-keda-deploy-kserve-router-scheduler-6499b6dbcf-r59fd"
Jul 27 17:41:40.567253 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:41:40.567153    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-autoscaling-keda-deployment-b2150d0b/autoscale-keda-deploy-kserve-router-scheduler-6499b6dbcf-r59fd"
Jul 27 17:41:40.707724 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:41:40.707698    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-autoscaling-keda-deployment-b2150d0b/autoscale-keda-deploy-kserve-router-scheduler-6499b6dbcf-r59fd"]
Jul 27 17:41:40.709948 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:41:40.709916    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1430134d_1ef4_439b_bb24_31828d7c5e93.slice/crio-a74683fc2681549ac4bf58376a8a5e248a67d4ffaa59deaeb814118aa6a9a370 WatchSource:0}: Error finding container a74683fc2681549ac4bf58376a8a5e248a67d4ffaa59deaeb814118aa6a9a370: Status 404 returned error can't find the container with id a74683fc2681549ac4bf58376a8a5e248a67d4ffaa59deaeb814118aa6a9a370
Jul 27 17:41:41.057009 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:41:41.056969    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-autoscaling-keda-deployment-b2150d0b/autoscale-keda-deploy-kserve-router-scheduler-6499b6dbcf-r59fd" event={"ID":"1430134d-1ef4-439b-bb24-31828d7c5e93","Type":"ContainerStarted","Data":"c5bba92b127a3384f0dbc6f95bcff2cecbd5a384e8adb82f0ae3f98452af8082"}
Jul 27 17:41:41.057496 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:41:41.057030    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-autoscaling-keda-deployment-b2150d0b/autoscale-keda-deploy-kserve-router-scheduler-6499b6dbcf-r59fd" event={"ID":"1430134d-1ef4-439b-bb24-31828d7c5e93","Type":"ContainerStarted","Data":"a74683fc2681549ac4bf58376a8a5e248a67d4ffaa59deaeb814118aa6a9a370"}
Jul 27 17:41:41.057496 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:41:41.057088    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-autoscaling-keda-deployment-b2150d0b/autoscale-keda-deploy-kserve-router-scheduler-6499b6dbcf-r59fd"
Jul 27 17:41:41.073922 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:41:41.073820    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-test-llm-autoscaling-keda-deployment-b2150d0b/autoscale-keda-deploy-kserve-router-scheduler-6499b6dbcf-r59fd" podStartSLOduration=1.07380384 podStartE2EDuration="1.07380384s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:41:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:41:41.073120698 +0000 UTC m=+2414.269865513" watchObservedRunningTime="2026-07-27 17:41:41.07380384 +0000 UTC m=+2414.270548642"
Jul 27 17:41:53.531512 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:41:53.531428    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:41:55.395116 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:41:55.395085    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:41:55.456344 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:41:55.456310    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:42:12.063264 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:42:12.063232    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-autoscaling-keda-deployment-b2150d0b/autoscale-keda-deploy-kserve-router-scheduler-6499b6dbcf-r59fd"
Jul 27 17:42:15.781232 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:42:15.781195    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:42:15.875549 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:42:15.875511    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:42:15.975709 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:42:15.975674    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:42:16.085999 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:42:16.085919    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:42:18.422405 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:42:18.422373    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:42:18.476572 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:42:18.476536    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:42:19.051762 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:42:19.051729    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:42:21.664569 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:42:21.664533    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:42:27.259385 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:42:27.259349    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:42:27.358083 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:42:27.358046    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:42:57.194864 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:42:57.194800    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:42:57.465076 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:42:57.464989    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:43:12.311209 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:43:12.311176    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:43:52.723119 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:43:52.723077    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:44:09.103307 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:44:09.103268    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:44:36.894032 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:44:36.893997    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:45:11.904058 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:45:11.904019    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:45:13.969525 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:45:13.969494    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:45:31.878451 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:45:31.878413    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:45:31.973916 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:45:31.973880    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:45:32.078694 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:45:32.078655    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:45:32.175893 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:45:32.175809    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:45:34.334926 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:45:34.334894    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:45:34.434854 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:45:34.434798    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:45:35.172520 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:45:35.172487    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:45:37.923816 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:45:37.923778    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:45:38.024768 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:45:38.024738    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:45:38.175134 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:45:38.175052    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:45:38.234358 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:45:38.234326    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:45:43.928146 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:45:43.928115    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:45:44.027286 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:45:44.027253    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:46:16.339230 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:46:16.339194    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:46:16.400412 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:46:16.400383    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:46:24.676168 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:46:24.676077    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:46:27.865047 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:46:27.865015    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:47:33.394974 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:47:33.394939    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:50:32.514896 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:50:32.514851    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:53:52.123928 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:53:52.123840    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:53:52.190906 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:53:52.190871    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:54:43.210077 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:54:43.210033    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:55:50.582104 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:55:50.582011    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:56:29.996996 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:56:29.996955    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-autoscaling-keda-deployment-b2150d0b/autoscale-keda-deploy-kserve-router-scheduler-6499b6dbcf-r59fd"]
Jul 27 17:56:30.997495 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:56:30.997459    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:56:31.099723 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:56:31.099689    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:56:32.063045 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:56:32.063004    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-autoscaling-keda-deployment-b2150d0b/autoscale-keda-deploy-kserve-router-scheduler-6499b6dbcf-r59fd" podUID="1430134d-1ef4-439b-bb24-31828d7c5e93" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Jul 27 17:56:42.062577 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:56:42.062533    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-autoscaling-keda-deployment-b2150d0b/autoscale-keda-deploy-kserve-router-scheduler-6499b6dbcf-r59fd" podUID="1430134d-1ef4-439b-bb24-31828d7c5e93" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Jul 27 17:56:45.020108 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:56:45.020066    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-test-llm-autoscaling-keda-deployment-b2150d0b/autoscale-keda-deploy-kserve-router-scheduler-6499b6dbcf-r59fd" podUID="1430134d-1ef4-439b-bb24-31828d7c5e93" containerName="main" containerID="cri-o://c5bba92b127a3384f0dbc6f95bcff2cecbd5a384e8adb82f0ae3f98452af8082" gracePeriod=45
Jul 27 17:56:45.207002 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:56:45.206970    2580 generic.go:356] "Generic (PLEG): container finished" podID="1430134d-1ef4-439b-bb24-31828d7c5e93" containerID="c5bba92b127a3384f0dbc6f95bcff2cecbd5a384e8adb82f0ae3f98452af8082" exitCode=0
Jul 27 17:56:45.207147 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:56:45.207040    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-autoscaling-keda-deployment-b2150d0b/autoscale-keda-deploy-kserve-router-scheduler-6499b6dbcf-r59fd" event={"ID":"1430134d-1ef4-439b-bb24-31828d7c5e93","Type":"ContainerDied","Data":"c5bba92b127a3384f0dbc6f95bcff2cecbd5a384e8adb82f0ae3f98452af8082"}
Jul 27 17:56:45.278137 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:56:45.278070    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-autoscaling-keda-deployment-b2150d0b/autoscale-keda-deploy-kserve-router-scheduler-6499b6dbcf-r59fd"
Jul 27 17:56:45.390402 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:56:45.390348    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8v2rx\" (UniqueName: \"kubernetes.io/projected/1430134d-1ef4-439b-bb24-31828d7c5e93-kube-api-access-8v2rx\") pod \"1430134d-1ef4-439b-bb24-31828d7c5e93\" (UID: \"1430134d-1ef4-439b-bb24-31828d7c5e93\") "
Jul 27 17:56:45.390402 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:56:45.390409    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1430134d-1ef4-439b-bb24-31828d7c5e93-tls-certs\") pod \"1430134d-1ef4-439b-bb24-31828d7c5e93\" (UID: \"1430134d-1ef4-439b-bb24-31828d7c5e93\") "
Jul 27 17:56:45.392695 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:56:45.392668    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1430134d-1ef4-439b-bb24-31828d7c5e93-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "1430134d-1ef4-439b-bb24-31828d7c5e93" (UID: "1430134d-1ef4-439b-bb24-31828d7c5e93"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 17:56:45.392814 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:56:45.392704    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1430134d-1ef4-439b-bb24-31828d7c5e93-kube-api-access-8v2rx" (OuterVolumeSpecName: "kube-api-access-8v2rx") pod "1430134d-1ef4-439b-bb24-31828d7c5e93" (UID: "1430134d-1ef4-439b-bb24-31828d7c5e93"). InnerVolumeSpecName "kube-api-access-8v2rx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 17:56:45.492139 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:56:45.492085    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8v2rx\" (UniqueName: \"kubernetes.io/projected/1430134d-1ef4-439b-bb24-31828d7c5e93-kube-api-access-8v2rx\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 27 17:56:45.492139 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:56:45.492134    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1430134d-1ef4-439b-bb24-31828d7c5e93-tls-certs\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 27 17:56:46.213717 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:56:46.213687    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-autoscaling-keda-deployment-b2150d0b/autoscale-keda-deploy-kserve-router-scheduler-6499b6dbcf-r59fd"
Jul 27 17:56:46.214149 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:56:46.213682    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-autoscaling-keda-deployment-b2150d0b/autoscale-keda-deploy-kserve-router-scheduler-6499b6dbcf-r59fd" event={"ID":"1430134d-1ef4-439b-bb24-31828d7c5e93","Type":"ContainerDied","Data":"a74683fc2681549ac4bf58376a8a5e248a67d4ffaa59deaeb814118aa6a9a370"}
Jul 27 17:56:46.214149 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:56:46.213821    2580 scope.go:117] "RemoveContainer" containerID="c5bba92b127a3384f0dbc6f95bcff2cecbd5a384e8adb82f0ae3f98452af8082"
Jul 27 17:56:46.236160 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:56:46.236137    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-autoscaling-keda-deployment-b2150d0b/autoscale-keda-deploy-kserve-router-scheduler-6499b6dbcf-r59fd"]
Jul 27 17:56:46.239103 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:56:46.239083    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-autoscaling-keda-deployment-b2150d0b/autoscale-keda-deploy-kserve-router-scheduler-6499b6dbcf-r59fd"]
Jul 27 17:56:46.490131 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:56:46.490054    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:56:46.595239 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:56:46.595202    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:56:47.271743 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:56:47.271707    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1430134d-1ef4-439b-bb24-31828d7c5e93" path="/var/lib/kubelet/pods/1430134d-1ef4-439b-bb24-31828d7c5e93/volumes"
Jul 27 17:57:20.423103 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:57:20.423059    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:57:20.523046 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:57:20.523010    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:57:20.574726 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:57:20.574686    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-test-llm-autoscaling-hpa-lws-d4cbcfd2/autoscale-hpa-lws-kserve-mn-0-1"]
Jul 27 17:57:20.575168 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:57:20.575148    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1430134d-1ef4-439b-bb24-31828d7c5e93" containerName="main"
Jul 27 17:57:20.575168 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:57:20.575170    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="1430134d-1ef4-439b-bb24-31828d7c5e93" containerName="main"
Jul 27 17:57:20.575355 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:57:20.575274    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="1430134d-1ef4-439b-bb24-31828d7c5e93" containerName="main"
Jul 27 17:57:20.578319 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:57:20.578298    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-autoscaling-hpa-lws-d4cbcfd2/autoscale-hpa-lws-kserve-mn-0-1"
Jul 27 17:57:20.580874 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:57:20.580854    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-autoscaling-hpa-lws-d4cbcfd2\"/\"kube-root-ca.crt\""
Jul 27 17:57:20.581848 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:57:20.581816    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-autoscaling-hpa-lws-d4cbcfd2\"/\"default-dockercfg-8jmgg\""
Jul 27 17:57:20.581976 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:57:20.581819    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-autoscaling-hpa-lws-d4cbcfd2\"/\"openshift-service-ca.crt\""
Jul 27 17:57:20.582107 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:57:20.582094    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-autoscaling-hpa-lws-d4cbcfd2\"/\"autoscale-hpa-lws-kserve-mn-dockercfg-97tmf\""
Jul 27 17:57:20.582179 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:57:20.582120    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-autoscaling-hpa-lws-d4cbcfd2\"/\"autoscale-hpa-lws-kserve-self-signed-certs\""
Jul 27 17:57:20.589719 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:57:20.589673    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-autoscaling-hpa-lws-d4cbcfd2/autoscale-hpa-lws-kserve-mn-0-1"]
Jul 27 17:57:20.592168 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:57:20.592145    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:57:20.675544 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:57:20.675479    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-test-llm-autoscaling-hpa-lws-d4cbcfd2/autoscale-hpa-lws-kserve-router-scheduler-584b9979f5-dmjq2"]
Jul 27 17:57:20.677109 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:57:20.677087    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a7f07e8d-a315-422b-8402-5d29108f0c7b-tls-certs\") pod \"autoscale-hpa-lws-kserve-mn-0-1\" (UID: \"a7f07e8d-a315-422b-8402-5d29108f0c7b\") " pod="e2e-test-llm-autoscaling-hpa-lws-d4cbcfd2/autoscale-hpa-lws-kserve-mn-0-1"
Jul 27 17:57:20.677219 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:57:20.677159    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a7f07e8d-a315-422b-8402-5d29108f0c7b-dshm\") pod \"autoscale-hpa-lws-kserve-mn-0-1\" (UID: \"a7f07e8d-a315-422b-8402-5d29108f0c7b\") " pod="e2e-test-llm-autoscaling-hpa-lws-d4cbcfd2/autoscale-hpa-lws-kserve-mn-0-1"
Jul 27 17:57:20.677219 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:57:20.677204    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8pcxc\" (UniqueName: \"kubernetes.io/projected/a7f07e8d-a315-422b-8402-5d29108f0c7b-kube-api-access-8pcxc\") pod \"autoscale-hpa-lws-kserve-mn-0-1\" (UID: \"a7f07e8d-a315-422b-8402-5d29108f0c7b\") " pod="e2e-test-llm-autoscaling-hpa-lws-d4cbcfd2/autoscale-hpa-lws-kserve-mn-0-1"
Jul 27 17:57:20.677342 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:57:20.677250    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a7f07e8d-a315-422b-8402-5d29108f0c7b-home\") pod \"autoscale-hpa-lws-kserve-mn-0-1\" (UID: \"a7f07e8d-a315-422b-8402-5d29108f0c7b\") " pod="e2e-test-llm-autoscaling-hpa-lws-d4cbcfd2/autoscale-hpa-lws-kserve-mn-0-1"
Jul 27 17:57:20.677342 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:57:20.677289    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a7f07e8d-a315-422b-8402-5d29108f0c7b-tmp-dir\") pod \"autoscale-hpa-lws-kserve-mn-0-1\" (UID: \"a7f07e8d-a315-422b-8402-5d29108f0c7b\") " pod="e2e-test-llm-autoscaling-hpa-lws-d4cbcfd2/autoscale-hpa-lws-kserve-mn-0-1"
Jul 27 17:57:20.677342 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:57:20.677311    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a7f07e8d-a315-422b-8402-5d29108f0c7b-model-cache\") pod \"autoscale-hpa-lws-kserve-mn-0-1\" (UID: \"a7f07e8d-a315-422b-8402-5d29108f0c7b\") " pod="e2e-test-llm-autoscaling-hpa-lws-d4cbcfd2/autoscale-hpa-lws-kserve-mn-0-1"
Jul 27 17:57:20.678735 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:57:20.678718    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-autoscaling-hpa-lws-d4cbcfd2/autoscale-hpa-lws-kserve-router-scheduler-584b9979f5-dmjq2"
Jul 27 17:57:20.680991 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:57:20.680972    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-autoscaling-hpa-lws-d4cbcfd2\"/\"autoscale-hpa-lws-epp-sa-dockercfg-pk8b4\""
Jul 27 17:57:20.687402 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:57:20.687382    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-autoscaling-hpa-lws-d4cbcfd2/autoscale-hpa-lws-kserve-router-scheduler-584b9979f5-dmjq2"]
Jul 27 17:57:20.731360 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:57:20.731337    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:57:20.778698 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:57:20.778678    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a7f07e8d-a315-422b-8402-5d29108f0c7b-home\") pod \"autoscale-hpa-lws-kserve-mn-0-1\" (UID: \"a7f07e8d-a315-422b-8402-5d29108f0c7b\") " pod="e2e-test-llm-autoscaling-hpa-lws-d4cbcfd2/autoscale-hpa-lws-kserve-mn-0-1"
Jul 27 17:57:20.778822 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:57:20.778711    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a7f07e8d-a315-422b-8402-5d29108f0c7b-tmp-dir\") pod \"autoscale-hpa-lws-kserve-mn-0-1\" (UID: \"a7f07e8d-a315-422b-8402-5d29108f0c7b\") " pod="e2e-test-llm-autoscaling-hpa-lws-d4cbcfd2/autoscale-hpa-lws-kserve-mn-0-1"
Jul 27 17:57:20.778822 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:57:20.778728    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a7f07e8d-a315-422b-8402-5d29108f0c7b-model-cache\") pod \"autoscale-hpa-lws-kserve-mn-0-1\" (UID: \"a7f07e8d-a315-422b-8402-5d29108f0c7b\") " pod="e2e-test-llm-autoscaling-hpa-lws-d4cbcfd2/autoscale-hpa-lws-kserve-mn-0-1"
Jul 27 17:57:20.778822 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:57:20.778747    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/475746b7-890d-4ac3-b6da-17bcaf8b2bd3-tls-certs\") pod \"autoscale-hpa-lws-kserve-router-scheduler-584b9979f5-dmjq2\" (UID: \"475746b7-890d-4ac3-b6da-17bcaf8b2bd3\") " pod="e2e-test-llm-autoscaling-hpa-lws-d4cbcfd2/autoscale-hpa-lws-kserve-router-scheduler-584b9979f5-dmjq2"
Jul 27 17:57:20.778822 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:57:20.778788    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a7f07e8d-a315-422b-8402-5d29108f0c7b-tls-certs\") pod \"autoscale-hpa-lws-kserve-mn-0-1\" (UID: \"a7f07e8d-a315-422b-8402-5d29108f0c7b\") " pod="e2e-test-llm-autoscaling-hpa-lws-d4cbcfd2/autoscale-hpa-lws-kserve-mn-0-1"
Jul 27 17:57:20.779066 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:57:20.778822    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a7f07e8d-a315-422b-8402-5d29108f0c7b-dshm\") pod \"autoscale-hpa-lws-kserve-mn-0-1\" (UID: \"a7f07e8d-a315-422b-8402-5d29108f0c7b\") " pod="e2e-test-llm-autoscaling-hpa-lws-d4cbcfd2/autoscale-hpa-lws-kserve-mn-0-1"
Jul 27 17:57:20.779066 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:57:20.778873    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8pcxc\" (UniqueName: \"kubernetes.io/projected/a7f07e8d-a315-422b-8402-5d29108f0c7b-kube-api-access-8pcxc\") pod \"autoscale-hpa-lws-kserve-mn-0-1\" (UID: \"a7f07e8d-a315-422b-8402-5d29108f0c7b\") " pod="e2e-test-llm-autoscaling-hpa-lws-d4cbcfd2/autoscale-hpa-lws-kserve-mn-0-1"
Jul 27 17:57:20.779066 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:57:20.778893    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pqh8d\" (UniqueName: \"kubernetes.io/projected/475746b7-890d-4ac3-b6da-17bcaf8b2bd3-kube-api-access-pqh8d\") pod \"autoscale-hpa-lws-kserve-router-scheduler-584b9979f5-dmjq2\" (UID: \"475746b7-890d-4ac3-b6da-17bcaf8b2bd3\") " pod="e2e-test-llm-autoscaling-hpa-lws-d4cbcfd2/autoscale-hpa-lws-kserve-router-scheduler-584b9979f5-dmjq2"
Jul 27 17:57:20.779210 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:57:20.779074    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a7f07e8d-a315-422b-8402-5d29108f0c7b-home\") pod \"autoscale-hpa-lws-kserve-mn-0-1\" (UID: \"a7f07e8d-a315-422b-8402-5d29108f0c7b\") " pod="e2e-test-llm-autoscaling-hpa-lws-d4cbcfd2/autoscale-hpa-lws-kserve-mn-0-1"
Jul 27 17:57:20.779210 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:57:20.779130    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a7f07e8d-a315-422b-8402-5d29108f0c7b-model-cache\") pod \"autoscale-hpa-lws-kserve-mn-0-1\" (UID: \"a7f07e8d-a315-422b-8402-5d29108f0c7b\") " pod="e2e-test-llm-autoscaling-hpa-lws-d4cbcfd2/autoscale-hpa-lws-kserve-mn-0-1"
Jul 27 17:57:20.779210 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:57:20.779156    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a7f07e8d-a315-422b-8402-5d29108f0c7b-tmp-dir\") pod \"autoscale-hpa-lws-kserve-mn-0-1\" (UID: \"a7f07e8d-a315-422b-8402-5d29108f0c7b\") " pod="e2e-test-llm-autoscaling-hpa-lws-d4cbcfd2/autoscale-hpa-lws-kserve-mn-0-1"
Jul 27 17:57:20.780999 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:57:20.780977    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a7f07e8d-a315-422b-8402-5d29108f0c7b-dshm\") pod \"autoscale-hpa-lws-kserve-mn-0-1\" (UID: \"a7f07e8d-a315-422b-8402-5d29108f0c7b\") " pod="e2e-test-llm-autoscaling-hpa-lws-d4cbcfd2/autoscale-hpa-lws-kserve-mn-0-1"
Jul 27 17:57:20.781126 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:57:20.781109    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a7f07e8d-a315-422b-8402-5d29108f0c7b-tls-certs\") pod \"autoscale-hpa-lws-kserve-mn-0-1\" (UID: \"a7f07e8d-a315-422b-8402-5d29108f0c7b\") " pod="e2e-test-llm-autoscaling-hpa-lws-d4cbcfd2/autoscale-hpa-lws-kserve-mn-0-1"
Jul 27 17:57:20.788749 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:57:20.788730    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8pcxc\" (UniqueName: \"kubernetes.io/projected/a7f07e8d-a315-422b-8402-5d29108f0c7b-kube-api-access-8pcxc\") pod \"autoscale-hpa-lws-kserve-mn-0-1\" (UID: \"a7f07e8d-a315-422b-8402-5d29108f0c7b\") " pod="e2e-test-llm-autoscaling-hpa-lws-d4cbcfd2/autoscale-hpa-lws-kserve-mn-0-1"
Jul 27 17:57:20.880265 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:57:20.880231    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pqh8d\" (UniqueName: \"kubernetes.io/projected/475746b7-890d-4ac3-b6da-17bcaf8b2bd3-kube-api-access-pqh8d\") pod \"autoscale-hpa-lws-kserve-router-scheduler-584b9979f5-dmjq2\" (UID: \"475746b7-890d-4ac3-b6da-17bcaf8b2bd3\") " pod="e2e-test-llm-autoscaling-hpa-lws-d4cbcfd2/autoscale-hpa-lws-kserve-router-scheduler-584b9979f5-dmjq2"
Jul 27 17:57:20.880405 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:57:20.880286    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/475746b7-890d-4ac3-b6da-17bcaf8b2bd3-tls-certs\") pod \"autoscale-hpa-lws-kserve-router-scheduler-584b9979f5-dmjq2\" (UID: \"475746b7-890d-4ac3-b6da-17bcaf8b2bd3\") " pod="e2e-test-llm-autoscaling-hpa-lws-d4cbcfd2/autoscale-hpa-lws-kserve-router-scheduler-584b9979f5-dmjq2"
Jul 27 17:57:20.883445 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:57:20.883419    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/475746b7-890d-4ac3-b6da-17bcaf8b2bd3-tls-certs\") pod \"autoscale-hpa-lws-kserve-router-scheduler-584b9979f5-dmjq2\" (UID: \"475746b7-890d-4ac3-b6da-17bcaf8b2bd3\") " pod="e2e-test-llm-autoscaling-hpa-lws-d4cbcfd2/autoscale-hpa-lws-kserve-router-scheduler-584b9979f5-dmjq2"
Jul 27 17:57:20.889385 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:57:20.889363    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-autoscaling-hpa-lws-d4cbcfd2/autoscale-hpa-lws-kserve-mn-0-1"
Jul 27 17:57:20.890163 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:57:20.890143    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pqh8d\" (UniqueName: \"kubernetes.io/projected/475746b7-890d-4ac3-b6da-17bcaf8b2bd3-kube-api-access-pqh8d\") pod \"autoscale-hpa-lws-kserve-router-scheduler-584b9979f5-dmjq2\" (UID: \"475746b7-890d-4ac3-b6da-17bcaf8b2bd3\") " pod="e2e-test-llm-autoscaling-hpa-lws-d4cbcfd2/autoscale-hpa-lws-kserve-router-scheduler-584b9979f5-dmjq2"
Jul 27 17:57:20.990335 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:57:20.990297    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-autoscaling-hpa-lws-d4cbcfd2/autoscale-hpa-lws-kserve-router-scheduler-584b9979f5-dmjq2"
Jul 27 17:57:21.019459 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:57:21.019433    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-autoscaling-hpa-lws-d4cbcfd2/autoscale-hpa-lws-kserve-mn-0-1"]
Jul 27 17:57:21.021573 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:57:21.021547    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7f07e8d_a315_422b_8402_5d29108f0c7b.slice/crio-0614e88ad94974c944764c0f4c51b3c3474372c5b508b0fdd4c2e5ec5484bcab WatchSource:0}: Error finding container 0614e88ad94974c944764c0f4c51b3c3474372c5b508b0fdd4c2e5ec5484bcab: Status 404 returned error can't find the container with id 0614e88ad94974c944764c0f4c51b3c3474372c5b508b0fdd4c2e5ec5484bcab
Jul 27 17:57:21.130166 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:57:21.127337    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-autoscaling-hpa-lws-d4cbcfd2/autoscale-hpa-lws-kserve-router-scheduler-584b9979f5-dmjq2"]
Jul 27 17:57:21.130848 ip-10-0-137-134 kubenswrapper[2580]: W0727 17:57:21.130800    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod475746b7_890d_4ac3_b6da_17bcaf8b2bd3.slice/crio-efa04f0689d97104dc78b626a5a83c5a68f9366d54cda597b01641fc97312e2e WatchSource:0}: Error finding container efa04f0689d97104dc78b626a5a83c5a68f9366d54cda597b01641fc97312e2e: Status 404 returned error can't find the container with id efa04f0689d97104dc78b626a5a83c5a68f9366d54cda597b01641fc97312e2e
Jul 27 17:57:21.371933 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:57:21.371893    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-autoscaling-hpa-lws-d4cbcfd2/autoscale-hpa-lws-kserve-mn-0-1" event={"ID":"a7f07e8d-a315-422b-8402-5d29108f0c7b","Type":"ContainerStarted","Data":"455958c682c475cd7571060be639b7a94f4af056e18064c31dea0f1267ee579d"}
Jul 27 17:57:21.372118 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:57:21.371960    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-autoscaling-hpa-lws-d4cbcfd2/autoscale-hpa-lws-kserve-mn-0-1" event={"ID":"a7f07e8d-a315-422b-8402-5d29108f0c7b","Type":"ContainerStarted","Data":"0614e88ad94974c944764c0f4c51b3c3474372c5b508b0fdd4c2e5ec5484bcab"}
Jul 27 17:57:21.373346 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:57:21.373325    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-autoscaling-hpa-lws-d4cbcfd2/autoscale-hpa-lws-kserve-router-scheduler-584b9979f5-dmjq2" event={"ID":"475746b7-890d-4ac3-b6da-17bcaf8b2bd3","Type":"ContainerStarted","Data":"4806b3f116e1b312284274d7313703958d0619b28fc95fd0005dffb8c758aad9"}
Jul 27 17:57:21.373433 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:57:21.373362    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-autoscaling-hpa-lws-d4cbcfd2/autoscale-hpa-lws-kserve-router-scheduler-584b9979f5-dmjq2" event={"ID":"475746b7-890d-4ac3-b6da-17bcaf8b2bd3","Type":"ContainerStarted","Data":"efa04f0689d97104dc78b626a5a83c5a68f9366d54cda597b01641fc97312e2e"}
Jul 27 17:57:21.373471 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:57:21.373444    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-autoscaling-hpa-lws-d4cbcfd2/autoscale-hpa-lws-kserve-router-scheduler-584b9979f5-dmjq2"
Jul 27 17:57:21.388737 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:57:21.388690    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-test-llm-autoscaling-hpa-lws-d4cbcfd2/autoscale-hpa-lws-kserve-mn-0-1" podStartSLOduration=1.388676988 podStartE2EDuration="1.388676988s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:57:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:57:21.388430924 +0000 UTC m=+3354.585175727" watchObservedRunningTime="2026-07-27 17:57:21.388676988 +0000 UTC m=+3354.585421790"
Jul 27 17:57:21.406393 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:57:21.406351    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-test-llm-autoscaling-hpa-lws-d4cbcfd2/autoscale-hpa-lws-kserve-router-scheduler-584b9979f5-dmjq2" podStartSLOduration=1.4063380699999999 podStartE2EDuration="1.40633807s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:57:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:57:21.405435061 +0000 UTC m=+3354.602179866" watchObservedRunningTime="2026-07-27 17:57:21.40633807 +0000 UTC m=+3354.603082872"
Jul 27 17:57:43.455800 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:57:43.455758    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 17:57:52.378811 ip-10-0-137-134 kubenswrapper[2580]: I0727 17:57:52.378783    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-autoscaling-hpa-lws-d4cbcfd2/autoscale-hpa-lws-kserve-router-scheduler-584b9979f5-dmjq2"
Jul 27 18:00:03.289020 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:00:03.288981    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 18:00:54.300282 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:00:54.300220    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 18:00:55.771043 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:00:55.771009    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 18:00:57.854981 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:00:57.854952    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 18:00:57.912686 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:00:57.912654    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 18:00:58.559317 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:00:58.559279    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 18:02:11.035140 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:02:11.035104    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 18:03:14.139402 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:03:14.139367    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 18:03:14.242435 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:03:14.242398    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 18:03:14.319510 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:03:14.319481    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 18:03:14.392297 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:03:14.392217    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-test-llm-inference-service-7c3633d1/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schek5cf5"]
Jul 27 18:03:14.395786 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:03:14.395765    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-7c3633d1/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schek5cf5"
Jul 27 18:03:14.402185 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:03:14.402164    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-7c3633d1\"/\"openshift-service-ca.crt\""
Jul 27 18:03:14.403436 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:03:14.403409    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-7c3633d1\"/\"llmisvc-model-pvc-router-manage-2577e794-epp-sa-dockercfg-xbrjl\""
Jul 27 18:03:14.403735 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:03:14.403706    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-7c3633d1\"/\"default-dockercfg-4r6xp\""
Jul 27 18:03:14.404248 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:03:14.404227    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-7c3633d1\"/\"kube-root-ca.crt\""
Jul 27 18:03:14.404725 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:03:14.404702    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-7c3633d1\"/\"llmisv1dc4269d1ada5f2d28562215d180c57f-kserve-self-signed-certs\""
Jul 27 18:03:14.406583 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:03:14.406563    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-7c3633d1/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schek5cf5"]
Jul 27 18:03:14.443820 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:03:14.443791    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 18:03:14.464641 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:03:14.464610    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dc36c688-2c2e-4376-af14-5e44e3f306c7-tls-certs\") pod \"llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schek5cf5\" (UID: \"dc36c688-2c2e-4376-af14-5e44e3f306c7\") " pod="e2e-test-llm-inference-service-7c3633d1/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schek5cf5"
Jul 27 18:03:14.464858 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:03:14.464670    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rbv7\" (UniqueName: \"kubernetes.io/projected/dc36c688-2c2e-4376-af14-5e44e3f306c7-kube-api-access-8rbv7\") pod \"llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schek5cf5\" (UID: \"dc36c688-2c2e-4376-af14-5e44e3f306c7\") " pod="e2e-test-llm-inference-service-7c3633d1/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schek5cf5"
Jul 27 18:03:14.565765 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:03:14.565735    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dc36c688-2c2e-4376-af14-5e44e3f306c7-tls-certs\") pod \"llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schek5cf5\" (UID: \"dc36c688-2c2e-4376-af14-5e44e3f306c7\") " pod="e2e-test-llm-inference-service-7c3633d1/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schek5cf5"
Jul 27 18:03:14.565956 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:03:14.565778    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rbv7\" (UniqueName: \"kubernetes.io/projected/dc36c688-2c2e-4376-af14-5e44e3f306c7-kube-api-access-8rbv7\") pod \"llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schek5cf5\" (UID: \"dc36c688-2c2e-4376-af14-5e44e3f306c7\") " pod="e2e-test-llm-inference-service-7c3633d1/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schek5cf5"
Jul 27 18:03:14.568340 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:03:14.568306    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dc36c688-2c2e-4376-af14-5e44e3f306c7-tls-certs\") pod \"llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schek5cf5\" (UID: \"dc36c688-2c2e-4376-af14-5e44e3f306c7\") " pod="e2e-test-llm-inference-service-7c3633d1/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schek5cf5"
Jul 27 18:03:14.579693 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:03:14.579668    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rbv7\" (UniqueName: \"kubernetes.io/projected/dc36c688-2c2e-4376-af14-5e44e3f306c7-kube-api-access-8rbv7\") pod \"llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schek5cf5\" (UID: \"dc36c688-2c2e-4376-af14-5e44e3f306c7\") " pod="e2e-test-llm-inference-service-7c3633d1/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schek5cf5"
Jul 27 18:03:14.708803 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:03:14.708718    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-7c3633d1/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schek5cf5"
Jul 27 18:03:14.841563 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:03:14.841533    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-7c3633d1/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schek5cf5"]
Jul 27 18:03:14.843406 ip-10-0-137-134 kubenswrapper[2580]: W0727 18:03:14.843383    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc36c688_2c2e_4376_af14_5e44e3f306c7.slice/crio-4943d1ec6118599e696a492478405a3162eb2bad6049e7be8336ffa02e262461 WatchSource:0}: Error finding container 4943d1ec6118599e696a492478405a3162eb2bad6049e7be8336ffa02e262461: Status 404 returned error can't find the container with id 4943d1ec6118599e696a492478405a3162eb2bad6049e7be8336ffa02e262461
Jul 27 18:03:14.994170 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:03:14.994078    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-7c3633d1/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schek5cf5" event={"ID":"dc36c688-2c2e-4376-af14-5e44e3f306c7","Type":"ContainerStarted","Data":"cccb22b6cc84daf69010cc1dfb99e1c3d67c9182dc1e6c926824c1a70f6890ff"}
Jul 27 18:03:14.994170 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:03:14.994133    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-7c3633d1/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schek5cf5" event={"ID":"dc36c688-2c2e-4376-af14-5e44e3f306c7","Type":"ContainerStarted","Data":"4943d1ec6118599e696a492478405a3162eb2bad6049e7be8336ffa02e262461"}
Jul 27 18:03:14.994360 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:03:14.994171    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-7c3633d1/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schek5cf5"
Jul 27 18:03:15.011038 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:03:15.010987    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-test-llm-inference-service-7c3633d1/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schek5cf5" podStartSLOduration=1.010970069 podStartE2EDuration="1.010970069s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:03:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:03:15.009564686 +0000 UTC m=+3708.206309489" watchObservedRunningTime="2026-07-27 18:03:15.010970069 +0000 UTC m=+3708.207714871"
Jul 27 18:03:46.008287 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:03:46.008254    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-inference-service-7c3633d1/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schek5cf5"
Jul 27 18:03:46.290602 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:03:46.290517    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 18:04:27.686597 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:04:27.686561    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 18:05:38.951320 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:05:38.951273    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 18:05:38.958499 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:05:38.958473    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-7c3633d1/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schek5cf5"]
Jul 27 18:05:39.065583 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:05:39.065543    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 18:05:46.007890 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:05:46.007849    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-7c3633d1/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schek5cf5" podUID="dc36c688-2c2e-4376-af14-5e44e3f306c7" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Jul 27 18:05:53.977658 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:05:53.977615    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-test-llm-inference-service-7c3633d1/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schek5cf5" podUID="dc36c688-2c2e-4376-af14-5e44e3f306c7" containerName="main" containerID="cri-o://cccb22b6cc84daf69010cc1dfb99e1c3d67c9182dc1e6c926824c1a70f6890ff" gracePeriod=45
Jul 27 18:05:54.231160 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:05:54.231098    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-7c3633d1/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schek5cf5"
Jul 27 18:05:54.370891 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:05:54.370861    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dc36c688-2c2e-4376-af14-5e44e3f306c7-tls-certs\") pod \"dc36c688-2c2e-4376-af14-5e44e3f306c7\" (UID: \"dc36c688-2c2e-4376-af14-5e44e3f306c7\") "
Jul 27 18:05:54.371058 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:05:54.370948    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8rbv7\" (UniqueName: \"kubernetes.io/projected/dc36c688-2c2e-4376-af14-5e44e3f306c7-kube-api-access-8rbv7\") pod \"dc36c688-2c2e-4376-af14-5e44e3f306c7\" (UID: \"dc36c688-2c2e-4376-af14-5e44e3f306c7\") "
Jul 27 18:05:54.373077 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:05:54.373052    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc36c688-2c2e-4376-af14-5e44e3f306c7-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "dc36c688-2c2e-4376-af14-5e44e3f306c7" (UID: "dc36c688-2c2e-4376-af14-5e44e3f306c7"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 18:05:54.373192 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:05:54.373089    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc36c688-2c2e-4376-af14-5e44e3f306c7-kube-api-access-8rbv7" (OuterVolumeSpecName: "kube-api-access-8rbv7") pod "dc36c688-2c2e-4376-af14-5e44e3f306c7" (UID: "dc36c688-2c2e-4376-af14-5e44e3f306c7"). InnerVolumeSpecName "kube-api-access-8rbv7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 18:05:54.472557 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:05:54.472523    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dc36c688-2c2e-4376-af14-5e44e3f306c7-tls-certs\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 27 18:05:54.472557 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:05:54.472552    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8rbv7\" (UniqueName: \"kubernetes.io/projected/dc36c688-2c2e-4376-af14-5e44e3f306c7-kube-api-access-8rbv7\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 27 18:05:54.749352 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:05:54.749319    2580 generic.go:356] "Generic (PLEG): container finished" podID="dc36c688-2c2e-4376-af14-5e44e3f306c7" containerID="cccb22b6cc84daf69010cc1dfb99e1c3d67c9182dc1e6c926824c1a70f6890ff" exitCode=0
Jul 27 18:05:54.749529 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:05:54.749362    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-7c3633d1/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schek5cf5"
Jul 27 18:05:54.749529 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:05:54.749367    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-7c3633d1/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schek5cf5" event={"ID":"dc36c688-2c2e-4376-af14-5e44e3f306c7","Type":"ContainerDied","Data":"cccb22b6cc84daf69010cc1dfb99e1c3d67c9182dc1e6c926824c1a70f6890ff"}
Jul 27 18:05:54.749529 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:05:54.749467    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-7c3633d1/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schek5cf5" event={"ID":"dc36c688-2c2e-4376-af14-5e44e3f306c7","Type":"ContainerDied","Data":"4943d1ec6118599e696a492478405a3162eb2bad6049e7be8336ffa02e262461"}
Jul 27 18:05:54.749529 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:05:54.749487    2580 scope.go:117] "RemoveContainer" containerID="cccb22b6cc84daf69010cc1dfb99e1c3d67c9182dc1e6c926824c1a70f6890ff"
Jul 27 18:05:54.758937 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:05:54.758920    2580 scope.go:117] "RemoveContainer" containerID="cccb22b6cc84daf69010cc1dfb99e1c3d67c9182dc1e6c926824c1a70f6890ff"
Jul 27 18:05:54.759189 ip-10-0-137-134 kubenswrapper[2580]: E0727 18:05:54.759167    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cccb22b6cc84daf69010cc1dfb99e1c3d67c9182dc1e6c926824c1a70f6890ff\": container with ID starting with cccb22b6cc84daf69010cc1dfb99e1c3d67c9182dc1e6c926824c1a70f6890ff not found: ID does not exist" containerID="cccb22b6cc84daf69010cc1dfb99e1c3d67c9182dc1e6c926824c1a70f6890ff"
Jul 27 18:05:54.759300 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:05:54.759204    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cccb22b6cc84daf69010cc1dfb99e1c3d67c9182dc1e6c926824c1a70f6890ff"} err="failed to get container status \"cccb22b6cc84daf69010cc1dfb99e1c3d67c9182dc1e6c926824c1a70f6890ff\": rpc error: code = NotFound desc = could not find container \"cccb22b6cc84daf69010cc1dfb99e1c3d67c9182dc1e6c926824c1a70f6890ff\": container with ID starting with cccb22b6cc84daf69010cc1dfb99e1c3d67c9182dc1e6c926824c1a70f6890ff not found: ID does not exist"
Jul 27 18:05:54.781249 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:05:54.781220    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-7c3633d1/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schek5cf5"]
Jul 27 18:05:54.784376 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:05:54.784352    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-inference-service-7c3633d1/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schek5cf5"]
Jul 27 18:05:55.270994 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:05:55.270964    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dc36c688-2c2e-4376-af14-5e44e3f306c7" path="/var/lib/kubelet/pods/dc36c688-2c2e-4376-af14-5e44e3f306c7/volumes"
Jul 27 18:05:59.094711 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:05:59.094669    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 18:06:05.046904 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:06:05.046861    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 18:06:06.200954 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:06:06.200907    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 18:06:07.835264 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:06:07.835207    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 18:06:07.928137 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:06:07.928092    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 18:06:08.105332 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:06:08.105287    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 18:06:08.204994 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:06:08.204954    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 18:06:08.305157 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:06:08.305129    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 18:06:11.917584 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:06:11.917547    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 18:06:12.016231 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:06:12.016194    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 18:06:14.589377 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:06:14.589346    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 18:06:16.899353 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:06:16.899320    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 18:06:19.801648 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:06:19.801606    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 18:06:19.870741 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:06:19.870711    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 18:06:44.326952 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:06:44.326906    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 18:06:44.434372 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:06:44.434336    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 18:06:44.539790 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:06:44.539755    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 18:06:49.124962 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:06:49.124931    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 18:06:49.425419 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:06:49.425311    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 18:06:49.527350 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:06:49.527320    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 18:06:50.327571 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:06:50.327479    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 18:06:51.372109 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:06:51.372072    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 18:06:51.471940 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:06:51.471907    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 18:06:54.210387 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:06:54.210342    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 18:06:55.777822 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:06:55.777783    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 18:06:55.878393 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:06:55.878358    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 18:06:56.047377 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:06:56.047268    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 18:06:56.155425 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:06:56.155394    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 18:06:56.644651 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:06:56.644619    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 18:06:56.757535 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:06:56.757505    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 18:06:57.143022 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:06:57.142979    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 18:06:57.234985 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:06:57.234951    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 18:06:57.450936 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:06:57.450853    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 18:06:57.549260 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:06:57.549232    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 18:07:01.318301 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:07:01.318268    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 18:07:01.398466 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:07:01.398435    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 18:07:01.749070 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:07:01.749033    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 18:07:01.848785 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:07:01.848750    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 18:07:02.762203 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:07:02.762167    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 18:07:02.863375 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:07:02.863343    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 18:07:03.355162 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:07:03.355131    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 18:07:03.450512 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:07:03.450480    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 18:07:03.799203 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:07:03.799087    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 18:07:03.886339 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:07:03.886310    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 18:07:15.162914 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:07:15.162881    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 18:07:15.263940 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:07:15.263903    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 18:07:52.818294 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:07:52.818172    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 18:07:53.087414 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:07:53.087301    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 18:07:58.586445 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:07:58.586409    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 18:08:35.070883 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:08:35.070816    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 18:10:21.560041 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:10:21.559939    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 18:10:21.690539 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:10:21.690500    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 18:10:21.788363 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:10:21.788314    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 18:10:39.595511 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:10:39.595478    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 18:10:39.802589 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:10:39.802538    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 18:11:13.599021 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:11:13.598937    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 18:11:29.902881 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:11:29.902838    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 18:11:55.758916 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:11:55.758876    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 18:11:55.826909 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:11:55.826875    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 18:12:10.708454 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:12:10.708414    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 18:12:11.540031 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:12:11.540001    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 18:12:38.178183 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:12:38.178146    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 18:12:38.275179 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:12:38.275142    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 18:12:39.172280 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:12:39.172237    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 18:12:39.270666 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:12:39.270627    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 18:12:39.576319 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:12:39.576206    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 18:12:39.672718 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:12:39.672686    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 18:12:40.175223 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:12:40.175188    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 18:12:40.256720 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:12:40.256681    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 18:12:42.271061 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:12:42.271027    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 18:12:42.534052 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:12:42.533949    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 18:12:43.509484 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:12:43.509451    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 18:12:43.619309 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:12:43.619275    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 18:12:47.615286 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:12:47.615251    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 18:12:47.888961 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:12:47.888870    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 18:12:47.993226 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:12:47.993185    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 18:12:48.239159 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:12:48.239070    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 18:12:48.345673 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:12:48.345634    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 18:12:48.446377 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:12:48.446343    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 18:13:12.329240 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:13:12.329203    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 18:13:12.428557 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:13:12.428521    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 18:13:32.906722 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:13:32.906689    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 18:13:32.921087 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:13:32.921058    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-autoscaling-hpa-lws-d4cbcfd2/autoscale-hpa-lws-kserve-router-scheduler-584b9979f5-dmjq2"]
Jul 27 18:13:32.973858 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:13:32.973809    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 18:13:33.773309 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:13:33.773277    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-autoscaling-hpa-lws-d4cbcfd2/autoscale-hpa-lws-kserve-mn-0-1"]
Jul 27 18:13:33.782087 ip-10-0-137-134 kubenswrapper[2580]: E0727 18:13:33.782052    2580 log.go:32] "ExecSync cmd from runtime service failed" err=<
Jul 27 18:13:33.782087 ip-10-0-137-134 kubenswrapper[2580]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 27 18:13:33.782087 ip-10-0-137-134 kubenswrapper[2580]:         , stdout: , stderr: , exit code -1
Jul 27 18:13:33.782087 ip-10-0-137-134 kubenswrapper[2580]:  > containerID="455958c682c475cd7571060be639b7a94f4af056e18064c31dea0f1267ee579d" cmd=["/bin/sleep","15"]
Jul 27 18:13:33.782332 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:13:33.782107    2580 handlers.go:82] "Exec lifecycle hook for Container in Pod failed" execCommand=["/bin/sleep","15"] containerName="main" pod="e2e-test-llm-autoscaling-hpa-lws-d4cbcfd2/autoscale-hpa-lws-kserve-mn-0-1" message="" err=<
Jul 27 18:13:33.782332 ip-10-0-137-134 kubenswrapper[2580]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 27 18:13:33.782332 ip-10-0-137-134 kubenswrapper[2580]:         , stdout: , stderr: , exit code -1
Jul 27 18:13:33.782332 ip-10-0-137-134 kubenswrapper[2580]:  >
Jul 27 18:13:33.782332 ip-10-0-137-134 kubenswrapper[2580]: E0727 18:13:33.782119    2580 kuberuntime_container.go:755] "PreStop hook failed" err=<
Jul 27 18:13:33.782332 ip-10-0-137-134 kubenswrapper[2580]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 27 18:13:33.782332 ip-10-0-137-134 kubenswrapper[2580]:         , stdout: , stderr: , exit code -1
Jul 27 18:13:33.782332 ip-10-0-137-134 kubenswrapper[2580]:  > pod="e2e-test-llm-autoscaling-hpa-lws-d4cbcfd2/autoscale-hpa-lws-kserve-mn-0-1" podUID="a7f07e8d-a315-422b-8402-5d29108f0c7b" containerName="main" containerID="cri-o://455958c682c475cd7571060be639b7a94f4af056e18064c31dea0f1267ee579d"
Jul 27 18:13:33.782332 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:13:33.782160    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-test-llm-autoscaling-hpa-lws-d4cbcfd2/autoscale-hpa-lws-kserve-mn-0-1" podUID="a7f07e8d-a315-422b-8402-5d29108f0c7b" containerName="main" containerID="cri-o://455958c682c475cd7571060be639b7a94f4af056e18064c31dea0f1267ee579d" gracePeriod=60
Jul 27 18:13:33.929246 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:13:33.929209    2580 generic.go:356] "Generic (PLEG): container finished" podID="a7f07e8d-a315-422b-8402-5d29108f0c7b" containerID="455958c682c475cd7571060be639b7a94f4af056e18064c31dea0f1267ee579d" exitCode=0
Jul 27 18:13:33.929653 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:13:33.929273    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-autoscaling-hpa-lws-d4cbcfd2/autoscale-hpa-lws-kserve-mn-0-1" event={"ID":"a7f07e8d-a315-422b-8402-5d29108f0c7b","Type":"ContainerDied","Data":"455958c682c475cd7571060be639b7a94f4af056e18064c31dea0f1267ee579d"}
Jul 27 18:13:34.035715 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:13:34.035659    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-autoscaling-hpa-lws-d4cbcfd2/autoscale-hpa-lws-kserve-mn-0-1"
Jul 27 18:13:34.047022 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:13:34.047000    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a7f07e8d-a315-422b-8402-5d29108f0c7b-tmp-dir\") pod \"a7f07e8d-a315-422b-8402-5d29108f0c7b\" (UID: \"a7f07e8d-a315-422b-8402-5d29108f0c7b\") "
Jul 27 18:13:34.047125 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:13:34.047033    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8pcxc\" (UniqueName: \"kubernetes.io/projected/a7f07e8d-a315-422b-8402-5d29108f0c7b-kube-api-access-8pcxc\") pod \"a7f07e8d-a315-422b-8402-5d29108f0c7b\" (UID: \"a7f07e8d-a315-422b-8402-5d29108f0c7b\") "
Jul 27 18:13:34.047125 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:13:34.047057    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a7f07e8d-a315-422b-8402-5d29108f0c7b-model-cache\") pod \"a7f07e8d-a315-422b-8402-5d29108f0c7b\" (UID: \"a7f07e8d-a315-422b-8402-5d29108f0c7b\") "
Jul 27 18:13:34.047125 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:13:34.047084    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a7f07e8d-a315-422b-8402-5d29108f0c7b-home\") pod \"a7f07e8d-a315-422b-8402-5d29108f0c7b\" (UID: \"a7f07e8d-a315-422b-8402-5d29108f0c7b\") "
Jul 27 18:13:34.047294 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:13:34.047132    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a7f07e8d-a315-422b-8402-5d29108f0c7b-dshm\") pod \"a7f07e8d-a315-422b-8402-5d29108f0c7b\" (UID: \"a7f07e8d-a315-422b-8402-5d29108f0c7b\") "
Jul 27 18:13:34.047294 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:13:34.047180    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a7f07e8d-a315-422b-8402-5d29108f0c7b-tls-certs\") pod \"a7f07e8d-a315-422b-8402-5d29108f0c7b\" (UID: \"a7f07e8d-a315-422b-8402-5d29108f0c7b\") "
Jul 27 18:13:34.047400 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:13:34.047299    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7f07e8d-a315-422b-8402-5d29108f0c7b-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a7f07e8d-a315-422b-8402-5d29108f0c7b" (UID: "a7f07e8d-a315-422b-8402-5d29108f0c7b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:13:34.047400 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:13:34.047321    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7f07e8d-a315-422b-8402-5d29108f0c7b-model-cache" (OuterVolumeSpecName: "model-cache") pod "a7f07e8d-a315-422b-8402-5d29108f0c7b" (UID: "a7f07e8d-a315-422b-8402-5d29108f0c7b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:13:34.047508 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:13:34.047455    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7f07e8d-a315-422b-8402-5d29108f0c7b-home" (OuterVolumeSpecName: "home") pod "a7f07e8d-a315-422b-8402-5d29108f0c7b" (UID: "a7f07e8d-a315-422b-8402-5d29108f0c7b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:13:34.047508 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:13:34.047480    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a7f07e8d-a315-422b-8402-5d29108f0c7b-tmp-dir\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 27 18:13:34.047508 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:13:34.047493    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a7f07e8d-a315-422b-8402-5d29108f0c7b-model-cache\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 27 18:13:34.049395 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:13:34.049364    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a7f07e8d-a315-422b-8402-5d29108f0c7b-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a7f07e8d-a315-422b-8402-5d29108f0c7b" (UID: "a7f07e8d-a315-422b-8402-5d29108f0c7b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 18:13:34.049513 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:13:34.049393    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7f07e8d-a315-422b-8402-5d29108f0c7b-dshm" (OuterVolumeSpecName: "dshm") pod "a7f07e8d-a315-422b-8402-5d29108f0c7b" (UID: "a7f07e8d-a315-422b-8402-5d29108f0c7b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:13:34.049513 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:13:34.049461    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7f07e8d-a315-422b-8402-5d29108f0c7b-kube-api-access-8pcxc" (OuterVolumeSpecName: "kube-api-access-8pcxc") pod "a7f07e8d-a315-422b-8402-5d29108f0c7b" (UID: "a7f07e8d-a315-422b-8402-5d29108f0c7b"). InnerVolumeSpecName "kube-api-access-8pcxc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 18:13:34.148028 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:13:34.147997    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8pcxc\" (UniqueName: \"kubernetes.io/projected/a7f07e8d-a315-422b-8402-5d29108f0c7b-kube-api-access-8pcxc\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 27 18:13:34.148028 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:13:34.148026    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a7f07e8d-a315-422b-8402-5d29108f0c7b-home\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 27 18:13:34.148028 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:13:34.148037    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a7f07e8d-a315-422b-8402-5d29108f0c7b-dshm\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 27 18:13:34.148240 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:13:34.148044    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a7f07e8d-a315-422b-8402-5d29108f0c7b-tls-certs\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 27 18:13:34.935076 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:13:34.935033    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-autoscaling-hpa-lws-d4cbcfd2/autoscale-hpa-lws-kserve-mn-0-1" event={"ID":"a7f07e8d-a315-422b-8402-5d29108f0c7b","Type":"ContainerDied","Data":"0614e88ad94974c944764c0f4c51b3c3474372c5b508b0fdd4c2e5ec5484bcab"}
Jul 27 18:13:34.935076 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:13:34.935072    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-autoscaling-hpa-lws-d4cbcfd2/autoscale-hpa-lws-kserve-mn-0-1"
Jul 27 18:13:34.935619 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:13:34.935101    2580 scope.go:117] "RemoveContainer" containerID="455958c682c475cd7571060be639b7a94f4af056e18064c31dea0f1267ee579d"
Jul 27 18:13:34.959485 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:13:34.959458    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-autoscaling-hpa-lws-d4cbcfd2/autoscale-hpa-lws-kserve-mn-0-1"]
Jul 27 18:13:34.965616 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:13:34.965587    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-autoscaling-hpa-lws-d4cbcfd2/autoscale-hpa-lws-kserve-mn-0-1"]
Jul 27 18:13:35.270885 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:13:35.270808    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a7f07e8d-a315-422b-8402-5d29108f0c7b" path="/var/lib/kubelet/pods/a7f07e8d-a315-422b-8402-5d29108f0c7b/volumes"
Jul 27 18:13:42.379124 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:13:42.379091    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-autoscaling-hpa-lws-d4cbcfd2/autoscale-hpa-lws-kserve-router-scheduler-584b9979f5-dmjq2" podUID="475746b7-890d-4ac3-b6da-17bcaf8b2bd3" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Jul 27 18:13:47.940047 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:13:47.939995    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-test-llm-autoscaling-hpa-lws-d4cbcfd2/autoscale-hpa-lws-kserve-router-scheduler-584b9979f5-dmjq2" podUID="475746b7-890d-4ac3-b6da-17bcaf8b2bd3" containerName="main" containerID="cri-o://4806b3f116e1b312284274d7313703958d0619b28fc95fd0005dffb8c758aad9" gracePeriod=45
Jul 27 18:13:48.199077 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:13:48.199017    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-autoscaling-hpa-lws-d4cbcfd2/autoscale-hpa-lws-kserve-router-scheduler-584b9979f5-dmjq2"
Jul 27 18:13:48.261726 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:13:48.261693    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/475746b7-890d-4ac3-b6da-17bcaf8b2bd3-tls-certs\") pod \"475746b7-890d-4ac3-b6da-17bcaf8b2bd3\" (UID: \"475746b7-890d-4ac3-b6da-17bcaf8b2bd3\") "
Jul 27 18:13:48.261905 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:13:48.261744    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pqh8d\" (UniqueName: \"kubernetes.io/projected/475746b7-890d-4ac3-b6da-17bcaf8b2bd3-kube-api-access-pqh8d\") pod \"475746b7-890d-4ac3-b6da-17bcaf8b2bd3\" (UID: \"475746b7-890d-4ac3-b6da-17bcaf8b2bd3\") "
Jul 27 18:13:48.263839 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:13:48.263796    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/475746b7-890d-4ac3-b6da-17bcaf8b2bd3-kube-api-access-pqh8d" (OuterVolumeSpecName: "kube-api-access-pqh8d") pod "475746b7-890d-4ac3-b6da-17bcaf8b2bd3" (UID: "475746b7-890d-4ac3-b6da-17bcaf8b2bd3"). InnerVolumeSpecName "kube-api-access-pqh8d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 18:13:48.263839 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:13:48.263811    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/475746b7-890d-4ac3-b6da-17bcaf8b2bd3-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "475746b7-890d-4ac3-b6da-17bcaf8b2bd3" (UID: "475746b7-890d-4ac3-b6da-17bcaf8b2bd3"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 18:13:48.363180 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:13:48.363148    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/475746b7-890d-4ac3-b6da-17bcaf8b2bd3-tls-certs\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 27 18:13:48.363180 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:13:48.363174    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pqh8d\" (UniqueName: \"kubernetes.io/projected/475746b7-890d-4ac3-b6da-17bcaf8b2bd3-kube-api-access-pqh8d\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 27 18:13:48.841619 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:13:48.841581    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 18:13:48.941292 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:13:48.941255    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 18:13:49.006294 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:13:49.006264    2580 generic.go:356] "Generic (PLEG): container finished" podID="475746b7-890d-4ac3-b6da-17bcaf8b2bd3" containerID="4806b3f116e1b312284274d7313703958d0619b28fc95fd0005dffb8c758aad9" exitCode=0
Jul 27 18:13:49.006474 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:13:49.006312    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-autoscaling-hpa-lws-d4cbcfd2/autoscale-hpa-lws-kserve-router-scheduler-584b9979f5-dmjq2"
Jul 27 18:13:49.006474 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:13:49.006333    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-autoscaling-hpa-lws-d4cbcfd2/autoscale-hpa-lws-kserve-router-scheduler-584b9979f5-dmjq2" event={"ID":"475746b7-890d-4ac3-b6da-17bcaf8b2bd3","Type":"ContainerDied","Data":"4806b3f116e1b312284274d7313703958d0619b28fc95fd0005dffb8c758aad9"}
Jul 27 18:13:49.006474 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:13:49.006375    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-autoscaling-hpa-lws-d4cbcfd2/autoscale-hpa-lws-kserve-router-scheduler-584b9979f5-dmjq2" event={"ID":"475746b7-890d-4ac3-b6da-17bcaf8b2bd3","Type":"ContainerDied","Data":"efa04f0689d97104dc78b626a5a83c5a68f9366d54cda597b01641fc97312e2e"}
Jul 27 18:13:49.006474 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:13:49.006398    2580 scope.go:117] "RemoveContainer" containerID="4806b3f116e1b312284274d7313703958d0619b28fc95fd0005dffb8c758aad9"
Jul 27 18:13:49.015228 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:13:49.015213    2580 scope.go:117] "RemoveContainer" containerID="4806b3f116e1b312284274d7313703958d0619b28fc95fd0005dffb8c758aad9"
Jul 27 18:13:49.015512 ip-10-0-137-134 kubenswrapper[2580]: E0727 18:13:49.015492    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4806b3f116e1b312284274d7313703958d0619b28fc95fd0005dffb8c758aad9\": container with ID starting with 4806b3f116e1b312284274d7313703958d0619b28fc95fd0005dffb8c758aad9 not found: ID does not exist" containerID="4806b3f116e1b312284274d7313703958d0619b28fc95fd0005dffb8c758aad9"
Jul 27 18:13:49.015562 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:13:49.015521    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4806b3f116e1b312284274d7313703958d0619b28fc95fd0005dffb8c758aad9"} err="failed to get container status \"4806b3f116e1b312284274d7313703958d0619b28fc95fd0005dffb8c758aad9\": rpc error: code = NotFound desc = could not find container \"4806b3f116e1b312284274d7313703958d0619b28fc95fd0005dffb8c758aad9\": container with ID starting with 4806b3f116e1b312284274d7313703958d0619b28fc95fd0005dffb8c758aad9 not found: ID does not exist"
Jul 27 18:13:49.031233 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:13:49.031206    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-autoscaling-hpa-lws-d4cbcfd2/autoscale-hpa-lws-kserve-router-scheduler-584b9979f5-dmjq2"]
Jul 27 18:13:49.041840 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:13:49.041814    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-autoscaling-hpa-lws-d4cbcfd2/autoscale-hpa-lws-kserve-router-scheduler-584b9979f5-dmjq2"]
Jul 27 18:13:49.271372 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:13:49.271341    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="475746b7-890d-4ac3-b6da-17bcaf8b2bd3" path="/var/lib/kubelet/pods/475746b7-890d-4ac3-b6da-17bcaf8b2bd3/volumes"
Jul 27 18:14:06.627087 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:14:06.627046    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 18:14:06.726030 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:14:06.725964    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 18:14:06.754059 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:14:06.754026    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-test-llm-autoscaling-keda-lws-e541a132/autoscale-keda-lws-kserve-mn-0"]
Jul 27 18:14:06.754421 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:14:06.754405    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc36c688-2c2e-4376-af14-5e44e3f306c7" containerName="main"
Jul 27 18:14:06.754473 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:14:06.754423    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc36c688-2c2e-4376-af14-5e44e3f306c7" containerName="main"
Jul 27 18:14:06.754473 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:14:06.754438    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="475746b7-890d-4ac3-b6da-17bcaf8b2bd3" containerName="main"
Jul 27 18:14:06.754473 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:14:06.754444    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="475746b7-890d-4ac3-b6da-17bcaf8b2bd3" containerName="main"
Jul 27 18:14:06.754473 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:14:06.754453    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7f07e8d-a315-422b-8402-5d29108f0c7b" containerName="main"
Jul 27 18:14:06.754473 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:14:06.754459    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7f07e8d-a315-422b-8402-5d29108f0c7b" containerName="main"
Jul 27 18:14:06.754655 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:14:06.754512    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="475746b7-890d-4ac3-b6da-17bcaf8b2bd3" containerName="main"
Jul 27 18:14:06.754655 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:14:06.754520    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc36c688-2c2e-4376-af14-5e44e3f306c7" containerName="main"
Jul 27 18:14:06.754655 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:14:06.754529    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="a7f07e8d-a315-422b-8402-5d29108f0c7b" containerName="main"
Jul 27 18:14:06.759043 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:14:06.759023    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-autoscaling-keda-lws-e541a132/autoscale-keda-lws-kserve-mn-0"
Jul 27 18:14:06.761553 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:14:06.761519    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-autoscaling-keda-lws-e541a132\"/\"default-dockercfg-7vr7h\""
Jul 27 18:14:06.762535 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:14:06.762513    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-autoscaling-keda-lws-e541a132\"/\"kube-root-ca.crt\""
Jul 27 18:14:06.762646 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:14:06.762562    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-autoscaling-keda-lws-e541a132\"/\"openshift-service-ca.crt\""
Jul 27 18:14:06.762646 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:14:06.762596    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-autoscaling-keda-lws-e541a132\"/\"autoscale-keda-lws-kserve-mn-dockercfg-kdpwr\""
Jul 27 18:14:06.762646 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:14:06.762632    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-autoscaling-keda-lws-e541a132\"/\"autoscale-keda-lws-kserve-self-signed-certs\""
Jul 27 18:14:06.770645 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:14:06.770622    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-autoscaling-keda-lws-e541a132/autoscale-keda-lws-kserve-mn-0"]
Jul 27 18:14:06.828154 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:14:06.828121    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 18:14:06.828432 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:14:06.828394    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c8cfd463-dbd9-4caa-b346-100144a301c1-tmp-dir\") pod \"autoscale-keda-lws-kserve-mn-0\" (UID: \"c8cfd463-dbd9-4caa-b346-100144a301c1\") " pod="e2e-test-llm-autoscaling-keda-lws-e541a132/autoscale-keda-lws-kserve-mn-0"
Jul 27 18:14:06.828503 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:14:06.828486    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c8cfd463-dbd9-4caa-b346-100144a301c1-dshm\") pod \"autoscale-keda-lws-kserve-mn-0\" (UID: \"c8cfd463-dbd9-4caa-b346-100144a301c1\") " pod="e2e-test-llm-autoscaling-keda-lws-e541a132/autoscale-keda-lws-kserve-mn-0"
Jul 27 18:14:06.828568 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:14:06.828555    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c8cfd463-dbd9-4caa-b346-100144a301c1-tls-certs\") pod \"autoscale-keda-lws-kserve-mn-0\" (UID: \"c8cfd463-dbd9-4caa-b346-100144a301c1\") " pod="e2e-test-llm-autoscaling-keda-lws-e541a132/autoscale-keda-lws-kserve-mn-0"
Jul 27 18:14:06.828613 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:14:06.828591    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c8cfd463-dbd9-4caa-b346-100144a301c1-home\") pod \"autoscale-keda-lws-kserve-mn-0\" (UID: \"c8cfd463-dbd9-4caa-b346-100144a301c1\") " pod="e2e-test-llm-autoscaling-keda-lws-e541a132/autoscale-keda-lws-kserve-mn-0"
Jul 27 18:14:06.828663 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:14:06.828649    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtmg6\" (UniqueName: \"kubernetes.io/projected/c8cfd463-dbd9-4caa-b346-100144a301c1-kube-api-access-rtmg6\") pod \"autoscale-keda-lws-kserve-mn-0\" (UID: \"c8cfd463-dbd9-4caa-b346-100144a301c1\") " pod="e2e-test-llm-autoscaling-keda-lws-e541a132/autoscale-keda-lws-kserve-mn-0"
Jul 27 18:14:06.828730 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:14:06.828712    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c8cfd463-dbd9-4caa-b346-100144a301c1-model-cache\") pod \"autoscale-keda-lws-kserve-mn-0\" (UID: \"c8cfd463-dbd9-4caa-b346-100144a301c1\") " pod="e2e-test-llm-autoscaling-keda-lws-e541a132/autoscale-keda-lws-kserve-mn-0"
Jul 27 18:14:06.929646 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:14:06.929559    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c8cfd463-dbd9-4caa-b346-100144a301c1-model-cache\") pod \"autoscale-keda-lws-kserve-mn-0\" (UID: \"c8cfd463-dbd9-4caa-b346-100144a301c1\") " pod="e2e-test-llm-autoscaling-keda-lws-e541a132/autoscale-keda-lws-kserve-mn-0"
Jul 27 18:14:06.929646 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:14:06.929610    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c8cfd463-dbd9-4caa-b346-100144a301c1-tmp-dir\") pod \"autoscale-keda-lws-kserve-mn-0\" (UID: \"c8cfd463-dbd9-4caa-b346-100144a301c1\") " pod="e2e-test-llm-autoscaling-keda-lws-e541a132/autoscale-keda-lws-kserve-mn-0"
Jul 27 18:14:06.929646 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:14:06.929641    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c8cfd463-dbd9-4caa-b346-100144a301c1-dshm\") pod \"autoscale-keda-lws-kserve-mn-0\" (UID: \"c8cfd463-dbd9-4caa-b346-100144a301c1\") " pod="e2e-test-llm-autoscaling-keda-lws-e541a132/autoscale-keda-lws-kserve-mn-0"
Jul 27 18:14:06.929934 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:14:06.929671    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c8cfd463-dbd9-4caa-b346-100144a301c1-tls-certs\") pod \"autoscale-keda-lws-kserve-mn-0\" (UID: \"c8cfd463-dbd9-4caa-b346-100144a301c1\") " pod="e2e-test-llm-autoscaling-keda-lws-e541a132/autoscale-keda-lws-kserve-mn-0"
Jul 27 18:14:06.929934 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:14:06.929703    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c8cfd463-dbd9-4caa-b346-100144a301c1-home\") pod \"autoscale-keda-lws-kserve-mn-0\" (UID: \"c8cfd463-dbd9-4caa-b346-100144a301c1\") " pod="e2e-test-llm-autoscaling-keda-lws-e541a132/autoscale-keda-lws-kserve-mn-0"
Jul 27 18:14:06.929934 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:14:06.929750    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtmg6\" (UniqueName: \"kubernetes.io/projected/c8cfd463-dbd9-4caa-b346-100144a301c1-kube-api-access-rtmg6\") pod \"autoscale-keda-lws-kserve-mn-0\" (UID: \"c8cfd463-dbd9-4caa-b346-100144a301c1\") " pod="e2e-test-llm-autoscaling-keda-lws-e541a132/autoscale-keda-lws-kserve-mn-0"
Jul 27 18:14:06.930087 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:14:06.930024    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c8cfd463-dbd9-4caa-b346-100144a301c1-model-cache\") pod \"autoscale-keda-lws-kserve-mn-0\" (UID: \"c8cfd463-dbd9-4caa-b346-100144a301c1\") " pod="e2e-test-llm-autoscaling-keda-lws-e541a132/autoscale-keda-lws-kserve-mn-0"
Jul 27 18:14:06.930148 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:14:06.930075    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c8cfd463-dbd9-4caa-b346-100144a301c1-tmp-dir\") pod \"autoscale-keda-lws-kserve-mn-0\" (UID: \"c8cfd463-dbd9-4caa-b346-100144a301c1\") " pod="e2e-test-llm-autoscaling-keda-lws-e541a132/autoscale-keda-lws-kserve-mn-0"
Jul 27 18:14:06.930209 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:14:06.930171    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c8cfd463-dbd9-4caa-b346-100144a301c1-home\") pod \"autoscale-keda-lws-kserve-mn-0\" (UID: \"c8cfd463-dbd9-4caa-b346-100144a301c1\") " pod="e2e-test-llm-autoscaling-keda-lws-e541a132/autoscale-keda-lws-kserve-mn-0"
Jul 27 18:14:06.931946 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:14:06.931925    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c8cfd463-dbd9-4caa-b346-100144a301c1-dshm\") pod \"autoscale-keda-lws-kserve-mn-0\" (UID: \"c8cfd463-dbd9-4caa-b346-100144a301c1\") " pod="e2e-test-llm-autoscaling-keda-lws-e541a132/autoscale-keda-lws-kserve-mn-0"
Jul 27 18:14:06.932114 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:14:06.932093    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c8cfd463-dbd9-4caa-b346-100144a301c1-tls-certs\") pod \"autoscale-keda-lws-kserve-mn-0\" (UID: \"c8cfd463-dbd9-4caa-b346-100144a301c1\") " pod="e2e-test-llm-autoscaling-keda-lws-e541a132/autoscale-keda-lws-kserve-mn-0"
Jul 27 18:14:06.939800 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:14:06.939771    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtmg6\" (UniqueName: \"kubernetes.io/projected/c8cfd463-dbd9-4caa-b346-100144a301c1-kube-api-access-rtmg6\") pod \"autoscale-keda-lws-kserve-mn-0\" (UID: \"c8cfd463-dbd9-4caa-b346-100144a301c1\") " pod="e2e-test-llm-autoscaling-keda-lws-e541a132/autoscale-keda-lws-kserve-mn-0"
Jul 27 18:14:07.001259 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:14:07.001227    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-test-llm-autoscaling-keda-lws-e541a132/autoscale-keda-lws-kserve-router-scheduler-6cd9466d4f-sbzf8"]
Jul 27 18:14:07.004818 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:14:07.004801    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-autoscaling-keda-lws-e541a132/autoscale-keda-lws-kserve-router-scheduler-6cd9466d4f-sbzf8"
Jul 27 18:14:07.007514 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:14:07.007493    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-autoscaling-keda-lws-e541a132\"/\"autoscale-keda-lws-epp-sa-dockercfg-rmbz7\""
Jul 27 18:14:07.016733 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:14:07.016713    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-autoscaling-keda-lws-e541a132/autoscale-keda-lws-kserve-router-scheduler-6cd9466d4f-sbzf8"]
Jul 27 18:14:07.046026 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:14:07.045992    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 18:14:07.069995 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:14:07.069972    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-autoscaling-keda-lws-e541a132/autoscale-keda-lws-kserve-mn-0"
Jul 27 18:14:07.131874 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:14:07.131824    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c989h\" (UniqueName: \"kubernetes.io/projected/f747c078-e947-4f9b-ba80-d08507d49f08-kube-api-access-c989h\") pod \"autoscale-keda-lws-kserve-router-scheduler-6cd9466d4f-sbzf8\" (UID: \"f747c078-e947-4f9b-ba80-d08507d49f08\") " pod="e2e-test-llm-autoscaling-keda-lws-e541a132/autoscale-keda-lws-kserve-router-scheduler-6cd9466d4f-sbzf8"
Jul 27 18:14:07.132051 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:14:07.131910    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f747c078-e947-4f9b-ba80-d08507d49f08-tls-certs\") pod \"autoscale-keda-lws-kserve-router-scheduler-6cd9466d4f-sbzf8\" (UID: \"f747c078-e947-4f9b-ba80-d08507d49f08\") " pod="e2e-test-llm-autoscaling-keda-lws-e541a132/autoscale-keda-lws-kserve-router-scheduler-6cd9466d4f-sbzf8"
Jul 27 18:14:07.202152 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:14:07.202125    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-autoscaling-keda-lws-e541a132/autoscale-keda-lws-kserve-mn-0"]
Jul 27 18:14:07.204359 ip-10-0-137-134 kubenswrapper[2580]: W0727 18:14:07.204329    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8cfd463_dbd9_4caa_b346_100144a301c1.slice/crio-a93e020f9555e924ce0da4d0c1daa263896c2065fa38ec9c3c21fc6ecb2a9a82 WatchSource:0}: Error finding container a93e020f9555e924ce0da4d0c1daa263896c2065fa38ec9c3c21fc6ecb2a9a82: Status 404 returned error can't find the container with id a93e020f9555e924ce0da4d0c1daa263896c2065fa38ec9c3c21fc6ecb2a9a82
Jul 27 18:14:07.232925 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:14:07.232898    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c989h\" (UniqueName: \"kubernetes.io/projected/f747c078-e947-4f9b-ba80-d08507d49f08-kube-api-access-c989h\") pod \"autoscale-keda-lws-kserve-router-scheduler-6cd9466d4f-sbzf8\" (UID: \"f747c078-e947-4f9b-ba80-d08507d49f08\") " pod="e2e-test-llm-autoscaling-keda-lws-e541a132/autoscale-keda-lws-kserve-router-scheduler-6cd9466d4f-sbzf8"
Jul 27 18:14:07.233023 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:14:07.232937    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f747c078-e947-4f9b-ba80-d08507d49f08-tls-certs\") pod \"autoscale-keda-lws-kserve-router-scheduler-6cd9466d4f-sbzf8\" (UID: \"f747c078-e947-4f9b-ba80-d08507d49f08\") " pod="e2e-test-llm-autoscaling-keda-lws-e541a132/autoscale-keda-lws-kserve-router-scheduler-6cd9466d4f-sbzf8"
Jul 27 18:14:07.235183 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:14:07.235162    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f747c078-e947-4f9b-ba80-d08507d49f08-tls-certs\") pod \"autoscale-keda-lws-kserve-router-scheduler-6cd9466d4f-sbzf8\" (UID: \"f747c078-e947-4f9b-ba80-d08507d49f08\") " pod="e2e-test-llm-autoscaling-keda-lws-e541a132/autoscale-keda-lws-kserve-router-scheduler-6cd9466d4f-sbzf8"
Jul 27 18:14:07.242175 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:14:07.242152    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c989h\" (UniqueName: \"kubernetes.io/projected/f747c078-e947-4f9b-ba80-d08507d49f08-kube-api-access-c989h\") pod \"autoscale-keda-lws-kserve-router-scheduler-6cd9466d4f-sbzf8\" (UID: \"f747c078-e947-4f9b-ba80-d08507d49f08\") " pod="e2e-test-llm-autoscaling-keda-lws-e541a132/autoscale-keda-lws-kserve-router-scheduler-6cd9466d4f-sbzf8"
Jul 27 18:14:07.315960 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:14:07.315929    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-autoscaling-keda-lws-e541a132/autoscale-keda-lws-kserve-router-scheduler-6cd9466d4f-sbzf8"
Jul 27 18:14:07.447069 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:14:07.447046    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-autoscaling-keda-lws-e541a132/autoscale-keda-lws-kserve-router-scheduler-6cd9466d4f-sbzf8"]
Jul 27 18:14:07.449474 ip-10-0-137-134 kubenswrapper[2580]: W0727 18:14:07.449445    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf747c078_e947_4f9b_ba80_d08507d49f08.slice/crio-4b8ce545018b3020b5fbbfe88c47ec33ea4fef04bd2f3e5b253f603c56884d0d WatchSource:0}: Error finding container 4b8ce545018b3020b5fbbfe88c47ec33ea4fef04bd2f3e5b253f603c56884d0d: Status 404 returned error can't find the container with id 4b8ce545018b3020b5fbbfe88c47ec33ea4fef04bd2f3e5b253f603c56884d0d
Jul 27 18:14:08.098661 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:14:08.098622    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-autoscaling-keda-lws-e541a132/autoscale-keda-lws-kserve-mn-0" event={"ID":"c8cfd463-dbd9-4caa-b346-100144a301c1","Type":"ContainerStarted","Data":"34b82608bf4096b53bdaa47400c366b601812d073ff424d2c0e2d42dec66f3f6"}
Jul 27 18:14:08.099112 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:14:08.098687    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-autoscaling-keda-lws-e541a132/autoscale-keda-lws-kserve-mn-0" event={"ID":"c8cfd463-dbd9-4caa-b346-100144a301c1","Type":"ContainerStarted","Data":"a93e020f9555e924ce0da4d0c1daa263896c2065fa38ec9c3c21fc6ecb2a9a82"}
Jul 27 18:14:08.100104 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:14:08.100079    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-autoscaling-keda-lws-e541a132/autoscale-keda-lws-kserve-router-scheduler-6cd9466d4f-sbzf8" event={"ID":"f747c078-e947-4f9b-ba80-d08507d49f08","Type":"ContainerStarted","Data":"f4338fdae3942fce54f62e662573d374fbd1d044779e628258f0837a4dc66649"}
Jul 27 18:14:08.100228 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:14:08.100125    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-autoscaling-keda-lws-e541a132/autoscale-keda-lws-kserve-router-scheduler-6cd9466d4f-sbzf8" event={"ID":"f747c078-e947-4f9b-ba80-d08507d49f08","Type":"ContainerStarted","Data":"4b8ce545018b3020b5fbbfe88c47ec33ea4fef04bd2f3e5b253f603c56884d0d"}
Jul 27 18:14:08.100228 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:14:08.100164    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-autoscaling-keda-lws-e541a132/autoscale-keda-lws-kserve-router-scheduler-6cd9466d4f-sbzf8"
Jul 27 18:14:08.124871 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:14:08.124803    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-test-llm-autoscaling-keda-lws-e541a132/autoscale-keda-lws-kserve-mn-0" podStartSLOduration=2.124790391 podStartE2EDuration="2.124790391s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:14:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:14:08.122767039 +0000 UTC m=+4361.319511842" watchObservedRunningTime="2026-07-27 18:14:08.124790391 +0000 UTC m=+4361.321535193"
Jul 27 18:14:08.142866 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:14:08.142802    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-test-llm-autoscaling-keda-lws-e541a132/autoscale-keda-lws-kserve-router-scheduler-6cd9466d4f-sbzf8" podStartSLOduration=2.142787387 podStartE2EDuration="2.142787387s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:14:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:14:08.141299215 +0000 UTC m=+4361.338044030" watchObservedRunningTime="2026-07-27 18:14:08.142787387 +0000 UTC m=+4361.339532189"
Jul 27 18:14:09.070971 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:14:09.070935    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-autoscaling-keda-lws-e541a132/autoscale-keda-lws-kserve-mn-0"
Jul 27 18:14:17.070234 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:14:17.070192    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-test-llm-autoscaling-keda-lws-e541a132/autoscale-keda-lws-kserve-mn-0"
Jul 27 18:14:17.082751 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:14:17.082725    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-test-llm-autoscaling-keda-lws-e541a132/autoscale-keda-lws-kserve-mn-0"
Jul 27 18:14:17.152699 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:14:17.152668    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-autoscaling-keda-lws-e541a132/autoscale-keda-lws-kserve-mn-0"
Jul 27 18:14:18.102141 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:14:18.102107    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 18:14:36.650291 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:14:36.650252    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 18:14:36.751654 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:14:36.751617    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 18:14:36.901416 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:14:36.901333    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 18:14:39.106667 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:14:39.106638    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-autoscaling-keda-lws-e541a132/autoscale-keda-lws-kserve-router-scheduler-6cd9466d4f-sbzf8"
Jul 27 18:15:58.550178 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:15:58.550135    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 18:17:51.314252 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:17:51.314167    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 18:17:53.354602 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:17:53.354569    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 18:18:50.185555 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:18:50.185520    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 18:19:36.766482 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:19:36.766404    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 18:26:43.628927 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:26:43.628894    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 18:27:10.478528 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:27:10.478479    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 18:27:10.541270 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:27:10.541239    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 18:28:36.798226 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:28:36.798136    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 18:28:48.591622 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:28:48.591564    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 18:29:00.216540 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:29:00.216501    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 18:29:00.235937 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:29:00.235906    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-autoscaling-keda-lws-e541a132/autoscale-keda-lws-kserve-router-scheduler-6cd9466d4f-sbzf8"]
Jul 27 18:29:00.239275 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:29:00.239246    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-autoscaling-keda-lws-e541a132/autoscale-keda-lws-kserve-mn-0"]
Jul 27 18:29:00.247372 ip-10-0-137-134 kubenswrapper[2580]: E0727 18:29:00.247331    2580 log.go:32] "ExecSync cmd from runtime service failed" err=<
Jul 27 18:29:00.247372 ip-10-0-137-134 kubenswrapper[2580]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 27 18:29:00.247372 ip-10-0-137-134 kubenswrapper[2580]:         , stdout: , stderr: , exit code -1
Jul 27 18:29:00.247372 ip-10-0-137-134 kubenswrapper[2580]:  > containerID="34b82608bf4096b53bdaa47400c366b601812d073ff424d2c0e2d42dec66f3f6" cmd=["/bin/sleep","15"]
Jul 27 18:29:00.247632 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:29:00.247385    2580 handlers.go:82] "Exec lifecycle hook for Container in Pod failed" execCommand=["/bin/sleep","15"] containerName="main" pod="e2e-test-llm-autoscaling-keda-lws-e541a132/autoscale-keda-lws-kserve-mn-0" message="" err=<
Jul 27 18:29:00.247632 ip-10-0-137-134 kubenswrapper[2580]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 27 18:29:00.247632 ip-10-0-137-134 kubenswrapper[2580]:         , stdout: , stderr: , exit code -1
Jul 27 18:29:00.247632 ip-10-0-137-134 kubenswrapper[2580]:  >
Jul 27 18:29:00.247632 ip-10-0-137-134 kubenswrapper[2580]: E0727 18:29:00.247398    2580 kuberuntime_container.go:755] "PreStop hook failed" err=<
Jul 27 18:29:00.247632 ip-10-0-137-134 kubenswrapper[2580]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 27 18:29:00.247632 ip-10-0-137-134 kubenswrapper[2580]:         , stdout: , stderr: , exit code -1
Jul 27 18:29:00.247632 ip-10-0-137-134 kubenswrapper[2580]:  > pod="e2e-test-llm-autoscaling-keda-lws-e541a132/autoscale-keda-lws-kserve-mn-0" podUID="c8cfd463-dbd9-4caa-b346-100144a301c1" containerName="main" containerID="cri-o://34b82608bf4096b53bdaa47400c366b601812d073ff424d2c0e2d42dec66f3f6"
Jul 27 18:29:00.247632 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:29:00.247456    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-test-llm-autoscaling-keda-lws-e541a132/autoscale-keda-lws-kserve-mn-0" podUID="c8cfd463-dbd9-4caa-b346-100144a301c1" containerName="main" containerID="cri-o://34b82608bf4096b53bdaa47400c366b601812d073ff424d2c0e2d42dec66f3f6" gracePeriod=60
Jul 27 18:29:00.289633 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:29:00.289603    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 18:29:00.982971 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:29:00.982946    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-autoscaling-keda-lws-e541a132/autoscale-keda-lws-kserve-mn-0"
Jul 27 18:29:01.075041 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:29:01.075007    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c8cfd463-dbd9-4caa-b346-100144a301c1-dshm\") pod \"c8cfd463-dbd9-4caa-b346-100144a301c1\" (UID: \"c8cfd463-dbd9-4caa-b346-100144a301c1\") "
Jul 27 18:29:01.075041 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:29:01.075049    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c8cfd463-dbd9-4caa-b346-100144a301c1-home\") pod \"c8cfd463-dbd9-4caa-b346-100144a301c1\" (UID: \"c8cfd463-dbd9-4caa-b346-100144a301c1\") "
Jul 27 18:29:01.075269 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:29:01.075091    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c8cfd463-dbd9-4caa-b346-100144a301c1-tmp-dir\") pod \"c8cfd463-dbd9-4caa-b346-100144a301c1\" (UID: \"c8cfd463-dbd9-4caa-b346-100144a301c1\") "
Jul 27 18:29:01.075269 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:29:01.075109    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rtmg6\" (UniqueName: \"kubernetes.io/projected/c8cfd463-dbd9-4caa-b346-100144a301c1-kube-api-access-rtmg6\") pod \"c8cfd463-dbd9-4caa-b346-100144a301c1\" (UID: \"c8cfd463-dbd9-4caa-b346-100144a301c1\") "
Jul 27 18:29:01.075269 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:29:01.075183    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c8cfd463-dbd9-4caa-b346-100144a301c1-model-cache\") pod \"c8cfd463-dbd9-4caa-b346-100144a301c1\" (UID: \"c8cfd463-dbd9-4caa-b346-100144a301c1\") "
Jul 27 18:29:01.075269 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:29:01.075248    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c8cfd463-dbd9-4caa-b346-100144a301c1-tls-certs\") pod \"c8cfd463-dbd9-4caa-b346-100144a301c1\" (UID: \"c8cfd463-dbd9-4caa-b346-100144a301c1\") "
Jul 27 18:29:01.075495 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:29:01.075373    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8cfd463-dbd9-4caa-b346-100144a301c1-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c8cfd463-dbd9-4caa-b346-100144a301c1" (UID: "c8cfd463-dbd9-4caa-b346-100144a301c1"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:29:01.075495 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:29:01.075388    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8cfd463-dbd9-4caa-b346-100144a301c1-home" (OuterVolumeSpecName: "home") pod "c8cfd463-dbd9-4caa-b346-100144a301c1" (UID: "c8cfd463-dbd9-4caa-b346-100144a301c1"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:29:01.075601 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:29:01.075512    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8cfd463-dbd9-4caa-b346-100144a301c1-model-cache" (OuterVolumeSpecName: "model-cache") pod "c8cfd463-dbd9-4caa-b346-100144a301c1" (UID: "c8cfd463-dbd9-4caa-b346-100144a301c1"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:29:01.075601 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:29:01.075528    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c8cfd463-dbd9-4caa-b346-100144a301c1-home\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 27 18:29:01.075601 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:29:01.075546    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c8cfd463-dbd9-4caa-b346-100144a301c1-tmp-dir\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 27 18:29:01.077328 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:29:01.077302    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8cfd463-dbd9-4caa-b346-100144a301c1-dshm" (OuterVolumeSpecName: "dshm") pod "c8cfd463-dbd9-4caa-b346-100144a301c1" (UID: "c8cfd463-dbd9-4caa-b346-100144a301c1"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:29:01.077432 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:29:01.077338    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c8cfd463-dbd9-4caa-b346-100144a301c1-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c8cfd463-dbd9-4caa-b346-100144a301c1" (UID: "c8cfd463-dbd9-4caa-b346-100144a301c1"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 18:29:01.077432 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:29:01.077414    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8cfd463-dbd9-4caa-b346-100144a301c1-kube-api-access-rtmg6" (OuterVolumeSpecName: "kube-api-access-rtmg6") pod "c8cfd463-dbd9-4caa-b346-100144a301c1" (UID: "c8cfd463-dbd9-4caa-b346-100144a301c1"). InnerVolumeSpecName "kube-api-access-rtmg6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 18:29:01.176491 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:29:01.176413    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c8cfd463-dbd9-4caa-b346-100144a301c1-model-cache\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 27 18:29:01.176491 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:29:01.176441    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c8cfd463-dbd9-4caa-b346-100144a301c1-tls-certs\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 27 18:29:01.176491 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:29:01.176451    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c8cfd463-dbd9-4caa-b346-100144a301c1-dshm\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 27 18:29:01.176491 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:29:01.176459    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rtmg6\" (UniqueName: \"kubernetes.io/projected/c8cfd463-dbd9-4caa-b346-100144a301c1-kube-api-access-rtmg6\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 27 18:29:01.212689 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:29:01.212660    2580 generic.go:356] "Generic (PLEG): container finished" podID="c8cfd463-dbd9-4caa-b346-100144a301c1" containerID="34b82608bf4096b53bdaa47400c366b601812d073ff424d2c0e2d42dec66f3f6" exitCode=0
Jul 27 18:29:01.212876 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:29:01.212706    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-autoscaling-keda-lws-e541a132/autoscale-keda-lws-kserve-mn-0"
Jul 27 18:29:01.212876 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:29:01.212728    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-autoscaling-keda-lws-e541a132/autoscale-keda-lws-kserve-mn-0" event={"ID":"c8cfd463-dbd9-4caa-b346-100144a301c1","Type":"ContainerDied","Data":"34b82608bf4096b53bdaa47400c366b601812d073ff424d2c0e2d42dec66f3f6"}
Jul 27 18:29:01.212876 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:29:01.212768    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-autoscaling-keda-lws-e541a132/autoscale-keda-lws-kserve-mn-0" event={"ID":"c8cfd463-dbd9-4caa-b346-100144a301c1","Type":"ContainerDied","Data":"a93e020f9555e924ce0da4d0c1daa263896c2065fa38ec9c3c21fc6ecb2a9a82"}
Jul 27 18:29:01.212876 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:29:01.212791    2580 scope.go:117] "RemoveContainer" containerID="34b82608bf4096b53bdaa47400c366b601812d073ff424d2c0e2d42dec66f3f6"
Jul 27 18:29:01.222081 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:29:01.222065    2580 scope.go:117] "RemoveContainer" containerID="34b82608bf4096b53bdaa47400c366b601812d073ff424d2c0e2d42dec66f3f6"
Jul 27 18:29:01.222433 ip-10-0-137-134 kubenswrapper[2580]: E0727 18:29:01.222355    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"34b82608bf4096b53bdaa47400c366b601812d073ff424d2c0e2d42dec66f3f6\": container with ID starting with 34b82608bf4096b53bdaa47400c366b601812d073ff424d2c0e2d42dec66f3f6 not found: ID does not exist" containerID="34b82608bf4096b53bdaa47400c366b601812d073ff424d2c0e2d42dec66f3f6"
Jul 27 18:29:01.222433 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:29:01.222381    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34b82608bf4096b53bdaa47400c366b601812d073ff424d2c0e2d42dec66f3f6"} err="failed to get container status \"34b82608bf4096b53bdaa47400c366b601812d073ff424d2c0e2d42dec66f3f6\": rpc error: code = NotFound desc = could not find container \"34b82608bf4096b53bdaa47400c366b601812d073ff424d2c0e2d42dec66f3f6\": container with ID starting with 34b82608bf4096b53bdaa47400c366b601812d073ff424d2c0e2d42dec66f3f6 not found: ID does not exist"
Jul 27 18:29:01.235348 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:29:01.235319    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-autoscaling-keda-lws-e541a132/autoscale-keda-lws-kserve-mn-0"]
Jul 27 18:29:01.238720 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:29:01.238699    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-autoscaling-keda-lws-e541a132/autoscale-keda-lws-kserve-mn-0"]
Jul 27 18:29:01.270967 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:29:01.270927    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c8cfd463-dbd9-4caa-b346-100144a301c1" path="/var/lib/kubelet/pods/c8cfd463-dbd9-4caa-b346-100144a301c1/volumes"
Jul 27 18:29:09.106913 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:29:09.106872    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-autoscaling-keda-lws-e541a132/autoscale-keda-lws-kserve-router-scheduler-6cd9466d4f-sbzf8" podUID="f747c078-e947-4f9b-ba80-d08507d49f08" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Jul 27 18:29:15.255029 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:29:15.254990    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-test-llm-autoscaling-keda-lws-e541a132/autoscale-keda-lws-kserve-router-scheduler-6cd9466d4f-sbzf8" podUID="f747c078-e947-4f9b-ba80-d08507d49f08" containerName="main" containerID="cri-o://f4338fdae3942fce54f62e662573d374fbd1d044779e628258f0837a4dc66649" gracePeriod=45
Jul 27 18:29:15.504109 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:29:15.504086    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-autoscaling-keda-lws-e541a132/autoscale-keda-lws-kserve-router-scheduler-6cd9466d4f-sbzf8"
Jul 27 18:29:15.603675 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:29:15.603652    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f747c078-e947-4f9b-ba80-d08507d49f08-tls-certs\") pod \"f747c078-e947-4f9b-ba80-d08507d49f08\" (UID: \"f747c078-e947-4f9b-ba80-d08507d49f08\") "
Jul 27 18:29:15.603822 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:29:15.603710    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c989h\" (UniqueName: \"kubernetes.io/projected/f747c078-e947-4f9b-ba80-d08507d49f08-kube-api-access-c989h\") pod \"f747c078-e947-4f9b-ba80-d08507d49f08\" (UID: \"f747c078-e947-4f9b-ba80-d08507d49f08\") "
Jul 27 18:29:15.605699 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:29:15.605666    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f747c078-e947-4f9b-ba80-d08507d49f08-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f747c078-e947-4f9b-ba80-d08507d49f08" (UID: "f747c078-e947-4f9b-ba80-d08507d49f08"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 18:29:15.605813 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:29:15.605716    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f747c078-e947-4f9b-ba80-d08507d49f08-kube-api-access-c989h" (OuterVolumeSpecName: "kube-api-access-c989h") pod "f747c078-e947-4f9b-ba80-d08507d49f08" (UID: "f747c078-e947-4f9b-ba80-d08507d49f08"). InnerVolumeSpecName "kube-api-access-c989h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 18:29:15.704601 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:29:15.704571    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f747c078-e947-4f9b-ba80-d08507d49f08-tls-certs\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 27 18:29:15.704601 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:29:15.704597    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c989h\" (UniqueName: \"kubernetes.io/projected/f747c078-e947-4f9b-ba80-d08507d49f08-kube-api-access-c989h\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 27 18:29:16.286548 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:29:16.286510    2580 generic.go:356] "Generic (PLEG): container finished" podID="f747c078-e947-4f9b-ba80-d08507d49f08" containerID="f4338fdae3942fce54f62e662573d374fbd1d044779e628258f0837a4dc66649" exitCode=0
Jul 27 18:29:16.286975 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:29:16.286566    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-autoscaling-keda-lws-e541a132/autoscale-keda-lws-kserve-router-scheduler-6cd9466d4f-sbzf8" event={"ID":"f747c078-e947-4f9b-ba80-d08507d49f08","Type":"ContainerDied","Data":"f4338fdae3942fce54f62e662573d374fbd1d044779e628258f0837a4dc66649"}
Jul 27 18:29:16.286975 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:29:16.286573    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-autoscaling-keda-lws-e541a132/autoscale-keda-lws-kserve-router-scheduler-6cd9466d4f-sbzf8"
Jul 27 18:29:16.286975 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:29:16.286631    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-autoscaling-keda-lws-e541a132/autoscale-keda-lws-kserve-router-scheduler-6cd9466d4f-sbzf8" event={"ID":"f747c078-e947-4f9b-ba80-d08507d49f08","Type":"ContainerDied","Data":"4b8ce545018b3020b5fbbfe88c47ec33ea4fef04bd2f3e5b253f603c56884d0d"}
Jul 27 18:29:16.286975 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:29:16.286656    2580 scope.go:117] "RemoveContainer" containerID="f4338fdae3942fce54f62e662573d374fbd1d044779e628258f0837a4dc66649"
Jul 27 18:29:16.295411 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:29:16.295393    2580 scope.go:117] "RemoveContainer" containerID="f4338fdae3942fce54f62e662573d374fbd1d044779e628258f0837a4dc66649"
Jul 27 18:29:16.295671 ip-10-0-137-134 kubenswrapper[2580]: E0727 18:29:16.295651    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f4338fdae3942fce54f62e662573d374fbd1d044779e628258f0837a4dc66649\": container with ID starting with f4338fdae3942fce54f62e662573d374fbd1d044779e628258f0837a4dc66649 not found: ID does not exist" containerID="f4338fdae3942fce54f62e662573d374fbd1d044779e628258f0837a4dc66649"
Jul 27 18:29:16.295738 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:29:16.295679    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4338fdae3942fce54f62e662573d374fbd1d044779e628258f0837a4dc66649"} err="failed to get container status \"f4338fdae3942fce54f62e662573d374fbd1d044779e628258f0837a4dc66649\": rpc error: code = NotFound desc = could not find container \"f4338fdae3942fce54f62e662573d374fbd1d044779e628258f0837a4dc66649\": container with ID starting with f4338fdae3942fce54f62e662573d374fbd1d044779e628258f0837a4dc66649 not found: ID does not exist"
Jul 27 18:29:16.307627 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:29:16.307605    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-autoscaling-keda-lws-e541a132/autoscale-keda-lws-kserve-router-scheduler-6cd9466d4f-sbzf8"]
Jul 27 18:29:16.311501 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:29:16.311481    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-autoscaling-keda-lws-e541a132/autoscale-keda-lws-kserve-router-scheduler-6cd9466d4f-sbzf8"]
Jul 27 18:29:17.272357 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:29:17.272325    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f747c078-e947-4f9b-ba80-d08507d49f08" path="/var/lib/kubelet/pods/f747c078-e947-4f9b-ba80-d08507d49f08/volumes"
Jul 27 18:29:22.787111 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:29:22.787079    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-pftgl/must-gather-bgn56"]
Jul 27 18:29:22.787470 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:29:22.787461    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f747c078-e947-4f9b-ba80-d08507d49f08" containerName="main"
Jul 27 18:29:22.787512 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:29:22.787474    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="f747c078-e947-4f9b-ba80-d08507d49f08" containerName="main"
Jul 27 18:29:22.787512 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:29:22.787495    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8cfd463-dbd9-4caa-b346-100144a301c1" containerName="main"
Jul 27 18:29:22.787512 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:29:22.787501    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8cfd463-dbd9-4caa-b346-100144a301c1" containerName="main"
Jul 27 18:29:22.787607 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:29:22.787555    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8cfd463-dbd9-4caa-b346-100144a301c1" containerName="main"
Jul 27 18:29:22.787607 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:29:22.787566    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="f747c078-e947-4f9b-ba80-d08507d49f08" containerName="main"
Jul 27 18:29:22.792218 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:29:22.792199    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pftgl/must-gather-bgn56"
Jul 27 18:29:22.794719 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:29:22.794692    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-pftgl\"/\"default-dockercfg-fv5j2\""
Jul 27 18:29:22.795038 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:29:22.795019    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-pftgl\"/\"openshift-service-ca.crt\""
Jul 27 18:29:22.795144 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:29:22.795077    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-pftgl\"/\"kube-root-ca.crt\""
Jul 27 18:29:22.801173 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:29:22.801152    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pftgl/must-gather-bgn56"]
Jul 27 18:29:22.804550 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:29:22.804531    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 18:29:22.871131 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:29:22.871104    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 18:29:22.968270 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:29:22.968243    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2pfcv\" (UniqueName: \"kubernetes.io/projected/d9bfc476-f7d8-4f00-93f9-783c221d8008-kube-api-access-2pfcv\") pod \"must-gather-bgn56\" (UID: \"d9bfc476-f7d8-4f00-93f9-783c221d8008\") " pod="openshift-must-gather-pftgl/must-gather-bgn56"
Jul 27 18:29:22.968446 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:29:22.968374    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d9bfc476-f7d8-4f00-93f9-783c221d8008-must-gather-output\") pod \"must-gather-bgn56\" (UID: \"d9bfc476-f7d8-4f00-93f9-783c221d8008\") " pod="openshift-must-gather-pftgl/must-gather-bgn56"
Jul 27 18:29:23.069883 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:29:23.069754    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d9bfc476-f7d8-4f00-93f9-783c221d8008-must-gather-output\") pod \"must-gather-bgn56\" (UID: \"d9bfc476-f7d8-4f00-93f9-783c221d8008\") " pod="openshift-must-gather-pftgl/must-gather-bgn56"
Jul 27 18:29:23.069883 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:29:23.069869    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2pfcv\" (UniqueName: \"kubernetes.io/projected/d9bfc476-f7d8-4f00-93f9-783c221d8008-kube-api-access-2pfcv\") pod \"must-gather-bgn56\" (UID: \"d9bfc476-f7d8-4f00-93f9-783c221d8008\") " pod="openshift-must-gather-pftgl/must-gather-bgn56"
Jul 27 18:29:23.070133 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:29:23.070110    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d9bfc476-f7d8-4f00-93f9-783c221d8008-must-gather-output\") pod \"must-gather-bgn56\" (UID: \"d9bfc476-f7d8-4f00-93f9-783c221d8008\") " pod="openshift-must-gather-pftgl/must-gather-bgn56"
Jul 27 18:29:23.077744 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:29:23.077725    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2pfcv\" (UniqueName: \"kubernetes.io/projected/d9bfc476-f7d8-4f00-93f9-783c221d8008-kube-api-access-2pfcv\") pod \"must-gather-bgn56\" (UID: \"d9bfc476-f7d8-4f00-93f9-783c221d8008\") " pod="openshift-must-gather-pftgl/must-gather-bgn56"
Jul 27 18:29:23.101798 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:29:23.101774    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pftgl/must-gather-bgn56"
Jul 27 18:29:23.226490 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:29:23.226465    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pftgl/must-gather-bgn56"]
Jul 27 18:29:23.228447 ip-10-0-137-134 kubenswrapper[2580]: W0727 18:29:23.228417    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd9bfc476_f7d8_4f00_93f9_783c221d8008.slice/crio-ff2c8bee0e9d10ae37946cce04863b1a5b738d18faa844a5c648368dc54cfcce WatchSource:0}: Error finding container ff2c8bee0e9d10ae37946cce04863b1a5b738d18faa844a5c648368dc54cfcce: Status 404 returned error can't find the container with id ff2c8bee0e9d10ae37946cce04863b1a5b738d18faa844a5c648368dc54cfcce
Jul 27 18:29:23.230100 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:29:23.230084    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 18:29:23.319107 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:29:23.319072    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pftgl/must-gather-bgn56" event={"ID":"d9bfc476-f7d8-4f00-93f9-783c221d8008","Type":"ContainerStarted","Data":"ff2c8bee0e9d10ae37946cce04863b1a5b738d18faa844a5c648368dc54cfcce"}
Jul 27 18:29:31.371008 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:29:31.370972    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pftgl/must-gather-bgn56" event={"ID":"d9bfc476-f7d8-4f00-93f9-783c221d8008","Type":"ContainerStarted","Data":"5677720de67da66956ac203dbb8b2c278dc66950595177b232e1559e5f25c0fe"}
Jul 27 18:29:31.371509 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:29:31.371020    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pftgl/must-gather-bgn56" event={"ID":"d9bfc476-f7d8-4f00-93f9-783c221d8008","Type":"ContainerStarted","Data":"5ae7a3ab9ac3d7ee7bde84573fbc7622ed08bd1ec961e75278e9faf9630552ca"}
Jul 27 18:29:51.616557 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:29:51.616481    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-ccbdf686-qq5xn_c4173255-8c4d-4e40-846b-5b77d9ee96eb/manager/0.log"
Jul 27 18:29:51.645318 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:29:51.645293    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-598f86468b-c5j4w_13cfa107-0eac-473c-b411-7e2bef8da192/kuadrant-console-plugin/0.log"
Jul 27 18:29:52.914874 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:29:52.914813    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-ccbdf686-qq5xn_c4173255-8c4d-4e40-846b-5b77d9ee96eb/manager/0.log"
Jul 27 18:29:52.930143 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:29:52.930119    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-598f86468b-c5j4w_13cfa107-0eac-473c-b411-7e2bef8da192/kuadrant-console-plugin/0.log"
Jul 27 18:29:54.237347 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:29:54.237322    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-ccbdf686-qq5xn_c4173255-8c4d-4e40-846b-5b77d9ee96eb/manager/0.log"
Jul 27 18:29:54.251669 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:29:54.251647    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-598f86468b-c5j4w_13cfa107-0eac-473c-b411-7e2bef8da192/kuadrant-console-plugin/0.log"
Jul 27 18:29:55.460281 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:29:55.460256    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-ccbdf686-qq5xn_c4173255-8c4d-4e40-846b-5b77d9ee96eb/manager/0.log"
Jul 27 18:29:55.474963 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:29:55.474944    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-598f86468b-c5j4w_13cfa107-0eac-473c-b411-7e2bef8da192/kuadrant-console-plugin/0.log"
Jul 27 18:29:56.793686 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:29:56.793656    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-ccbdf686-qq5xn_c4173255-8c4d-4e40-846b-5b77d9ee96eb/manager/0.log"
Jul 27 18:29:56.810336 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:29:56.810311    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-598f86468b-c5j4w_13cfa107-0eac-473c-b411-7e2bef8da192/kuadrant-console-plugin/0.log"
Jul 27 18:29:58.019651 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:29:58.019618    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-ccbdf686-qq5xn_c4173255-8c4d-4e40-846b-5b77d9ee96eb/manager/0.log"
Jul 27 18:29:58.033355 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:29:58.033330    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-598f86468b-c5j4w_13cfa107-0eac-473c-b411-7e2bef8da192/kuadrant-console-plugin/0.log"
Jul 27 18:29:59.262315 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:29:59.262283    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-ccbdf686-qq5xn_c4173255-8c4d-4e40-846b-5b77d9ee96eb/manager/0.log"
Jul 27 18:29:59.277765 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:29:59.277742    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-598f86468b-c5j4w_13cfa107-0eac-473c-b411-7e2bef8da192/kuadrant-console-plugin/0.log"
Jul 27 18:30:00.513327 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:30:00.513303    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-ccbdf686-qq5xn_c4173255-8c4d-4e40-846b-5b77d9ee96eb/manager/0.log"
Jul 27 18:30:00.529498 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:30:00.529472    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-598f86468b-c5j4w_13cfa107-0eac-473c-b411-7e2bef8da192/kuadrant-console-plugin/0.log"
Jul 27 18:30:01.790135 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:30:01.790110    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-ccbdf686-qq5xn_c4173255-8c4d-4e40-846b-5b77d9ee96eb/manager/0.log"
Jul 27 18:30:01.807343 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:30:01.807317    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-598f86468b-c5j4w_13cfa107-0eac-473c-b411-7e2bef8da192/kuadrant-console-plugin/0.log"
Jul 27 18:30:03.204008 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:30:03.203980    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-ccbdf686-qq5xn_c4173255-8c4d-4e40-846b-5b77d9ee96eb/manager/0.log"
Jul 27 18:30:03.219163 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:30:03.219141    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-598f86468b-c5j4w_13cfa107-0eac-473c-b411-7e2bef8da192/kuadrant-console-plugin/0.log"
Jul 27 18:30:04.523578 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:30:04.523552    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-ccbdf686-qq5xn_c4173255-8c4d-4e40-846b-5b77d9ee96eb/manager/0.log"
Jul 27 18:30:04.538099 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:30:04.538077    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-598f86468b-c5j4w_13cfa107-0eac-473c-b411-7e2bef8da192/kuadrant-console-plugin/0.log"
Jul 27 18:30:05.808341 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:30:05.808314    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-ccbdf686-qq5xn_c4173255-8c4d-4e40-846b-5b77d9ee96eb/manager/0.log"
Jul 27 18:30:05.823655 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:30:05.823630    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-598f86468b-c5j4w_13cfa107-0eac-473c-b411-7e2bef8da192/kuadrant-console-plugin/0.log"
Jul 27 18:30:07.082312 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:30:07.082287    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-ccbdf686-qq5xn_c4173255-8c4d-4e40-846b-5b77d9ee96eb/manager/0.log"
Jul 27 18:30:07.096330 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:30:07.096306    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-598f86468b-c5j4w_13cfa107-0eac-473c-b411-7e2bef8da192/kuadrant-console-plugin/0.log"
Jul 27 18:30:08.346270 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:30:08.346244    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-ccbdf686-qq5xn_c4173255-8c4d-4e40-846b-5b77d9ee96eb/manager/0.log"
Jul 27 18:30:08.361203 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:30:08.361183    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-598f86468b-c5j4w_13cfa107-0eac-473c-b411-7e2bef8da192/kuadrant-console-plugin/0.log"
Jul 27 18:30:09.590449 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:30:09.590423    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-ccbdf686-qq5xn_c4173255-8c4d-4e40-846b-5b77d9ee96eb/manager/0.log"
Jul 27 18:30:09.604445 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:30:09.604424    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-598f86468b-c5j4w_13cfa107-0eac-473c-b411-7e2bef8da192/kuadrant-console-plugin/0.log"
Jul 27 18:30:10.784580 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:30:10.784550    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-ccbdf686-qq5xn_c4173255-8c4d-4e40-846b-5b77d9ee96eb/manager/0.log"
Jul 27 18:30:10.801372 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:30:10.801350    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-598f86468b-c5j4w_13cfa107-0eac-473c-b411-7e2bef8da192/kuadrant-console-plugin/0.log"
Jul 27 18:30:12.021716 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:30:12.021690    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-ccbdf686-qq5xn_c4173255-8c4d-4e40-846b-5b77d9ee96eb/manager/0.log"
Jul 27 18:30:12.034454 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:30:12.034432    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-598f86468b-c5j4w_13cfa107-0eac-473c-b411-7e2bef8da192/kuadrant-console-plugin/0.log"
Jul 27 18:30:13.264331 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:30:13.264303    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-ccbdf686-qq5xn_c4173255-8c4d-4e40-846b-5b77d9ee96eb/manager/0.log"
Jul 27 18:30:13.291811 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:30:13.291786    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-598f86468b-c5j4w_13cfa107-0eac-473c-b411-7e2bef8da192/kuadrant-console-plugin/0.log"
Jul 27 18:30:14.551697 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:30:14.551663    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-ccbdf686-qq5xn_c4173255-8c4d-4e40-846b-5b77d9ee96eb/manager/0.log"
Jul 27 18:30:14.566738 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:30:14.566718    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-598f86468b-c5j4w_13cfa107-0eac-473c-b411-7e2bef8da192/kuadrant-console-plugin/0.log"
Jul 27 18:30:15.800388 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:30:15.800347    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-ccbdf686-qq5xn_c4173255-8c4d-4e40-846b-5b77d9ee96eb/manager/0.log"
Jul 27 18:30:15.814676 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:30:15.814655    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-598f86468b-c5j4w_13cfa107-0eac-473c-b411-7e2bef8da192/kuadrant-console-plugin/0.log"
Jul 27 18:30:17.047219 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:30:17.047190    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-ccbdf686-qq5xn_c4173255-8c4d-4e40-846b-5b77d9ee96eb/manager/0.log"
Jul 27 18:30:17.064552 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:30:17.064527    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-598f86468b-c5j4w_13cfa107-0eac-473c-b411-7e2bef8da192/kuadrant-console-plugin/0.log"
Jul 27 18:30:18.258530 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:30:18.258502    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-ccbdf686-qq5xn_c4173255-8c4d-4e40-846b-5b77d9ee96eb/manager/0.log"
Jul 27 18:30:18.272842 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:30:18.272792    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-598f86468b-c5j4w_13cfa107-0eac-473c-b411-7e2bef8da192/kuadrant-console-plugin/0.log"
Jul 27 18:30:19.529940 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:30:19.529908    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-ccbdf686-qq5xn_c4173255-8c4d-4e40-846b-5b77d9ee96eb/manager/0.log"
Jul 27 18:30:19.546055 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:30:19.546029    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-598f86468b-c5j4w_13cfa107-0eac-473c-b411-7e2bef8da192/kuadrant-console-plugin/0.log"
Jul 27 18:30:20.799398 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:30:20.799373    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-ccbdf686-qq5xn_c4173255-8c4d-4e40-846b-5b77d9ee96eb/manager/0.log"
Jul 27 18:30:20.813477 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:30:20.813454    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-598f86468b-c5j4w_13cfa107-0eac-473c-b411-7e2bef8da192/kuadrant-console-plugin/0.log"
Jul 27 18:30:22.087924 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:30:22.087896    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-ccbdf686-qq5xn_c4173255-8c4d-4e40-846b-5b77d9ee96eb/manager/0.log"
Jul 27 18:30:22.102346 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:30:22.102325    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-598f86468b-c5j4w_13cfa107-0eac-473c-b411-7e2bef8da192/kuadrant-console-plugin/0.log"
Jul 27 18:30:23.356806 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:30:23.356779    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-ccbdf686-qq5xn_c4173255-8c4d-4e40-846b-5b77d9ee96eb/manager/0.log"
Jul 27 18:30:23.369643 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:30:23.369620    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-598f86468b-c5j4w_13cfa107-0eac-473c-b411-7e2bef8da192/kuadrant-console-plugin/0.log"
Jul 27 18:30:24.611951 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:30:24.611914    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-ccbdf686-qq5xn_c4173255-8c4d-4e40-846b-5b77d9ee96eb/manager/0.log"
Jul 27 18:30:24.625582 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:30:24.625560    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-598f86468b-c5j4w_13cfa107-0eac-473c-b411-7e2bef8da192/kuadrant-console-plugin/0.log"
Jul 27 18:30:25.877125 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:30:25.877100    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-ccbdf686-qq5xn_c4173255-8c4d-4e40-846b-5b77d9ee96eb/manager/0.log"
Jul 27 18:30:25.891719 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:30:25.891693    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-598f86468b-c5j4w_13cfa107-0eac-473c-b411-7e2bef8da192/kuadrant-console-plugin/0.log"
Jul 27 18:30:27.146527 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:30:27.146494    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-ccbdf686-qq5xn_c4173255-8c4d-4e40-846b-5b77d9ee96eb/manager/0.log"
Jul 27 18:30:27.162362 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:30:27.162335    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-598f86468b-c5j4w_13cfa107-0eac-473c-b411-7e2bef8da192/kuadrant-console-plugin/0.log"
Jul 27 18:30:28.403427 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:30:28.403402    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-ccbdf686-qq5xn_c4173255-8c4d-4e40-846b-5b77d9ee96eb/manager/0.log"
Jul 27 18:30:28.418698 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:30:28.418672    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-598f86468b-c5j4w_13cfa107-0eac-473c-b411-7e2bef8da192/kuadrant-console-plugin/0.log"
Jul 27 18:30:29.695903 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:30:29.695872    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-ccbdf686-qq5xn_c4173255-8c4d-4e40-846b-5b77d9ee96eb/manager/0.log"
Jul 27 18:30:29.711603 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:30:29.711579    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-598f86468b-c5j4w_13cfa107-0eac-473c-b411-7e2bef8da192/kuadrant-console-plugin/0.log"
Jul 27 18:30:30.980646 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:30:30.980615    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-ccbdf686-qq5xn_c4173255-8c4d-4e40-846b-5b77d9ee96eb/manager/0.log"
Jul 27 18:30:30.996886 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:30:30.996861    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-598f86468b-c5j4w_13cfa107-0eac-473c-b411-7e2bef8da192/kuadrant-console-plugin/0.log"
Jul 27 18:30:32.279377 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:30:32.279353    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-ccbdf686-qq5xn_c4173255-8c4d-4e40-846b-5b77d9ee96eb/manager/0.log"
Jul 27 18:30:32.293908 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:30:32.293885    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-598f86468b-c5j4w_13cfa107-0eac-473c-b411-7e2bef8da192/kuadrant-console-plugin/0.log"
Jul 27 18:30:33.572615 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:30:33.572581    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-ccbdf686-qq5xn_c4173255-8c4d-4e40-846b-5b77d9ee96eb/manager/0.log"
Jul 27 18:30:33.590020 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:30:33.589995    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-598f86468b-c5j4w_13cfa107-0eac-473c-b411-7e2bef8da192/kuadrant-console-plugin/0.log"
Jul 27 18:30:34.847406 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:30:34.847381    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-ccbdf686-qq5xn_c4173255-8c4d-4e40-846b-5b77d9ee96eb/manager/0.log"
Jul 27 18:30:34.863492 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:30:34.863464    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-598f86468b-c5j4w_13cfa107-0eac-473c-b411-7e2bef8da192/kuadrant-console-plugin/0.log"
Jul 27 18:30:36.133259 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:30:36.133230    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-ccbdf686-qq5xn_c4173255-8c4d-4e40-846b-5b77d9ee96eb/manager/0.log"
Jul 27 18:30:36.147688 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:30:36.147659    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-598f86468b-c5j4w_13cfa107-0eac-473c-b411-7e2bef8da192/kuadrant-console-plugin/0.log"
Jul 27 18:30:37.437953 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:30:37.437918    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-ccbdf686-qq5xn_c4173255-8c4d-4e40-846b-5b77d9ee96eb/manager/0.log"
Jul 27 18:30:37.451815 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:30:37.451795    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-598f86468b-c5j4w_13cfa107-0eac-473c-b411-7e2bef8da192/kuadrant-console-plugin/0.log"
Jul 27 18:30:38.715225 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:30:38.715198    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-ccbdf686-qq5xn_c4173255-8c4d-4e40-846b-5b77d9ee96eb/manager/0.log"
Jul 27 18:30:38.729400 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:30:38.729376    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-598f86468b-c5j4w_13cfa107-0eac-473c-b411-7e2bef8da192/kuadrant-console-plugin/0.log"
Jul 27 18:30:39.961850 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:30:39.961796    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-ccbdf686-qq5xn_c4173255-8c4d-4e40-846b-5b77d9ee96eb/manager/0.log"
Jul 27 18:30:39.976034 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:30:39.976013    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-598f86468b-c5j4w_13cfa107-0eac-473c-b411-7e2bef8da192/kuadrant-console-plugin/0.log"
Jul 27 18:30:41.223286 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:30:41.223257    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-ccbdf686-qq5xn_c4173255-8c4d-4e40-846b-5b77d9ee96eb/manager/0.log"
Jul 27 18:30:41.236988 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:30:41.236960    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-598f86468b-c5j4w_13cfa107-0eac-473c-b411-7e2bef8da192/kuadrant-console-plugin/0.log"
Jul 27 18:30:42.502580 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:30:42.502555    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-ccbdf686-qq5xn_c4173255-8c4d-4e40-846b-5b77d9ee96eb/manager/0.log"
Jul 27 18:30:42.516844 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:30:42.516817    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-598f86468b-c5j4w_13cfa107-0eac-473c-b411-7e2bef8da192/kuadrant-console-plugin/0.log"
Jul 27 18:30:43.777014 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:30:43.776985    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-ccbdf686-qq5xn_c4173255-8c4d-4e40-846b-5b77d9ee96eb/manager/0.log"
Jul 27 18:30:43.790358 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:30:43.790333    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-598f86468b-c5j4w_13cfa107-0eac-473c-b411-7e2bef8da192/kuadrant-console-plugin/0.log"
Jul 27 18:30:45.058357 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:30:45.058325    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-ccbdf686-qq5xn_c4173255-8c4d-4e40-846b-5b77d9ee96eb/manager/0.log"
Jul 27 18:30:45.072663 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:30:45.072640    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-598f86468b-c5j4w_13cfa107-0eac-473c-b411-7e2bef8da192/kuadrant-console-plugin/0.log"
Jul 27 18:30:46.331085 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:30:46.331055    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-ccbdf686-qq5xn_c4173255-8c4d-4e40-846b-5b77d9ee96eb/manager/0.log"
Jul 27 18:30:46.345612 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:30:46.345587    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-598f86468b-c5j4w_13cfa107-0eac-473c-b411-7e2bef8da192/kuadrant-console-plugin/0.log"
Jul 27 18:30:47.626742 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:30:47.626717    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-ccbdf686-qq5xn_c4173255-8c4d-4e40-846b-5b77d9ee96eb/manager/0.log"
Jul 27 18:30:47.641135 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:30:47.641111    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-598f86468b-c5j4w_13cfa107-0eac-473c-b411-7e2bef8da192/kuadrant-console-plugin/0.log"
Jul 27 18:30:48.888861 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:30:48.888822    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-ccbdf686-qq5xn_c4173255-8c4d-4e40-846b-5b77d9ee96eb/manager/0.log"
Jul 27 18:30:48.902523 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:30:48.902499    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-598f86468b-c5j4w_13cfa107-0eac-473c-b411-7e2bef8da192/kuadrant-console-plugin/0.log"
Jul 27 18:30:50.152144 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:30:50.152120    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-ccbdf686-qq5xn_c4173255-8c4d-4e40-846b-5b77d9ee96eb/manager/0.log"
Jul 27 18:30:50.167720 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:30:50.167698    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-598f86468b-c5j4w_13cfa107-0eac-473c-b411-7e2bef8da192/kuadrant-console-plugin/0.log"
Jul 27 18:30:51.404025 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:30:51.404000    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-ccbdf686-qq5xn_c4173255-8c4d-4e40-846b-5b77d9ee96eb/manager/0.log"
Jul 27 18:30:51.419159 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:30:51.419132    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-598f86468b-c5j4w_13cfa107-0eac-473c-b411-7e2bef8da192/kuadrant-console-plugin/0.log"
Jul 27 18:30:52.686772 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:30:52.686739    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-ccbdf686-qq5xn_c4173255-8c4d-4e40-846b-5b77d9ee96eb/manager/0.log"
Jul 27 18:30:52.701319 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:30:52.701297    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-598f86468b-c5j4w_13cfa107-0eac-473c-b411-7e2bef8da192/kuadrant-console-plugin/0.log"
Jul 27 18:30:53.808277 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:30:53.808179    2580 generic.go:356] "Generic (PLEG): container finished" podID="d9bfc476-f7d8-4f00-93f9-783c221d8008" containerID="5ae7a3ab9ac3d7ee7bde84573fbc7622ed08bd1ec961e75278e9faf9630552ca" exitCode=0
Jul 27 18:30:53.808277 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:30:53.808256    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pftgl/must-gather-bgn56" event={"ID":"d9bfc476-f7d8-4f00-93f9-783c221d8008","Type":"ContainerDied","Data":"5ae7a3ab9ac3d7ee7bde84573fbc7622ed08bd1ec961e75278e9faf9630552ca"}
Jul 27 18:30:53.808789 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:30:53.808675    2580 scope.go:117] "RemoveContainer" containerID="5ae7a3ab9ac3d7ee7bde84573fbc7622ed08bd1ec961e75278e9faf9630552ca"
Jul 27 18:30:54.511885 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:30:54.511858    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-pftgl_must-gather-bgn56_d9bfc476-f7d8-4f00-93f9-783c221d8008/gather/0.log"
Jul 27 18:30:54.962858 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:30:54.962814    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 18:30:55.080965 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:30:55.080927    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-q5775/must-gather-dw5cm"]
Jul 27 18:30:55.084656 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:30:55.084638    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-q5775/must-gather-dw5cm"
Jul 27 18:30:55.087310 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:30:55.087291    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-q5775\"/\"default-dockercfg-gsljn\""
Jul 27 18:30:55.087445 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:30:55.087381    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-q5775\"/\"openshift-service-ca.crt\""
Jul 27 18:30:55.087513 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:30:55.087455    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-q5775\"/\"kube-root-ca.crt\""
Jul 27 18:30:55.095790 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:30:55.095763    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 18:30:55.095908 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:30:55.095800    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-q5775/must-gather-dw5cm"]
Jul 27 18:30:55.173259 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:30:55.173225    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 18:30:55.210525 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:30:55.210489    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/e4a9ac73-6126-4d9d-ad10-c87bc373fa8a-must-gather-output\") pod \"must-gather-dw5cm\" (UID: \"e4a9ac73-6126-4d9d-ad10-c87bc373fa8a\") " pod="openshift-must-gather-q5775/must-gather-dw5cm"
Jul 27 18:30:55.210685 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:30:55.210529    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pllfc\" (UniqueName: \"kubernetes.io/projected/e4a9ac73-6126-4d9d-ad10-c87bc373fa8a-kube-api-access-pllfc\") pod \"must-gather-dw5cm\" (UID: \"e4a9ac73-6126-4d9d-ad10-c87bc373fa8a\") " pod="openshift-must-gather-q5775/must-gather-dw5cm"
Jul 27 18:30:55.311248 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:30:55.311160    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/e4a9ac73-6126-4d9d-ad10-c87bc373fa8a-must-gather-output\") pod \"must-gather-dw5cm\" (UID: \"e4a9ac73-6126-4d9d-ad10-c87bc373fa8a\") " pod="openshift-must-gather-q5775/must-gather-dw5cm"
Jul 27 18:30:55.311248 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:30:55.311194    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pllfc\" (UniqueName: \"kubernetes.io/projected/e4a9ac73-6126-4d9d-ad10-c87bc373fa8a-kube-api-access-pllfc\") pod \"must-gather-dw5cm\" (UID: \"e4a9ac73-6126-4d9d-ad10-c87bc373fa8a\") " pod="openshift-must-gather-q5775/must-gather-dw5cm"
Jul 27 18:30:55.311515 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:30:55.311497    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/e4a9ac73-6126-4d9d-ad10-c87bc373fa8a-must-gather-output\") pod \"must-gather-dw5cm\" (UID: \"e4a9ac73-6126-4d9d-ad10-c87bc373fa8a\") " pod="openshift-must-gather-q5775/must-gather-dw5cm"
Jul 27 18:30:55.320891 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:30:55.320869    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pllfc\" (UniqueName: \"kubernetes.io/projected/e4a9ac73-6126-4d9d-ad10-c87bc373fa8a-kube-api-access-pllfc\") pod \"must-gather-dw5cm\" (UID: \"e4a9ac73-6126-4d9d-ad10-c87bc373fa8a\") " pod="openshift-must-gather-q5775/must-gather-dw5cm"
Jul 27 18:30:55.395190 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:30:55.395159    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-q5775/must-gather-dw5cm"
Jul 27 18:30:55.527376 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:30:55.527352    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-q5775/must-gather-dw5cm"]
Jul 27 18:30:55.529463 ip-10-0-137-134 kubenswrapper[2580]: W0727 18:30:55.529434    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode4a9ac73_6126_4d9d_ad10_c87bc373fa8a.slice/crio-730f7d544b575c101588e0c34468a597f1d801645df27d3fae885bd77ad4aa52 WatchSource:0}: Error finding container 730f7d544b575c101588e0c34468a597f1d801645df27d3fae885bd77ad4aa52: Status 404 returned error can't find the container with id 730f7d544b575c101588e0c34468a597f1d801645df27d3fae885bd77ad4aa52
Jul 27 18:30:55.820622 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:30:55.820591    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-q5775/must-gather-dw5cm" event={"ID":"e4a9ac73-6126-4d9d-ad10-c87bc373fa8a","Type":"ContainerStarted","Data":"730f7d544b575c101588e0c34468a597f1d801645df27d3fae885bd77ad4aa52"}
Jul 27 18:30:56.827097 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:30:56.827065    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-q5775/must-gather-dw5cm" event={"ID":"e4a9ac73-6126-4d9d-ad10-c87bc373fa8a","Type":"ContainerStarted","Data":"b40eb4fbec94bef62c0418a2475e82526beccd0786ce13837a74769aca4d6d17"}
Jul 27 18:30:57.836323 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:30:57.836270    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-q5775/must-gather-dw5cm" event={"ID":"e4a9ac73-6126-4d9d-ad10-c87bc373fa8a","Type":"ContainerStarted","Data":"9cc9172e275ab2d4fb82d7d5411abcb657086d2d5ba0459d21c4a5078b04e214"}
Jul 27 18:30:58.368959 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:30:58.368928    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-g6775_2b793cd9-1cc7-4f3b-b882-1999e673076d/global-pull-secret-syncer/0.log"
Jul 27 18:30:58.421401 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:30:58.421370    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log"
Jul 27 18:30:58.618534 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:30:58.618500    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-134.ec2.internal_083a17672f59f98418db0cff06013128/haproxy/0.log"
Jul 27 18:30:59.921452 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:30:59.921383    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-q5775/must-gather-dw5cm" podStartSLOduration=3.792024558 podStartE2EDuration="4.921358501s" totalImagesPullingTime="1.129333943s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:30:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:30:57.867545868 +0000 UTC m=+5371.064290673" watchObservedRunningTime="2026-07-27 18:30:59.921358501 +0000 UTC m=+5373.118103305"
Jul 27 18:30:59.922643 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:30:59.922611    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-pftgl/must-gather-bgn56"]
Jul 27 18:30:59.922879 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:30:59.922849    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-must-gather-pftgl/must-gather-bgn56" podUID="d9bfc476-f7d8-4f00-93f9-783c221d8008" containerName="copy" containerID="cri-o://5677720de67da66956ac203dbb8b2c278dc66950595177b232e1559e5f25c0fe" gracePeriod=2
Jul 27 18:30:59.928596 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:30:59.928318    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-pftgl/must-gather-bgn56"]
Jul 27 18:31:00.353429 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:31:00.353381    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-pftgl_must-gather-bgn56_d9bfc476-f7d8-4f00-93f9-783c221d8008/copy/0.log"
Jul 27 18:31:00.357168 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:31:00.357128    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pftgl/must-gather-bgn56"
Jul 27 18:31:00.369403 ip-10-0-137-134 kubenswrapper[2580]: E0727 18:31:00.360514    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-bgn56\" is forbidden: User \"system:node:ip-10-0-137-134.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-pftgl\": no relationship found between node 'ip-10-0-137-134.ec2.internal' and this object" podUID="d9bfc476-f7d8-4f00-93f9-783c221d8008" pod="openshift-must-gather-pftgl/must-gather-bgn56"
Jul 27 18:31:00.472797 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:31:00.472683    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d9bfc476-f7d8-4f00-93f9-783c221d8008-must-gather-output\") pod \"d9bfc476-f7d8-4f00-93f9-783c221d8008\" (UID: \"d9bfc476-f7d8-4f00-93f9-783c221d8008\") "
Jul 27 18:31:00.472797 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:31:00.472757    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2pfcv\" (UniqueName: \"kubernetes.io/projected/d9bfc476-f7d8-4f00-93f9-783c221d8008-kube-api-access-2pfcv\") pod \"d9bfc476-f7d8-4f00-93f9-783c221d8008\" (UID: \"d9bfc476-f7d8-4f00-93f9-783c221d8008\") "
Jul 27 18:31:00.481806 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:31:00.481758    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d9bfc476-f7d8-4f00-93f9-783c221d8008-kube-api-access-2pfcv" (OuterVolumeSpecName: "kube-api-access-2pfcv") pod "d9bfc476-f7d8-4f00-93f9-783c221d8008" (UID: "d9bfc476-f7d8-4f00-93f9-783c221d8008"). InnerVolumeSpecName "kube-api-access-2pfcv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 18:31:00.482358 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:31:00.482323    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9bfc476-f7d8-4f00-93f9-783c221d8008-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "d9bfc476-f7d8-4f00-93f9-783c221d8008" (UID: "d9bfc476-f7d8-4f00-93f9-783c221d8008"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:31:00.574302 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:31:00.574264    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2pfcv\" (UniqueName: \"kubernetes.io/projected/d9bfc476-f7d8-4f00-93f9-783c221d8008-kube-api-access-2pfcv\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 27 18:31:00.574522 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:31:00.574312    2580 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d9bfc476-f7d8-4f00-93f9-783c221d8008-must-gather-output\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 27 18:31:00.765965 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:31:00.765866    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 18:31:00.859874 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:31:00.859841    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-pftgl_must-gather-bgn56_d9bfc476-f7d8-4f00-93f9-783c221d8008/copy/0.log"
Jul 27 18:31:00.860809 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:31:00.860774    2580 generic.go:356] "Generic (PLEG): container finished" podID="d9bfc476-f7d8-4f00-93f9-783c221d8008" containerID="5677720de67da66956ac203dbb8b2c278dc66950595177b232e1559e5f25c0fe" exitCode=143
Jul 27 18:31:00.860962 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:31:00.860904    2580 scope.go:117] "RemoveContainer" containerID="5677720de67da66956ac203dbb8b2c278dc66950595177b232e1559e5f25c0fe"
Jul 27 18:31:00.861081 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:31:00.861064    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pftgl/must-gather-bgn56"
Jul 27 18:31:00.863907 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:31:00.863879    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdxlg_6e5b6418-be32-4e11-88d2-929d0f6f52d6/konnectivity-agent/0.log" limit=1024
Jul 27 18:31:00.867476 ip-10-0-137-134 kubenswrapper[2580]: E0727 18:31:00.867428    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-bgn56\" is forbidden: User \"system:node:ip-10-0-137-134.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-pftgl\": no relationship found between node 'ip-10-0-137-134.ec2.internal' and this object" podUID="d9bfc476-f7d8-4f00-93f9-783c221d8008" pod="openshift-must-gather-pftgl/must-gather-bgn56"
Jul 27 18:31:00.876124 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:31:00.875899    2580 scope.go:117] "RemoveContainer" containerID="5ae7a3ab9ac3d7ee7bde84573fbc7622ed08bd1ec961e75278e9faf9630552ca"
Jul 27 18:31:00.882955 ip-10-0-137-134 kubenswrapper[2580]: E0727 18:31:00.882397    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-bgn56\" is forbidden: User \"system:node:ip-10-0-137-134.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-pftgl\": no relationship found between node 'ip-10-0-137-134.ec2.internal' and this object" podUID="d9bfc476-f7d8-4f00-93f9-783c221d8008" pod="openshift-must-gather-pftgl/must-gather-bgn56"
Jul 27 18:31:00.902452 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:31:00.902425    2580 scope.go:117] "RemoveContainer" containerID="5677720de67da66956ac203dbb8b2c278dc66950595177b232e1559e5f25c0fe"
Jul 27 18:31:00.902846 ip-10-0-137-134 kubenswrapper[2580]: E0727 18:31:00.902806    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5677720de67da66956ac203dbb8b2c278dc66950595177b232e1559e5f25c0fe\": container with ID starting with 5677720de67da66956ac203dbb8b2c278dc66950595177b232e1559e5f25c0fe not found: ID does not exist" containerID="5677720de67da66956ac203dbb8b2c278dc66950595177b232e1559e5f25c0fe"
Jul 27 18:31:00.902974 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:31:00.902862    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5677720de67da66956ac203dbb8b2c278dc66950595177b232e1559e5f25c0fe"} err="failed to get container status \"5677720de67da66956ac203dbb8b2c278dc66950595177b232e1559e5f25c0fe\": rpc error: code = NotFound desc = could not find container \"5677720de67da66956ac203dbb8b2c278dc66950595177b232e1559e5f25c0fe\": container with ID starting with 5677720de67da66956ac203dbb8b2c278dc66950595177b232e1559e5f25c0fe not found: ID does not exist"
Jul 27 18:31:00.902974 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:31:00.902889    2580 scope.go:117] "RemoveContainer" containerID="5ae7a3ab9ac3d7ee7bde84573fbc7622ed08bd1ec961e75278e9faf9630552ca"
Jul 27 18:31:00.903209 ip-10-0-137-134 kubenswrapper[2580]: E0727 18:31:00.903138    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5ae7a3ab9ac3d7ee7bde84573fbc7622ed08bd1ec961e75278e9faf9630552ca\": container with ID starting with 5ae7a3ab9ac3d7ee7bde84573fbc7622ed08bd1ec961e75278e9faf9630552ca not found: ID does not exist" containerID="5ae7a3ab9ac3d7ee7bde84573fbc7622ed08bd1ec961e75278e9faf9630552ca"
Jul 27 18:31:00.903209 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:31:00.903170    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ae7a3ab9ac3d7ee7bde84573fbc7622ed08bd1ec961e75278e9faf9630552ca"} err="failed to get container status \"5ae7a3ab9ac3d7ee7bde84573fbc7622ed08bd1ec961e75278e9faf9630552ca\": rpc error: code = NotFound desc = could not find container \"5ae7a3ab9ac3d7ee7bde84573fbc7622ed08bd1ec961e75278e9faf9630552ca\": container with ID starting with 5ae7a3ab9ac3d7ee7bde84573fbc7622ed08bd1ec961e75278e9faf9630552ca not found: ID does not exist"
Jul 27 18:31:01.273762 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:31:01.273717    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d9bfc476-f7d8-4f00-93f9-783c221d8008" path="/var/lib/kubelet/pods/d9bfc476-f7d8-4f00-93f9-783c221d8008/volumes"
Jul 27 18:31:03.430427 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:31:03.430394    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-ccbdf686-qq5xn_c4173255-8c4d-4e40-846b-5b77d9ee96eb/manager/0.log"
Jul 27 18:31:03.465233 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:31:03.465190    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-598f86468b-c5j4w_13cfa107-0eac-473c-b411-7e2bef8da192/kuadrant-console-plugin/0.log"
Jul 27 18:31:05.292212 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:31:05.292181    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-2ltcp_11b5826a-e337-4601-b61d-566151a3b95a/kube-state-metrics/0.log"
Jul 27 18:31:05.314851 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:31:05.314806    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-2ltcp_11b5826a-e337-4601-b61d-566151a3b95a/kube-rbac-proxy-main/0.log"
Jul 27 18:31:05.344986 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:31:05.344955    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-2ltcp_11b5826a-e337-4601-b61d-566151a3b95a/kube-rbac-proxy-self/0.log"
Jul 27 18:31:05.442146 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:31:05.442113    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-67d88cc47d-fdgh8_584a4a01-9a97-42dd-b163-a6ea16b856bb/metrics-server/0.log"
Jul 27 18:31:05.490878 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:31:05.490815    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-68b7fc9574-st8bz_78561ad9-f5ca-4e06-8491-9f2782579000/monitoring-plugin/0.log"
Jul 27 18:31:05.659870 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:31:05.659816    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jbxlh_7df45bbc-1f70-4a48-b344-8b7302a774a4/node-exporter/0.log"
Jul 27 18:31:05.688087 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:31:05.688041    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jbxlh_7df45bbc-1f70-4a48-b344-8b7302a774a4/kube-rbac-proxy/0.log"
Jul 27 18:31:05.719066 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:31:05.719039    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jbxlh_7df45bbc-1f70-4a48-b344-8b7302a774a4/init-textfile/0.log"
Jul 27 18:31:05.989352 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:31:05.989314    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_03a486b4-3578-4a40-9076-3e1980944df1/prometheus/0.log"
Jul 27 18:31:06.011630 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:31:06.011601    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_03a486b4-3578-4a40-9076-3e1980944df1/config-reloader/0.log"
Jul 27 18:31:06.039851 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:31:06.039810    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_03a486b4-3578-4a40-9076-3e1980944df1/thanos-sidecar/0.log"
Jul 27 18:31:06.069873 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:31:06.069842    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_03a486b4-3578-4a40-9076-3e1980944df1/kube-rbac-proxy-web/0.log"
Jul 27 18:31:06.096876 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:31:06.096817    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_03a486b4-3578-4a40-9076-3e1980944df1/kube-rbac-proxy/0.log"
Jul 27 18:31:06.124457 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:31:06.124427    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_03a486b4-3578-4a40-9076-3e1980944df1/kube-rbac-proxy-thanos/0.log"
Jul 27 18:31:06.151007 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:31:06.150977    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_03a486b4-3578-4a40-9076-3e1980944df1/init-config-reloader/0.log"
Jul 27 18:31:08.901040 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:31:08.901006    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-q5775/perf-node-gather-daemonset-l9xqp"]
Jul 27 18:31:08.901609 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:31:08.901397    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9bfc476-f7d8-4f00-93f9-783c221d8008" containerName="gather"
Jul 27 18:31:08.901609 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:31:08.901415    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9bfc476-f7d8-4f00-93f9-783c221d8008" containerName="gather"
Jul 27 18:31:08.901609 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:31:08.901438    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9bfc476-f7d8-4f00-93f9-783c221d8008" containerName="copy"
Jul 27 18:31:08.901609 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:31:08.901447    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9bfc476-f7d8-4f00-93f9-783c221d8008" containerName="copy"
Jul 27 18:31:08.901609 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:31:08.901552    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="d9bfc476-f7d8-4f00-93f9-783c221d8008" containerName="copy"
Jul 27 18:31:08.901609 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:31:08.901569    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="d9bfc476-f7d8-4f00-93f9-783c221d8008" containerName="gather"
Jul 27 18:31:08.906987 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:31:08.906962    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-q5775/perf-node-gather-daemonset-l9xqp"
Jul 27 18:31:08.916801 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:31:08.916554    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-q5775/perf-node-gather-daemonset-l9xqp"]
Jul 27 18:31:08.953722 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:31:08.953678    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzxhr\" (UniqueName: \"kubernetes.io/projected/fe33bc75-78ff-45ec-b451-34befe09db2a-kube-api-access-jzxhr\") pod \"perf-node-gather-daemonset-l9xqp\" (UID: \"fe33bc75-78ff-45ec-b451-34befe09db2a\") " pod="openshift-must-gather-q5775/perf-node-gather-daemonset-l9xqp"
Jul 27 18:31:08.953926 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:31:08.953784    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fe33bc75-78ff-45ec-b451-34befe09db2a-sys\") pod \"perf-node-gather-daemonset-l9xqp\" (UID: \"fe33bc75-78ff-45ec-b451-34befe09db2a\") " pod="openshift-must-gather-q5775/perf-node-gather-daemonset-l9xqp"
Jul 27 18:31:08.953926 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:31:08.953823    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fe33bc75-78ff-45ec-b451-34befe09db2a-proc\") pod \"perf-node-gather-daemonset-l9xqp\" (UID: \"fe33bc75-78ff-45ec-b451-34befe09db2a\") " pod="openshift-must-gather-q5775/perf-node-gather-daemonset-l9xqp"
Jul 27 18:31:08.953926 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:31:08.953869    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fe33bc75-78ff-45ec-b451-34befe09db2a-lib-modules\") pod \"perf-node-gather-daemonset-l9xqp\" (UID: \"fe33bc75-78ff-45ec-b451-34befe09db2a\") " pod="openshift-must-gather-q5775/perf-node-gather-daemonset-l9xqp"
Jul 27 18:31:08.953926 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:31:08.953916    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fe33bc75-78ff-45ec-b451-34befe09db2a-podres\") pod \"perf-node-gather-daemonset-l9xqp\" (UID: \"fe33bc75-78ff-45ec-b451-34befe09db2a\") " pod="openshift-must-gather-q5775/perf-node-gather-daemonset-l9xqp"
Jul 27 18:31:09.054886 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:31:09.054850    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzxhr\" (UniqueName: \"kubernetes.io/projected/fe33bc75-78ff-45ec-b451-34befe09db2a-kube-api-access-jzxhr\") pod \"perf-node-gather-daemonset-l9xqp\" (UID: \"fe33bc75-78ff-45ec-b451-34befe09db2a\") " pod="openshift-must-gather-q5775/perf-node-gather-daemonset-l9xqp"
Jul 27 18:31:09.055053 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:31:09.054908    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fe33bc75-78ff-45ec-b451-34befe09db2a-sys\") pod \"perf-node-gather-daemonset-l9xqp\" (UID: \"fe33bc75-78ff-45ec-b451-34befe09db2a\") " pod="openshift-must-gather-q5775/perf-node-gather-daemonset-l9xqp"
Jul 27 18:31:09.055053 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:31:09.054937    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fe33bc75-78ff-45ec-b451-34befe09db2a-proc\") pod \"perf-node-gather-daemonset-l9xqp\" (UID: \"fe33bc75-78ff-45ec-b451-34befe09db2a\") " pod="openshift-must-gather-q5775/perf-node-gather-daemonset-l9xqp"
Jul 27 18:31:09.055053 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:31:09.054957    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fe33bc75-78ff-45ec-b451-34befe09db2a-lib-modules\") pod \"perf-node-gather-daemonset-l9xqp\" (UID: \"fe33bc75-78ff-45ec-b451-34befe09db2a\") " pod="openshift-must-gather-q5775/perf-node-gather-daemonset-l9xqp"
Jul 27 18:31:09.055053 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:31:09.055002    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fe33bc75-78ff-45ec-b451-34befe09db2a-podres\") pod \"perf-node-gather-daemonset-l9xqp\" (UID: \"fe33bc75-78ff-45ec-b451-34befe09db2a\") " pod="openshift-must-gather-q5775/perf-node-gather-daemonset-l9xqp"
Jul 27 18:31:09.055053 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:31:09.055032    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fe33bc75-78ff-45ec-b451-34befe09db2a-sys\") pod \"perf-node-gather-daemonset-l9xqp\" (UID: \"fe33bc75-78ff-45ec-b451-34befe09db2a\") " pod="openshift-must-gather-q5775/perf-node-gather-daemonset-l9xqp"
Jul 27 18:31:09.055319 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:31:09.055043    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fe33bc75-78ff-45ec-b451-34befe09db2a-proc\") pod \"perf-node-gather-daemonset-l9xqp\" (UID: \"fe33bc75-78ff-45ec-b451-34befe09db2a\") " pod="openshift-must-gather-q5775/perf-node-gather-daemonset-l9xqp"
Jul 27 18:31:09.055319 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:31:09.055175    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fe33bc75-78ff-45ec-b451-34befe09db2a-podres\") pod \"perf-node-gather-daemonset-l9xqp\" (UID: \"fe33bc75-78ff-45ec-b451-34befe09db2a\") " pod="openshift-must-gather-q5775/perf-node-gather-daemonset-l9xqp"
Jul 27 18:31:09.055319 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:31:09.055190    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fe33bc75-78ff-45ec-b451-34befe09db2a-lib-modules\") pod \"perf-node-gather-daemonset-l9xqp\" (UID: \"fe33bc75-78ff-45ec-b451-34befe09db2a\") " pod="openshift-must-gather-q5775/perf-node-gather-daemonset-l9xqp"
Jul 27 18:31:09.062930 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:31:09.062903    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzxhr\" (UniqueName: \"kubernetes.io/projected/fe33bc75-78ff-45ec-b451-34befe09db2a-kube-api-access-jzxhr\") pod \"perf-node-gather-daemonset-l9xqp\" (UID: \"fe33bc75-78ff-45ec-b451-34befe09db2a\") " pod="openshift-must-gather-q5775/perf-node-gather-daemonset-l9xqp"
Jul 27 18:31:09.240265 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:31:09.240152    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-q5775/perf-node-gather-daemonset-l9xqp"
Jul 27 18:31:09.427102 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:31:09.427059    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-q5775/perf-node-gather-daemonset-l9xqp"]
Jul 27 18:31:09.430137 ip-10-0-137-134 kubenswrapper[2580]: W0727 18:31:09.430106    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podfe33bc75_78ff_45ec_b451_34befe09db2a.slice/crio-c15a075bd5b19019e8c961d54bc5c5c5249c4d1b04acb7c5a54d3f4383a09580 WatchSource:0}: Error finding container c15a075bd5b19019e8c961d54bc5c5c5249c4d1b04acb7c5a54d3f4383a09580: Status 404 returned error can't find the container with id c15a075bd5b19019e8c961d54bc5c5c5249c4d1b04acb7c5a54d3f4383a09580
Jul 27 18:31:09.933647 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:31:09.933607    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-q5775/perf-node-gather-daemonset-l9xqp" event={"ID":"fe33bc75-78ff-45ec-b451-34befe09db2a","Type":"ContainerStarted","Data":"06d1de16211fe08110adbec542e5e0d53d262d2336ea92b4b2a3d8690e92b361"}
Jul 27 18:31:09.934166 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:31:09.933683    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-q5775/perf-node-gather-daemonset-l9xqp" event={"ID":"fe33bc75-78ff-45ec-b451-34befe09db2a","Type":"ContainerStarted","Data":"c15a075bd5b19019e8c961d54bc5c5c5249c4d1b04acb7c5a54d3f4383a09580"}
Jul 27 18:31:09.934256 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:31:09.934219    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-q5775/perf-node-gather-daemonset-l9xqp"
Jul 27 18:31:09.952242 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:31:09.952190    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-q5775/perf-node-gather-daemonset-l9xqp" podStartSLOduration=1.952172559 podStartE2EDuration="1.952172559s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 18:31:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:31:09.950070756 +0000 UTC m=+5383.146815558" watchObservedRunningTime="2026-07-27 18:31:09.952172559 +0000 UTC m=+5383.148917360"
Jul 27 18:31:10.541810 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:31:10.541783    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-pvns7_ad547374-9c50-4b13-8884-74ed191f077a/dns/0.log"
Jul 27 18:31:10.567806 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:31:10.567777    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-pvns7_ad547374-9c50-4b13-8884-74ed191f077a/kube-rbac-proxy/0.log"
Jul 27 18:31:10.696598 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:31:10.696566    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-kt2nr_0ed8e5dc-750b-42d0-86b3-7d1e6802c992/dns-node-resolver/0.log"
Jul 27 18:31:11.223597 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:31:11.223555    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5f6478cfcf-8vjv8_794bcdd8-469e-45d8-90f7-36af8e118d22/registry/0.log"
Jul 27 18:31:11.312984 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:31:11.312956    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-dk4md_0bb4594a-a23f-4e66-a579-087b20377307/node-ca/0.log"
Jul 27 18:31:13.280227 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:31:13.280184    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-9nm5r_07c213e5-4e80-4cba-984d-d6b344d8a17a/serve-healthcheck-canary/0.log"
Jul 27 18:31:13.815780 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:31:13.815749    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gjcfv_68c7bd95-3782-462d-88dd-76fff9fbabed/kube-rbac-proxy/0.log"
Jul 27 18:31:13.838895 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:31:13.838867    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gjcfv_68c7bd95-3782-462d-88dd-76fff9fbabed/exporter/0.log"
Jul 27 18:31:13.863941 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:31:13.863916    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gjcfv_68c7bd95-3782-462d-88dd-76fff9fbabed/extractor/0.log"
Jul 27 18:31:16.957092 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:31:16.957061    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-q5775/perf-node-gather-daemonset-l9xqp"
Jul 27 18:31:17.044316 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:31:17.044288    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-58bd97cf4-7mprj_0a322f33-55cd-44a9-be2a-4d692181cee9/manager/0.log"
Jul 27 18:31:17.104570 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:31:17.104537    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-dqnrn_efed6a6a-1255-43b4-ad15-be9f171a36b9/openshift-lws-operator/0.log"
Jul 27 18:31:18.016923 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:31:18.016894    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_model-serving-api-7b954ffc95-gmv9t_f54bd66b-92cc-4432-b896-e081e7c2da4e/server/0.log"
Jul 27 18:31:18.800394 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:31:18.800353    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_odh-model-controller-75d9cdbddf-t5dhh_144e70fb-3c86-4179-8116-7538daede502/manager/0.log"
Jul 27 18:31:23.863151 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:31:23.863125    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-wgpdw_bd95eb69-1423-4fd1-8632-8795f287cd78/migrator/0.log"
Jul 27 18:31:23.886165 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:31:23.886136    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-wgpdw_bd95eb69-1423-4fd1-8632-8795f287cd78/graceful-termination/0.log"
Jul 27 18:31:24.249570 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:31:24.249477    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-jm6np_fa7f3110-1af2-4201-ae03-cae4fb2e5a51/kube-storage-version-migrator-operator/1.log"
Jul 27 18:31:24.251142 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:31:24.251114    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-jm6np_fa7f3110-1af2-4201-ae03-cae4fb2e5a51/kube-storage-version-migrator-operator/0.log"
Jul 27 18:31:25.301638 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:31:25.301565    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-7h9zp_f9a42d19-2eff-4160-a5ec-950fffedb6a3/kube-multus/0.log"
Jul 27 18:31:25.698240 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:31:25.698211    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vlzgx_7834bc12-869c-4364-b081-1c665ba26024/kube-multus-additional-cni-plugins/0.log"
Jul 27 18:31:25.719379 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:31:25.719350    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vlzgx_7834bc12-869c-4364-b081-1c665ba26024/egress-router-binary-copy/0.log"
Jul 27 18:31:25.740694 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:31:25.740670    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vlzgx_7834bc12-869c-4364-b081-1c665ba26024/cni-plugins/0.log"
Jul 27 18:31:25.762295 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:31:25.762265    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vlzgx_7834bc12-869c-4364-b081-1c665ba26024/bond-cni-plugin/0.log"
Jul 27 18:31:25.784889 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:31:25.784860    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vlzgx_7834bc12-869c-4364-b081-1c665ba26024/routeoverride-cni/0.log"
Jul 27 18:31:25.807725 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:31:25.807700    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vlzgx_7834bc12-869c-4364-b081-1c665ba26024/whereabouts-cni-bincopy/0.log"
Jul 27 18:31:25.830258 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:31:25.830231    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vlzgx_7834bc12-869c-4364-b081-1c665ba26024/whereabouts-cni/0.log"
Jul 27 18:31:25.903682 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:31:25.903655    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-s5bhd_d26abfd5-3102-42ec-a7e0-c5abe0e9dc85/network-metrics-daemon/0.log"
Jul 27 18:31:25.924932 ip-10-0-137-134 kubenswrapper[2580]: I0727 18:31:25.924905    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-s5bhd_d26abfd5-3102-42ec-a7e0-c5abe0e9dc85/kube-rbac-proxy/0.log"