Jul 20 19:00:38.667368 ip-10-0-139-141 systemd[1]: Starting Kubernetes Kubelet...
Jul 20 19:00:39.099064 ip-10-0-139-141 kubenswrapper[2563]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 20 19:00:39.099064 ip-10-0-139-141 kubenswrapper[2563]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 20 19:00:39.099064 ip-10-0-139-141 kubenswrapper[2563]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 20 19:00:39.099064 ip-10-0-139-141 kubenswrapper[2563]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 20 19:00:39.099064 ip-10-0-139-141 kubenswrapper[2563]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 20 19:00:39.100131 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.100034    2563 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 20 19:00:39.106411 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.106387    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 19:00:39.106411 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.106406    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 19:00:39.106411 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.106410    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 19:00:39.106411 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.106413    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 19:00:39.106411 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.106416    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 19:00:39.106411 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.106419    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 19:00:39.106645 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.106422    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 19:00:39.106645 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.106425    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 19:00:39.106645 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.106428    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 19:00:39.106645 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.106431    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 19:00:39.106645 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.106434    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 19:00:39.106645 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.106436    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 19:00:39.106645 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.106441    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 19:00:39.106645 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.106445    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 19:00:39.106645 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.106448    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 19:00:39.106645 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.106451    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 19:00:39.106645 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.106454    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 19:00:39.106645 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.106457    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 19:00:39.106645 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.106459    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 19:00:39.106645 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.106462    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 19:00:39.106645 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.106465    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 19:00:39.106645 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.106467    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 19:00:39.106645 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.106470    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 19:00:39.106645 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.106472    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 19:00:39.106645 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.106475    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 19:00:39.107114 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.106480    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 19:00:39.107114 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.106483    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 19:00:39.107114 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.106486    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 19:00:39.107114 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.106488    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 19:00:39.107114 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.106490    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 19:00:39.107114 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.106493    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 19:00:39.107114 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.106495    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 19:00:39.107114 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.106498    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 19:00:39.107114 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.106500    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 19:00:39.107114 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.106503    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 19:00:39.107114 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.106505    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 19:00:39.107114 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.106507    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 19:00:39.107114 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.106510    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 19:00:39.107114 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.106513    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 19:00:39.107114 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.106516    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 19:00:39.107114 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.106519    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 19:00:39.107114 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.106521    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 19:00:39.107114 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.106524    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 19:00:39.107114 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.106526    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 19:00:39.107114 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.106530    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 19:00:39.107620 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.106532    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 19:00:39.107620 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.106535    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 19:00:39.107620 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.106537    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 19:00:39.107620 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.106540    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 19:00:39.107620 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.106542    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 19:00:39.107620 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.106546    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 19:00:39.107620 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.106548    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 19:00:39.107620 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.106551    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 19:00:39.107620 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.106553    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 19:00:39.107620 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.106555    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 19:00:39.107620 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.106558    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 19:00:39.107620 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.106560    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 19:00:39.107620 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.106563    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 19:00:39.107620 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.106566    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 19:00:39.107620 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.106568    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 19:00:39.107620 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.106571    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 19:00:39.107620 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.106575    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 19:00:39.107620 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.106579    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 19:00:39.107620 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.106581    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 19:00:39.107620 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.106584    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 19:00:39.108108 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.106587    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 19:00:39.108108 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.106589    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 19:00:39.108108 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.106592    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 19:00:39.108108 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.106597    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 19:00:39.108108 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.106601    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 19:00:39.108108 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.106604    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 19:00:39.108108 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.106608    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 19:00:39.108108 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.106610    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 19:00:39.108108 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.106613    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 19:00:39.108108 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.106615    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 19:00:39.108108 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.106617    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 19:00:39.108108 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.106620    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 19:00:39.108108 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.106622    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 19:00:39.108108 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.106625    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 19:00:39.108108 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.106627    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 19:00:39.108108 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.106629    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 19:00:39.108108 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.106632    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 19:00:39.108108 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.106634    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 19:00:39.108108 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.106637    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 19:00:39.108605 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.106640    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 19:00:39.108605 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.106642    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 19:00:39.108605 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.106645    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 19:00:39.108605 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.106648    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 19:00:39.108605 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.106650    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 19:00:39.108605 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.106653    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 19:00:39.108605 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.106655    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 19:00:39.108605 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.106658    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 19:00:39.108605 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.106660    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 19:00:39.108605 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.106663    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 19:00:39.108605 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.106665    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 19:00:39.108605 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.106668    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 19:00:39.108605 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.106670    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 19:00:39.108605 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.106672    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 19:00:39.108605 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.106675    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 19:00:39.108966 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.108857    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 19:00:39.108966 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.108865    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 19:00:39.108966 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.108869    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 19:00:39.108966 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.108874    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 19:00:39.108966 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.108878    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 19:00:39.108966 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.108883    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 19:00:39.108966 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.108887    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 19:00:39.108966 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.108890    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 19:00:39.108966 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.108892    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 19:00:39.108966 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.108895    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 19:00:39.108966 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.108898    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 19:00:39.108966 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.108900    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 19:00:39.108966 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.108903    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 19:00:39.108966 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.108906    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 19:00:39.108966 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.108908    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 19:00:39.108966 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.108911    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 19:00:39.108966 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.108914    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 19:00:39.108966 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.108917    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 19:00:39.108966 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.108919    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 19:00:39.109463 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.108922    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 19:00:39.109463 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.108924    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 19:00:39.109463 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.108926    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 19:00:39.109463 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.108929    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 19:00:39.109463 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.108931    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 19:00:39.109463 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.108934    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 19:00:39.109463 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.108936    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 19:00:39.109463 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.108939    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 19:00:39.109463 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.108941    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 19:00:39.109463 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.108943    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 19:00:39.109463 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.108946    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 19:00:39.109463 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.108948    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 19:00:39.109463 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.108950    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 19:00:39.109463 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.108954    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 19:00:39.109463 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.108957    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 19:00:39.109463 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.108960    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 19:00:39.109463 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.108962    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 19:00:39.109463 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.108965    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 19:00:39.109463 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.108967    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 19:00:39.109463 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.108970    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 19:00:39.109956 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.108973    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 19:00:39.109956 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.108975    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 19:00:39.109956 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.108978    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 19:00:39.109956 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.108980    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 19:00:39.109956 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.108984    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 19:00:39.109956 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.108987    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 19:00:39.109956 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.108989    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 19:00:39.109956 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.108992    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 19:00:39.109956 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.108994    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 19:00:39.109956 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.108997    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 19:00:39.109956 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.108999    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 19:00:39.109956 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109003    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 19:00:39.109956 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109005    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 19:00:39.109956 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109008    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 19:00:39.109956 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109010    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 19:00:39.109956 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109013    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 19:00:39.109956 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109015    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 19:00:39.109956 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109017    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 19:00:39.109956 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109020    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 19:00:39.109956 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109022    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 19:00:39.110456 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109025    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 19:00:39.110456 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109027    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 19:00:39.110456 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109029    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 19:00:39.110456 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109032    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 19:00:39.110456 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109034    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 19:00:39.110456 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109037    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 19:00:39.110456 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109040    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 19:00:39.110456 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109042    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 19:00:39.110456 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109045    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 19:00:39.110456 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109047    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 19:00:39.110456 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109049    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 19:00:39.110456 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109053    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 19:00:39.110456 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109056    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 19:00:39.110456 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109059    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 19:00:39.110456 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109062    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 19:00:39.110456 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109066    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 19:00:39.110456 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109068    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 19:00:39.110456 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109071    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 19:00:39.110456 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109073    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 19:00:39.110456 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109076    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 19:00:39.110938 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109078    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 19:00:39.110938 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109081    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 19:00:39.110938 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109083    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 19:00:39.110938 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109086    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 19:00:39.110938 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109089    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 19:00:39.110938 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109119    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 19:00:39.110938 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109123    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 19:00:39.110938 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109126    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 19:00:39.110938 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109128    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 19:00:39.110938 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109132    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 19:00:39.110938 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109135    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 19:00:39.110938 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109138    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 19:00:39.110938 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109140    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 19:00:39.110938 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109143    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 19:00:39.110938 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109145    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 19:00:39.110938 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109148    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 19:00:39.110938 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109150    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 19:00:39.110938 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109153    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 19:00:39.110938 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109156    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 19:00:39.110938 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109158    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 19:00:39.111459 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109566    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 19:00:39.111459 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109571    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 19:00:39.111459 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109574    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 19:00:39.111459 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109577    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 19:00:39.111459 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109580    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 19:00:39.111459 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109583    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 19:00:39.111459 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109585    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 19:00:39.111459 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109588    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 19:00:39.111459 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109590    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 19:00:39.111459 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109593    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 19:00:39.111459 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109595    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 19:00:39.111459 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109598    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 19:00:39.111459 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109601    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 19:00:39.111459 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109603    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 19:00:39.111459 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109606    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 19:00:39.111459 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109608    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 19:00:39.111459 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109616    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 19:00:39.111459 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109620    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 19:00:39.111459 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109623    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 19:00:39.111913 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109625    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 19:00:39.111913 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109628    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 19:00:39.111913 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109631    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 19:00:39.111913 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109634    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 19:00:39.111913 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109636    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 19:00:39.111913 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109639    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 19:00:39.111913 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109641    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 19:00:39.111913 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109644    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 19:00:39.111913 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109646    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 19:00:39.111913 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109649    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 19:00:39.111913 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109652    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 19:00:39.111913 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109657    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 19:00:39.111913 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109660    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 19:00:39.111913 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109663    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 19:00:39.111913 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109666    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 19:00:39.111913 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109669    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 19:00:39.111913 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109671    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 19:00:39.111913 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109674    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 19:00:39.111913 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109676    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 19:00:39.112382 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109679    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 19:00:39.112382 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109682    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 19:00:39.112382 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109685    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 19:00:39.112382 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109687    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 19:00:39.112382 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109690    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 19:00:39.112382 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109692    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 19:00:39.112382 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109695    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 19:00:39.112382 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109697    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 19:00:39.112382 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109700    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 19:00:39.112382 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109702    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 19:00:39.112382 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109706    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 19:00:39.112382 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109710    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 19:00:39.112382 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109713    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 19:00:39.112382 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109715    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 19:00:39.112382 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109717    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 19:00:39.112382 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109720    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 19:00:39.112382 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109724    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 19:00:39.112382 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109726    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 19:00:39.112382 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109729    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 19:00:39.112833 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109731    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 19:00:39.112833 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109734    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 19:00:39.112833 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109736    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 19:00:39.112833 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109739    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 19:00:39.112833 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109741    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 19:00:39.112833 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109744    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 19:00:39.112833 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109747    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 19:00:39.112833 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109749    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 19:00:39.112833 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109752    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 19:00:39.112833 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109754    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 19:00:39.112833 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109757    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 19:00:39.112833 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109759    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 19:00:39.112833 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109762    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 19:00:39.112833 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109764    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 19:00:39.112833 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109767    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 19:00:39.112833 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109769    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 19:00:39.112833 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109771    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 19:00:39.112833 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109774    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 19:00:39.112833 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109776    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 19:00:39.112833 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109779    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 19:00:39.113368 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109781    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 19:00:39.113368 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109783    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 19:00:39.113368 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109786    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 19:00:39.113368 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109788    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 19:00:39.113368 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109791    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 19:00:39.113368 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109793    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 19:00:39.113368 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109796    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 19:00:39.113368 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109798    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 19:00:39.113368 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109801    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 19:00:39.113368 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109803    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 19:00:39.113368 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109805    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 19:00:39.113368 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109807    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 19:00:39.113368 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109810    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 19:00:39.113368 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109812    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 19:00:39.113368 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109814    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 19:00:39.113368 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109817    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 19:00:39.113368 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109820    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 19:00:39.113368 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109822    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 19:00:39.113368 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109824    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 19:00:39.113368 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109827    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 19:00:39.113850 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109830    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 19:00:39.113850 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.109832    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 19:00:39.113850 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.109903    2563 flags.go:64] FLAG: --address="0.0.0.0"
Jul 20 19:00:39.113850 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.109909    2563 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 20 19:00:39.113850 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.109916    2563 flags.go:64] FLAG: --anonymous-auth="true"
Jul 20 19:00:39.113850 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.109921    2563 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 20 19:00:39.113850 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.109925    2563 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 20 19:00:39.113850 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.109928    2563 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 20 19:00:39.113850 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.109932    2563 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 20 19:00:39.113850 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.109936    2563 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 20 19:00:39.113850 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.109939    2563 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 20 19:00:39.113850 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.109943    2563 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 20 19:00:39.113850 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.109946    2563 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 20 19:00:39.113850 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.109949    2563 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 20 19:00:39.113850 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.109952    2563 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 20 19:00:39.113850 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.109955    2563 flags.go:64] FLAG: --cgroup-root=""
Jul 20 19:00:39.113850 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.109958    2563 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 20 19:00:39.113850 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.109961    2563 flags.go:64] FLAG: --client-ca-file=""
Jul 20 19:00:39.113850 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.109965    2563 flags.go:64] FLAG: --cloud-provider="external"
Jul 20 19:00:39.113850 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.109968    2563 flags.go:64] FLAG: --cluster-dns="[]"
Jul 20 19:00:39.113850 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.109972    2563 flags.go:64] FLAG: --cluster-domain=""
Jul 20 19:00:39.113850 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.109975    2563 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 20 19:00:39.113850 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.109978    2563 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 20 19:00:39.113850 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.109980    2563 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 20 19:00:39.114446 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.109983    2563 flags.go:64] FLAG: --container-log-max-files="5"
Jul 20 19:00:39.114446 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.109987    2563 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 20 19:00:39.114446 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.109990    2563 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 20 19:00:39.114446 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.109993    2563 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 20 19:00:39.114446 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.109996    2563 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 20 19:00:39.114446 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.109999    2563 flags.go:64] FLAG: --contention-profiling="false"
Jul 20 19:00:39.114446 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.110001    2563 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 20 19:00:39.114446 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.110004    2563 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 20 19:00:39.114446 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.110007    2563 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 20 19:00:39.114446 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.110010    2563 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 20 19:00:39.114446 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.110014    2563 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 20 19:00:39.114446 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.110016    2563 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 20 19:00:39.114446 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.110019    2563 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 20 19:00:39.114446 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.110022    2563 flags.go:64] FLAG: --enable-load-reader="false"
Jul 20 19:00:39.114446 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.110024    2563 flags.go:64] FLAG: --enable-server="true"
Jul 20 19:00:39.114446 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.110027    2563 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 20 19:00:39.114446 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.110032    2563 flags.go:64] FLAG: --event-burst="100"
Jul 20 19:00:39.114446 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.110034    2563 flags.go:64] FLAG: --event-qps="50"
Jul 20 19:00:39.114446 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.110037    2563 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 20 19:00:39.114446 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.110040    2563 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 20 19:00:39.114446 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.110043    2563 flags.go:64] FLAG: --eviction-hard=""
Jul 20 19:00:39.114446 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.110046    2563 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 20 19:00:39.114446 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.110049    2563 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 20 19:00:39.114446 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.110052    2563 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 20 19:00:39.114446 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.110055    2563 flags.go:64] FLAG: --eviction-soft=""
Jul 20 19:00:39.115040 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.110058    2563 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 20 19:00:39.115040 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.110060    2563 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 20 19:00:39.115040 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.110064    2563 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 20 19:00:39.115040 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.110066    2563 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 20 19:00:39.115040 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.110069    2563 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 20 19:00:39.115040 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.110072    2563 flags.go:64] FLAG: --fail-swap-on="true"
Jul 20 19:00:39.115040 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.110075    2563 flags.go:64] FLAG: --feature-gates=""
Jul 20 19:00:39.115040 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.110078    2563 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 20 19:00:39.115040 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.110081    2563 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 20 19:00:39.115040 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.110083    2563 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 20 19:00:39.115040 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.110086    2563 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 20 19:00:39.115040 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.110108    2563 flags.go:64] FLAG: --healthz-port="10248"
Jul 20 19:00:39.115040 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.110111    2563 flags.go:64] FLAG: --help="false"
Jul 20 19:00:39.115040 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.110114    2563 flags.go:64] FLAG: --hostname-override="ip-10-0-139-141.ec2.internal"
Jul 20 19:00:39.115040 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.110117    2563 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 20 19:00:39.115040 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.110120    2563 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 20 19:00:39.115040 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.110123    2563 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 20 19:00:39.115040 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.110126    2563 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 20 19:00:39.115040 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.110129    2563 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 20 19:00:39.115040 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.110132    2563 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 20 19:00:39.115040 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.110134    2563 flags.go:64] FLAG: --image-service-endpoint=""
Jul 20 19:00:39.115040 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.110137    2563 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 20 19:00:39.115040 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.110140    2563 flags.go:64] FLAG: --kube-api-burst="100"
Jul 20 19:00:39.115640 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.110143    2563 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 20 19:00:39.115640 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.110145    2563 flags.go:64] FLAG: --kube-api-qps="50"
Jul 20 19:00:39.115640 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.110148    2563 flags.go:64] FLAG: --kube-reserved=""
Jul 20 19:00:39.115640 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.110151    2563 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 20 19:00:39.115640 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.110153    2563 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 20 19:00:39.115640 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.110156    2563 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 20 19:00:39.115640 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.110159    2563 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 20 19:00:39.115640 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.110161    2563 flags.go:64] FLAG: --lock-file=""
Jul 20 19:00:39.115640 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.110164    2563 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 20 19:00:39.115640 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.110167    2563 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 20 19:00:39.115640 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.110169    2563 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 20 19:00:39.115640 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.110174    2563 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 20 19:00:39.115640 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.110178    2563 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 20 19:00:39.115640 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.110181    2563 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 20 19:00:39.115640 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.110183    2563 flags.go:64] FLAG: --logging-format="text"
Jul 20 19:00:39.115640 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.110186    2563 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 20 19:00:39.115640 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.110189    2563 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 20 19:00:39.115640 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.110192    2563 flags.go:64] FLAG: --manifest-url=""
Jul 20 19:00:39.115640 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.110194    2563 flags.go:64] FLAG: --manifest-url-header=""
Jul 20 19:00:39.115640 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.110200    2563 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 20 19:00:39.115640 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.110204    2563 flags.go:64] FLAG: --max-open-files="1000000"
Jul 20 19:00:39.115640 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.110208    2563 flags.go:64] FLAG: --max-pods="110"
Jul 20 19:00:39.115640 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.110211    2563 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 20 19:00:39.115640 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.110214    2563 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 20 19:00:39.115640 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.110216    2563 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 20 19:00:39.116277 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.110219    2563 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 20 19:00:39.116277 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.110222    2563 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 20 19:00:39.116277 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.110225    2563 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 20 19:00:39.116277 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.110228    2563 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 20 19:00:39.116277 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.110235    2563 flags.go:64] FLAG: --node-status-max-images="50"
Jul 20 19:00:39.116277 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.110238    2563 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 20 19:00:39.116277 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.110241    2563 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 20 19:00:39.116277 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.110244    2563 flags.go:64] FLAG: --pod-cidr=""
Jul 20 19:00:39.116277 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.110246    2563 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 20 19:00:39.116277 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.110251    2563 flags.go:64] FLAG: --pod-manifest-path=""
Jul 20 19:00:39.116277 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.110254    2563 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 20 19:00:39.116277 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.110257    2563 flags.go:64] FLAG: --pods-per-core="0"
Jul 20 19:00:39.116277 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.110260    2563 flags.go:64] FLAG: --port="10250"
Jul 20 19:00:39.116277 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.110263    2563 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 20 19:00:39.116277 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.110266    2563 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-07e22c1e1e70543be"
Jul 20 19:00:39.116277 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.110269    2563 flags.go:64] FLAG: --qos-reserved=""
Jul 20 19:00:39.116277 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.110272    2563 flags.go:64] FLAG: --read-only-port="10255"
Jul 20 19:00:39.116277 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.110274    2563 flags.go:64] FLAG: --register-node="true"
Jul 20 19:00:39.116277 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.110277    2563 flags.go:64] FLAG: --register-with-taints=""
Jul 20 19:00:39.116277 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.110280    2563 flags.go:64] FLAG: --registry-burst="10"
Jul 20 19:00:39.116277 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.110283    2563 flags.go:64] FLAG: --registry-qps="5"
Jul 20 19:00:39.116277 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.110286    2563 flags.go:64] FLAG: --reserved-cpus=""
Jul 20 19:00:39.116277 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.110289    2563 flags.go:64] FLAG: --reserved-memory=""
Jul 20 19:00:39.116277 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.110292    2563 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 20 19:00:39.116277 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.110295    2563 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 20 19:00:39.116914 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.110298    2563 flags.go:64] FLAG: --rotate-certificates="false"
Jul 20 19:00:39.116914 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.110302    2563 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 20 19:00:39.116914 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.110305    2563 flags.go:64] FLAG: --runonce="false"
Jul 20 19:00:39.116914 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.110309    2563 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 20 19:00:39.116914 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.110311    2563 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 20 19:00:39.116914 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.110314    2563 flags.go:64] FLAG: --seccomp-default="false"
Jul 20 19:00:39.116914 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.110317    2563 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 20 19:00:39.116914 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.110320    2563 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 20 19:00:39.116914 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.110322    2563 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 20 19:00:39.116914 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.110326    2563 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 20 19:00:39.116914 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.110329    2563 flags.go:64] FLAG: --storage-driver-password="root"
Jul 20 19:00:39.116914 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.110332    2563 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 20 19:00:39.116914 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.110335    2563 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 20 19:00:39.116914 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.110338    2563 flags.go:64] FLAG: --storage-driver-user="root"
Jul 20 19:00:39.116914 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.110341    2563 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 20 19:00:39.116914 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.110344    2563 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 20 19:00:39.116914 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.110346    2563 flags.go:64] FLAG: --system-cgroups=""
Jul 20 19:00:39.116914 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.110349    2563 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 20 19:00:39.116914 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.110354    2563 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 20 19:00:39.116914 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.110357    2563 flags.go:64] FLAG: --tls-cert-file=""
Jul 20 19:00:39.116914 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.110360    2563 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 20 19:00:39.116914 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.110363    2563 flags.go:64] FLAG: --tls-min-version=""
Jul 20 19:00:39.116914 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.110366    2563 flags.go:64] FLAG: --tls-private-key-file=""
Jul 20 19:00:39.116914 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.110368    2563 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 20 19:00:39.116914 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.110371    2563 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 20 19:00:39.117591 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.110374    2563 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 20 19:00:39.117591 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.110376    2563 flags.go:64] FLAG: --v="2"
Jul 20 19:00:39.117591 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.110380    2563 flags.go:64] FLAG: --version="false"
Jul 20 19:00:39.117591 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.110384    2563 flags.go:64] FLAG: --vmodule=""
Jul 20 19:00:39.117591 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.110388    2563 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 20 19:00:39.117591 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.110391    2563 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 20 19:00:39.117591 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.110504    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 19:00:39.117591 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.110507    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 19:00:39.117591 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.110512    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 19:00:39.117591 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.110515    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 19:00:39.117591 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.110518    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 19:00:39.117591 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.110521    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 19:00:39.117591 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.110524    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 19:00:39.117591 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.110527    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 19:00:39.117591 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.110529    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 19:00:39.117591 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.110532    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 19:00:39.117591 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.110534    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 19:00:39.117591 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.110537    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 19:00:39.117591 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.110540    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 19:00:39.117591 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.110542    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 19:00:39.117591 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.110545    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 19:00:39.118108 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.110548    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 19:00:39.118108 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.110551    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 19:00:39.118108 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.110553    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 19:00:39.118108 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.110556    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 19:00:39.118108 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.110558    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 19:00:39.118108 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.110562    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 19:00:39.118108 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.110564    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 19:00:39.118108 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.110567    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 19:00:39.118108 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.110569    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 19:00:39.118108 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.110572    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 19:00:39.118108 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.110574    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 19:00:39.118108 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.110576    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 19:00:39.118108 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.110580    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 19:00:39.118108 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.110584    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 19:00:39.118108 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.110587    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 19:00:39.118108 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.110591    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 19:00:39.118108 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.110594    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 19:00:39.118108 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.110597    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 19:00:39.118108 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.110600    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 19:00:39.118577 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.110603    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 19:00:39.118577 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.110606    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 19:00:39.118577 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.110610    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 19:00:39.118577 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.110613    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 19:00:39.118577 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.110616    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 19:00:39.118577 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.110619    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 19:00:39.118577 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.110621    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 19:00:39.118577 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.110624    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 19:00:39.118577 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.110628    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 19:00:39.118577 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.110632    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 19:00:39.118577 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.110634    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 19:00:39.118577 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.110637    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 19:00:39.118577 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.110639    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 19:00:39.118577 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.110642    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 19:00:39.118577 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.110645    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 19:00:39.118577 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.110647    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 19:00:39.118577 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.110650    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 19:00:39.118577 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.110652    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 19:00:39.118577 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.110655    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 19:00:39.119028 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.110658    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 19:00:39.119028 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.110662    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 19:00:39.119028 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.110665    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 19:00:39.119028 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.110667    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 19:00:39.119028 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.110670    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 19:00:39.119028 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.110672    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 19:00:39.119028 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.110675    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 19:00:39.119028 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.110678    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 19:00:39.119028 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.110680    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 19:00:39.119028 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.110683    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 19:00:39.119028 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.110686    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 19:00:39.119028 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.110688    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 19:00:39.119028 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.110691    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 19:00:39.119028 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.110695    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 19:00:39.119028 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.110698    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 19:00:39.119028 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.110702    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 19:00:39.119028 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.110704    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 19:00:39.119028 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.110707    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 19:00:39.119028 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.110709    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 19:00:39.119028 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.110712    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 19:00:39.119541 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.110714    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 19:00:39.119541 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.110716    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 19:00:39.119541 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.110719    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 19:00:39.119541 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.110721    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 19:00:39.119541 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.110724    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 19:00:39.119541 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.110727    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 19:00:39.119541 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.110729    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 19:00:39.119541 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.110732    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 19:00:39.119541 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.110734    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 19:00:39.119541 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.110736    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 19:00:39.119541 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.110739    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 19:00:39.119541 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.110741    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 19:00:39.119541 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.110744    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 19:00:39.119541 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.110746    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 19:00:39.119541 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.110749    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 19:00:39.119541 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.110751    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 19:00:39.119541 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.110754    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 19:00:39.119541 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.110756    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 19:00:39.119541 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.110758    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 19:00:39.119541 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.110761    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 19:00:39.120025 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.110763    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 19:00:39.120025 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.110765    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 19:00:39.120025 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.110768    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 19:00:39.120025 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.110773    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 19:00:39.120025 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.110776    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 19:00:39.120025 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.110779    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 19:00:39.120025 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.111264    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 20 19:00:39.120025 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.118389    2563 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 20 19:00:39.120025 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.118406    2563 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 20 19:00:39.120025 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.118426    2563 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 20 19:00:39.120025 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.118432    2563 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 20 19:00:39.120025 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118486    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 19:00:39.120025 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118491    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 19:00:39.120025 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118495    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 19:00:39.120025 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118498    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 19:00:39.120430 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118500    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 19:00:39.120430 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118503    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 19:00:39.120430 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118507    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 19:00:39.120430 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118511    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 19:00:39.120430 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118515    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 19:00:39.120430 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118518    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 19:00:39.120430 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118521    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 19:00:39.120430 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118523    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 19:00:39.120430 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118526    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 19:00:39.120430 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118529    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 19:00:39.120430 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118531    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 19:00:39.120430 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118534    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 19:00:39.120430 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118536    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 19:00:39.120430 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118539    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 19:00:39.120430 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118542    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 19:00:39.120430 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118544    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 19:00:39.120430 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118547    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 19:00:39.120430 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118549    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 19:00:39.120430 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118552    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 19:00:39.120884 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118554    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 19:00:39.120884 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118557    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 19:00:39.120884 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118559    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 19:00:39.120884 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118562    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 19:00:39.120884 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118564    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 19:00:39.120884 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118567    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 19:00:39.120884 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118571    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 19:00:39.120884 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118574    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 19:00:39.120884 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118576    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 19:00:39.120884 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118579    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 19:00:39.120884 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118582    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 19:00:39.120884 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118584    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 19:00:39.120884 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118587    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 19:00:39.120884 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118590    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 19:00:39.120884 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118592    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 19:00:39.120884 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118595    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 19:00:39.120884 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118597    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 19:00:39.120884 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118599    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 19:00:39.120884 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118602    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 19:00:39.120884 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118604    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 19:00:39.121473 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118607    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 19:00:39.121473 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118609    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 19:00:39.121473 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118611    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 19:00:39.121473 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118614    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 19:00:39.121473 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118616    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 19:00:39.121473 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118619    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 19:00:39.121473 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118623    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 19:00:39.121473 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118626    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 19:00:39.121473 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118629    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 19:00:39.121473 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118632    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 19:00:39.121473 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118634    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 19:00:39.121473 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118637    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 19:00:39.121473 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118639    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 19:00:39.121473 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118641    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 19:00:39.121473 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118645    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 19:00:39.121473 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118649    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 19:00:39.121473 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118651    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 19:00:39.121473 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118654    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 19:00:39.121473 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118658    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 19:00:39.121930 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118661    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 19:00:39.121930 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118664    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 19:00:39.121930 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118666    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 19:00:39.121930 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118669    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 19:00:39.121930 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118671    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 19:00:39.121930 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118673    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 19:00:39.121930 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118676    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 19:00:39.121930 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118678    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 19:00:39.121930 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118681    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 19:00:39.121930 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118683    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 19:00:39.121930 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118686    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 19:00:39.121930 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118689    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 19:00:39.121930 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118691    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 19:00:39.121930 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118693    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 19:00:39.121930 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118696    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 19:00:39.121930 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118698    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 19:00:39.121930 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118700    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 19:00:39.121930 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118703    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 19:00:39.121930 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118705    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 19:00:39.121930 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118708    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 19:00:39.122463 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118710    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 19:00:39.122463 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118713    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 19:00:39.122463 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118715    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 19:00:39.122463 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118718    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 19:00:39.122463 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118720    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 19:00:39.122463 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118723    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 19:00:39.122463 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118725    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 19:00:39.122463 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118727    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 19:00:39.122463 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118730    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 19:00:39.122463 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118733    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 19:00:39.122463 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118735    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 19:00:39.122463 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118738    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 19:00:39.122463 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118740    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 19:00:39.122463 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118743    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 19:00:39.122463 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118746    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 19:00:39.122463 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118748    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 19:00:39.122463 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118751    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 19:00:39.122898 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.118756    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 20 19:00:39.122898 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118861    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 19:00:39.122898 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118865    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 19:00:39.122898 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118867    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 19:00:39.122898 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118870    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 19:00:39.122898 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118873    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 19:00:39.122898 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118876    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 19:00:39.122898 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118878    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 19:00:39.122898 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118881    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 19:00:39.122898 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118883    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 19:00:39.122898 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118886    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 19:00:39.122898 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118888    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 19:00:39.122898 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118891    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 19:00:39.122898 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118893    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 19:00:39.122898 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118896    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 19:00:39.123304 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118898    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 19:00:39.123304 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118901    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 19:00:39.123304 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118903    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 19:00:39.123304 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118906    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 19:00:39.123304 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118908    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 19:00:39.123304 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118910    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 19:00:39.123304 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118913    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 19:00:39.123304 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118915    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 19:00:39.123304 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118918    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 19:00:39.123304 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118920    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 19:00:39.123304 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118923    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 19:00:39.123304 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118925    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 19:00:39.123304 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118928    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 19:00:39.123304 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118931    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 19:00:39.123304 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118934    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 19:00:39.123304 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118936    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 19:00:39.123304 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118939    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 19:00:39.123304 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118941    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 19:00:39.123304 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118943    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 19:00:39.123804 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118946    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 19:00:39.123804 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118948    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 19:00:39.123804 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118950    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 19:00:39.123804 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118953    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 19:00:39.123804 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118955    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 19:00:39.123804 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118958    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 19:00:39.123804 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118960    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 19:00:39.123804 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118962    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 19:00:39.123804 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118965    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 19:00:39.123804 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118967    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 19:00:39.123804 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118969    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 19:00:39.123804 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118972    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 19:00:39.123804 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118974    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 19:00:39.123804 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118977    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 19:00:39.123804 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118979    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 19:00:39.123804 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118982    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 19:00:39.123804 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118984    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 19:00:39.123804 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118986    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 19:00:39.123804 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118989    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 19:00:39.123804 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118991    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 19:00:39.124307 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118994    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 19:00:39.124307 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.118997    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 19:00:39.124307 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.119000    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 19:00:39.124307 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.119003    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 19:00:39.124307 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.119006    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 19:00:39.124307 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.119009    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 19:00:39.124307 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.119012    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 19:00:39.124307 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.119015    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 19:00:39.124307 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.119018    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 19:00:39.124307 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.119020    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 19:00:39.124307 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.119022    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 19:00:39.124307 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.119025    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 19:00:39.124307 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.119027    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 19:00:39.124307 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.119030    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 19:00:39.124307 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.119033    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 19:00:39.124307 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.119035    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 19:00:39.124307 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.119038    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 19:00:39.124307 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.119040    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 19:00:39.124307 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.119044    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 19:00:39.124307 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.119046    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 19:00:39.124773 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.119048    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 19:00:39.124773 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.119051    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 19:00:39.124773 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.119053    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 19:00:39.124773 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.119057    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 19:00:39.124773 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.119060    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 19:00:39.124773 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.119063    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 19:00:39.124773 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.119065    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 19:00:39.124773 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.119067    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 19:00:39.124773 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.119070    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 19:00:39.124773 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.119072    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 19:00:39.124773 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.119074    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 19:00:39.124773 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.119077    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 19:00:39.124773 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.119080    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 19:00:39.124773 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.119082    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 19:00:39.124773 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.119084    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 19:00:39.124773 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.119087    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 19:00:39.124773 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.119089    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 19:00:39.124773 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.119109    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 19:00:39.124773 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.119112    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 19:00:39.124773 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.119114    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 19:00:39.125278 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.119117    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 19:00:39.125278 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.119120    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 19:00:39.125278 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.119124    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 19:00:39.125278 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.119127    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 19:00:39.125278 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.119129    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 19:00:39.125278 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:39.119132    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 19:00:39.125278 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.119136    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 20 19:00:39.125278 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.119238    2563 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 20 19:00:39.125278 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.122428    2563 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 20 19:00:39.125278 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.123641    2563 server.go:1019] "Starting client certificate rotation"
Jul 20 19:00:39.125278 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.123739    2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 20 19:00:39.125278 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.123774    2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 20 19:00:39.125971 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.125958    2563 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 20 19:00:39.129779 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.129756    2563 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 20 19:00:39.140654 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.140636    2563 log.go:25] "Validated CRI v1 runtime API"
Jul 20 19:00:39.142820 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.142801    2563 log.go:25] "Validated CRI v1 image API"
Jul 20 19:00:39.144199 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.144183    2563 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 20 19:00:39.147360 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.147343    2563 fs.go:135] Filesystem UUIDs: map[4360bcbb-3aa3-4320-9a1b-432a6dfb547d:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 ffac5f34-8a83-46be-84c8-ab28ad8f669c:/dev/nvme0n1p3]
Jul 20 19:00:39.147414 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.147361    2563 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 20 19:00:39.152246 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.152135    2563 manager.go:216] Machine: {Timestamp:2026-07-20 19:00:39.150872315 +0000 UTC m=+0.362655550 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3070719 MemoryCapacity:32812171264 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec22190d83dfcd9bf04057f36e525b41 SystemUUID:ec22190d-83df-cd9b-f040-57f36e525b41 BootID:d211ee7f-ad36-4bdc-ac28-8a309a2baf46 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:3c:8b:35:d3:19 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:3c:8b:35:d3:19 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:82:bc:33:d7:fc:7c Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812171264 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 20 19:00:39.152246 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.152245    2563 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 20 19:00:39.152340 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.152321    2563 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 20 19:00:39.155494 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.155473    2563 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 20 19:00:39.155631 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.155498    2563 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-141.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 20 19:00:39.156422 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.156406    2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 20 19:00:39.157286 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.157276    2563 topology_manager.go:138] "Creating topology manager with none policy"
Jul 20 19:00:39.157323 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.157288    2563 container_manager_linux.go:309] "Creating device plugin manager"
Jul 20 19:00:39.157323 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.157295    2563 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 20 19:00:39.158543 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.158532    2563 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 20 19:00:39.159627 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.159618    2563 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 20 19:00:39.162454 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.162444    2563 state_mem.go:36] "Initialized new in-memory state store"
Jul 20 19:00:39.162570 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.162561    2563 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 20 19:00:39.162599 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.162590    2563 kubelet.go:486] "Attempting to sync node with API server"
Jul 20 19:00:39.162629 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.162607    2563 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 20 19:00:39.162629 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.162626    2563 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 20 19:00:39.162681 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.162635    2563 kubelet.go:398] "Adding apiserver pod source"
Jul 20 19:00:39.162681 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.162644    2563 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 20 19:00:39.162991 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.162979    2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 20 19:00:39.163058 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.162997    2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 20 19:00:39.165507 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.165491    2563 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 20 19:00:39.167597 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.167584    2563 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 20 19:00:39.167643 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.167614    2563 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 20 19:00:39.168684 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.168662    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 20 19:00:39.168684 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.168679    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 20 19:00:39.168684 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.168686    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 20 19:00:39.168819 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.168692    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 20 19:00:39.168819 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.168709    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 20 19:00:39.168819 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.168715    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 20 19:00:39.168819 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.168723    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 20 19:00:39.168819 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.168728    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 20 19:00:39.168819 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.168734    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 20 19:00:39.168819 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.168739    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 20 19:00:39.168819 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.168755    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 20 19:00:39.168819 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.168760    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 20 19:00:39.170193 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.170182    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 20 19:00:39.170226 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.170195    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 20 19:00:39.173711 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.173691    2563 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-139-141.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 20 19:00:39.173811 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:00:39.173709    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-139-141.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 20 19:00:39.173895 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:00:39.173868    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 20 19:00:39.174715 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.174700    2563 server.go:1268] "Started kubelet"
Jul 20 19:00:39.174834 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.174789    2563 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 20 19:00:39.174888 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.174844    2563 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 20 19:00:39.174928 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.174910    2563 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 20 19:00:39.175852 ip-10-0-139-141 systemd[1]: Started Kubernetes Kubelet.
Jul 20 19:00:39.176638 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.176625    2563 server.go:310] "Adding debug handlers to kubelet server"
Jul 20 19:00:39.179049 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.179033    2563 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 20 19:00:39.181691 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:00:39.181671    2563 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 20 19:00:39.183272 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:00:39.182066    2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-141.ec2.internal.18c414a23063c17c  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-141.ec2.internal,UID:ip-10-0-139-141.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-139-141.ec2.internal,},FirstTimestamp:2026-07-20 19:00:39.174660476 +0000 UTC m=+0.386443700,LastTimestamp:2026-07-20 19:00:39.174660476 +0000 UTC m=+0.386443700,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-141.ec2.internal,}"
Jul 20 19:00:39.184673 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.184658    2563 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 20 19:00:39.184744 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.184659    2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 20 19:00:39.184744 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:00:39.184727    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-141.ec2.internal\" not found"
Jul 20 19:00:39.185393 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.185355    2563 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 20 19:00:39.185393 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.185364    2563 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 20 19:00:39.185393 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.185386    2563 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 20 19:00:39.185593 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.185476    2563 reconstruct.go:97] "Volume reconstruction finished"
Jul 20 19:00:39.185593 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.185484    2563 reconciler.go:29] "Reconciler: start to sync state"
Jul 20 19:00:39.185695 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.185662    2563 factory.go:153] Registering CRI-O factory
Jul 20 19:00:39.185695 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.185683    2563 factory.go:223] Registration of the crio container factory successfully
Jul 20 19:00:39.185794 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.185733    2563 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 20 19:00:39.185794 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.185749    2563 factory.go:55] Registering systemd factory
Jul 20 19:00:39.185794 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.185758    2563 factory.go:223] Registration of the systemd container factory successfully
Jul 20 19:00:39.185794 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.185777    2563 factory.go:103] Registering Raw factory
Jul 20 19:00:39.185794 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.185792    2563 manager.go:1196] Started watching for new ooms in manager
Jul 20 19:00:39.186240 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.186224    2563 manager.go:349] Starting recovery of all containers
Jul 20 19:00:39.188174 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:00:39.188147    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 20 19:00:39.188247 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:00:39.188161    2563 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-139-141.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 20 19:00:39.197398 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.197378    2563 manager.go:354] Recovery completed
Jul 20 19:00:39.200600 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:00:39.200578    2563 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Jul 20 19:00:39.203508 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.203495    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 19:00:39.205283 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.205259    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-141.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 19:00:39.205355 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.205298    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-141.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 19:00:39.205355 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.205318    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-141.ec2.internal" event="NodeHasSufficientPID"
Jul 20 19:00:39.205805 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.205789    2563 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 20 19:00:39.205847 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.205805    2563 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 20 19:00:39.205847 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.205820    2563 state_mem.go:36] "Initialized new in-memory state store"
Jul 20 19:00:39.205847 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.205805    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 19:00:39.206527 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.206514    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-141.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 19:00:39.206569 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.206540    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-141.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 19:00:39.206569 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.206554    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-141.ec2.internal" event="NodeHasSufficientPID"
Jul 20 19:00:39.207366 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.207339    2563 policy_none.go:49] "None policy: Start"
Jul 20 19:00:39.207366 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.207368    2563 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 20 19:00:39.207468 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.207379    2563 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 20 19:00:39.207468 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:00:39.207359    2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-141.ec2.internal.18c414a232370187  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-141.ec2.internal,UID:ip-10-0-139-141.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-139-141.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-139-141.ec2.internal,},FirstTimestamp:2026-07-20 19:00:39.205282183 +0000 UTC m=+0.417065415,LastTimestamp:2026-07-20 19:00:39.205282183 +0000 UTC m=+0.417065415,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-141.ec2.internal,}"
Jul 20 19:00:39.208760 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.208749    2563 policy_none.go:47] "Start"
Jul 20 19:00:39.215375 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:00:39.215317    2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-141.ec2.internal.18c414a232375ac6  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-141.ec2.internal,UID:ip-10-0-139-141.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-139-141.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-139-141.ec2.internal,},FirstTimestamp:2026-07-20 19:00:39.20530503 +0000 UTC m=+0.417088253,LastTimestamp:2026-07-20 19:00:39.20530503 +0000 UTC m=+0.417088253,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-141.ec2.internal,}"
Jul 20 19:00:39.225197 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:00:39.225139    2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-141.ec2.internal.18c414a23237a919  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-141.ec2.internal,UID:ip-10-0-139-141.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-139-141.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-139-141.ec2.internal,},FirstTimestamp:2026-07-20 19:00:39.205325081 +0000 UTC m=+0.417108304,LastTimestamp:2026-07-20 19:00:39.205325081 +0000 UTC m=+0.417108304,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-141.ec2.internal,}"
Jul 20 19:00:39.236729 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:00:39.236675    2563 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-139-141.ec2.internal.18c414a232370187\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-141.ec2.internal.18c414a232370187  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-141.ec2.internal,UID:ip-10-0-139-141.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-139-141.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-139-141.ec2.internal,},FirstTimestamp:2026-07-20 19:00:39.205282183 +0000 UTC m=+0.417065415,LastTimestamp:2026-07-20 19:00:39.206528046 +0000 UTC m=+0.418311266,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-141.ec2.internal,}"
Jul 20 19:00:39.246642 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.246629    2563 manager.go:337] "Starting Device Plugin manager"
Jul 20 19:00:39.246703 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:00:39.246656    2563 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 20 19:00:39.246703 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.246666    2563 server.go:87] "Starting device plugin registration server"
Jul 20 19:00:39.246836 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:00:39.246714    2563 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-139-141.ec2.internal.18c414a232375ac6\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-141.ec2.internal.18c414a232375ac6  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-141.ec2.internal,UID:ip-10-0-139-141.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-139-141.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-139-141.ec2.internal,},FirstTimestamp:2026-07-20 19:00:39.20530503 +0000 UTC m=+0.417088253,LastTimestamp:2026-07-20 19:00:39.206545993 +0000 UTC m=+0.418329219,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-141.ec2.internal,}"
Jul 20 19:00:39.246953 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.246901    2563 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 20 19:00:39.246953 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.246911    2563 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 20 19:00:39.247054 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.247042    2563 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 20 19:00:39.247154 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.247140    2563 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 20 19:00:39.247154 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.247154    2563 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 20 19:00:39.247514 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:00:39.247494    2563 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 20 19:00:39.247586 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:00:39.247551    2563 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-141.ec2.internal\" not found"
Jul 20 19:00:39.256420 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:00:39.256365    2563 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-139-141.ec2.internal.18c414a23237a919\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-141.ec2.internal.18c414a23237a919  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-141.ec2.internal,UID:ip-10-0-139-141.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-139-141.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-139-141.ec2.internal,},FirstTimestamp:2026-07-20 19:00:39.205325081 +0000 UTC m=+0.417108304,LastTimestamp:2026-07-20 19:00:39.206559174 +0000 UTC m=+0.418342397,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-141.ec2.internal,}"
Jul 20 19:00:39.264286 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:00:39.264230    2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-141.ec2.internal.18c414a234cdf538  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-141.ec2.internal,UID:ip-10-0-139-141.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeAllocatableEnforced,Message:Updated Node Allocatable limit across pods,Source:EventSource{Component:kubelet,Host:ip-10-0-139-141.ec2.internal,},FirstTimestamp:2026-07-20 19:00:39.2487294 +0000 UTC m=+0.460512608,LastTimestamp:2026-07-20 19:00:39.2487294 +0000 UTC m=+0.460512608,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-141.ec2.internal,}"
Jul 20 19:00:39.286655 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.286636    2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ht5xc"
Jul 20 19:00:39.305009 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.304986    2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ht5xc"
Jul 20 19:00:39.347278 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.347253    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 19:00:39.348396 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.348381    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-141.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 19:00:39.348448 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.348409    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-141.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 19:00:39.348448 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.348419    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-141.ec2.internal" event="NodeHasSufficientPID"
Jul 20 19:00:39.348448 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.348442    2563 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-139-141.ec2.internal"
Jul 20 19:00:39.356037 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.355992    2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 20 19:00:39.357319 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.357303    2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 20 19:00:39.357372 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.357350    2563 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 20 19:00:39.357415 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.357372    2563 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 20 19:00:39.357415 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:00:39.357407    2563 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 20 19:00:39.359590 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.359566    2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 19:00:39.362405 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.362389    2563 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-139-141.ec2.internal"
Jul 20 19:00:39.362476 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:00:39.362409    2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-139-141.ec2.internal\": node \"ip-10-0-139-141.ec2.internal\" not found"
Jul 20 19:00:39.385638 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:00:39.385619    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-141.ec2.internal\" not found"
Jul 20 19:00:39.458427 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.458401    2563 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-141.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-139-141.ec2.internal"]
Jul 20 19:00:39.458504 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.458467    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 19:00:39.459820 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.459804    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-141.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 19:00:39.459890 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.459827    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-141.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 19:00:39.459890 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.459837    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-141.ec2.internal" event="NodeHasSufficientPID"
Jul 20 19:00:39.461367 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.461355    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 19:00:39.461476 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.461462    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-141.ec2.internal"
Jul 20 19:00:39.461522 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.461489    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 19:00:39.462063 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.462047    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-141.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 19:00:39.462153 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.462077    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-141.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 19:00:39.462153 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.462108    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-141.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 19:00:39.462153 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.462131    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-141.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 19:00:39.462153 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.462140    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-141.ec2.internal" event="NodeHasSufficientPID"
Jul 20 19:00:39.462333 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.462113    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-141.ec2.internal" event="NodeHasSufficientPID"
Jul 20 19:00:39.463501 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.463484    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-141.ec2.internal"
Jul 20 19:00:39.463577 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.463515    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 19:00:39.464140 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.464124    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-141.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 19:00:39.464206 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.464152    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-141.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 19:00:39.464206 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.464166    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-141.ec2.internal" event="NodeHasSufficientPID"
Jul 20 19:00:39.479644 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:00:39.479625    2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-141.ec2.internal\" not found" node="ip-10-0-139-141.ec2.internal"
Jul 20 19:00:39.482774 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:00:39.482759    2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-141.ec2.internal\" not found" node="ip-10-0-139-141.ec2.internal"
Jul 20 19:00:39.485783 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:00:39.485771    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-141.ec2.internal\" not found"
Jul 20 19:00:39.486915 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.486897    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7466360cc91f8dce9f649835caab8eb1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-141.ec2.internal\" (UID: \"7466360cc91f8dce9f649835caab8eb1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-141.ec2.internal"
Jul 20 19:00:39.486959 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.486924    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7466360cc91f8dce9f649835caab8eb1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-141.ec2.internal\" (UID: \"7466360cc91f8dce9f649835caab8eb1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-141.ec2.internal"
Jul 20 19:00:39.486959 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.486940    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/508e3b649792abc37cafc631d8189428-config\") pod \"kube-apiserver-proxy-ip-10-0-139-141.ec2.internal\" (UID: \"508e3b649792abc37cafc631d8189428\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-141.ec2.internal"
Jul 20 19:00:39.585826 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:00:39.585807    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-141.ec2.internal\" not found"
Jul 20 19:00:39.587957 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.587942    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7466360cc91f8dce9f649835caab8eb1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-141.ec2.internal\" (UID: \"7466360cc91f8dce9f649835caab8eb1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-141.ec2.internal"
Jul 20 19:00:39.588003 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.587965    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7466360cc91f8dce9f649835caab8eb1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-141.ec2.internal\" (UID: \"7466360cc91f8dce9f649835caab8eb1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-141.ec2.internal"
Jul 20 19:00:39.588003 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.587982    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/508e3b649792abc37cafc631d8189428-config\") pod \"kube-apiserver-proxy-ip-10-0-139-141.ec2.internal\" (UID: \"508e3b649792abc37cafc631d8189428\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-141.ec2.internal"
Jul 20 19:00:39.588079 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.588022    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/508e3b649792abc37cafc631d8189428-config\") pod \"kube-apiserver-proxy-ip-10-0-139-141.ec2.internal\" (UID: \"508e3b649792abc37cafc631d8189428\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-141.ec2.internal"
Jul 20 19:00:39.588079 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.588051    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7466360cc91f8dce9f649835caab8eb1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-141.ec2.internal\" (UID: \"7466360cc91f8dce9f649835caab8eb1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-141.ec2.internal"
Jul 20 19:00:39.588079 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.588051    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7466360cc91f8dce9f649835caab8eb1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-141.ec2.internal\" (UID: \"7466360cc91f8dce9f649835caab8eb1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-141.ec2.internal"
Jul 20 19:00:39.686550 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:00:39.686484    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-141.ec2.internal\" not found"
Jul 20 19:00:39.782863 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.782829    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-141.ec2.internal"
Jul 20 19:00:39.785408 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:39.785390    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-141.ec2.internal"
Jul 20 19:00:39.787046 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:00:39.786645    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-141.ec2.internal\" not found"
Jul 20 19:00:41.415619 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:00:41.415465    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-141.ec2.internal\" not found"
Jul 20 19:00:41.515989 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:00:41.515925    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-141.ec2.internal\" not found"
Jul 20 19:00:41.559943 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:41.559920    2563 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 19:00:41.616482 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:00:41.616455    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-141.ec2.internal\" not found"
Jul 20 19:00:41.651777 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:41.651756    2563 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 20 19:00:41.652155 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:41.651904    2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 20 19:00:41.652155 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:41.651934    2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 20 19:00:41.717161 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:00:41.717142    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-141.ec2.internal\" not found"
Jul 20 19:00:41.795642 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:41.795567    2563 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 19:00:41.817748 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:00:41.817725    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-141.ec2.internal\" not found"
Jul 20 19:00:41.837024 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:41.836991    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-19 18:55:40 +0000 UTC" deadline="2028-02-17 22:59:45.123802587 +0000 UTC"
Jul 20 19:00:41.837024 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:41.837020    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13851h59m3.286784371s"
Jul 20 19:00:41.892119 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:41.892100    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 19:00:41.893694 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:41.893679    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-141.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 19:00:41.893759 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:41.893707    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-141.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 19:00:41.893759 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:41.893721    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-141.ec2.internal" event="NodeHasSufficientPID"
Jul 20 19:00:41.918765 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:00:41.918748    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-141.ec2.internal\" not found"
Jul 20 19:00:42.019249 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:00:42.019226    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-141.ec2.internal\" not found"
Jul 20 19:00:42.119814 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:00:42.119778    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-141.ec2.internal\" not found"
Jul 20 19:00:42.220631 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:00:42.220602    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-141.ec2.internal\" not found"
Jul 20 19:00:42.272084 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.272062    2563 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 19:00:42.313913 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.313883    2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-141.ec2.internal"
Jul 20 19:00:42.325703 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.325683    2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 20 19:00:42.326596 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.326582    2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-141.ec2.internal"
Jul 20 19:00:42.333299 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.333286    2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 20 19:00:42.538098 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:42.538074    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7466360cc91f8dce9f649835caab8eb1.slice/crio-38f79f520e970ce06f3191671dca7f5d45599c472643d4fcb4cb8f531cc76de2 WatchSource:0}: Error finding container 38f79f520e970ce06f3191671dca7f5d45599c472643d4fcb4cb8f531cc76de2: Status 404 returned error can't find the container with id 38f79f520e970ce06f3191671dca7f5d45599c472643d4fcb4cb8f531cc76de2
Jul 20 19:00:42.541977 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.541958    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 19:00:42.586496 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.586475    2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 19:00:42.676169 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:42.676151    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod508e3b649792abc37cafc631d8189428.slice/crio-33869e32f4ec9efd078879ca97bd43beb19e4441c903bdd464e3a0225db0d8c7 WatchSource:0}: Error finding container 33869e32f4ec9efd078879ca97bd43beb19e4441c903bdd464e3a0225db0d8c7: Status 404 returned error can't find the container with id 33869e32f4ec9efd078879ca97bd43beb19e4441c903bdd464e3a0225db0d8c7
Jul 20 19:00:42.692243 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.692228    2563 apiserver.go:52] "Watching apiserver"
Jul 20 19:00:42.699643 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.699600    2563 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 20 19:00:42.699947 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.699929    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-j6vb4","openshift-multus/network-metrics-daemon-cd24s","openshift-ovn-kubernetes/ovnkube-node-5j2qh","kube-system/konnectivity-agent-pkr2l","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t6xc2","openshift-cluster-node-tuning-operator/tuned-vks8w","openshift-image-registry/node-ca-dz7gc","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-141.ec2.internal","openshift-multus/multus-mpz54","openshift-network-diagnostics/network-check-target-8r6m4","openshift-network-operator/iptables-alerter-84cfb","kube-system/global-pull-secret-syncer-ng85c","kube-system/kube-apiserver-proxy-ip-10-0-139-141.ec2.internal","openshift-dns/node-resolver-fz2dc"]
Jul 20 19:00:42.701438 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.701422    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-dz7gc"
Jul 20 19:00:42.702393 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.702374    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-84cfb"
Jul 20 19:00:42.703278 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.703257    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 20 19:00:42.703725 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.703704    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5j2qh"
Jul 20 19:00:42.703820 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.703776    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 20 19:00:42.704031 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.704006    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-8pwtb\""
Jul 20 19:00:42.704145 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.704075    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 20 19:00:42.705003 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.704984    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-pkr2l"
Jul 20 19:00:42.705215 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.705195    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 20 19:00:42.705318 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.705255    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 20 19:00:42.705318 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.705290    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 20 19:00:42.705461 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.705439    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-cpss2\""
Jul 20 19:00:42.706130 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.706113    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 20 19:00:42.706217 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.706113    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 20 19:00:42.706284 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.706216    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t6xc2"
Jul 20 19:00:42.706284 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.706121    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-84j7c\""
Jul 20 19:00:42.707195 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.706956    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 20 19:00:42.707195 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.707010    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 20 19:00:42.707195 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.707028    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 20 19:00:42.707195 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.707030    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 20 19:00:42.707195 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.707108    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-zq2z5\""
Jul 20 19:00:42.707195 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.707163    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 20 19:00:42.707831 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.707317    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 20 19:00:42.707831 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.707599    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vks8w"
Jul 20 19:00:42.708674 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.708653    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 20 19:00:42.708821 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.708791    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mpz54"
Jul 20 19:00:42.709410 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.709390    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-tbrrq\""
Jul 20 19:00:42.710132 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.710112    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 20 19:00:42.711227 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.710636    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 20 19:00:42.711227 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.710686    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 20 19:00:42.711227 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.710638    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 20 19:00:42.711227 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.710753    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-vvbg9\""
Jul 20 19:00:42.711227 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.711011    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-fz2dc"
Jul 20 19:00:42.711507 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.711303    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 20 19:00:42.711507 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.711398    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 20 19:00:42.711686 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.711665    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 20 19:00:42.712422 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.712402    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 20 19:00:42.712541 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.712454    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cd24s"
Jul 20 19:00:42.712585 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:00:42.712558    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cd24s" podUID="073c7302-c5d7-4bfc-87fa-993163c6fd01"
Jul 20 19:00:42.713595 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.713575    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-6pnl4\""
Jul 20 19:00:42.713743 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.713610    2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 20 19:00:42.713743 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.713739    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-l84n7\""
Jul 20 19:00:42.713859 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.713790    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 20 19:00:42.713927 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.713915    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 20 19:00:42.714174 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.714159    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8r6m4"
Jul 20 19:00:42.714261 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:00:42.714244    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8r6m4" podUID="4cf9f593-d26c-43c1-a246-259d0b23f251"
Jul 20 19:00:42.715576 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.715556    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-j6vb4"
Jul 20 19:00:42.716560 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.716543    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ng85c"
Jul 20 19:00:42.716645 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:00:42.716599    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ng85c" podUID="08e8b8dd-1dde-4bb0-863b-1322d836d18c"
Jul 20 19:00:42.718014 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.717994    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-2bw5c\""
Jul 20 19:00:42.718123 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.718102    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 20 19:00:42.718343 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.718329    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 20 19:00:42.723167 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.723150    2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 20 19:00:42.724760 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.724741    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0a1f8730-2c45-4088-a934-dd6cb2467293-os-release\") pod \"multus-mpz54\" (UID: \"0a1f8730-2c45-4088-a934-dd6cb2467293\") " pod="openshift-multus/multus-mpz54"
Jul 20 19:00:42.724820 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.724774    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0a1f8730-2c45-4088-a934-dd6cb2467293-host-var-lib-kubelet\") pod \"multus-mpz54\" (UID: \"0a1f8730-2c45-4088-a934-dd6cb2467293\") " pod="openshift-multus/multus-mpz54"
Jul 20 19:00:42.724820 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.724803    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9bbfb437-297e-4ce4-b49b-d0794f1a4201-run\") pod \"tuned-vks8w\" (UID: \"9bbfb437-297e-4ce4-b49b-d0794f1a4201\") " pod="openshift-cluster-node-tuning-operator/tuned-vks8w"
Jul 20 19:00:42.724906 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.724826    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/51b7fa8c-4743-49aa-82c4-43bc98a705dc-kubelet-dir\") pod \"aws-ebs-csi-driver-node-t6xc2\" (UID: \"51b7fa8c-4743-49aa-82c4-43bc98a705dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t6xc2"
Jul 20 19:00:42.724906 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.724849    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/51b7fa8c-4743-49aa-82c4-43bc98a705dc-device-dir\") pod \"aws-ebs-csi-driver-node-t6xc2\" (UID: \"51b7fa8c-4743-49aa-82c4-43bc98a705dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t6xc2"
Jul 20 19:00:42.724906 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.724870    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wftmt\" (UniqueName: \"kubernetes.io/projected/9bbfb437-297e-4ce4-b49b-d0794f1a4201-kube-api-access-wftmt\") pod \"tuned-vks8w\" (UID: \"9bbfb437-297e-4ce4-b49b-d0794f1a4201\") " pod="openshift-cluster-node-tuning-operator/tuned-vks8w"
Jul 20 19:00:42.724906 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.724896    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/146cbab8-fe62-44fd-91c3-c25bd7d36c0c-ovnkube-config\") pod \"ovnkube-node-5j2qh\" (UID: \"146cbab8-fe62-44fd-91c3-c25bd7d36c0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5j2qh"
Jul 20 19:00:42.725026 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.724921    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9bbfb437-297e-4ce4-b49b-d0794f1a4201-etc-sysctl-conf\") pod \"tuned-vks8w\" (UID: \"9bbfb437-297e-4ce4-b49b-d0794f1a4201\") " pod="openshift-cluster-node-tuning-operator/tuned-vks8w"
Jul 20 19:00:42.725026 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.724942    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/25f85dbe-c3b0-41a1-8c59-a68cc45c1306-hosts-file\") pod \"node-resolver-fz2dc\" (UID: \"25f85dbe-c3b0-41a1-8c59-a68cc45c1306\") " pod="openshift-dns/node-resolver-fz2dc"
Jul 20 19:00:42.725026 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.724964    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c43a2dd8-3638-4e80-ba88-bc0d0ea5f866-host\") pod \"node-ca-dz7gc\" (UID: \"c43a2dd8-3638-4e80-ba88-bc0d0ea5f866\") " pod="openshift-image-registry/node-ca-dz7gc"
Jul 20 19:00:42.725026 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.724987    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9fz8\" (UniqueName: \"kubernetes.io/projected/5eb7da33-928c-4a4e-9622-80424aed2e71-kube-api-access-g9fz8\") pod \"iptables-alerter-84cfb\" (UID: \"5eb7da33-928c-4a4e-9622-80424aed2e71\") " pod="openshift-network-operator/iptables-alerter-84cfb"
Jul 20 19:00:42.725026 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.725009    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/146cbab8-fe62-44fd-91c3-c25bd7d36c0c-run-systemd\") pod \"ovnkube-node-5j2qh\" (UID: \"146cbab8-fe62-44fd-91c3-c25bd7d36c0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5j2qh"
Jul 20 19:00:42.725161 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.725033    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5ee65ed0-cd62-4933-9888-a6077bd14239-agent-certs\") pod \"konnectivity-agent-pkr2l\" (UID: \"5ee65ed0-cd62-4933-9888-a6077bd14239\") " pod="kube-system/konnectivity-agent-pkr2l"
Jul 20 19:00:42.725161 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.725056    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0a1f8730-2c45-4088-a934-dd6cb2467293-system-cni-dir\") pod \"multus-mpz54\" (UID: \"0a1f8730-2c45-4088-a934-dd6cb2467293\") " pod="openshift-multus/multus-mpz54"
Jul 20 19:00:42.725161 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.725077    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9bbfb437-297e-4ce4-b49b-d0794f1a4201-etc-tuned\") pod \"tuned-vks8w\" (UID: \"9bbfb437-297e-4ce4-b49b-d0794f1a4201\") " pod="openshift-cluster-node-tuning-operator/tuned-vks8w"
Jul 20 19:00:42.725161 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.725102    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/25f85dbe-c3b0-41a1-8c59-a68cc45c1306-tmp-dir\") pod \"node-resolver-fz2dc\" (UID: \"25f85dbe-c3b0-41a1-8c59-a68cc45c1306\") " pod="openshift-dns/node-resolver-fz2dc"
Jul 20 19:00:42.725161 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.725124    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5576p\" (UniqueName: \"kubernetes.io/projected/4cf9f593-d26c-43c1-a246-259d0b23f251-kube-api-access-5576p\") pod \"network-check-target-8r6m4\" (UID: \"4cf9f593-d26c-43c1-a246-259d0b23f251\") " pod="openshift-network-diagnostics/network-check-target-8r6m4"
Jul 20 19:00:42.725161 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.725148    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/146cbab8-fe62-44fd-91c3-c25bd7d36c0c-var-lib-openvswitch\") pod \"ovnkube-node-5j2qh\" (UID: \"146cbab8-fe62-44fd-91c3-c25bd7d36c0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5j2qh"
Jul 20 19:00:42.725365 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.725177    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/146cbab8-fe62-44fd-91c3-c25bd7d36c0c-host-cni-netd\") pod \"ovnkube-node-5j2qh\" (UID: \"146cbab8-fe62-44fd-91c3-c25bd7d36c0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5j2qh"
Jul 20 19:00:42.725365 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.725198    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0a1f8730-2c45-4088-a934-dd6cb2467293-cnibin\") pod \"multus-mpz54\" (UID: \"0a1f8730-2c45-4088-a934-dd6cb2467293\") " pod="openshift-multus/multus-mpz54"
Jul 20 19:00:42.725365 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.725220    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0a1f8730-2c45-4088-a934-dd6cb2467293-multus-socket-dir-parent\") pod \"multus-mpz54\" (UID: \"0a1f8730-2c45-4088-a934-dd6cb2467293\") " pod="openshift-multus/multus-mpz54"
Jul 20 19:00:42.725365 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.725243    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0a1f8730-2c45-4088-a934-dd6cb2467293-multus-conf-dir\") pod \"multus-mpz54\" (UID: \"0a1f8730-2c45-4088-a934-dd6cb2467293\") " pod="openshift-multus/multus-mpz54"
Jul 20 19:00:42.725365 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.725264    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0a1f8730-2c45-4088-a934-dd6cb2467293-multus-daemon-config\") pod \"multus-mpz54\" (UID: \"0a1f8730-2c45-4088-a934-dd6cb2467293\") " pod="openshift-multus/multus-mpz54"
Jul 20 19:00:42.725365 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.725294    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/51b7fa8c-4743-49aa-82c4-43bc98a705dc-registration-dir\") pod \"aws-ebs-csi-driver-node-t6xc2\" (UID: \"51b7fa8c-4743-49aa-82c4-43bc98a705dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t6xc2"
Jul 20 19:00:42.725365 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.725327    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/146cbab8-fe62-44fd-91c3-c25bd7d36c0c-host-slash\") pod \"ovnkube-node-5j2qh\" (UID: \"146cbab8-fe62-44fd-91c3-c25bd7d36c0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5j2qh"
Jul 20 19:00:42.725588 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.725372    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5eb7da33-928c-4a4e-9622-80424aed2e71-host-slash\") pod \"iptables-alerter-84cfb\" (UID: \"5eb7da33-928c-4a4e-9622-80424aed2e71\") " pod="openshift-network-operator/iptables-alerter-84cfb"
Jul 20 19:00:42.725588 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.725394    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/146cbab8-fe62-44fd-91c3-c25bd7d36c0c-node-log\") pod \"ovnkube-node-5j2qh\" (UID: \"146cbab8-fe62-44fd-91c3-c25bd7d36c0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5j2qh"
Jul 20 19:00:42.725588 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.725416    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0a1f8730-2c45-4088-a934-dd6cb2467293-etc-kubernetes\") pod \"multus-mpz54\" (UID: \"0a1f8730-2c45-4088-a934-dd6cb2467293\") " pod="openshift-multus/multus-mpz54"
Jul 20 19:00:42.725588 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.725438    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9bbfb437-297e-4ce4-b49b-d0794f1a4201-etc-kubernetes\") pod \"tuned-vks8w\" (UID: \"9bbfb437-297e-4ce4-b49b-d0794f1a4201\") " pod="openshift-cluster-node-tuning-operator/tuned-vks8w"
Jul 20 19:00:42.725588 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.725460    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9bbfb437-297e-4ce4-b49b-d0794f1a4201-var-lib-kubelet\") pod \"tuned-vks8w\" (UID: \"9bbfb437-297e-4ce4-b49b-d0794f1a4201\") " pod="openshift-cluster-node-tuning-operator/tuned-vks8w"
Jul 20 19:00:42.725588 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.725486    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/073c7302-c5d7-4bfc-87fa-993163c6fd01-metrics-certs\") pod \"network-metrics-daemon-cd24s\" (UID: \"073c7302-c5d7-4bfc-87fa-993163c6fd01\") " pod="openshift-multus/network-metrics-daemon-cd24s"
Jul 20 19:00:42.725588 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.725508    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/146cbab8-fe62-44fd-91c3-c25bd7d36c0c-host-run-netns\") pod \"ovnkube-node-5j2qh\" (UID: \"146cbab8-fe62-44fd-91c3-c25bd7d36c0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5j2qh"
Jul 20 19:00:42.725588 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.725535    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/146cbab8-fe62-44fd-91c3-c25bd7d36c0c-log-socket\") pod \"ovnkube-node-5j2qh\" (UID: \"146cbab8-fe62-44fd-91c3-c25bd7d36c0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5j2qh"
Jul 20 19:00:42.725588 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.725568    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9fjl8\" (UniqueName: \"kubernetes.io/projected/146cbab8-fe62-44fd-91c3-c25bd7d36c0c-kube-api-access-9fjl8\") pod \"ovnkube-node-5j2qh\" (UID: \"146cbab8-fe62-44fd-91c3-c25bd7d36c0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5j2qh"
Jul 20 19:00:42.725858 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.725589    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9bbfb437-297e-4ce4-b49b-d0794f1a4201-etc-sysconfig\") pod \"tuned-vks8w\" (UID: \"9bbfb437-297e-4ce4-b49b-d0794f1a4201\") " pod="openshift-cluster-node-tuning-operator/tuned-vks8w"
Jul 20 19:00:42.725858 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.725611    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/146cbab8-fe62-44fd-91c3-c25bd7d36c0c-env-overrides\") pod \"ovnkube-node-5j2qh\" (UID: \"146cbab8-fe62-44fd-91c3-c25bd7d36c0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5j2qh"
Jul 20 19:00:42.725858 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.725652    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/146cbab8-fe62-44fd-91c3-c25bd7d36c0c-ovn-node-metrics-cert\") pod \"ovnkube-node-5j2qh\" (UID: \"146cbab8-fe62-44fd-91c3-c25bd7d36c0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5j2qh"
Jul 20 19:00:42.725858 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.725679    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrz45\" (UniqueName: \"kubernetes.io/projected/0a1f8730-2c45-4088-a934-dd6cb2467293-kube-api-access-hrz45\") pod \"multus-mpz54\" (UID: \"0a1f8730-2c45-4088-a934-dd6cb2467293\") " pod="openshift-multus/multus-mpz54"
Jul 20 19:00:42.725858 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.725709    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9bbfb437-297e-4ce4-b49b-d0794f1a4201-etc-systemd\") pod \"tuned-vks8w\" (UID: \"9bbfb437-297e-4ce4-b49b-d0794f1a4201\") " pod="openshift-cluster-node-tuning-operator/tuned-vks8w"
Jul 20 19:00:42.725858 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.725746    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9bbfb437-297e-4ce4-b49b-d0794f1a4201-host\") pod \"tuned-vks8w\" (UID: \"9bbfb437-297e-4ce4-b49b-d0794f1a4201\") " pod="openshift-cluster-node-tuning-operator/tuned-vks8w"
Jul 20 19:00:42.725858 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.725769    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/146cbab8-fe62-44fd-91c3-c25bd7d36c0c-run-openvswitch\") pod \"ovnkube-node-5j2qh\" (UID: \"146cbab8-fe62-44fd-91c3-c25bd7d36c0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5j2qh"
Jul 20 19:00:42.725858 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.725791    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c43a2dd8-3638-4e80-ba88-bc0d0ea5f866-serviceca\") pod \"node-ca-dz7gc\" (UID: \"c43a2dd8-3638-4e80-ba88-bc0d0ea5f866\") " pod="openshift-image-registry/node-ca-dz7gc"
Jul 20 19:00:42.725858 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.725815    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/146cbab8-fe62-44fd-91c3-c25bd7d36c0c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5j2qh\" (UID: \"146cbab8-fe62-44fd-91c3-c25bd7d36c0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5j2qh"
Jul 20 19:00:42.725858 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.725840    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zp6jv\" (UniqueName: \"kubernetes.io/projected/51b7fa8c-4743-49aa-82c4-43bc98a705dc-kube-api-access-zp6jv\") pod \"aws-ebs-csi-driver-node-t6xc2\" (UID: \"51b7fa8c-4743-49aa-82c4-43bc98a705dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t6xc2"
Jul 20 19:00:42.726187 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.725860    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9bbfb437-297e-4ce4-b49b-d0794f1a4201-sys\") pod \"tuned-vks8w\" (UID: \"9bbfb437-297e-4ce4-b49b-d0794f1a4201\") " pod="openshift-cluster-node-tuning-operator/tuned-vks8w"
Jul 20 19:00:42.726187 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.725903    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46jll\" (UniqueName: \"kubernetes.io/projected/c43a2dd8-3638-4e80-ba88-bc0d0ea5f866-kube-api-access-46jll\") pod \"node-ca-dz7gc\" (UID: \"c43a2dd8-3638-4e80-ba88-bc0d0ea5f866\") " pod="openshift-image-registry/node-ca-dz7gc"
Jul 20 19:00:42.726187 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.725926    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/146cbab8-fe62-44fd-91c3-c25bd7d36c0c-run-ovn\") pod \"ovnkube-node-5j2qh\" (UID: \"146cbab8-fe62-44fd-91c3-c25bd7d36c0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5j2qh"
Jul 20 19:00:42.726187 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.725949    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0a1f8730-2c45-4088-a934-dd6cb2467293-host-var-lib-cni-multus\") pod \"multus-mpz54\" (UID: \"0a1f8730-2c45-4088-a934-dd6cb2467293\") " pod="openshift-multus/multus-mpz54"
Jul 20 19:00:42.726187 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.725974    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/51b7fa8c-4743-49aa-82c4-43bc98a705dc-etc-selinux\") pod \"aws-ebs-csi-driver-node-t6xc2\" (UID: \"51b7fa8c-4743-49aa-82c4-43bc98a705dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t6xc2"
Jul 20 19:00:42.726187 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.726003    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kl24b\" (UniqueName: \"kubernetes.io/projected/25f85dbe-c3b0-41a1-8c59-a68cc45c1306-kube-api-access-kl24b\") pod \"node-resolver-fz2dc\" (UID: \"25f85dbe-c3b0-41a1-8c59-a68cc45c1306\") " pod="openshift-dns/node-resolver-fz2dc"
Jul 20 19:00:42.726187 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.726040    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwc6m\" (UniqueName: \"kubernetes.io/projected/073c7302-c5d7-4bfc-87fa-993163c6fd01-kube-api-access-kwc6m\") pod \"network-metrics-daemon-cd24s\" (UID: \"073c7302-c5d7-4bfc-87fa-993163c6fd01\") " pod="openshift-multus/network-metrics-daemon-cd24s"
Jul 20 19:00:42.726187 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.726074    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5eb7da33-928c-4a4e-9622-80424aed2e71-iptables-alerter-script\") pod \"iptables-alerter-84cfb\" (UID: \"5eb7da33-928c-4a4e-9622-80424aed2e71\") " pod="openshift-network-operator/iptables-alerter-84cfb"
Jul 20 19:00:42.726187 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.726120    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/146cbab8-fe62-44fd-91c3-c25bd7d36c0c-host-cni-bin\") pod \"ovnkube-node-5j2qh\" (UID: \"146cbab8-fe62-44fd-91c3-c25bd7d36c0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5j2qh"
Jul 20 19:00:42.726187 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.726166    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5ee65ed0-cd62-4933-9888-a6077bd14239-konnectivity-ca\") pod \"konnectivity-agent-pkr2l\" (UID: \"5ee65ed0-cd62-4933-9888-a6077bd14239\") " pod="kube-system/konnectivity-agent-pkr2l"
Jul 20 19:00:42.726524 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.726194    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0a1f8730-2c45-4088-a934-dd6cb2467293-host-run-k8s-cni-cncf-io\") pod \"multus-mpz54\" (UID: \"0a1f8730-2c45-4088-a934-dd6cb2467293\") " pod="openshift-multus/multus-mpz54"
Jul 20 19:00:42.726524 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.726218    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0a1f8730-2c45-4088-a934-dd6cb2467293-multus-cni-dir\") pod \"multus-mpz54\" (UID: \"0a1f8730-2c45-4088-a934-dd6cb2467293\") " pod="openshift-multus/multus-mpz54"
Jul 20 19:00:42.726524 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.726243    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0a1f8730-2c45-4088-a934-dd6cb2467293-host-var-lib-cni-bin\") pod \"multus-mpz54\" (UID: \"0a1f8730-2c45-4088-a934-dd6cb2467293\") " pod="openshift-multus/multus-mpz54"
Jul 20 19:00:42.726524 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.726265    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0a1f8730-2c45-4088-a934-dd6cb2467293-host-run-multus-certs\") pod \"multus-mpz54\" (UID: \"0a1f8730-2c45-4088-a934-dd6cb2467293\") " pod="openshift-multus/multus-mpz54"
Jul 20 19:00:42.726524 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.726287    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/146cbab8-fe62-44fd-91c3-c25bd7d36c0c-host-run-ovn-kubernetes\") pod \"ovnkube-node-5j2qh\" (UID: \"146cbab8-fe62-44fd-91c3-c25bd7d36c0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5j2qh"
Jul 20 19:00:42.726524 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.726306    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/146cbab8-fe62-44fd-91c3-c25bd7d36c0c-ovnkube-script-lib\") pod \"ovnkube-node-5j2qh\" (UID: \"146cbab8-fe62-44fd-91c3-c25bd7d36c0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5j2qh"
Jul 20 19:00:42.726524 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.726322    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9bbfb437-297e-4ce4-b49b-d0794f1a4201-etc-modprobe-d\") pod \"tuned-vks8w\" (UID: \"9bbfb437-297e-4ce4-b49b-d0794f1a4201\") " pod="openshift-cluster-node-tuning-operator/tuned-vks8w"
Jul 20 19:00:42.726524 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.726374    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0a1f8730-2c45-4088-a934-dd6cb2467293-cni-binary-copy\") pod \"multus-mpz54\" (UID: \"0a1f8730-2c45-4088-a934-dd6cb2467293\") " pod="openshift-multus/multus-mpz54"
Jul 20 19:00:42.726524 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.726401    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/51b7fa8c-4743-49aa-82c4-43bc98a705dc-socket-dir\") pod \"aws-ebs-csi-driver-node-t6xc2\" (UID: \"51b7fa8c-4743-49aa-82c4-43bc98a705dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t6xc2"
Jul 20 19:00:42.726524 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.726426    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9bbfb437-297e-4ce4-b49b-d0794f1a4201-etc-sysctl-d\") pod \"tuned-vks8w\" (UID: \"9bbfb437-297e-4ce4-b49b-d0794f1a4201\") " pod="openshift-cluster-node-tuning-operator/tuned-vks8w"
Jul 20 19:00:42.726524 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.726451    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/146cbab8-fe62-44fd-91c3-c25bd7d36c0c-systemd-units\") pod \"ovnkube-node-5j2qh\" (UID: \"146cbab8-fe62-44fd-91c3-c25bd7d36c0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5j2qh"
Jul 20 19:00:42.726524 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.726477    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0a1f8730-2c45-4088-a934-dd6cb2467293-host-run-netns\") pod \"multus-mpz54\" (UID: \"0a1f8730-2c45-4088-a934-dd6cb2467293\") " pod="openshift-multus/multus-mpz54"
Jul 20 19:00:42.726524 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.726501    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9bbfb437-297e-4ce4-b49b-d0794f1a4201-lib-modules\") pod \"tuned-vks8w\" (UID: \"9bbfb437-297e-4ce4-b49b-d0794f1a4201\") " pod="openshift-cluster-node-tuning-operator/tuned-vks8w"
Jul 20 19:00:42.726524 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.726523    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/146cbab8-fe62-44fd-91c3-c25bd7d36c0c-etc-openvswitch\") pod \"ovnkube-node-5j2qh\" (UID: \"146cbab8-fe62-44fd-91c3-c25bd7d36c0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5j2qh"
Jul 20 19:00:42.726926 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.726545    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0a1f8730-2c45-4088-a934-dd6cb2467293-hostroot\") pod \"multus-mpz54\" (UID: \"0a1f8730-2c45-4088-a934-dd6cb2467293\") " pod="openshift-multus/multus-mpz54"
Jul 20 19:00:42.726926 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.726574    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/51b7fa8c-4743-49aa-82c4-43bc98a705dc-sys-fs\") pod \"aws-ebs-csi-driver-node-t6xc2\" (UID: \"51b7fa8c-4743-49aa-82c4-43bc98a705dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t6xc2"
Jul 20 19:00:42.726926 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.726596    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9bbfb437-297e-4ce4-b49b-d0794f1a4201-tmp\") pod \"tuned-vks8w\" (UID: \"9bbfb437-297e-4ce4-b49b-d0794f1a4201\") " pod="openshift-cluster-node-tuning-operator/tuned-vks8w"
Jul 20 19:00:42.726926 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.726612    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/146cbab8-fe62-44fd-91c3-c25bd7d36c0c-host-kubelet\") pod \"ovnkube-node-5j2qh\" (UID: \"146cbab8-fe62-44fd-91c3-c25bd7d36c0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5j2qh"
Jul 20 19:00:42.747454 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.747439    2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-dhnpj"
Jul 20 19:00:42.754724 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.754709    2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-dhnpj"
Jul 20 19:00:42.814601 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.814574    2563 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 20 19:00:42.827677 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.827650    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrz45\" (UniqueName: \"kubernetes.io/projected/0a1f8730-2c45-4088-a934-dd6cb2467293-kube-api-access-hrz45\") pod \"multus-mpz54\" (UID: \"0a1f8730-2c45-4088-a934-dd6cb2467293\") " pod="openshift-multus/multus-mpz54"
Jul 20 19:00:42.827788 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.827683    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9bbfb437-297e-4ce4-b49b-d0794f1a4201-etc-systemd\") pod \"tuned-vks8w\" (UID: \"9bbfb437-297e-4ce4-b49b-d0794f1a4201\") " pod="openshift-cluster-node-tuning-operator/tuned-vks8w"
Jul 20 19:00:42.827788 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.827699    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9bbfb437-297e-4ce4-b49b-d0794f1a4201-host\") pod \"tuned-vks8w\" (UID: \"9bbfb437-297e-4ce4-b49b-d0794f1a4201\") " pod="openshift-cluster-node-tuning-operator/tuned-vks8w"
Jul 20 19:00:42.827788 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.827712    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/146cbab8-fe62-44fd-91c3-c25bd7d36c0c-run-openvswitch\") pod \"ovnkube-node-5j2qh\" (UID: \"146cbab8-fe62-44fd-91c3-c25bd7d36c0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5j2qh"
Jul 20 19:00:42.827788 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.827751    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/08e8b8dd-1dde-4bb0-863b-1322d836d18c-dbus\") pod \"global-pull-secret-syncer-ng85c\" (UID: \"08e8b8dd-1dde-4bb0-863b-1322d836d18c\") " pod="kube-system/global-pull-secret-syncer-ng85c"
Jul 20 19:00:42.827788 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.827773    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c43a2dd8-3638-4e80-ba88-bc0d0ea5f866-serviceca\") pod \"node-ca-dz7gc\" (UID: \"c43a2dd8-3638-4e80-ba88-bc0d0ea5f866\") " pod="openshift-image-registry/node-ca-dz7gc"
Jul 20 19:00:42.828039 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.827807    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9bbfb437-297e-4ce4-b49b-d0794f1a4201-host\") pod \"tuned-vks8w\" (UID: \"9bbfb437-297e-4ce4-b49b-d0794f1a4201\") " pod="openshift-cluster-node-tuning-operator/tuned-vks8w"
Jul 20 19:00:42.828039 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.827805    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/146cbab8-fe62-44fd-91c3-c25bd7d36c0c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5j2qh\" (UID: \"146cbab8-fe62-44fd-91c3-c25bd7d36c0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5j2qh"
Jul 20 19:00:42.828039 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.827783    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9bbfb437-297e-4ce4-b49b-d0794f1a4201-etc-systemd\") pod \"tuned-vks8w\" (UID: \"9bbfb437-297e-4ce4-b49b-d0794f1a4201\") " pod="openshift-cluster-node-tuning-operator/tuned-vks8w"
Jul 20 19:00:42.828039 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.827853    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/146cbab8-fe62-44fd-91c3-c25bd7d36c0c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5j2qh\" (UID: \"146cbab8-fe62-44fd-91c3-c25bd7d36c0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5j2qh"
Jul 20 19:00:42.828039 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.827849    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/af77ba01-d870-408b-badb-3910b3fc4e0e-cni-binary-copy\") pod \"multus-additional-cni-plugins-j6vb4\" (UID: \"af77ba01-d870-408b-badb-3910b3fc4e0e\") " pod="openshift-multus/multus-additional-cni-plugins-j6vb4"
Jul 20 19:00:42.828039 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.827975    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/146cbab8-fe62-44fd-91c3-c25bd7d36c0c-run-openvswitch\") pod \"ovnkube-node-5j2qh\" (UID: \"146cbab8-fe62-44fd-91c3-c25bd7d36c0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5j2qh"
Jul 20 19:00:42.828039 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.827982    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zp6jv\" (UniqueName: \"kubernetes.io/projected/51b7fa8c-4743-49aa-82c4-43bc98a705dc-kube-api-access-zp6jv\") pod \"aws-ebs-csi-driver-node-t6xc2\" (UID: \"51b7fa8c-4743-49aa-82c4-43bc98a705dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t6xc2"
Jul 20 19:00:42.828039 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.828015    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9bbfb437-297e-4ce4-b49b-d0794f1a4201-sys\") pod \"tuned-vks8w\" (UID: \"9bbfb437-297e-4ce4-b49b-d0794f1a4201\") " pod="openshift-cluster-node-tuning-operator/tuned-vks8w"
Jul 20 19:00:42.828039 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.828032    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46jll\" (UniqueName: \"kubernetes.io/projected/c43a2dd8-3638-4e80-ba88-bc0d0ea5f866-kube-api-access-46jll\") pod \"node-ca-dz7gc\" (UID: \"c43a2dd8-3638-4e80-ba88-bc0d0ea5f866\") " pod="openshift-image-registry/node-ca-dz7gc"
Jul 20 19:00:42.828483 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.828051    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/146cbab8-fe62-44fd-91c3-c25bd7d36c0c-run-ovn\") pod \"ovnkube-node-5j2qh\" (UID: \"146cbab8-fe62-44fd-91c3-c25bd7d36c0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5j2qh"
Jul 20 19:00:42.828483 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.828073    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0a1f8730-2c45-4088-a934-dd6cb2467293-host-var-lib-cni-multus\") pod \"multus-mpz54\" (UID: \"0a1f8730-2c45-4088-a934-dd6cb2467293\") " pod="openshift-multus/multus-mpz54"
Jul 20 19:00:42.828483 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.828113    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/51b7fa8c-4743-49aa-82c4-43bc98a705dc-etc-selinux\") pod \"aws-ebs-csi-driver-node-t6xc2\" (UID: \"51b7fa8c-4743-49aa-82c4-43bc98a705dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t6xc2"
Jul 20 19:00:42.828483 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.828155    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/146cbab8-fe62-44fd-91c3-c25bd7d36c0c-run-ovn\") pod \"ovnkube-node-5j2qh\" (UID: \"146cbab8-fe62-44fd-91c3-c25bd7d36c0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5j2qh"
Jul 20 19:00:42.828483 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.828165    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9bbfb437-297e-4ce4-b49b-d0794f1a4201-sys\") pod \"tuned-vks8w\" (UID: \"9bbfb437-297e-4ce4-b49b-d0794f1a4201\") " pod="openshift-cluster-node-tuning-operator/tuned-vks8w"
Jul 20 19:00:42.828483 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.828170    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kl24b\" (UniqueName: \"kubernetes.io/projected/25f85dbe-c3b0-41a1-8c59-a68cc45c1306-kube-api-access-kl24b\") pod \"node-resolver-fz2dc\" (UID: \"25f85dbe-c3b0-41a1-8c59-a68cc45c1306\") " pod="openshift-dns/node-resolver-fz2dc"
Jul 20 19:00:42.828483 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.828201    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0a1f8730-2c45-4088-a934-dd6cb2467293-host-var-lib-cni-multus\") pod \"multus-mpz54\" (UID: \"0a1f8730-2c45-4088-a934-dd6cb2467293\") " pod="openshift-multus/multus-mpz54"
Jul 20 19:00:42.828483 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.828281    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwc6m\" (UniqueName: \"kubernetes.io/projected/073c7302-c5d7-4bfc-87fa-993163c6fd01-kube-api-access-kwc6m\") pod \"network-metrics-daemon-cd24s\" (UID: \"073c7302-c5d7-4bfc-87fa-993163c6fd01\") " pod="openshift-multus/network-metrics-daemon-cd24s"
Jul 20 19:00:42.828483 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.828286    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/51b7fa8c-4743-49aa-82c4-43bc98a705dc-etc-selinux\") pod \"aws-ebs-csi-driver-node-t6xc2\" (UID: \"51b7fa8c-4743-49aa-82c4-43bc98a705dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t6xc2"
Jul 20 19:00:42.828483 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.828316    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5eb7da33-928c-4a4e-9622-80424aed2e71-iptables-alerter-script\") pod \"iptables-alerter-84cfb\" (UID: \"5eb7da33-928c-4a4e-9622-80424aed2e71\") " pod="openshift-network-operator/iptables-alerter-84cfb"
Jul 20 19:00:42.828483 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.828414    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/146cbab8-fe62-44fd-91c3-c25bd7d36c0c-host-cni-bin\") pod \"ovnkube-node-5j2qh\" (UID: \"146cbab8-fe62-44fd-91c3-c25bd7d36c0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5j2qh"
Jul 20 19:00:42.828483 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.828441    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c43a2dd8-3638-4e80-ba88-bc0d0ea5f866-serviceca\") pod \"node-ca-dz7gc\" (UID: \"c43a2dd8-3638-4e80-ba88-bc0d0ea5f866\") " pod="openshift-image-registry/node-ca-dz7gc"
Jul 20 19:00:42.828483 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.828480    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5ee65ed0-cd62-4933-9888-a6077bd14239-konnectivity-ca\") pod \"konnectivity-agent-pkr2l\" (UID: \"5ee65ed0-cd62-4933-9888-a6077bd14239\") " pod="kube-system/konnectivity-agent-pkr2l"
Jul 20 19:00:42.829012 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.828546    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zrwv\" (UniqueName: \"kubernetes.io/projected/af77ba01-d870-408b-badb-3910b3fc4e0e-kube-api-access-8zrwv\") pod \"multus-additional-cni-plugins-j6vb4\" (UID: \"af77ba01-d870-408b-badb-3910b3fc4e0e\") " pod="openshift-multus/multus-additional-cni-plugins-j6vb4"
Jul 20 19:00:42.829012 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.828566    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/146cbab8-fe62-44fd-91c3-c25bd7d36c0c-host-cni-bin\") pod \"ovnkube-node-5j2qh\" (UID: \"146cbab8-fe62-44fd-91c3-c25bd7d36c0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5j2qh"
Jul 20 19:00:42.829012 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.828636    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0a1f8730-2c45-4088-a934-dd6cb2467293-host-run-k8s-cni-cncf-io\") pod \"multus-mpz54\" (UID: \"0a1f8730-2c45-4088-a934-dd6cb2467293\") " pod="openshift-multus/multus-mpz54"
Jul 20 19:00:42.829012 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.828667    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/af77ba01-d870-408b-badb-3910b3fc4e0e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-j6vb4\" (UID: \"af77ba01-d870-408b-badb-3910b3fc4e0e\") " pod="openshift-multus/multus-additional-cni-plugins-j6vb4"
Jul 20 19:00:42.829012 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.828691    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/08e8b8dd-1dde-4bb0-863b-1322d836d18c-kubelet-config\") pod \"global-pull-secret-syncer-ng85c\" (UID: \"08e8b8dd-1dde-4bb0-863b-1322d836d18c\") " pod="kube-system/global-pull-secret-syncer-ng85c"
Jul 20 19:00:42.829012 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.828694    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0a1f8730-2c45-4088-a934-dd6cb2467293-host-run-k8s-cni-cncf-io\") pod \"multus-mpz54\" (UID: \"0a1f8730-2c45-4088-a934-dd6cb2467293\") " pod="openshift-multus/multus-mpz54"
Jul 20 19:00:42.829012 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.828753    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0a1f8730-2c45-4088-a934-dd6cb2467293-multus-cni-dir\") pod \"multus-mpz54\" (UID: \"0a1f8730-2c45-4088-a934-dd6cb2467293\") " pod="openshift-multus/multus-mpz54"
Jul 20 19:00:42.829012 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.828784    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0a1f8730-2c45-4088-a934-dd6cb2467293-host-var-lib-cni-bin\") pod \"multus-mpz54\" (UID: \"0a1f8730-2c45-4088-a934-dd6cb2467293\") " pod="openshift-multus/multus-mpz54"
Jul 20 19:00:42.829012 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.828810    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0a1f8730-2c45-4088-a934-dd6cb2467293-host-run-multus-certs\") pod \"multus-mpz54\" (UID: \"0a1f8730-2c45-4088-a934-dd6cb2467293\") " pod="openshift-multus/multus-mpz54"
Jul 20 19:00:42.829012 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.828848    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0a1f8730-2c45-4088-a934-dd6cb2467293-host-var-lib-cni-bin\") pod \"multus-mpz54\" (UID: \"0a1f8730-2c45-4088-a934-dd6cb2467293\") " pod="openshift-multus/multus-mpz54"
Jul 20 19:00:42.829452 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.829380    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5eb7da33-928c-4a4e-9622-80424aed2e71-iptables-alerter-script\") pod \"iptables-alerter-84cfb\" (UID: \"5eb7da33-928c-4a4e-9622-80424aed2e71\") " pod="openshift-network-operator/iptables-alerter-84cfb"
Jul 20 19:00:42.829452 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.829408    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/146cbab8-fe62-44fd-91c3-c25bd7d36c0c-host-run-ovn-kubernetes\") pod \"ovnkube-node-5j2qh\" (UID: \"146cbab8-fe62-44fd-91c3-c25bd7d36c0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5j2qh"
Jul 20 19:00:42.829566 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.829447    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0a1f8730-2c45-4088-a934-dd6cb2467293-multus-cni-dir\") pod \"multus-mpz54\" (UID: \"0a1f8730-2c45-4088-a934-dd6cb2467293\") " pod="openshift-multus/multus-mpz54"
Jul 20 19:00:42.829620 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.829593    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/146cbab8-fe62-44fd-91c3-c25bd7d36c0c-ovnkube-script-lib\") pod \"ovnkube-node-5j2qh\" (UID: \"146cbab8-fe62-44fd-91c3-c25bd7d36c0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5j2qh"
Jul 20 19:00:42.829620 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.829609    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5ee65ed0-cd62-4933-9888-a6077bd14239-konnectivity-ca\") pod \"konnectivity-agent-pkr2l\" (UID: \"5ee65ed0-cd62-4933-9888-a6077bd14239\") " pod="kube-system/konnectivity-agent-pkr2l"
Jul 20 19:00:42.829734 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.829659    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9bbfb437-297e-4ce4-b49b-d0794f1a4201-etc-modprobe-d\") pod \"tuned-vks8w\" (UID: \"9bbfb437-297e-4ce4-b49b-d0794f1a4201\") " pod="openshift-cluster-node-tuning-operator/tuned-vks8w"
Jul 20 19:00:42.829830 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.829780    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0a1f8730-2c45-4088-a934-dd6cb2467293-cni-binary-copy\") pod \"multus-mpz54\" (UID: \"0a1f8730-2c45-4088-a934-dd6cb2467293\") " pod="openshift-multus/multus-mpz54"
Jul 20 19:00:42.829881 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.829835    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/51b7fa8c-4743-49aa-82c4-43bc98a705dc-socket-dir\") pod \"aws-ebs-csi-driver-node-t6xc2\" (UID: \"51b7fa8c-4743-49aa-82c4-43bc98a705dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t6xc2"
Jul 20 19:00:42.829881 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.829322    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0a1f8730-2c45-4088-a934-dd6cb2467293-host-run-multus-certs\") pod \"multus-mpz54\" (UID: \"0a1f8730-2c45-4088-a934-dd6cb2467293\") " pod="openshift-multus/multus-mpz54"
Jul 20 19:00:42.829968 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.829867    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9bbfb437-297e-4ce4-b49b-d0794f1a4201-etc-sysctl-d\") pod \"tuned-vks8w\" (UID: \"9bbfb437-297e-4ce4-b49b-d0794f1a4201\") " pod="openshift-cluster-node-tuning-operator/tuned-vks8w"
Jul 20 19:00:42.829968 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.829941    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/146cbab8-fe62-44fd-91c3-c25bd7d36c0c-systemd-units\") pod \"ovnkube-node-5j2qh\" (UID: \"146cbab8-fe62-44fd-91c3-c25bd7d36c0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5j2qh"
Jul 20 19:00:42.830091 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.830045    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0a1f8730-2c45-4088-a934-dd6cb2467293-host-run-netns\") pod \"multus-mpz54\" (UID: \"0a1f8730-2c45-4088-a934-dd6cb2467293\") " pod="openshift-multus/multus-mpz54"
Jul 20 19:00:42.830139 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.830087    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/146cbab8-fe62-44fd-91c3-c25bd7d36c0c-host-run-ovn-kubernetes\") pod \"ovnkube-node-5j2qh\" (UID: \"146cbab8-fe62-44fd-91c3-c25bd7d36c0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5j2qh"
Jul 20 19:00:42.830139 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.830105    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9bbfb437-297e-4ce4-b49b-d0794f1a4201-lib-modules\") pod \"tuned-vks8w\" (UID: \"9bbfb437-297e-4ce4-b49b-d0794f1a4201\") " pod="openshift-cluster-node-tuning-operator/tuned-vks8w"
Jul 20 19:00:42.830233 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.830185    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/146cbab8-fe62-44fd-91c3-c25bd7d36c0c-etc-openvswitch\") pod \"ovnkube-node-5j2qh\" (UID: \"146cbab8-fe62-44fd-91c3-c25bd7d36c0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5j2qh"
Jul 20 19:00:42.830285 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.830234    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/af77ba01-d870-408b-badb-3910b3fc4e0e-cnibin\") pod \"multus-additional-cni-plugins-j6vb4\" (UID: \"af77ba01-d870-408b-badb-3910b3fc4e0e\") " pod="openshift-multus/multus-additional-cni-plugins-j6vb4"
Jul 20 19:00:42.830285 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.830263    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9bbfb437-297e-4ce4-b49b-d0794f1a4201-etc-sysctl-d\") pod \"tuned-vks8w\" (UID: \"9bbfb437-297e-4ce4-b49b-d0794f1a4201\") " pod="openshift-cluster-node-tuning-operator/tuned-vks8w"
Jul 20 19:00:42.830409 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.830266    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/08e8b8dd-1dde-4bb0-863b-1322d836d18c-original-pull-secret\") pod \"global-pull-secret-syncer-ng85c\" (UID: \"08e8b8dd-1dde-4bb0-863b-1322d836d18c\") " pod="kube-system/global-pull-secret-syncer-ng85c"
Jul 20 19:00:42.830409 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.830326    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0a1f8730-2c45-4088-a934-dd6cb2467293-hostroot\") pod \"multus-mpz54\" (UID: \"0a1f8730-2c45-4088-a934-dd6cb2467293\") " pod="openshift-multus/multus-mpz54"
Jul 20 19:00:42.830409 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.830386    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/51b7fa8c-4743-49aa-82c4-43bc98a705dc-sys-fs\") pod \"aws-ebs-csi-driver-node-t6xc2\" (UID: \"51b7fa8c-4743-49aa-82c4-43bc98a705dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t6xc2"
Jul 20 19:00:42.830550 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.830425    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9bbfb437-297e-4ce4-b49b-d0794f1a4201-tmp\") pod \"tuned-vks8w\" (UID: \"9bbfb437-297e-4ce4-b49b-d0794f1a4201\") " pod="openshift-cluster-node-tuning-operator/tuned-vks8w"
Jul 20 19:00:42.830550 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.830451    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/146cbab8-fe62-44fd-91c3-c25bd7d36c0c-host-kubelet\") pod \"ovnkube-node-5j2qh\" (UID: \"146cbab8-fe62-44fd-91c3-c25bd7d36c0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5j2qh"
Jul 20 19:00:42.830550 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.830486    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/146cbab8-fe62-44fd-91c3-c25bd7d36c0c-ovnkube-script-lib\") pod \"ovnkube-node-5j2qh\" (UID: \"146cbab8-fe62-44fd-91c3-c25bd7d36c0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5j2qh"
Jul 20 19:00:42.830550 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.830499    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0a1f8730-2c45-4088-a934-dd6cb2467293-cni-binary-copy\") pod \"multus-mpz54\" (UID: \"0a1f8730-2c45-4088-a934-dd6cb2467293\") " pod="openshift-multus/multus-mpz54"
Jul 20 19:00:42.830761 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.830600    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0a1f8730-2c45-4088-a934-dd6cb2467293-host-run-netns\") pod \"multus-mpz54\" (UID: \"0a1f8730-2c45-4088-a934-dd6cb2467293\") " pod="openshift-multus/multus-mpz54"
Jul 20 19:00:42.830761 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.830608    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0a1f8730-2c45-4088-a934-dd6cb2467293-hostroot\") pod \"multus-mpz54\" (UID: \"0a1f8730-2c45-4088-a934-dd6cb2467293\") " pod="openshift-multus/multus-mpz54"
Jul 20 19:00:42.830761 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.830640    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/146cbab8-fe62-44fd-91c3-c25bd7d36c0c-etc-openvswitch\") pod \"ovnkube-node-5j2qh\" (UID: \"146cbab8-fe62-44fd-91c3-c25bd7d36c0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5j2qh"
Jul 20 19:00:42.830761 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.830655    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9bbfb437-297e-4ce4-b49b-d0794f1a4201-etc-modprobe-d\") pod \"tuned-vks8w\" (UID: \"9bbfb437-297e-4ce4-b49b-d0794f1a4201\") " pod="openshift-cluster-node-tuning-operator/tuned-vks8w"
Jul 20 19:00:42.830761 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.830657    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/51b7fa8c-4743-49aa-82c4-43bc98a705dc-sys-fs\") pod \"aws-ebs-csi-driver-node-t6xc2\" (UID: \"51b7fa8c-4743-49aa-82c4-43bc98a705dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t6xc2"
Jul 20 19:00:42.830761 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.830684    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0a1f8730-2c45-4088-a934-dd6cb2467293-os-release\") pod \"multus-mpz54\" (UID: \"0a1f8730-2c45-4088-a934-dd6cb2467293\") " pod="openshift-multus/multus-mpz54"
Jul 20 19:00:42.830761 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.830721    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/146cbab8-fe62-44fd-91c3-c25bd7d36c0c-systemd-units\") pod \"ovnkube-node-5j2qh\" (UID: \"146cbab8-fe62-44fd-91c3-c25bd7d36c0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5j2qh"
Jul 20 19:00:42.831051 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.830761    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/51b7fa8c-4743-49aa-82c4-43bc98a705dc-socket-dir\") pod \"aws-ebs-csi-driver-node-t6xc2\" (UID: \"51b7fa8c-4743-49aa-82c4-43bc98a705dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t6xc2"
Jul 20 19:00:42.831051 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.830763    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0a1f8730-2c45-4088-a934-dd6cb2467293-host-var-lib-kubelet\") pod \"multus-mpz54\" (UID: \"0a1f8730-2c45-4088-a934-dd6cb2467293\") " pod="openshift-multus/multus-mpz54"
Jul 20 19:00:42.831051 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.830780    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/146cbab8-fe62-44fd-91c3-c25bd7d36c0c-host-kubelet\") pod \"ovnkube-node-5j2qh\" (UID: \"146cbab8-fe62-44fd-91c3-c25bd7d36c0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5j2qh"
Jul 20 19:00:42.831051 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.830816    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0a1f8730-2c45-4088-a934-dd6cb2467293-host-var-lib-kubelet\") pod \"multus-mpz54\" (UID: \"0a1f8730-2c45-4088-a934-dd6cb2467293\") " pod="openshift-multus/multus-mpz54"
Jul 20 19:00:42.831051 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.830846    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0a1f8730-2c45-4088-a934-dd6cb2467293-os-release\") pod \"multus-mpz54\" (UID: \"0a1f8730-2c45-4088-a934-dd6cb2467293\") " pod="openshift-multus/multus-mpz54"
Jul 20 19:00:42.831051 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.830860    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9bbfb437-297e-4ce4-b49b-d0794f1a4201-lib-modules\") pod \"tuned-vks8w\" (UID: \"9bbfb437-297e-4ce4-b49b-d0794f1a4201\") " pod="openshift-cluster-node-tuning-operator/tuned-vks8w"
Jul 20 19:00:42.831051 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.830865    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9bbfb437-297e-4ce4-b49b-d0794f1a4201-run\") pod \"tuned-vks8w\" (UID: \"9bbfb437-297e-4ce4-b49b-d0794f1a4201\") " pod="openshift-cluster-node-tuning-operator/tuned-vks8w"
Jul 20 19:00:42.831051 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.830911    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/51b7fa8c-4743-49aa-82c4-43bc98a705dc-kubelet-dir\") pod \"aws-ebs-csi-driver-node-t6xc2\" (UID: \"51b7fa8c-4743-49aa-82c4-43bc98a705dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t6xc2"
Jul 20 19:00:42.831051 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.830917    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9bbfb437-297e-4ce4-b49b-d0794f1a4201-run\") pod \"tuned-vks8w\" (UID: \"9bbfb437-297e-4ce4-b49b-d0794f1a4201\") " pod="openshift-cluster-node-tuning-operator/tuned-vks8w"
Jul 20 19:00:42.831051 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.830942    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/51b7fa8c-4743-49aa-82c4-43bc98a705dc-device-dir\") pod \"aws-ebs-csi-driver-node-t6xc2\" (UID: \"51b7fa8c-4743-49aa-82c4-43bc98a705dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t6xc2"
Jul 20 19:00:42.831051 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.830944    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/51b7fa8c-4743-49aa-82c4-43bc98a705dc-kubelet-dir\") pod \"aws-ebs-csi-driver-node-t6xc2\" (UID: \"51b7fa8c-4743-49aa-82c4-43bc98a705dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t6xc2"
Jul 20 19:00:42.831051 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.830965    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wftmt\" (UniqueName: \"kubernetes.io/projected/9bbfb437-297e-4ce4-b49b-d0794f1a4201-kube-api-access-wftmt\") pod \"tuned-vks8w\" (UID: \"9bbfb437-297e-4ce4-b49b-d0794f1a4201\") " pod="openshift-cluster-node-tuning-operator/tuned-vks8w"
Jul 20 19:00:42.831051 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.831001    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/51b7fa8c-4743-49aa-82c4-43bc98a705dc-device-dir\") pod \"aws-ebs-csi-driver-node-t6xc2\" (UID: \"51b7fa8c-4743-49aa-82c4-43bc98a705dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t6xc2"
Jul 20 19:00:42.831051 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.830992    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/146cbab8-fe62-44fd-91c3-c25bd7d36c0c-ovnkube-config\") pod \"ovnkube-node-5j2qh\" (UID: \"146cbab8-fe62-44fd-91c3-c25bd7d36c0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5j2qh"
Jul 20 19:00:42.831051 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.831050    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9bbfb437-297e-4ce4-b49b-d0794f1a4201-etc-sysctl-conf\") pod \"tuned-vks8w\" (UID: \"9bbfb437-297e-4ce4-b49b-d0794f1a4201\") " pod="openshift-cluster-node-tuning-operator/tuned-vks8w"
Jul 20 19:00:42.831667 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.831136    2563 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 20 19:00:42.831667 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.831190    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9bbfb437-297e-4ce4-b49b-d0794f1a4201-etc-sysctl-conf\") pod \"tuned-vks8w\" (UID: \"9bbfb437-297e-4ce4-b49b-d0794f1a4201\") " pod="openshift-cluster-node-tuning-operator/tuned-vks8w"
Jul 20 19:00:42.831667 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.831234    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/25f85dbe-c3b0-41a1-8c59-a68cc45c1306-hosts-file\") pod \"node-resolver-fz2dc\" (UID: \"25f85dbe-c3b0-41a1-8c59-a68cc45c1306\") " pod="openshift-dns/node-resolver-fz2dc"
Jul 20 19:00:42.831667 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.831271    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c43a2dd8-3638-4e80-ba88-bc0d0ea5f866-host\") pod \"node-ca-dz7gc\" (UID: \"c43a2dd8-3638-4e80-ba88-bc0d0ea5f866\") " pod="openshift-image-registry/node-ca-dz7gc"
Jul 20 19:00:42.831667 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.831316    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/25f85dbe-c3b0-41a1-8c59-a68cc45c1306-hosts-file\") pod \"node-resolver-fz2dc\" (UID: \"25f85dbe-c3b0-41a1-8c59-a68cc45c1306\") " pod="openshift-dns/node-resolver-fz2dc"
Jul 20 19:00:42.831667 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.831333    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c43a2dd8-3638-4e80-ba88-bc0d0ea5f866-host\") pod \"node-ca-dz7gc\" (UID: \"c43a2dd8-3638-4e80-ba88-bc0d0ea5f866\") " pod="openshift-image-registry/node-ca-dz7gc"
Jul 20 19:00:42.831667 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.831375    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9fz8\" (UniqueName: \"kubernetes.io/projected/5eb7da33-928c-4a4e-9622-80424aed2e71-kube-api-access-g9fz8\") pod \"iptables-alerter-84cfb\" (UID: \"5eb7da33-928c-4a4e-9622-80424aed2e71\") " pod="openshift-network-operator/iptables-alerter-84cfb"
Jul 20 19:00:42.831667 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.831409    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/146cbab8-fe62-44fd-91c3-c25bd7d36c0c-run-systemd\") pod \"ovnkube-node-5j2qh\" (UID: \"146cbab8-fe62-44fd-91c3-c25bd7d36c0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5j2qh"
Jul 20 19:00:42.831667 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.831553    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5ee65ed0-cd62-4933-9888-a6077bd14239-agent-certs\") pod \"konnectivity-agent-pkr2l\" (UID: \"5ee65ed0-cd62-4933-9888-a6077bd14239\") " pod="kube-system/konnectivity-agent-pkr2l"
Jul 20 19:00:42.831667 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.831600    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/146cbab8-fe62-44fd-91c3-c25bd7d36c0c-ovnkube-config\") pod \"ovnkube-node-5j2qh\" (UID: \"146cbab8-fe62-44fd-91c3-c25bd7d36c0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5j2qh"
Jul 20 19:00:42.831667 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.831609    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0a1f8730-2c45-4088-a934-dd6cb2467293-system-cni-dir\") pod \"multus-mpz54\" (UID: \"0a1f8730-2c45-4088-a934-dd6cb2467293\") " pod="openshift-multus/multus-mpz54"
Jul 20 19:00:42.831667 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.831660    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0a1f8730-2c45-4088-a934-dd6cb2467293-system-cni-dir\") pod \"multus-mpz54\" (UID: \"0a1f8730-2c45-4088-a934-dd6cb2467293\") " pod="openshift-multus/multus-mpz54"
Jul 20 19:00:42.832131 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.831751    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9bbfb437-297e-4ce4-b49b-d0794f1a4201-etc-tuned\") pod \"tuned-vks8w\" (UID: \"9bbfb437-297e-4ce4-b49b-d0794f1a4201\") " pod="openshift-cluster-node-tuning-operator/tuned-vks8w"
Jul 20 19:00:42.832711 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.832691    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/25f85dbe-c3b0-41a1-8c59-a68cc45c1306-tmp-dir\") pod \"node-resolver-fz2dc\" (UID: \"25f85dbe-c3b0-41a1-8c59-a68cc45c1306\") " pod="openshift-dns/node-resolver-fz2dc"
Jul 20 19:00:42.832874 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.832858    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5576p\" (UniqueName: \"kubernetes.io/projected/4cf9f593-d26c-43c1-a246-259d0b23f251-kube-api-access-5576p\") pod \"network-check-target-8r6m4\" (UID: \"4cf9f593-d26c-43c1-a246-259d0b23f251\") " pod="openshift-network-diagnostics/network-check-target-8r6m4"
Jul 20 19:00:42.833673 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.833644    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/146cbab8-fe62-44fd-91c3-c25bd7d36c0c-var-lib-openvswitch\") pod \"ovnkube-node-5j2qh\" (UID: \"146cbab8-fe62-44fd-91c3-c25bd7d36c0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5j2qh"
Jul 20 19:00:42.833778 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.833685    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/146cbab8-fe62-44fd-91c3-c25bd7d36c0c-host-cni-netd\") pod \"ovnkube-node-5j2qh\" (UID: \"146cbab8-fe62-44fd-91c3-c25bd7d36c0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5j2qh"
Jul 20 19:00:42.833778 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.833720    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/af77ba01-d870-408b-badb-3910b3fc4e0e-os-release\") pod \"multus-additional-cni-plugins-j6vb4\" (UID: \"af77ba01-d870-408b-badb-3910b3fc4e0e\") " pod="openshift-multus/multus-additional-cni-plugins-j6vb4"
Jul 20 19:00:42.833778 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.833752    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/af77ba01-d870-408b-badb-3910b3fc4e0e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-j6vb4\" (UID: \"af77ba01-d870-408b-badb-3910b3fc4e0e\") " pod="openshift-multus/multus-additional-cni-plugins-j6vb4"
Jul 20 19:00:42.833990 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.833779    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0a1f8730-2c45-4088-a934-dd6cb2467293-cnibin\") pod \"multus-mpz54\" (UID: \"0a1f8730-2c45-4088-a934-dd6cb2467293\") " pod="openshift-multus/multus-mpz54"
Jul 20 19:00:42.833990 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.833330    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/25f85dbe-c3b0-41a1-8c59-a68cc45c1306-tmp-dir\") pod \"node-resolver-fz2dc\" (UID: \"25f85dbe-c3b0-41a1-8c59-a68cc45c1306\") " pod="openshift-dns/node-resolver-fz2dc"
Jul 20 19:00:42.833990 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.833806    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0a1f8730-2c45-4088-a934-dd6cb2467293-multus-socket-dir-parent\") pod \"multus-mpz54\" (UID: \"0a1f8730-2c45-4088-a934-dd6cb2467293\") " pod="openshift-multus/multus-mpz54"
Jul 20 19:00:42.833990 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.833052    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/146cbab8-fe62-44fd-91c3-c25bd7d36c0c-run-systemd\") pod \"ovnkube-node-5j2qh\" (UID: \"146cbab8-fe62-44fd-91c3-c25bd7d36c0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5j2qh"
Jul 20 19:00:42.833990 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.833836    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0a1f8730-2c45-4088-a934-dd6cb2467293-multus-conf-dir\") pod \"multus-mpz54\" (UID: \"0a1f8730-2c45-4088-a934-dd6cb2467293\") " pod="openshift-multus/multus-mpz54"
Jul 20 19:00:42.833990 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.833891    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/146cbab8-fe62-44fd-91c3-c25bd7d36c0c-var-lib-openvswitch\") pod \"ovnkube-node-5j2qh\" (UID: \"146cbab8-fe62-44fd-91c3-c25bd7d36c0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5j2qh"
Jul 20 19:00:42.833990 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.833929    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0a1f8730-2c45-4088-a934-dd6cb2467293-cnibin\") pod \"multus-mpz54\" (UID: \"0a1f8730-2c45-4088-a934-dd6cb2467293\") " pod="openshift-multus/multus-mpz54"
Jul 20 19:00:42.833990 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.833962    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/146cbab8-fe62-44fd-91c3-c25bd7d36c0c-host-cni-netd\") pod \"ovnkube-node-5j2qh\" (UID: \"146cbab8-fe62-44fd-91c3-c25bd7d36c0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5j2qh"
Jul 20 19:00:42.833990 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.833982    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0a1f8730-2c45-4088-a934-dd6cb2467293-multus-conf-dir\") pod \"multus-mpz54\" (UID: \"0a1f8730-2c45-4088-a934-dd6cb2467293\") " pod="openshift-multus/multus-mpz54"
Jul 20 19:00:42.834422 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.834000    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0a1f8730-2c45-4088-a934-dd6cb2467293-multus-daemon-config\") pod \"multus-mpz54\" (UID: \"0a1f8730-2c45-4088-a934-dd6cb2467293\") " pod="openshift-multus/multus-mpz54"
Jul 20 19:00:42.834422 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.834043    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0a1f8730-2c45-4088-a934-dd6cb2467293-multus-socket-dir-parent\") pod \"multus-mpz54\" (UID: \"0a1f8730-2c45-4088-a934-dd6cb2467293\") " pod="openshift-multus/multus-mpz54"
Jul 20 19:00:42.834422 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.834047    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/51b7fa8c-4743-49aa-82c4-43bc98a705dc-registration-dir\") pod \"aws-ebs-csi-driver-node-t6xc2\" (UID: \"51b7fa8c-4743-49aa-82c4-43bc98a705dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t6xc2"
Jul 20 19:00:42.834422 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.834151    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/146cbab8-fe62-44fd-91c3-c25bd7d36c0c-host-slash\") pod \"ovnkube-node-5j2qh\" (UID: \"146cbab8-fe62-44fd-91c3-c25bd7d36c0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5j2qh"
Jul 20 19:00:42.834422 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.834185    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5eb7da33-928c-4a4e-9622-80424aed2e71-host-slash\") pod \"iptables-alerter-84cfb\" (UID: \"5eb7da33-928c-4a4e-9622-80424aed2e71\") " pod="openshift-network-operator/iptables-alerter-84cfb"
Jul 20 19:00:42.834422 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.834197    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/51b7fa8c-4743-49aa-82c4-43bc98a705dc-registration-dir\") pod \"aws-ebs-csi-driver-node-t6xc2\" (UID: \"51b7fa8c-4743-49aa-82c4-43bc98a705dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t6xc2"
Jul 20 19:00:42.834422 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.834231    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/146cbab8-fe62-44fd-91c3-c25bd7d36c0c-node-log\") pod \"ovnkube-node-5j2qh\" (UID: \"146cbab8-fe62-44fd-91c3-c25bd7d36c0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5j2qh"
Jul 20 19:00:42.834422 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.834255    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/146cbab8-fe62-44fd-91c3-c25bd7d36c0c-host-slash\") pod \"ovnkube-node-5j2qh\" (UID: \"146cbab8-fe62-44fd-91c3-c25bd7d36c0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5j2qh"
Jul 20 19:00:42.834422 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.834264    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5eb7da33-928c-4a4e-9622-80424aed2e71-host-slash\") pod \"iptables-alerter-84cfb\" (UID: \"5eb7da33-928c-4a4e-9622-80424aed2e71\") " pod="openshift-network-operator/iptables-alerter-84cfb"
Jul 20 19:00:42.834422 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.834283    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0a1f8730-2c45-4088-a934-dd6cb2467293-etc-kubernetes\") pod \"multus-mpz54\" (UID: \"0a1f8730-2c45-4088-a934-dd6cb2467293\") " pod="openshift-multus/multus-mpz54"
Jul 20 19:00:42.834422 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.834308    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/146cbab8-fe62-44fd-91c3-c25bd7d36c0c-node-log\") pod \"ovnkube-node-5j2qh\" (UID: \"146cbab8-fe62-44fd-91c3-c25bd7d36c0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5j2qh"
Jul 20 19:00:42.834422 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.834314    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9bbfb437-297e-4ce4-b49b-d0794f1a4201-etc-kubernetes\") pod \"tuned-vks8w\" (UID: \"9bbfb437-297e-4ce4-b49b-d0794f1a4201\") " pod="openshift-cluster-node-tuning-operator/tuned-vks8w"
Jul 20 19:00:42.834422 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.834369    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9bbfb437-297e-4ce4-b49b-d0794f1a4201-var-lib-kubelet\") pod \"tuned-vks8w\" (UID: \"9bbfb437-297e-4ce4-b49b-d0794f1a4201\") " pod="openshift-cluster-node-tuning-operator/tuned-vks8w"
Jul 20 19:00:42.834422 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.834389    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9bbfb437-297e-4ce4-b49b-d0794f1a4201-etc-kubernetes\") pod \"tuned-vks8w\" (UID: \"9bbfb437-297e-4ce4-b49b-d0794f1a4201\") " pod="openshift-cluster-node-tuning-operator/tuned-vks8w"
Jul 20 19:00:42.834422 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.834397    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0a1f8730-2c45-4088-a934-dd6cb2467293-etc-kubernetes\") pod \"multus-mpz54\" (UID: \"0a1f8730-2c45-4088-a934-dd6cb2467293\") " pod="openshift-multus/multus-mpz54"
Jul 20 19:00:42.834422 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.834402    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/073c7302-c5d7-4bfc-87fa-993163c6fd01-metrics-certs\") pod \"network-metrics-daemon-cd24s\" (UID: \"073c7302-c5d7-4bfc-87fa-993163c6fd01\") " pod="openshift-multus/network-metrics-daemon-cd24s"
Jul 20 19:00:42.835129 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.834455    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/146cbab8-fe62-44fd-91c3-c25bd7d36c0c-host-run-netns\") pod \"ovnkube-node-5j2qh\" (UID: \"146cbab8-fe62-44fd-91c3-c25bd7d36c0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5j2qh"
Jul 20 19:00:42.835129 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.834476    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/146cbab8-fe62-44fd-91c3-c25bd7d36c0c-log-socket\") pod \"ovnkube-node-5j2qh\" (UID: \"146cbab8-fe62-44fd-91c3-c25bd7d36c0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5j2qh"
Jul 20 19:00:42.835129 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.834506    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9fjl8\" (UniqueName: \"kubernetes.io/projected/146cbab8-fe62-44fd-91c3-c25bd7d36c0c-kube-api-access-9fjl8\") pod \"ovnkube-node-5j2qh\" (UID: \"146cbab8-fe62-44fd-91c3-c25bd7d36c0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5j2qh"
Jul 20 19:00:42.835129 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.834517    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/146cbab8-fe62-44fd-91c3-c25bd7d36c0c-host-run-netns\") pod \"ovnkube-node-5j2qh\" (UID: \"146cbab8-fe62-44fd-91c3-c25bd7d36c0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5j2qh"
Jul 20 19:00:42.835129 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.834541    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0a1f8730-2c45-4088-a934-dd6cb2467293-multus-daemon-config\") pod \"multus-mpz54\" (UID: \"0a1f8730-2c45-4088-a934-dd6cb2467293\") " pod="openshift-multus/multus-mpz54"
Jul 20 19:00:42.835129 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.834564    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/146cbab8-fe62-44fd-91c3-c25bd7d36c0c-log-socket\") pod \"ovnkube-node-5j2qh\" (UID: \"146cbab8-fe62-44fd-91c3-c25bd7d36c0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5j2qh"
Jul 20 19:00:42.835129 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.834543    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/af77ba01-d870-408b-badb-3910b3fc4e0e-system-cni-dir\") pod \"multus-additional-cni-plugins-j6vb4\" (UID: \"af77ba01-d870-408b-badb-3910b3fc4e0e\") " pod="openshift-multus/multus-additional-cni-plugins-j6vb4"
Jul 20 19:00:42.835129 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:00:42.834575    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 19:00:42.835129 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.834454    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9bbfb437-297e-4ce4-b49b-d0794f1a4201-var-lib-kubelet\") pod \"tuned-vks8w\" (UID: \"9bbfb437-297e-4ce4-b49b-d0794f1a4201\") " pod="openshift-cluster-node-tuning-operator/tuned-vks8w"
Jul 20 19:00:42.835129 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.834603    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9bbfb437-297e-4ce4-b49b-d0794f1a4201-etc-sysconfig\") pod \"tuned-vks8w\" (UID: \"9bbfb437-297e-4ce4-b49b-d0794f1a4201\") " pod="openshift-cluster-node-tuning-operator/tuned-vks8w"
Jul 20 19:00:42.835129 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.834639    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/146cbab8-fe62-44fd-91c3-c25bd7d36c0c-env-overrides\") pod \"ovnkube-node-5j2qh\" (UID: \"146cbab8-fe62-44fd-91c3-c25bd7d36c0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5j2qh"
Jul 20 19:00:42.835129 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:00:42.834689    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/073c7302-c5d7-4bfc-87fa-993163c6fd01-metrics-certs podName:073c7302-c5d7-4bfc-87fa-993163c6fd01 nodeName:}" failed. No retries permitted until 2026-07-20 19:00:43.334636892 +0000 UTC m=+3.018164893 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/073c7302-c5d7-4bfc-87fa-993163c6fd01-metrics-certs") pod "network-metrics-daemon-cd24s" (UID: "073c7302-c5d7-4bfc-87fa-993163c6fd01") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 19:00:42.835129 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.834723    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9bbfb437-297e-4ce4-b49b-d0794f1a4201-etc-sysconfig\") pod \"tuned-vks8w\" (UID: \"9bbfb437-297e-4ce4-b49b-d0794f1a4201\") " pod="openshift-cluster-node-tuning-operator/tuned-vks8w"
Jul 20 19:00:42.835129 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.834785    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/146cbab8-fe62-44fd-91c3-c25bd7d36c0c-ovn-node-metrics-cert\") pod \"ovnkube-node-5j2qh\" (UID: \"146cbab8-fe62-44fd-91c3-c25bd7d36c0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5j2qh"
Jul 20 19:00:42.835129 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.834811    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/af77ba01-d870-408b-badb-3910b3fc4e0e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-j6vb4\" (UID: \"af77ba01-d870-408b-badb-3910b3fc4e0e\") " pod="openshift-multus/multus-additional-cni-plugins-j6vb4"
Jul 20 19:00:42.835129 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.835018    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/146cbab8-fe62-44fd-91c3-c25bd7d36c0c-env-overrides\") pod \"ovnkube-node-5j2qh\" (UID: \"146cbab8-fe62-44fd-91c3-c25bd7d36c0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5j2qh"
Jul 20 19:00:42.835924 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.835406    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9bbfb437-297e-4ce4-b49b-d0794f1a4201-etc-tuned\") pod \"tuned-vks8w\" (UID: \"9bbfb437-297e-4ce4-b49b-d0794f1a4201\") " pod="openshift-cluster-node-tuning-operator/tuned-vks8w"
Jul 20 19:00:42.835924 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.835575    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5ee65ed0-cd62-4933-9888-a6077bd14239-agent-certs\") pod \"konnectivity-agent-pkr2l\" (UID: \"5ee65ed0-cd62-4933-9888-a6077bd14239\") " pod="kube-system/konnectivity-agent-pkr2l"
Jul 20 19:00:42.836283 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.836214    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9bbfb437-297e-4ce4-b49b-d0794f1a4201-tmp\") pod \"tuned-vks8w\" (UID: \"9bbfb437-297e-4ce4-b49b-d0794f1a4201\") " pod="openshift-cluster-node-tuning-operator/tuned-vks8w"
Jul 20 19:00:42.838519 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.838500    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrz45\" (UniqueName: \"kubernetes.io/projected/0a1f8730-2c45-4088-a934-dd6cb2467293-kube-api-access-hrz45\") pod \"multus-mpz54\" (UID: \"0a1f8730-2c45-4088-a934-dd6cb2467293\") " pod="openshift-multus/multus-mpz54"
Jul 20 19:00:42.838636 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.838618    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/146cbab8-fe62-44fd-91c3-c25bd7d36c0c-ovn-node-metrics-cert\") pod \"ovnkube-node-5j2qh\" (UID: \"146cbab8-fe62-44fd-91c3-c25bd7d36c0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5j2qh"
Jul 20 19:00:42.838700 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.838637    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zp6jv\" (UniqueName: \"kubernetes.io/projected/51b7fa8c-4743-49aa-82c4-43bc98a705dc-kube-api-access-zp6jv\") pod \"aws-ebs-csi-driver-node-t6xc2\" (UID: \"51b7fa8c-4743-49aa-82c4-43bc98a705dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t6xc2"
Jul 20 19:00:42.838700 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.838671    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-46jll\" (UniqueName: \"kubernetes.io/projected/c43a2dd8-3638-4e80-ba88-bc0d0ea5f866-kube-api-access-46jll\") pod \"node-ca-dz7gc\" (UID: \"c43a2dd8-3638-4e80-ba88-bc0d0ea5f866\") " pod="openshift-image-registry/node-ca-dz7gc"
Jul 20 19:00:42.839058 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.839034    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kl24b\" (UniqueName: \"kubernetes.io/projected/25f85dbe-c3b0-41a1-8c59-a68cc45c1306-kube-api-access-kl24b\") pod \"node-resolver-fz2dc\" (UID: \"25f85dbe-c3b0-41a1-8c59-a68cc45c1306\") " pod="openshift-dns/node-resolver-fz2dc"
Jul 20 19:00:42.839131 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:00:42.839061    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 19:00:42.839131 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:00:42.839086    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 19:00:42.839131 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:00:42.839096    2563 projected.go:196] Error preparing data for projected volume kube-api-access-5576p for pod openshift-network-diagnostics/network-check-target-8r6m4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 19:00:42.839131 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.839108    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwc6m\" (UniqueName: \"kubernetes.io/projected/073c7302-c5d7-4bfc-87fa-993163c6fd01-kube-api-access-kwc6m\") pod \"network-metrics-daemon-cd24s\" (UID: \"073c7302-c5d7-4bfc-87fa-993163c6fd01\") " pod="openshift-multus/network-metrics-daemon-cd24s"
Jul 20 19:00:42.839273 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:00:42.839144    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4cf9f593-d26c-43c1-a246-259d0b23f251-kube-api-access-5576p podName:4cf9f593-d26c-43c1-a246-259d0b23f251 nodeName:}" failed. No retries permitted until 2026-07-20 19:00:43.339130162 +0000 UTC m=+3.022658162 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-5576p" (UniqueName: "kubernetes.io/projected/4cf9f593-d26c-43c1-a246-259d0b23f251-kube-api-access-5576p") pod "network-check-target-8r6m4" (UID: "4cf9f593-d26c-43c1-a246-259d0b23f251") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 19:00:42.840837 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.840810    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9fz8\" (UniqueName: \"kubernetes.io/projected/5eb7da33-928c-4a4e-9622-80424aed2e71-kube-api-access-g9fz8\") pod \"iptables-alerter-84cfb\" (UID: \"5eb7da33-928c-4a4e-9622-80424aed2e71\") " pod="openshift-network-operator/iptables-alerter-84cfb"
Jul 20 19:00:42.841012 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.840995    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wftmt\" (UniqueName: \"kubernetes.io/projected/9bbfb437-297e-4ce4-b49b-d0794f1a4201-kube-api-access-wftmt\") pod \"tuned-vks8w\" (UID: \"9bbfb437-297e-4ce4-b49b-d0794f1a4201\") " pod="openshift-cluster-node-tuning-operator/tuned-vks8w"
Jul 20 19:00:42.844481 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.844466    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9fjl8\" (UniqueName: \"kubernetes.io/projected/146cbab8-fe62-44fd-91c3-c25bd7d36c0c-kube-api-access-9fjl8\") pod \"ovnkube-node-5j2qh\" (UID: \"146cbab8-fe62-44fd-91c3-c25bd7d36c0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5j2qh"
Jul 20 19:00:42.889767 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.889732    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-141.ec2.internal" event={"ID":"508e3b649792abc37cafc631d8189428","Type":"ContainerStarted","Data":"33869e32f4ec9efd078879ca97bd43beb19e4441c903bdd464e3a0225db0d8c7"}
Jul 20 19:00:42.890708 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.890691    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-141.ec2.internal" event={"ID":"7466360cc91f8dce9f649835caab8eb1","Type":"ContainerStarted","Data":"38f79f520e970ce06f3191671dca7f5d45599c472643d4fcb4cb8f531cc76de2"}
Jul 20 19:00:42.935007 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.934992    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/af77ba01-d870-408b-badb-3910b3fc4e0e-os-release\") pod \"multus-additional-cni-plugins-j6vb4\" (UID: \"af77ba01-d870-408b-badb-3910b3fc4e0e\") " pod="openshift-multus/multus-additional-cni-plugins-j6vb4"
Jul 20 19:00:42.935104 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.935014    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/af77ba01-d870-408b-badb-3910b3fc4e0e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-j6vb4\" (UID: \"af77ba01-d870-408b-badb-3910b3fc4e0e\") " pod="openshift-multus/multus-additional-cni-plugins-j6vb4"
Jul 20 19:00:42.935104 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.935041    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/af77ba01-d870-408b-badb-3910b3fc4e0e-system-cni-dir\") pod \"multus-additional-cni-plugins-j6vb4\" (UID: \"af77ba01-d870-408b-badb-3910b3fc4e0e\") " pod="openshift-multus/multus-additional-cni-plugins-j6vb4"
Jul 20 19:00:42.935104 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.935056    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/af77ba01-d870-408b-badb-3910b3fc4e0e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-j6vb4\" (UID: \"af77ba01-d870-408b-badb-3910b3fc4e0e\") " pod="openshift-multus/multus-additional-cni-plugins-j6vb4"
Jul 20 19:00:42.935104 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.935072    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/08e8b8dd-1dde-4bb0-863b-1322d836d18c-dbus\") pod \"global-pull-secret-syncer-ng85c\" (UID: \"08e8b8dd-1dde-4bb0-863b-1322d836d18c\") " pod="kube-system/global-pull-secret-syncer-ng85c"
Jul 20 19:00:42.935104 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.935087    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/af77ba01-d870-408b-badb-3910b3fc4e0e-cni-binary-copy\") pod \"multus-additional-cni-plugins-j6vb4\" (UID: \"af77ba01-d870-408b-badb-3910b3fc4e0e\") " pod="openshift-multus/multus-additional-cni-plugins-j6vb4"
Jul 20 19:00:42.935104 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.935105    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8zrwv\" (UniqueName: \"kubernetes.io/projected/af77ba01-d870-408b-badb-3910b3fc4e0e-kube-api-access-8zrwv\") pod \"multus-additional-cni-plugins-j6vb4\" (UID: \"af77ba01-d870-408b-badb-3910b3fc4e0e\") " pod="openshift-multus/multus-additional-cni-plugins-j6vb4"
Jul 20 19:00:42.935419 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.935126    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/af77ba01-d870-408b-badb-3910b3fc4e0e-os-release\") pod \"multus-additional-cni-plugins-j6vb4\" (UID: \"af77ba01-d870-408b-badb-3910b3fc4e0e\") " pod="openshift-multus/multus-additional-cni-plugins-j6vb4"
Jul 20 19:00:42.935419 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.935128    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/af77ba01-d870-408b-badb-3910b3fc4e0e-system-cni-dir\") pod \"multus-additional-cni-plugins-j6vb4\" (UID: \"af77ba01-d870-408b-badb-3910b3fc4e0e\") " pod="openshift-multus/multus-additional-cni-plugins-j6vb4"
Jul 20 19:00:42.935419 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.935130    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/af77ba01-d870-408b-badb-3910b3fc4e0e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-j6vb4\" (UID: \"af77ba01-d870-408b-badb-3910b3fc4e0e\") " pod="openshift-multus/multus-additional-cni-plugins-j6vb4"
Jul 20 19:00:42.935419 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.935162    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/08e8b8dd-1dde-4bb0-863b-1322d836d18c-dbus\") pod \"global-pull-secret-syncer-ng85c\" (UID: \"08e8b8dd-1dde-4bb0-863b-1322d836d18c\") " pod="kube-system/global-pull-secret-syncer-ng85c"
Jul 20 19:00:42.935419 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.935185    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/08e8b8dd-1dde-4bb0-863b-1322d836d18c-kubelet-config\") pod \"global-pull-secret-syncer-ng85c\" (UID: \"08e8b8dd-1dde-4bb0-863b-1322d836d18c\") " pod="kube-system/global-pull-secret-syncer-ng85c"
Jul 20 19:00:42.935419 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.935215    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/af77ba01-d870-408b-badb-3910b3fc4e0e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-j6vb4\" (UID: \"af77ba01-d870-408b-badb-3910b3fc4e0e\") " pod="openshift-multus/multus-additional-cni-plugins-j6vb4"
Jul 20 19:00:42.935419 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.935222    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/af77ba01-d870-408b-badb-3910b3fc4e0e-cnibin\") pod \"multus-additional-cni-plugins-j6vb4\" (UID: \"af77ba01-d870-408b-badb-3910b3fc4e0e\") " pod="openshift-multus/multus-additional-cni-plugins-j6vb4"
Jul 20 19:00:42.935419 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.935247    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/08e8b8dd-1dde-4bb0-863b-1322d836d18c-original-pull-secret\") pod \"global-pull-secret-syncer-ng85c\" (UID: \"08e8b8dd-1dde-4bb0-863b-1322d836d18c\") " pod="kube-system/global-pull-secret-syncer-ng85c"
Jul 20 19:00:42.935419 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.935264    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/08e8b8dd-1dde-4bb0-863b-1322d836d18c-kubelet-config\") pod \"global-pull-secret-syncer-ng85c\" (UID: \"08e8b8dd-1dde-4bb0-863b-1322d836d18c\") " pod="kube-system/global-pull-secret-syncer-ng85c"
Jul 20 19:00:42.935419 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.935285    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/af77ba01-d870-408b-badb-3910b3fc4e0e-cnibin\") pod \"multus-additional-cni-plugins-j6vb4\" (UID: \"af77ba01-d870-408b-badb-3910b3fc4e0e\") " pod="openshift-multus/multus-additional-cni-plugins-j6vb4"
Jul 20 19:00:42.935419 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:00:42.935413    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 19:00:42.935818 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:00:42.935478    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08e8b8dd-1dde-4bb0-863b-1322d836d18c-original-pull-secret podName:08e8b8dd-1dde-4bb0-863b-1322d836d18c nodeName:}" failed. No retries permitted until 2026-07-20 19:00:43.435461252 +0000 UTC m=+3.118989256 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/08e8b8dd-1dde-4bb0-863b-1322d836d18c-original-pull-secret") pod "global-pull-secret-syncer-ng85c" (UID: "08e8b8dd-1dde-4bb0-863b-1322d836d18c") : object "kube-system"/"original-pull-secret" not registered
Jul 20 19:00:42.935818 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.935695    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/af77ba01-d870-408b-badb-3910b3fc4e0e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-j6vb4\" (UID: \"af77ba01-d870-408b-badb-3910b3fc4e0e\") " pod="openshift-multus/multus-additional-cni-plugins-j6vb4"
Jul 20 19:00:42.935818 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.935734    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/af77ba01-d870-408b-badb-3910b3fc4e0e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-j6vb4\" (UID: \"af77ba01-d870-408b-badb-3910b3fc4e0e\") " pod="openshift-multus/multus-additional-cni-plugins-j6vb4"
Jul 20 19:00:42.936301 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.936283    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/af77ba01-d870-408b-badb-3910b3fc4e0e-cni-binary-copy\") pod \"multus-additional-cni-plugins-j6vb4\" (UID: \"af77ba01-d870-408b-badb-3910b3fc4e0e\") " pod="openshift-multus/multus-additional-cni-plugins-j6vb4"
Jul 20 19:00:42.944984 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:42.944960    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zrwv\" (UniqueName: \"kubernetes.io/projected/af77ba01-d870-408b-badb-3910b3fc4e0e-kube-api-access-8zrwv\") pod \"multus-additional-cni-plugins-j6vb4\" (UID: \"af77ba01-d870-408b-badb-3910b3fc4e0e\") " pod="openshift-multus/multus-additional-cni-plugins-j6vb4"
Jul 20 19:00:43.012964 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:43.012911    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-dz7gc"
Jul 20 19:00:43.020791 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:43.020771    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-84cfb"
Jul 20 19:00:43.021491 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:43.021470    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc43a2dd8_3638_4e80_ba88_bc0d0ea5f866.slice/crio-5c48504b3aec32fb373fb270b29cfca6391bcbd0a1b0f18879710ca78ea5faaa WatchSource:0}: Error finding container 5c48504b3aec32fb373fb270b29cfca6391bcbd0a1b0f18879710ca78ea5faaa: Status 404 returned error can't find the container with id 5c48504b3aec32fb373fb270b29cfca6391bcbd0a1b0f18879710ca78ea5faaa
Jul 20 19:00:43.027840 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:43.027825    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5j2qh"
Jul 20 19:00:43.032010 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:43.031992    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-pkr2l"
Jul 20 19:00:43.037051 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:43.037027    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t6xc2"
Jul 20 19:00:43.039957 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:43.039933    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5eb7da33_928c_4a4e_9622_80424aed2e71.slice/crio-e86718c0de228e485fa7f1efc65695755c4515ec30c44e3ecf918661cfe953b0 WatchSource:0}: Error finding container e86718c0de228e485fa7f1efc65695755c4515ec30c44e3ecf918661cfe953b0: Status 404 returned error can't find the container with id e86718c0de228e485fa7f1efc65695755c4515ec30c44e3ecf918661cfe953b0
Jul 20 19:00:43.042538 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:43.042497    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vks8w"
Jul 20 19:00:43.047724 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:43.047706    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mpz54"
Jul 20 19:00:43.048731 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:43.048703    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod146cbab8_fe62_44fd_91c3_c25bd7d36c0c.slice/crio-f5bf80a39a73652c6d49f33072aab33e4dacbf1c400e3a8ffaa0be9cb5722d32 WatchSource:0}: Error finding container f5bf80a39a73652c6d49f33072aab33e4dacbf1c400e3a8ffaa0be9cb5722d32: Status 404 returned error can't find the container with id f5bf80a39a73652c6d49f33072aab33e4dacbf1c400e3a8ffaa0be9cb5722d32
Jul 20 19:00:43.051066 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:43.051042    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ee65ed0_cd62_4933_9888_a6077bd14239.slice/crio-0678bd01f3e687a86cdbc75d02962a2e1965979f8ce4a40f09c3f3fa8cce931c WatchSource:0}: Error finding container 0678bd01f3e687a86cdbc75d02962a2e1965979f8ce4a40f09c3f3fa8cce931c: Status 404 returned error can't find the container with id 0678bd01f3e687a86cdbc75d02962a2e1965979f8ce4a40f09c3f3fa8cce931c
Jul 20 19:00:43.051616 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:43.051596    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51b7fa8c_4743_49aa_82c4_43bc98a705dc.slice/crio-1eb6f693a58fc75bccd538a4c99a35bdf9df30ffa3caff4a54996faf2e665847 WatchSource:0}: Error finding container 1eb6f693a58fc75bccd538a4c99a35bdf9df30ffa3caff4a54996faf2e665847: Status 404 returned error can't find the container with id 1eb6f693a58fc75bccd538a4c99a35bdf9df30ffa3caff4a54996faf2e665847
Jul 20 19:00:43.053175 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:43.053155    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-fz2dc"
Jul 20 19:00:43.057330 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:43.057309    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-j6vb4"
Jul 20 19:00:43.057587 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:43.057570    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bbfb437_297e_4ce4_b49b_d0794f1a4201.slice/crio-3dc15ca26fa9a0e168bc3420fae574bd49db9ab9ecb4f6e629e12a2e34c5d0d1 WatchSource:0}: Error finding container 3dc15ca26fa9a0e168bc3420fae574bd49db9ab9ecb4f6e629e12a2e34c5d0d1: Status 404 returned error can't find the container with id 3dc15ca26fa9a0e168bc3420fae574bd49db9ab9ecb4f6e629e12a2e34c5d0d1
Jul 20 19:00:43.058251 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:43.058228    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a1f8730_2c45_4088_a934_dd6cb2467293.slice/crio-22aab76ad0b29dcf9a7e9a80da9036799deda271143fb05544236d4a97fe84e7 WatchSource:0}: Error finding container 22aab76ad0b29dcf9a7e9a80da9036799deda271143fb05544236d4a97fe84e7: Status 404 returned error can't find the container with id 22aab76ad0b29dcf9a7e9a80da9036799deda271143fb05544236d4a97fe84e7
Jul 20 19:00:43.063668 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:43.063638    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25f85dbe_c3b0_41a1_8c59_a68cc45c1306.slice/crio-6ffe48565bbdb6631dba766d5afbc31371038f3fd8b06a5328c6bf457b3d2748 WatchSource:0}: Error finding container 6ffe48565bbdb6631dba766d5afbc31371038f3fd8b06a5328c6bf457b3d2748: Status 404 returned error can't find the container with id 6ffe48565bbdb6631dba766d5afbc31371038f3fd8b06a5328c6bf457b3d2748
Jul 20 19:00:43.067734 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:00:43.067715    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf77ba01_d870_408b_badb_3910b3fc4e0e.slice/crio-11562f180e36fd155099a352c7c76ffd9b44536c3e68b0a2df9f294d96563fac WatchSource:0}: Error finding container 11562f180e36fd155099a352c7c76ffd9b44536c3e68b0a2df9f294d96563fac: Status 404 returned error can't find the container with id 11562f180e36fd155099a352c7c76ffd9b44536c3e68b0a2df9f294d96563fac
Jul 20 19:00:43.338566 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:43.338487    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/073c7302-c5d7-4bfc-87fa-993163c6fd01-metrics-certs\") pod \"network-metrics-daemon-cd24s\" (UID: \"073c7302-c5d7-4bfc-87fa-993163c6fd01\") " pod="openshift-multus/network-metrics-daemon-cd24s"
Jul 20 19:00:43.338696 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:00:43.338640    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 19:00:43.338731 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:00:43.338704    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/073c7302-c5d7-4bfc-87fa-993163c6fd01-metrics-certs podName:073c7302-c5d7-4bfc-87fa-993163c6fd01 nodeName:}" failed. No retries permitted until 2026-07-20 19:00:44.33868507 +0000 UTC m=+4.022213071 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/073c7302-c5d7-4bfc-87fa-993163c6fd01-metrics-certs") pod "network-metrics-daemon-cd24s" (UID: "073c7302-c5d7-4bfc-87fa-993163c6fd01") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 19:00:43.439623 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:43.439582    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5576p\" (UniqueName: \"kubernetes.io/projected/4cf9f593-d26c-43c1-a246-259d0b23f251-kube-api-access-5576p\") pod \"network-check-target-8r6m4\" (UID: \"4cf9f593-d26c-43c1-a246-259d0b23f251\") " pod="openshift-network-diagnostics/network-check-target-8r6m4"
Jul 20 19:00:43.439786 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:43.439690    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/08e8b8dd-1dde-4bb0-863b-1322d836d18c-original-pull-secret\") pod \"global-pull-secret-syncer-ng85c\" (UID: \"08e8b8dd-1dde-4bb0-863b-1322d836d18c\") " pod="kube-system/global-pull-secret-syncer-ng85c"
Jul 20 19:00:43.439786 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:00:43.439774    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 19:00:43.439895 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:00:43.439798    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 19:00:43.439895 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:00:43.439820    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 19:00:43.439895 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:00:43.439822    2563 projected.go:196] Error preparing data for projected volume kube-api-access-5576p for pod openshift-network-diagnostics/network-check-target-8r6m4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 19:00:43.439895 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:00:43.439874    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08e8b8dd-1dde-4bb0-863b-1322d836d18c-original-pull-secret podName:08e8b8dd-1dde-4bb0-863b-1322d836d18c nodeName:}" failed. No retries permitted until 2026-07-20 19:00:44.439856279 +0000 UTC m=+4.123384293 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/08e8b8dd-1dde-4bb0-863b-1322d836d18c-original-pull-secret") pod "global-pull-secret-syncer-ng85c" (UID: "08e8b8dd-1dde-4bb0-863b-1322d836d18c") : object "kube-system"/"original-pull-secret" not registered
Jul 20 19:00:43.439895 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:00:43.439890    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4cf9f593-d26c-43c1-a246-259d0b23f251-kube-api-access-5576p podName:4cf9f593-d26c-43c1-a246-259d0b23f251 nodeName:}" failed. No retries permitted until 2026-07-20 19:00:44.439882619 +0000 UTC m=+4.123410619 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-5576p" (UniqueName: "kubernetes.io/projected/4cf9f593-d26c-43c1-a246-259d0b23f251-kube-api-access-5576p") pod "network-check-target-8r6m4" (UID: "4cf9f593-d26c-43c1-a246-259d0b23f251") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 19:00:43.756587 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:43.756548    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-19 18:55:42 +0000 UTC" deadline="2028-01-09 01:46:08.780633999 +0000 UTC"
Jul 20 19:00:43.756587 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:43.756585    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12894h45m25.024053384s"
Jul 20 19:00:43.907658 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:43.907573    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vks8w" event={"ID":"9bbfb437-297e-4ce4-b49b-d0794f1a4201","Type":"ContainerStarted","Data":"3dc15ca26fa9a0e168bc3420fae574bd49db9ab9ecb4f6e629e12a2e34c5d0d1"}
Jul 20 19:00:43.916944 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:43.916912    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5j2qh" event={"ID":"146cbab8-fe62-44fd-91c3-c25bd7d36c0c","Type":"ContainerStarted","Data":"f5bf80a39a73652c6d49f33072aab33e4dacbf1c400e3a8ffaa0be9cb5722d32"}
Jul 20 19:00:43.921731 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:43.921705    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-dz7gc" event={"ID":"c43a2dd8-3638-4e80-ba88-bc0d0ea5f866","Type":"ContainerStarted","Data":"5c48504b3aec32fb373fb270b29cfca6391bcbd0a1b0f18879710ca78ea5faaa"}
Jul 20 19:00:43.927088 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:43.927065    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-fz2dc" event={"ID":"25f85dbe-c3b0-41a1-8c59-a68cc45c1306","Type":"ContainerStarted","Data":"6ffe48565bbdb6631dba766d5afbc31371038f3fd8b06a5328c6bf457b3d2748"}
Jul 20 19:00:43.940096 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:43.940075    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t6xc2" event={"ID":"51b7fa8c-4743-49aa-82c4-43bc98a705dc","Type":"ContainerStarted","Data":"1eb6f693a58fc75bccd538a4c99a35bdf9df30ffa3caff4a54996faf2e665847"}
Jul 20 19:00:43.942915 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:43.942862    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-pkr2l" event={"ID":"5ee65ed0-cd62-4933-9888-a6077bd14239","Type":"ContainerStarted","Data":"0678bd01f3e687a86cdbc75d02962a2e1965979f8ce4a40f09c3f3fa8cce931c"}
Jul 20 19:00:43.946490 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:43.946467    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-84cfb" event={"ID":"5eb7da33-928c-4a4e-9622-80424aed2e71","Type":"ContainerStarted","Data":"e86718c0de228e485fa7f1efc65695755c4515ec30c44e3ecf918661cfe953b0"}
Jul 20 19:00:43.951478 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:43.951433    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j6vb4" event={"ID":"af77ba01-d870-408b-badb-3910b3fc4e0e","Type":"ContainerStarted","Data":"11562f180e36fd155099a352c7c76ffd9b44536c3e68b0a2df9f294d96563fac"}
Jul 20 19:00:43.959685 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:43.959653    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mpz54" event={"ID":"0a1f8730-2c45-4088-a934-dd6cb2467293","Type":"ContainerStarted","Data":"22aab76ad0b29dcf9a7e9a80da9036799deda271143fb05544236d4a97fe84e7"}
Jul 20 19:00:44.350802 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:44.350726    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/073c7302-c5d7-4bfc-87fa-993163c6fd01-metrics-certs\") pod \"network-metrics-daemon-cd24s\" (UID: \"073c7302-c5d7-4bfc-87fa-993163c6fd01\") " pod="openshift-multus/network-metrics-daemon-cd24s"
Jul 20 19:00:44.350950 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:00:44.350928    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 19:00:44.351011 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:00:44.350999    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/073c7302-c5d7-4bfc-87fa-993163c6fd01-metrics-certs podName:073c7302-c5d7-4bfc-87fa-993163c6fd01 nodeName:}" failed. No retries permitted until 2026-07-20 19:00:46.350974164 +0000 UTC m=+6.034502182 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/073c7302-c5d7-4bfc-87fa-993163c6fd01-metrics-certs") pod "network-metrics-daemon-cd24s" (UID: "073c7302-c5d7-4bfc-87fa-993163c6fd01") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 19:00:44.451178 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:44.451130    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/08e8b8dd-1dde-4bb0-863b-1322d836d18c-original-pull-secret\") pod \"global-pull-secret-syncer-ng85c\" (UID: \"08e8b8dd-1dde-4bb0-863b-1322d836d18c\") " pod="kube-system/global-pull-secret-syncer-ng85c"
Jul 20 19:00:44.451370 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:44.451195    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5576p\" (UniqueName: \"kubernetes.io/projected/4cf9f593-d26c-43c1-a246-259d0b23f251-kube-api-access-5576p\") pod \"network-check-target-8r6m4\" (UID: \"4cf9f593-d26c-43c1-a246-259d0b23f251\") " pod="openshift-network-diagnostics/network-check-target-8r6m4"
Jul 20 19:00:44.451470 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:00:44.451433    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 19:00:44.451470 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:00:44.451460    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 19:00:44.451604 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:00:44.451473    2563 projected.go:196] Error preparing data for projected volume kube-api-access-5576p for pod openshift-network-diagnostics/network-check-target-8r6m4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 19:00:44.451604 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:00:44.451533    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4cf9f593-d26c-43c1-a246-259d0b23f251-kube-api-access-5576p podName:4cf9f593-d26c-43c1-a246-259d0b23f251 nodeName:}" failed. No retries permitted until 2026-07-20 19:00:46.451513754 +0000 UTC m=+6.135041770 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-5576p" (UniqueName: "kubernetes.io/projected/4cf9f593-d26c-43c1-a246-259d0b23f251-kube-api-access-5576p") pod "network-check-target-8r6m4" (UID: "4cf9f593-d26c-43c1-a246-259d0b23f251") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 19:00:44.451962 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:00:44.451938    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 19:00:44.452052 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:00:44.452002    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08e8b8dd-1dde-4bb0-863b-1322d836d18c-original-pull-secret podName:08e8b8dd-1dde-4bb0-863b-1322d836d18c nodeName:}" failed. No retries permitted until 2026-07-20 19:00:46.451986085 +0000 UTC m=+6.135514092 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/08e8b8dd-1dde-4bb0-863b-1322d836d18c-original-pull-secret") pod "global-pull-secret-syncer-ng85c" (UID: "08e8b8dd-1dde-4bb0-863b-1322d836d18c") : object "kube-system"/"original-pull-secret" not registered
Jul 20 19:00:44.534017 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:44.530373    2563 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 19:00:44.757782 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:44.757643    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-19 18:55:42 +0000 UTC" deadline="2028-03-05 19:20:07.755610438 +0000 UTC"
Jul 20 19:00:44.757782 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:44.757702    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14256h19m22.997912001s"
Jul 20 19:00:44.889104 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:44.889072    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ng85c"
Jul 20 19:00:44.889266 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:00:44.889200    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ng85c" podUID="08e8b8dd-1dde-4bb0-863b-1322d836d18c"
Jul 20 19:00:44.889645 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:44.889624    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cd24s"
Jul 20 19:00:44.889754 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:00:44.889733    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cd24s" podUID="073c7302-c5d7-4bfc-87fa-993163c6fd01"
Jul 20 19:00:44.889815 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:44.889801    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8r6m4"
Jul 20 19:00:44.889884 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:00:44.889869    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8r6m4" podUID="4cf9f593-d26c-43c1-a246-259d0b23f251"
Jul 20 19:00:46.367756 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:46.367722    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/073c7302-c5d7-4bfc-87fa-993163c6fd01-metrics-certs\") pod \"network-metrics-daemon-cd24s\" (UID: \"073c7302-c5d7-4bfc-87fa-993163c6fd01\") " pod="openshift-multus/network-metrics-daemon-cd24s"
Jul 20 19:00:46.368213 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:00:46.367872    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 19:00:46.368213 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:00:46.367929    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/073c7302-c5d7-4bfc-87fa-993163c6fd01-metrics-certs podName:073c7302-c5d7-4bfc-87fa-993163c6fd01 nodeName:}" failed. No retries permitted until 2026-07-20 19:00:50.367914828 +0000 UTC m=+10.051442828 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/073c7302-c5d7-4bfc-87fa-993163c6fd01-metrics-certs") pod "network-metrics-daemon-cd24s" (UID: "073c7302-c5d7-4bfc-87fa-993163c6fd01") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 19:00:46.469735 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:46.469006    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/08e8b8dd-1dde-4bb0-863b-1322d836d18c-original-pull-secret\") pod \"global-pull-secret-syncer-ng85c\" (UID: \"08e8b8dd-1dde-4bb0-863b-1322d836d18c\") " pod="kube-system/global-pull-secret-syncer-ng85c"
Jul 20 19:00:46.469735 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:46.469064    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5576p\" (UniqueName: \"kubernetes.io/projected/4cf9f593-d26c-43c1-a246-259d0b23f251-kube-api-access-5576p\") pod \"network-check-target-8r6m4\" (UID: \"4cf9f593-d26c-43c1-a246-259d0b23f251\") " pod="openshift-network-diagnostics/network-check-target-8r6m4"
Jul 20 19:00:46.469735 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:00:46.469207    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 19:00:46.469735 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:00:46.469222    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 19:00:46.469735 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:00:46.469233    2563 projected.go:196] Error preparing data for projected volume kube-api-access-5576p for pod openshift-network-diagnostics/network-check-target-8r6m4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 19:00:46.469735 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:00:46.469281    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4cf9f593-d26c-43c1-a246-259d0b23f251-kube-api-access-5576p podName:4cf9f593-d26c-43c1-a246-259d0b23f251 nodeName:}" failed. No retries permitted until 2026-07-20 19:00:50.469267461 +0000 UTC m=+10.152795461 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-5576p" (UniqueName: "kubernetes.io/projected/4cf9f593-d26c-43c1-a246-259d0b23f251-kube-api-access-5576p") pod "network-check-target-8r6m4" (UID: "4cf9f593-d26c-43c1-a246-259d0b23f251") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 19:00:46.469735 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:00:46.469653    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 19:00:46.469735 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:00:46.469703    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08e8b8dd-1dde-4bb0-863b-1322d836d18c-original-pull-secret podName:08e8b8dd-1dde-4bb0-863b-1322d836d18c nodeName:}" failed. No retries permitted until 2026-07-20 19:00:50.469691613 +0000 UTC m=+10.153219613 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/08e8b8dd-1dde-4bb0-863b-1322d836d18c-original-pull-secret") pod "global-pull-secret-syncer-ng85c" (UID: "08e8b8dd-1dde-4bb0-863b-1322d836d18c") : object "kube-system"/"original-pull-secret" not registered
Jul 20 19:00:46.886709 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:46.886679    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ng85c"
Jul 20 19:00:46.886889 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:00:46.886800    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ng85c" podUID="08e8b8dd-1dde-4bb0-863b-1322d836d18c"
Jul 20 19:00:46.886889 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:46.886852    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cd24s"
Jul 20 19:00:46.886997 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:00:46.886906    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cd24s" podUID="073c7302-c5d7-4bfc-87fa-993163c6fd01"
Jul 20 19:00:46.886997 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:46.886931    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8r6m4"
Jul 20 19:00:46.886997 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:00:46.886969    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8r6m4" podUID="4cf9f593-d26c-43c1-a246-259d0b23f251"
Jul 20 19:00:48.891175 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:48.890673    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8r6m4"
Jul 20 19:00:48.891175 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:48.890715    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ng85c"
Jul 20 19:00:48.891175 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:00:48.890793    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8r6m4" podUID="4cf9f593-d26c-43c1-a246-259d0b23f251"
Jul 20 19:00:48.891175 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:48.890811    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cd24s"
Jul 20 19:00:48.891175 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:00:48.891015    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cd24s" podUID="073c7302-c5d7-4bfc-87fa-993163c6fd01"
Jul 20 19:00:48.891737 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:00:48.891185    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ng85c" podUID="08e8b8dd-1dde-4bb0-863b-1322d836d18c"
Jul 20 19:00:50.405968 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:50.405933    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/073c7302-c5d7-4bfc-87fa-993163c6fd01-metrics-certs\") pod \"network-metrics-daemon-cd24s\" (UID: \"073c7302-c5d7-4bfc-87fa-993163c6fd01\") " pod="openshift-multus/network-metrics-daemon-cd24s"
Jul 20 19:00:50.406419 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:00:50.406106    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 19:00:50.406419 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:00:50.406176    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/073c7302-c5d7-4bfc-87fa-993163c6fd01-metrics-certs podName:073c7302-c5d7-4bfc-87fa-993163c6fd01 nodeName:}" failed. No retries permitted until 2026-07-20 19:00:58.406155332 +0000 UTC m=+18.089683354 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/073c7302-c5d7-4bfc-87fa-993163c6fd01-metrics-certs") pod "network-metrics-daemon-cd24s" (UID: "073c7302-c5d7-4bfc-87fa-993163c6fd01") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 19:00:50.507392 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:50.507087    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/08e8b8dd-1dde-4bb0-863b-1322d836d18c-original-pull-secret\") pod \"global-pull-secret-syncer-ng85c\" (UID: \"08e8b8dd-1dde-4bb0-863b-1322d836d18c\") " pod="kube-system/global-pull-secret-syncer-ng85c"
Jul 20 19:00:50.507392 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:50.507151    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5576p\" (UniqueName: \"kubernetes.io/projected/4cf9f593-d26c-43c1-a246-259d0b23f251-kube-api-access-5576p\") pod \"network-check-target-8r6m4\" (UID: \"4cf9f593-d26c-43c1-a246-259d0b23f251\") " pod="openshift-network-diagnostics/network-check-target-8r6m4"
Jul 20 19:00:50.507392 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:00:50.507337    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 19:00:50.507392 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:00:50.507380    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 19:00:50.507392 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:00:50.507393    2563 projected.go:196] Error preparing data for projected volume kube-api-access-5576p for pod openshift-network-diagnostics/network-check-target-8r6m4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 19:00:50.507780 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:00:50.507450    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4cf9f593-d26c-43c1-a246-259d0b23f251-kube-api-access-5576p podName:4cf9f593-d26c-43c1-a246-259d0b23f251 nodeName:}" failed. No retries permitted until 2026-07-20 19:00:58.50743179 +0000 UTC m=+18.190959792 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-5576p" (UniqueName: "kubernetes.io/projected/4cf9f593-d26c-43c1-a246-259d0b23f251-kube-api-access-5576p") pod "network-check-target-8r6m4" (UID: "4cf9f593-d26c-43c1-a246-259d0b23f251") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 19:00:50.507928 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:00:50.507843    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 19:00:50.507928 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:00:50.507903    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08e8b8dd-1dde-4bb0-863b-1322d836d18c-original-pull-secret podName:08e8b8dd-1dde-4bb0-863b-1322d836d18c nodeName:}" failed. No retries permitted until 2026-07-20 19:00:58.507887653 +0000 UTC m=+18.191415673 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/08e8b8dd-1dde-4bb0-863b-1322d836d18c-original-pull-secret") pod "global-pull-secret-syncer-ng85c" (UID: "08e8b8dd-1dde-4bb0-863b-1322d836d18c") : object "kube-system"/"original-pull-secret" not registered
Jul 20 19:00:50.889879 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:50.889807    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cd24s"
Jul 20 19:00:50.890035 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:00:50.889919    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cd24s" podUID="073c7302-c5d7-4bfc-87fa-993163c6fd01"
Jul 20 19:00:50.890413 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:50.890279    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8r6m4"
Jul 20 19:00:50.890413 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:00:50.890381    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8r6m4" podUID="4cf9f593-d26c-43c1-a246-259d0b23f251"
Jul 20 19:00:50.890595 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:50.890470    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ng85c"
Jul 20 19:00:50.890641 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:00:50.890617    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ng85c" podUID="08e8b8dd-1dde-4bb0-863b-1322d836d18c"
Jul 20 19:00:52.887332 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:52.886693    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ng85c"
Jul 20 19:00:52.887332 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:00:52.886824    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ng85c" podUID="08e8b8dd-1dde-4bb0-863b-1322d836d18c"
Jul 20 19:00:52.887332 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:52.887190    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cd24s"
Jul 20 19:00:52.887332 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:00:52.887288    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cd24s" podUID="073c7302-c5d7-4bfc-87fa-993163c6fd01"
Jul 20 19:00:52.888100 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:52.887421    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8r6m4"
Jul 20 19:00:52.888100 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:00:52.887494    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8r6m4" podUID="4cf9f593-d26c-43c1-a246-259d0b23f251"
Jul 20 19:00:54.886594 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:54.886562    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ng85c"
Jul 20 19:00:54.887002 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:54.886562    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cd24s"
Jul 20 19:00:54.887002 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:00:54.886666    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ng85c" podUID="08e8b8dd-1dde-4bb0-863b-1322d836d18c"
Jul 20 19:00:54.887002 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:54.886562    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8r6m4"
Jul 20 19:00:54.887002 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:00:54.886760    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cd24s" podUID="073c7302-c5d7-4bfc-87fa-993163c6fd01"
Jul 20 19:00:54.887002 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:00:54.886855    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8r6m4" podUID="4cf9f593-d26c-43c1-a246-259d0b23f251"
Jul 20 19:00:56.886810 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:56.886779    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cd24s"
Jul 20 19:00:56.887234 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:56.886821    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8r6m4"
Jul 20 19:00:56.887234 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:56.886777    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ng85c"
Jul 20 19:00:56.887234 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:00:56.886897    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cd24s" podUID="073c7302-c5d7-4bfc-87fa-993163c6fd01"
Jul 20 19:00:56.887234 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:00:56.886974    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ng85c" podUID="08e8b8dd-1dde-4bb0-863b-1322d836d18c"
Jul 20 19:00:56.887234 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:00:56.887074    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8r6m4" podUID="4cf9f593-d26c-43c1-a246-259d0b23f251"
Jul 20 19:00:58.468647 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:58.468613    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/073c7302-c5d7-4bfc-87fa-993163c6fd01-metrics-certs\") pod \"network-metrics-daemon-cd24s\" (UID: \"073c7302-c5d7-4bfc-87fa-993163c6fd01\") " pod="openshift-multus/network-metrics-daemon-cd24s"
Jul 20 19:00:58.469002 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:00:58.468721    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 19:00:58.469002 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:00:58.468774    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/073c7302-c5d7-4bfc-87fa-993163c6fd01-metrics-certs podName:073c7302-c5d7-4bfc-87fa-993163c6fd01 nodeName:}" failed. No retries permitted until 2026-07-20 19:01:14.468758818 +0000 UTC m=+34.152286818 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/073c7302-c5d7-4bfc-87fa-993163c6fd01-metrics-certs") pod "network-metrics-daemon-cd24s" (UID: "073c7302-c5d7-4bfc-87fa-993163c6fd01") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 19:00:58.569760 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:58.569731    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/08e8b8dd-1dde-4bb0-863b-1322d836d18c-original-pull-secret\") pod \"global-pull-secret-syncer-ng85c\" (UID: \"08e8b8dd-1dde-4bb0-863b-1322d836d18c\") " pod="kube-system/global-pull-secret-syncer-ng85c"
Jul 20 19:00:58.569906 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:58.569772    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5576p\" (UniqueName: \"kubernetes.io/projected/4cf9f593-d26c-43c1-a246-259d0b23f251-kube-api-access-5576p\") pod \"network-check-target-8r6m4\" (UID: \"4cf9f593-d26c-43c1-a246-259d0b23f251\") " pod="openshift-network-diagnostics/network-check-target-8r6m4"
Jul 20 19:00:58.569987 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:00:58.569899    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 19:00:58.569987 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:00:58.569933    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 19:00:58.569987 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:00:58.569948    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 19:00:58.569987 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:00:58.569957    2563 projected.go:196] Error preparing data for projected volume kube-api-access-5576p for pod openshift-network-diagnostics/network-check-target-8r6m4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 19:00:58.569987 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:00:58.569979    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08e8b8dd-1dde-4bb0-863b-1322d836d18c-original-pull-secret podName:08e8b8dd-1dde-4bb0-863b-1322d836d18c nodeName:}" failed. No retries permitted until 2026-07-20 19:01:14.569959607 +0000 UTC m=+34.253487624 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/08e8b8dd-1dde-4bb0-863b-1322d836d18c-original-pull-secret") pod "global-pull-secret-syncer-ng85c" (UID: "08e8b8dd-1dde-4bb0-863b-1322d836d18c") : object "kube-system"/"original-pull-secret" not registered
Jul 20 19:00:58.570216 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:00:58.570002    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4cf9f593-d26c-43c1-a246-259d0b23f251-kube-api-access-5576p podName:4cf9f593-d26c-43c1-a246-259d0b23f251 nodeName:}" failed. No retries permitted until 2026-07-20 19:01:14.569987666 +0000 UTC m=+34.253515666 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-5576p" (UniqueName: "kubernetes.io/projected/4cf9f593-d26c-43c1-a246-259d0b23f251-kube-api-access-5576p") pod "network-check-target-8r6m4" (UID: "4cf9f593-d26c-43c1-a246-259d0b23f251") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 19:00:58.886691 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:58.886607    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ng85c"
Jul 20 19:00:58.886838 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:58.886617    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cd24s"
Jul 20 19:00:58.886838 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:00:58.886737    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ng85c" podUID="08e8b8dd-1dde-4bb0-863b-1322d836d18c"
Jul 20 19:00:58.886947 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:00:58.886842    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cd24s" podUID="073c7302-c5d7-4bfc-87fa-993163c6fd01"
Jul 20 19:00:58.886947 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:00:58.886894    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8r6m4"
Jul 20 19:00:58.887032 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:00:58.886959    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8r6m4" podUID="4cf9f593-d26c-43c1-a246-259d0b23f251"
Jul 20 19:01:00.887421 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:00.887388    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ng85c"
Jul 20 19:01:00.887841 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:00.887489    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8r6m4"
Jul 20 19:01:00.887841 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:01:00.887499    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ng85c" podUID="08e8b8dd-1dde-4bb0-863b-1322d836d18c"
Jul 20 19:01:00.887841 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:00.887609    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cd24s"
Jul 20 19:01:00.887841 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:01:00.887616    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8r6m4" podUID="4cf9f593-d26c-43c1-a246-259d0b23f251"
Jul 20 19:01:00.887841 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:01:00.887710    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cd24s" podUID="073c7302-c5d7-4bfc-87fa-993163c6fd01"
Jul 20 19:01:02.885849 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:02.885812    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cd24s"
Jul 20 19:01:02.885849 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:02.885834    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ng85c"
Jul 20 19:01:02.886475 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:01:02.885924    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cd24s" podUID="073c7302-c5d7-4bfc-87fa-993163c6fd01"
Jul 20 19:01:02.886475 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:02.885946    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8r6m4"
Jul 20 19:01:02.886475 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:01:02.886022    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8r6m4" podUID="4cf9f593-d26c-43c1-a246-259d0b23f251"
Jul 20 19:01:02.886475 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:01:02.886096    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ng85c" podUID="08e8b8dd-1dde-4bb0-863b-1322d836d18c"
Jul 20 19:01:04.007133 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:04.006741    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-dz7gc" event={"ID":"c43a2dd8-3638-4e80-ba88-bc0d0ea5f866","Type":"ContainerStarted","Data":"b4d0f76cefab0835f43826af6256a18c4a7e6a4c404111f4ff618516324a6432"}
Jul 20 19:01:04.008247 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:04.008221    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-141.ec2.internal" event={"ID":"508e3b649792abc37cafc631d8189428","Type":"ContainerStarted","Data":"df0da989d4aa2b3d6ffc99377bb88ed9097086006c1d45f1123c43894d0dfe8b"}
Jul 20 19:01:04.009495 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:04.009471    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-fz2dc" event={"ID":"25f85dbe-c3b0-41a1-8c59-a68cc45c1306","Type":"ContainerStarted","Data":"b676b55edc593479ae8618a10c9c96425847b88ec4b5afe3bc6eb9e68f0d8388"}
Jul 20 19:01:04.011327 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:04.011308    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t6xc2" event={"ID":"51b7fa8c-4743-49aa-82c4-43bc98a705dc","Type":"ContainerStarted","Data":"072c25664b51a638e69b63c322d2fe640c935b421774b5ba09d4672ac29a20fd"}
Jul 20 19:01:04.012651 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:04.012632    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-pkr2l" event={"ID":"5ee65ed0-cd62-4933-9888-a6077bd14239","Type":"ContainerStarted","Data":"1e91d85eed78b1a31d597107f8888ae14d971c0f91a82eb2aaf81926551f6762"}
Jul 20 19:01:04.014045 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:04.014026    2563 generic.go:356] "Generic (PLEG): container finished" podID="7466360cc91f8dce9f649835caab8eb1" containerID="024437499c7f95edf1223e31d133f4dbb8018860d4ff7084829e871bda2f049c" exitCode=0
Jul 20 19:01:04.014110 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:04.014094    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-141.ec2.internal" event={"ID":"7466360cc91f8dce9f649835caab8eb1","Type":"ContainerDied","Data":"024437499c7f95edf1223e31d133f4dbb8018860d4ff7084829e871bda2f049c"}
Jul 20 19:01:04.015341 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:04.015321    2563 generic.go:356] "Generic (PLEG): container finished" podID="af77ba01-d870-408b-badb-3910b3fc4e0e" containerID="3d951cd4d9529e5f7caf09456fd722c35e9345899176602307b1f851520f23fc" exitCode=0
Jul 20 19:01:04.015438 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:04.015384    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j6vb4" event={"ID":"af77ba01-d870-408b-badb-3910b3fc4e0e","Type":"ContainerDied","Data":"3d951cd4d9529e5f7caf09456fd722c35e9345899176602307b1f851520f23fc"}
Jul 20 19:01:04.019383 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:04.017702    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mpz54" event={"ID":"0a1f8730-2c45-4088-a934-dd6cb2467293","Type":"ContainerStarted","Data":"5ad3c02c4e0af8735ccfe05f578c2dde1d4e6bfc33f091ee9afac0a94e7cd3ae"}
Jul 20 19:01:04.020934 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:04.020907    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vks8w" event={"ID":"9bbfb437-297e-4ce4-b49b-d0794f1a4201","Type":"ContainerStarted","Data":"76eb31606682b6e14300bc2774c32f12a9e9641831f4972a7d3a71d32ea90e81"}
Jul 20 19:01:04.022427 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:04.022389    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-dz7gc" podStartSLOduration=3.802093451 podStartE2EDuration="24.022376522s" totalImagesPullingTime="20.220283071s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:00:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:01:04.021889557 +0000 UTC m=+23.705417580" watchObservedRunningTime="2026-07-20 19:01:04.022376522 +0000 UTC m=+23.705904541"
Jul 20 19:01:04.023589 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:04.023571    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5j2qh" event={"ID":"146cbab8-fe62-44fd-91c3-c25bd7d36c0c","Type":"ContainerStarted","Data":"74898833f4759abf82b92cf48d7b35bee59403cd5e56da01256c69576f8419bb"}
Jul 20 19:01:04.023692 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:04.023620    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5j2qh" event={"ID":"146cbab8-fe62-44fd-91c3-c25bd7d36c0c","Type":"ContainerStarted","Data":"f7f5f82fd906b9a49e5fcb0fe2c4447427917757a808ae33d5d89e2834292bf0"}
Jul 20 19:01:04.023692 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:04.023648    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5j2qh" event={"ID":"146cbab8-fe62-44fd-91c3-c25bd7d36c0c","Type":"ContainerStarted","Data":"894429153a1cc103fbb03962d34a4624b959bd421fd4c66440e9f15cf3bd4c18"}
Jul 20 19:01:04.023692 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:04.023687    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5j2qh" event={"ID":"146cbab8-fe62-44fd-91c3-c25bd7d36c0c","Type":"ContainerStarted","Data":"0b05afd42b8f1a9d112a18524b5a900dcaaf086bb06e2e3a98c0a5fc5d2a9a8f"}
Jul 20 19:01:04.023836 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:04.023713    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5j2qh" event={"ID":"146cbab8-fe62-44fd-91c3-c25bd7d36c0c","Type":"ContainerStarted","Data":"42825484bac0383815ca173ba4b031f793e7db624803d7d410236c82f94e3617"}
Jul 20 19:01:04.055858 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:04.055825    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-141.ec2.internal" podStartSLOduration=22.055813678 podStartE2EDuration="22.055813678s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:00:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:01:04.055660859 +0000 UTC m=+23.739188882" watchObservedRunningTime="2026-07-20 19:01:04.055813678 +0000 UTC m=+23.739341700"
Jul 20 19:01:04.069743 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:04.069713    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-pkr2l" podStartSLOduration=3.879437107 podStartE2EDuration="24.06970044s" totalImagesPullingTime="20.190263333s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:00:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:01:04.069499384 +0000 UTC m=+23.753027407" watchObservedRunningTime="2026-07-20 19:01:04.06970044 +0000 UTC m=+23.753228462"
Jul 20 19:01:04.086564 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:04.086531    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-vks8w" podStartSLOduration=3.903194865 podStartE2EDuration="24.086520765s" totalImagesPullingTime="20.1833259s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:00:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:01:04.086323436 +0000 UTC m=+23.769851458" watchObservedRunningTime="2026-07-20 19:01:04.086520765 +0000 UTC m=+23.770048788"
Jul 20 19:01:04.102995 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:04.102951    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-mpz54" podStartSLOduration=3.868657925 podStartE2EDuration="24.102937174s" totalImagesPullingTime="20.234279249s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:00:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:01:04.102528277 +0000 UTC m=+23.786056300" watchObservedRunningTime="2026-07-20 19:01:04.102937174 +0000 UTC m=+23.786465186"
Jul 20 19:01:04.886497 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:04.886408    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cd24s"
Jul 20 19:01:04.886637 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:04.886407    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8r6m4"
Jul 20 19:01:04.886637 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:01:04.886551    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cd24s" podUID="073c7302-c5d7-4bfc-87fa-993163c6fd01"
Jul 20 19:01:04.886637 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:04.886415    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ng85c"
Jul 20 19:01:04.886637 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:01:04.886597    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8r6m4" podUID="4cf9f593-d26c-43c1-a246-259d0b23f251"
Jul 20 19:01:04.886797 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:01:04.886649    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ng85c" podUID="08e8b8dd-1dde-4bb0-863b-1322d836d18c"
Jul 20 19:01:05.029286 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:05.029247    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5j2qh" event={"ID":"146cbab8-fe62-44fd-91c3-c25bd7d36c0c","Type":"ContainerStarted","Data":"d0af2a3779ac23b2969e512f04d5589ec7063eae74ded2b4f2bc42386833beb3"}
Jul 20 19:01:05.032389 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:05.032342    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-84cfb" event={"ID":"5eb7da33-928c-4a4e-9622-80424aed2e71","Type":"ContainerStarted","Data":"eb07bd0249bc1413cc021e1ef7874efc441773b0a0d0667031254f4c175ebdde"}
Jul 20 19:01:05.048967 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:05.048922    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-fz2dc" podStartSLOduration=4.870750383 podStartE2EDuration="25.04890733s" totalImagesPullingTime="20.178156947s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:00:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:01:04.116598706 +0000 UTC m=+23.800126727" watchObservedRunningTime="2026-07-20 19:01:05.04890733 +0000 UTC m=+24.732435352"
Jul 20 19:01:05.780034 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:05.779711    2563 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 20 19:01:05.790649 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:05.790553    2563 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-20T19:01:05.779862238Z","UUID":"f4d23f11-28da-46fe-8015-11da38ecd4e6","Handler":null,"Name":"","Endpoint":""}
Jul 20 19:01:05.792095 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:05.792081    2563 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 20 19:01:05.792192 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:05.792115    2563 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 20 19:01:05.812545 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:05.812516    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-pkr2l"
Jul 20 19:01:05.813457 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:05.813439    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-pkr2l"
Jul 20 19:01:05.827203 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:05.827163    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-84cfb" podStartSLOduration=5.619755482 podStartE2EDuration="25.827151356s" totalImagesPullingTime="20.207395874s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:00:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:01:05.072906848 +0000 UTC m=+24.756434883" watchObservedRunningTime="2026-07-20 19:01:05.827151356 +0000 UTC m=+25.510679378"
Jul 20 19:01:06.035879 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:06.035793    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t6xc2" event={"ID":"51b7fa8c-4743-49aa-82c4-43bc98a705dc","Type":"ContainerStarted","Data":"d43da58953eb8ed666b260b240817e8d820c9478d64de7ab33d3aae8c9dff1fa"}
Jul 20 19:01:06.037835 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:06.037808    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-141.ec2.internal" event={"ID":"7466360cc91f8dce9f649835caab8eb1","Type":"ContainerStarted","Data":"a49c66084cc6deaf5bd88e0418f7a27293ee07babfdfb7c1e4a4598f50bf2656"}
Jul 20 19:01:06.038052 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:06.038034    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-pkr2l"
Jul 20 19:01:06.038571 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:06.038554    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-pkr2l"
Jul 20 19:01:06.053738 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:06.053692    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-141.ec2.internal" podStartSLOduration=24.053675957 podStartE2EDuration="24.053675957s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:00:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:01:06.053097936 +0000 UTC m=+25.736625958" watchObservedRunningTime="2026-07-20 19:01:06.053675957 +0000 UTC m=+25.737203982"
Jul 20 19:01:06.886780 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:06.886751    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ng85c"
Jul 20 19:01:06.886971 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:06.886752    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cd24s"
Jul 20 19:01:06.886971 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:01:06.886877    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ng85c" podUID="08e8b8dd-1dde-4bb0-863b-1322d836d18c"
Jul 20 19:01:06.886971 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:06.886903    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8r6m4"
Jul 20 19:01:06.887135 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:01:06.887003    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cd24s" podUID="073c7302-c5d7-4bfc-87fa-993163c6fd01"
Jul 20 19:01:06.887135 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:01:06.887082    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8r6m4" podUID="4cf9f593-d26c-43c1-a246-259d0b23f251"
Jul 20 19:01:07.043056 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:07.043028    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5j2qh" event={"ID":"146cbab8-fe62-44fd-91c3-c25bd7d36c0c","Type":"ContainerStarted","Data":"f17fee413d54871ef0545fc76b64e3d3f422eb6bf6f8adf0b1fc0e3e4abf17b6"}
Jul 20 19:01:08.887453 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:08.887270    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ng85c"
Jul 20 19:01:08.887737 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:01:08.887558    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ng85c" podUID="08e8b8dd-1dde-4bb0-863b-1322d836d18c"
Jul 20 19:01:08.887737 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:08.887322    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cd24s"
Jul 20 19:01:08.887737 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:01:08.887671    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cd24s" podUID="073c7302-c5d7-4bfc-87fa-993163c6fd01"
Jul 20 19:01:08.887737 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:08.887271    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8r6m4"
Jul 20 19:01:08.887887 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:01:08.887743    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8r6m4" podUID="4cf9f593-d26c-43c1-a246-259d0b23f251"
Jul 20 19:01:09.049977 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:09.049948    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t6xc2" event={"ID":"51b7fa8c-4743-49aa-82c4-43bc98a705dc","Type":"ContainerStarted","Data":"00b0107bc71136f30da6e17add503324a7b3b6f04eacd2fa4da78f8ec064d14e"}
Jul 20 19:01:09.052167 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:09.052143    2563 generic.go:356] "Generic (PLEG): container finished" podID="af77ba01-d870-408b-badb-3910b3fc4e0e" containerID="15fc23883d0d3a066f0c467b9c6fbd2e308d5f70689365244876970a7587b915" exitCode=0
Jul 20 19:01:09.052279 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:09.052225    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j6vb4" event={"ID":"af77ba01-d870-408b-badb-3910b3fc4e0e","Type":"ContainerDied","Data":"15fc23883d0d3a066f0c467b9c6fbd2e308d5f70689365244876970a7587b915"}
Jul 20 19:01:09.055745 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:09.055723    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5j2qh" event={"ID":"146cbab8-fe62-44fd-91c3-c25bd7d36c0c","Type":"ContainerStarted","Data":"3400a77c93a38abef0efe08a01399f0509a9ef89019f9e7c532ee1127c008f85"}
Jul 20 19:01:09.056025 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:09.056006    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5j2qh"
Jul 20 19:01:09.056109 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:09.056059    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5j2qh"
Jul 20 19:01:09.067869 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:09.067831    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t6xc2" podStartSLOduration=4.070863208 podStartE2EDuration="29.067818821s" totalImagesPullingTime="24.996955613s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:00:40 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:01:09.06756247 +0000 UTC m=+28.751090492" watchObservedRunningTime="2026-07-20 19:01:09.067818821 +0000 UTC m=+28.751346842"
Jul 20 19:01:09.070995 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:09.070969    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5j2qh"
Jul 20 19:01:09.071245 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:09.071220    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5j2qh"
Jul 20 19:01:09.092415 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:09.092373    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-5j2qh" podStartSLOduration=8.841867005 podStartE2EDuration="29.09234146s" totalImagesPullingTime="20.250474455s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:00:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:01:09.092177955 +0000 UTC m=+28.775705974" watchObservedRunningTime="2026-07-20 19:01:09.09234146 +0000 UTC m=+28.775869481"
Jul 20 19:01:10.058548 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:10.058471    2563 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 20 19:01:10.718914 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:10.718672    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8r6m4"]
Jul 20 19:01:10.719136 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:10.719074    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8r6m4"
Jul 20 19:01:10.719240 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:01:10.719211    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8r6m4" podUID="4cf9f593-d26c-43c1-a246-259d0b23f251"
Jul 20 19:01:10.719397 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:10.719372    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-cd24s"]
Jul 20 19:01:10.719491 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:10.719473    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cd24s"
Jul 20 19:01:10.719586 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:01:10.719566    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cd24s" podUID="073c7302-c5d7-4bfc-87fa-993163c6fd01"
Jul 20 19:01:10.720747 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:10.720726    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-ng85c"]
Jul 20 19:01:10.720854 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:10.720814    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ng85c"
Jul 20 19:01:10.720913 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:01:10.720886    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ng85c" podUID="08e8b8dd-1dde-4bb0-863b-1322d836d18c"
Jul 20 19:01:11.063032 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:11.062957    2563 generic.go:356] "Generic (PLEG): container finished" podID="af77ba01-d870-408b-badb-3910b3fc4e0e" containerID="d435949558546d6b9aac13cb7a995a9b78a09a6515fea0e48d06c7dde2ee0929" exitCode=0
Jul 20 19:01:11.063477 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:11.063027    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j6vb4" event={"ID":"af77ba01-d870-408b-badb-3910b3fc4e0e","Type":"ContainerDied","Data":"d435949558546d6b9aac13cb7a995a9b78a09a6515fea0e48d06c7dde2ee0929"}
Jul 20 19:01:11.063477 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:11.063098    2563 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 20 19:01:11.309360 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:11.309334    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5j2qh"
Jul 20 19:01:12.886955 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:12.886926    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ng85c"
Jul 20 19:01:12.887340 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:12.886948    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cd24s"
Jul 20 19:01:12.887340 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:01:12.887053    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ng85c" podUID="08e8b8dd-1dde-4bb0-863b-1322d836d18c"
Jul 20 19:01:12.887340 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:12.887067    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8r6m4"
Jul 20 19:01:12.887340 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:01:12.887195    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cd24s" podUID="073c7302-c5d7-4bfc-87fa-993163c6fd01"
Jul 20 19:01:12.887340 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:01:12.887278    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8r6m4" podUID="4cf9f593-d26c-43c1-a246-259d0b23f251"
Jul 20 19:01:13.069953 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:13.069924    2563 generic.go:356] "Generic (PLEG): container finished" podID="af77ba01-d870-408b-badb-3910b3fc4e0e" containerID="78aaeb2b35a756ed9808ab1d9f2e4cf76bef8e45f3ec72dbc788dcb763df1585" exitCode=0
Jul 20 19:01:13.070035 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:13.069984    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j6vb4" event={"ID":"af77ba01-d870-408b-badb-3910b3fc4e0e","Type":"ContainerDied","Data":"78aaeb2b35a756ed9808ab1d9f2e4cf76bef8e45f3ec72dbc788dcb763df1585"}
Jul 20 19:01:14.483923 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:14.483889    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/073c7302-c5d7-4bfc-87fa-993163c6fd01-metrics-certs\") pod \"network-metrics-daemon-cd24s\" (UID: \"073c7302-c5d7-4bfc-87fa-993163c6fd01\") " pod="openshift-multus/network-metrics-daemon-cd24s"
Jul 20 19:01:14.484339 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:01:14.484020    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 19:01:14.484339 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:01:14.484090    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/073c7302-c5d7-4bfc-87fa-993163c6fd01-metrics-certs podName:073c7302-c5d7-4bfc-87fa-993163c6fd01 nodeName:}" failed. No retries permitted until 2026-07-20 19:01:46.484070379 +0000 UTC m=+66.167598391 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/073c7302-c5d7-4bfc-87fa-993163c6fd01-metrics-certs") pod "network-metrics-daemon-cd24s" (UID: "073c7302-c5d7-4bfc-87fa-993163c6fd01") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 19:01:14.584853 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:14.584818    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/08e8b8dd-1dde-4bb0-863b-1322d836d18c-original-pull-secret\") pod \"global-pull-secret-syncer-ng85c\" (UID: \"08e8b8dd-1dde-4bb0-863b-1322d836d18c\") " pod="kube-system/global-pull-secret-syncer-ng85c"
Jul 20 19:01:14.585001 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:14.584885    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5576p\" (UniqueName: \"kubernetes.io/projected/4cf9f593-d26c-43c1-a246-259d0b23f251-kube-api-access-5576p\") pod \"network-check-target-8r6m4\" (UID: \"4cf9f593-d26c-43c1-a246-259d0b23f251\") " pod="openshift-network-diagnostics/network-check-target-8r6m4"
Jul 20 19:01:14.585001 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:01:14.584981    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 19:01:14.585122 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:01:14.585048    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08e8b8dd-1dde-4bb0-863b-1322d836d18c-original-pull-secret podName:08e8b8dd-1dde-4bb0-863b-1322d836d18c nodeName:}" failed. No retries permitted until 2026-07-20 19:01:46.585028143 +0000 UTC m=+66.268556159 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/08e8b8dd-1dde-4bb0-863b-1322d836d18c-original-pull-secret") pod "global-pull-secret-syncer-ng85c" (UID: "08e8b8dd-1dde-4bb0-863b-1322d836d18c") : object "kube-system"/"original-pull-secret" not registered
Jul 20 19:01:14.585122 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:01:14.585051    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 19:01:14.585122 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:01:14.585071    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 19:01:14.585122 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:01:14.585080    2563 projected.go:196] Error preparing data for projected volume kube-api-access-5576p for pod openshift-network-diagnostics/network-check-target-8r6m4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 19:01:14.585446 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:01:14.585126    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4cf9f593-d26c-43c1-a246-259d0b23f251-kube-api-access-5576p podName:4cf9f593-d26c-43c1-a246-259d0b23f251 nodeName:}" failed. No retries permitted until 2026-07-20 19:01:46.585110702 +0000 UTC m=+66.268638702 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-5576p" (UniqueName: "kubernetes.io/projected/4cf9f593-d26c-43c1-a246-259d0b23f251-kube-api-access-5576p") pod "network-check-target-8r6m4" (UID: "4cf9f593-d26c-43c1-a246-259d0b23f251") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 19:01:14.886941 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:14.886409    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ng85c"
Jul 20 19:01:14.886941 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:14.886421    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cd24s"
Jul 20 19:01:14.886941 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:01:14.886529    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ng85c" podUID="08e8b8dd-1dde-4bb0-863b-1322d836d18c"
Jul 20 19:01:14.886941 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:14.886423    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8r6m4"
Jul 20 19:01:14.886941 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:01:14.886606    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cd24s" podUID="073c7302-c5d7-4bfc-87fa-993163c6fd01"
Jul 20 19:01:14.886941 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:01:14.886650    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8r6m4" podUID="4cf9f593-d26c-43c1-a246-259d0b23f251"
Jul 20 19:01:15.953228 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:15.953198    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:01:16.034393 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:16.034297    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:01:16.086197 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:16.086167    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:01:16.098965 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:16.098936    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-141.ec2.internal" event="NodeReady"
Jul 20 19:01:16.099100 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:16.099071    2563 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 20 19:01:16.149178 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:16.149145    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-f9znr"]
Jul 20 19:01:16.151777 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:16.151757    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-z8fvx"]
Jul 20 19:01:16.151912 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:16.151898    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-f9znr"
Jul 20 19:01:16.153543 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:16.153524    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-55f89b56-jbvgr"]
Jul 20 19:01:16.153661 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:16.153641    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-z8fvx"
Jul 20 19:01:16.154246 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:16.154229    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 20 19:01:16.154365 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:16.154332    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-shkhq\""
Jul 20 19:01:16.154432 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:16.154334    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 20 19:01:16.156294 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:16.155313    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-55f89b56-jbvgr"
Jul 20 19:01:16.156294 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:16.155641    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 20 19:01:16.156294 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:16.155710    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 20 19:01:16.156294 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:16.155966    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-tjwjb\""
Jul 20 19:01:16.156294 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:16.155997    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 20 19:01:16.157868 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:16.157851    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-kl4lh\""
Jul 20 19:01:16.158554 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:16.158387    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 20 19:01:16.158924 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:16.158771    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 20 19:01:16.158924 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:16.158854    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 20 19:01:16.163551 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:16.163533    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-z8fvx"]
Jul 20 19:01:16.164091 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:16.163977    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-f9znr"]
Jul 20 19:01:16.164646 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:16.164620    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 20 19:01:16.165932 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:16.165914    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-55f89b56-jbvgr"]
Jul 20 19:01:16.295431 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:16.295330    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ee2de18c-442c-479c-9fe1-1bf28182217f-image-registry-private-configuration\") pod \"image-registry-55f89b56-jbvgr\" (UID: \"ee2de18c-442c-479c-9fe1-1bf28182217f\") " pod="openshift-image-registry/image-registry-55f89b56-jbvgr"
Jul 20 19:01:16.295431 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:16.295381    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ee2de18c-442c-479c-9fe1-1bf28182217f-registry-certificates\") pod \"image-registry-55f89b56-jbvgr\" (UID: \"ee2de18c-442c-479c-9fe1-1bf28182217f\") " pod="openshift-image-registry/image-registry-55f89b56-jbvgr"
Jul 20 19:01:16.295431 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:16.295415    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ee2de18c-442c-479c-9fe1-1bf28182217f-trusted-ca\") pod \"image-registry-55f89b56-jbvgr\" (UID: \"ee2de18c-442c-479c-9fe1-1bf28182217f\") " pod="openshift-image-registry/image-registry-55f89b56-jbvgr"
Jul 20 19:01:16.295708 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:16.295442    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/056c4b09-fdec-4f12-bcb2-e1fe989dec49-tmp-dir\") pod \"dns-default-f9znr\" (UID: \"056c4b09-fdec-4f12-bcb2-e1fe989dec49\") " pod="openshift-dns/dns-default-f9znr"
Jul 20 19:01:16.295708 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:16.295466    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ee2de18c-442c-479c-9fe1-1bf28182217f-bound-sa-token\") pod \"image-registry-55f89b56-jbvgr\" (UID: \"ee2de18c-442c-479c-9fe1-1bf28182217f\") " pod="openshift-image-registry/image-registry-55f89b56-jbvgr"
Jul 20 19:01:16.295708 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:16.295514    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ee2de18c-442c-479c-9fe1-1bf28182217f-installation-pull-secrets\") pod \"image-registry-55f89b56-jbvgr\" (UID: \"ee2de18c-442c-479c-9fe1-1bf28182217f\") " pod="openshift-image-registry/image-registry-55f89b56-jbvgr"
Jul 20 19:01:16.295708 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:16.295578    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2m5vs\" (UniqueName: \"kubernetes.io/projected/57f10f00-c288-4363-8126-1c278a8d249d-kube-api-access-2m5vs\") pod \"ingress-canary-z8fvx\" (UID: \"57f10f00-c288-4363-8126-1c278a8d249d\") " pod="openshift-ingress-canary/ingress-canary-z8fvx"
Jul 20 19:01:16.295708 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:16.295599    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/056c4b09-fdec-4f12-bcb2-e1fe989dec49-config-volume\") pod \"dns-default-f9znr\" (UID: \"056c4b09-fdec-4f12-bcb2-e1fe989dec49\") " pod="openshift-dns/dns-default-f9znr"
Jul 20 19:01:16.295708 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:16.295624    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/056c4b09-fdec-4f12-bcb2-e1fe989dec49-metrics-tls\") pod \"dns-default-f9znr\" (UID: \"056c4b09-fdec-4f12-bcb2-e1fe989dec49\") " pod="openshift-dns/dns-default-f9znr"
Jul 20 19:01:16.295708 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:16.295651    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7799p\" (UniqueName: \"kubernetes.io/projected/ee2de18c-442c-479c-9fe1-1bf28182217f-kube-api-access-7799p\") pod \"image-registry-55f89b56-jbvgr\" (UID: \"ee2de18c-442c-479c-9fe1-1bf28182217f\") " pod="openshift-image-registry/image-registry-55f89b56-jbvgr"
Jul 20 19:01:16.295708 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:16.295681    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wz8xx\" (UniqueName: \"kubernetes.io/projected/056c4b09-fdec-4f12-bcb2-e1fe989dec49-kube-api-access-wz8xx\") pod \"dns-default-f9znr\" (UID: \"056c4b09-fdec-4f12-bcb2-e1fe989dec49\") " pod="openshift-dns/dns-default-f9znr"
Jul 20 19:01:16.296078 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:16.295718    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ee2de18c-442c-479c-9fe1-1bf28182217f-ca-trust-extracted\") pod \"image-registry-55f89b56-jbvgr\" (UID: \"ee2de18c-442c-479c-9fe1-1bf28182217f\") " pod="openshift-image-registry/image-registry-55f89b56-jbvgr"
Jul 20 19:01:16.296078 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:16.295784    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ee2de18c-442c-479c-9fe1-1bf28182217f-registry-tls\") pod \"image-registry-55f89b56-jbvgr\" (UID: \"ee2de18c-442c-479c-9fe1-1bf28182217f\") " pod="openshift-image-registry/image-registry-55f89b56-jbvgr"
Jul 20 19:01:16.296078 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:16.295818    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/57f10f00-c288-4363-8126-1c278a8d249d-cert\") pod \"ingress-canary-z8fvx\" (UID: \"57f10f00-c288-4363-8126-1c278a8d249d\") " pod="openshift-ingress-canary/ingress-canary-z8fvx"
Jul 20 19:01:16.396763 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:16.396730    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ee2de18c-442c-479c-9fe1-1bf28182217f-image-registry-private-configuration\") pod \"image-registry-55f89b56-jbvgr\" (UID: \"ee2de18c-442c-479c-9fe1-1bf28182217f\") " pod="openshift-image-registry/image-registry-55f89b56-jbvgr"
Jul 20 19:01:16.396945 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:16.396774    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ee2de18c-442c-479c-9fe1-1bf28182217f-registry-certificates\") pod \"image-registry-55f89b56-jbvgr\" (UID: \"ee2de18c-442c-479c-9fe1-1bf28182217f\") " pod="openshift-image-registry/image-registry-55f89b56-jbvgr"
Jul 20 19:01:16.396945 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:16.396806    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ee2de18c-442c-479c-9fe1-1bf28182217f-trusted-ca\") pod \"image-registry-55f89b56-jbvgr\" (UID: \"ee2de18c-442c-479c-9fe1-1bf28182217f\") " pod="openshift-image-registry/image-registry-55f89b56-jbvgr"
Jul 20 19:01:16.396945 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:16.396832    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/056c4b09-fdec-4f12-bcb2-e1fe989dec49-tmp-dir\") pod \"dns-default-f9znr\" (UID: \"056c4b09-fdec-4f12-bcb2-e1fe989dec49\") " pod="openshift-dns/dns-default-f9znr"
Jul 20 19:01:16.397255 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:16.397230    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/056c4b09-fdec-4f12-bcb2-e1fe989dec49-tmp-dir\") pod \"dns-default-f9znr\" (UID: \"056c4b09-fdec-4f12-bcb2-e1fe989dec49\") " pod="openshift-dns/dns-default-f9znr"
Jul 20 19:01:16.397409 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:16.397272    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ee2de18c-442c-479c-9fe1-1bf28182217f-bound-sa-token\") pod \"image-registry-55f89b56-jbvgr\" (UID: \"ee2de18c-442c-479c-9fe1-1bf28182217f\") " pod="openshift-image-registry/image-registry-55f89b56-jbvgr"
Jul 20 19:01:16.397409 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:16.397319    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ee2de18c-442c-479c-9fe1-1bf28182217f-installation-pull-secrets\") pod \"image-registry-55f89b56-jbvgr\" (UID: \"ee2de18c-442c-479c-9fe1-1bf28182217f\") " pod="openshift-image-registry/image-registry-55f89b56-jbvgr"
Jul 20 19:01:16.397409 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:16.397389    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2m5vs\" (UniqueName: \"kubernetes.io/projected/57f10f00-c288-4363-8126-1c278a8d249d-kube-api-access-2m5vs\") pod \"ingress-canary-z8fvx\" (UID: \"57f10f00-c288-4363-8126-1c278a8d249d\") " pod="openshift-ingress-canary/ingress-canary-z8fvx"
Jul 20 19:01:16.397409 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:16.397410    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/056c4b09-fdec-4f12-bcb2-e1fe989dec49-config-volume\") pod \"dns-default-f9znr\" (UID: \"056c4b09-fdec-4f12-bcb2-e1fe989dec49\") " pod="openshift-dns/dns-default-f9znr"
Jul 20 19:01:16.397607 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:16.397428    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/056c4b09-fdec-4f12-bcb2-e1fe989dec49-metrics-tls\") pod \"dns-default-f9znr\" (UID: \"056c4b09-fdec-4f12-bcb2-e1fe989dec49\") " pod="openshift-dns/dns-default-f9znr"
Jul 20 19:01:16.397607 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:16.397458    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7799p\" (UniqueName: \"kubernetes.io/projected/ee2de18c-442c-479c-9fe1-1bf28182217f-kube-api-access-7799p\") pod \"image-registry-55f89b56-jbvgr\" (UID: \"ee2de18c-442c-479c-9fe1-1bf28182217f\") " pod="openshift-image-registry/image-registry-55f89b56-jbvgr"
Jul 20 19:01:16.397607 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:16.397485    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wz8xx\" (UniqueName: \"kubernetes.io/projected/056c4b09-fdec-4f12-bcb2-e1fe989dec49-kube-api-access-wz8xx\") pod \"dns-default-f9znr\" (UID: \"056c4b09-fdec-4f12-bcb2-e1fe989dec49\") " pod="openshift-dns/dns-default-f9znr"
Jul 20 19:01:16.397607 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:16.397508    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ee2de18c-442c-479c-9fe1-1bf28182217f-ca-trust-extracted\") pod \"image-registry-55f89b56-jbvgr\" (UID: \"ee2de18c-442c-479c-9fe1-1bf28182217f\") " pod="openshift-image-registry/image-registry-55f89b56-jbvgr"
Jul 20 19:01:16.397607 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:16.397534    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ee2de18c-442c-479c-9fe1-1bf28182217f-registry-tls\") pod \"image-registry-55f89b56-jbvgr\" (UID: \"ee2de18c-442c-479c-9fe1-1bf28182217f\") " pod="openshift-image-registry/image-registry-55f89b56-jbvgr"
Jul 20 19:01:16.397607 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:16.397553    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/57f10f00-c288-4363-8126-1c278a8d249d-cert\") pod \"ingress-canary-z8fvx\" (UID: \"57f10f00-c288-4363-8126-1c278a8d249d\") " pod="openshift-ingress-canary/ingress-canary-z8fvx"
Jul 20 19:01:16.397877 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:01:16.397734    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 19:01:16.397877 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:01:16.397801    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/056c4b09-fdec-4f12-bcb2-e1fe989dec49-metrics-tls podName:056c4b09-fdec-4f12-bcb2-e1fe989dec49 nodeName:}" failed. No retries permitted until 2026-07-20 19:01:16.897779798 +0000 UTC m=+36.581307813 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/056c4b09-fdec-4f12-bcb2-e1fe989dec49-metrics-tls") pod "dns-default-f9znr" (UID: "056c4b09-fdec-4f12-bcb2-e1fe989dec49") : secret "dns-default-metrics-tls" not found
Jul 20 19:01:16.398014 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:01:16.397992    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 20 19:01:16.398014 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:01:16.398015    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-55f89b56-jbvgr: secret "image-registry-tls" not found
Jul 20 19:01:16.398215 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:01:16.398067    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ee2de18c-442c-479c-9fe1-1bf28182217f-registry-tls podName:ee2de18c-442c-479c-9fe1-1bf28182217f nodeName:}" failed. No retries permitted until 2026-07-20 19:01:16.898052999 +0000 UTC m=+36.581581032 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ee2de18c-442c-479c-9fe1-1bf28182217f-registry-tls") pod "image-registry-55f89b56-jbvgr" (UID: "ee2de18c-442c-479c-9fe1-1bf28182217f") : secret "image-registry-tls" not found
Jul 20 19:01:16.398215 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:16.398098    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ee2de18c-442c-479c-9fe1-1bf28182217f-ca-trust-extracted\") pod \"image-registry-55f89b56-jbvgr\" (UID: \"ee2de18c-442c-479c-9fe1-1bf28182217f\") " pod="openshift-image-registry/image-registry-55f89b56-jbvgr"
Jul 20 19:01:16.398215 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:16.398193    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/056c4b09-fdec-4f12-bcb2-e1fe989dec49-config-volume\") pod \"dns-default-f9znr\" (UID: \"056c4b09-fdec-4f12-bcb2-e1fe989dec49\") " pod="openshift-dns/dns-default-f9znr"
Jul 20 19:01:16.398526 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:16.398482    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ee2de18c-442c-479c-9fe1-1bf28182217f-registry-certificates\") pod \"image-registry-55f89b56-jbvgr\" (UID: \"ee2de18c-442c-479c-9fe1-1bf28182217f\") " pod="openshift-image-registry/image-registry-55f89b56-jbvgr"
Jul 20 19:01:16.398944 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:16.398921    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ee2de18c-442c-479c-9fe1-1bf28182217f-trusted-ca\") pod \"image-registry-55f89b56-jbvgr\" (UID: \"ee2de18c-442c-479c-9fe1-1bf28182217f\") " pod="openshift-image-registry/image-registry-55f89b56-jbvgr"
Jul 20 19:01:16.402264 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:16.402099    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ee2de18c-442c-479c-9fe1-1bf28182217f-installation-pull-secrets\") pod \"image-registry-55f89b56-jbvgr\" (UID: \"ee2de18c-442c-479c-9fe1-1bf28182217f\") " pod="openshift-image-registry/image-registry-55f89b56-jbvgr"
Jul 20 19:01:16.402264 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:16.402112    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ee2de18c-442c-479c-9fe1-1bf28182217f-image-registry-private-configuration\") pod \"image-registry-55f89b56-jbvgr\" (UID: \"ee2de18c-442c-479c-9fe1-1bf28182217f\") " pod="openshift-image-registry/image-registry-55f89b56-jbvgr"
Jul 20 19:01:16.402264 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:16.402115    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/57f10f00-c288-4363-8126-1c278a8d249d-cert\") pod \"ingress-canary-z8fvx\" (UID: \"57f10f00-c288-4363-8126-1c278a8d249d\") " pod="openshift-ingress-canary/ingress-canary-z8fvx"
Jul 20 19:01:16.408739 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:16.408715    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7799p\" (UniqueName: \"kubernetes.io/projected/ee2de18c-442c-479c-9fe1-1bf28182217f-kube-api-access-7799p\") pod \"image-registry-55f89b56-jbvgr\" (UID: \"ee2de18c-442c-479c-9fe1-1bf28182217f\") " pod="openshift-image-registry/image-registry-55f89b56-jbvgr"
Jul 20 19:01:16.409019 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:16.409001    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2m5vs\" (UniqueName: \"kubernetes.io/projected/57f10f00-c288-4363-8126-1c278a8d249d-kube-api-access-2m5vs\") pod \"ingress-canary-z8fvx\" (UID: \"57f10f00-c288-4363-8126-1c278a8d249d\") " pod="openshift-ingress-canary/ingress-canary-z8fvx"
Jul 20 19:01:16.409600 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:16.409578    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ee2de18c-442c-479c-9fe1-1bf28182217f-bound-sa-token\") pod \"image-registry-55f89b56-jbvgr\" (UID: \"ee2de18c-442c-479c-9fe1-1bf28182217f\") " pod="openshift-image-registry/image-registry-55f89b56-jbvgr"
Jul 20 19:01:16.409743 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:16.409726    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wz8xx\" (UniqueName: \"kubernetes.io/projected/056c4b09-fdec-4f12-bcb2-e1fe989dec49-kube-api-access-wz8xx\") pod \"dns-default-f9znr\" (UID: \"056c4b09-fdec-4f12-bcb2-e1fe989dec49\") " pod="openshift-dns/dns-default-f9znr"
Jul 20 19:01:16.474417 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:16.474392    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-z8fvx"
Jul 20 19:01:16.886529 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:16.886489    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8r6m4"
Jul 20 19:01:16.886704 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:16.886547    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ng85c"
Jul 20 19:01:16.886704 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:16.886487    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cd24s"
Jul 20 19:01:16.889025 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:16.889005    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 20 19:01:16.889981 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:16.889953    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-s7pj6\""
Jul 20 19:01:16.889981 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:16.889979    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 20 19:01:16.890155 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:16.889992    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 20 19:01:16.890155 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:16.890030    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-74mbs\""
Jul 20 19:01:16.890303 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:16.890285    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 20 19:01:16.901070 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:16.901052    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/056c4b09-fdec-4f12-bcb2-e1fe989dec49-metrics-tls\") pod \"dns-default-f9znr\" (UID: \"056c4b09-fdec-4f12-bcb2-e1fe989dec49\") " pod="openshift-dns/dns-default-f9znr"
Jul 20 19:01:16.901152 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:16.901087    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ee2de18c-442c-479c-9fe1-1bf28182217f-registry-tls\") pod \"image-registry-55f89b56-jbvgr\" (UID: \"ee2de18c-442c-479c-9fe1-1bf28182217f\") " pod="openshift-image-registry/image-registry-55f89b56-jbvgr"
Jul 20 19:01:16.901191 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:01:16.901180    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 19:01:16.901224 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:01:16.901188    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 20 19:01:16.901224 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:01:16.901202    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-55f89b56-jbvgr: secret "image-registry-tls" not found
Jul 20 19:01:16.901303 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:01:16.901237    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/056c4b09-fdec-4f12-bcb2-e1fe989dec49-metrics-tls podName:056c4b09-fdec-4f12-bcb2-e1fe989dec49 nodeName:}" failed. No retries permitted until 2026-07-20 19:01:17.901216824 +0000 UTC m=+37.584744824 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/056c4b09-fdec-4f12-bcb2-e1fe989dec49-metrics-tls") pod "dns-default-f9znr" (UID: "056c4b09-fdec-4f12-bcb2-e1fe989dec49") : secret "dns-default-metrics-tls" not found
Jul 20 19:01:16.901303 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:01:16.901255    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ee2de18c-442c-479c-9fe1-1bf28182217f-registry-tls podName:ee2de18c-442c-479c-9fe1-1bf28182217f nodeName:}" failed. No retries permitted until 2026-07-20 19:01:17.901246309 +0000 UTC m=+37.584774310 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ee2de18c-442c-479c-9fe1-1bf28182217f-registry-tls") pod "image-registry-55f89b56-jbvgr" (UID: "ee2de18c-442c-479c-9fe1-1bf28182217f") : secret "image-registry-tls" not found
Jul 20 19:01:17.538913 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:17.538883    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-z8fvx"]
Jul 20 19:01:17.542215 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:01:17.542184    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57f10f00_c288_4363_8126_1c278a8d249d.slice/crio-1e32f64cc638d575d0af2397df19d63bcd9deefe0eb1e26a5d1917f3a5b34de0 WatchSource:0}: Error finding container 1e32f64cc638d575d0af2397df19d63bcd9deefe0eb1e26a5d1917f3a5b34de0: Status 404 returned error can't find the container with id 1e32f64cc638d575d0af2397df19d63bcd9deefe0eb1e26a5d1917f3a5b34de0
Jul 20 19:01:17.909254 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:17.909221    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/056c4b09-fdec-4f12-bcb2-e1fe989dec49-metrics-tls\") pod \"dns-default-f9znr\" (UID: \"056c4b09-fdec-4f12-bcb2-e1fe989dec49\") " pod="openshift-dns/dns-default-f9znr"
Jul 20 19:01:17.909399 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:17.909266    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ee2de18c-442c-479c-9fe1-1bf28182217f-registry-tls\") pod \"image-registry-55f89b56-jbvgr\" (UID: \"ee2de18c-442c-479c-9fe1-1bf28182217f\") " pod="openshift-image-registry/image-registry-55f89b56-jbvgr"
Jul 20 19:01:17.909399 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:01:17.909373    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 20 19:01:17.909399 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:01:17.909386    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-55f89b56-jbvgr: secret "image-registry-tls" not found
Jul 20 19:01:17.909507 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:01:17.909393    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 19:01:17.909507 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:01:17.909435    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ee2de18c-442c-479c-9fe1-1bf28182217f-registry-tls podName:ee2de18c-442c-479c-9fe1-1bf28182217f nodeName:}" failed. No retries permitted until 2026-07-20 19:01:19.909422821 +0000 UTC m=+39.592950821 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ee2de18c-442c-479c-9fe1-1bf28182217f-registry-tls") pod "image-registry-55f89b56-jbvgr" (UID: "ee2de18c-442c-479c-9fe1-1bf28182217f") : secret "image-registry-tls" not found
Jul 20 19:01:17.909507 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:01:17.909447    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/056c4b09-fdec-4f12-bcb2-e1fe989dec49-metrics-tls podName:056c4b09-fdec-4f12-bcb2-e1fe989dec49 nodeName:}" failed. No retries permitted until 2026-07-20 19:01:19.909441242 +0000 UTC m=+39.592969241 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/056c4b09-fdec-4f12-bcb2-e1fe989dec49-metrics-tls") pod "dns-default-f9znr" (UID: "056c4b09-fdec-4f12-bcb2-e1fe989dec49") : secret "dns-default-metrics-tls" not found
Jul 20 19:01:18.082779 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:18.082743    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-z8fvx" event={"ID":"57f10f00-c288-4363-8126-1c278a8d249d","Type":"ContainerStarted","Data":"1e32f64cc638d575d0af2397df19d63bcd9deefe0eb1e26a5d1917f3a5b34de0"}
Jul 20 19:01:18.085318 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:18.085294    2563 generic.go:356] "Generic (PLEG): container finished" podID="af77ba01-d870-408b-badb-3910b3fc4e0e" containerID="8d3419f5252725ec1efd4973f216d00db7eb64b6285fec0746e72d245cd35af1" exitCode=0
Jul 20 19:01:18.085448 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:18.085345    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j6vb4" event={"ID":"af77ba01-d870-408b-badb-3910b3fc4e0e","Type":"ContainerDied","Data":"8d3419f5252725ec1efd4973f216d00db7eb64b6285fec0746e72d245cd35af1"}
Jul 20 19:01:18.087972 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:18.087945    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:01:19.096371 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:19.096329    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j6vb4" event={"ID":"af77ba01-d870-408b-badb-3910b3fc4e0e","Type":"ContainerDied","Data":"5ff424813499c012358514c54d8dc8170f56910d313bcafc4f10823242e20842"}
Jul 20 19:01:19.097680 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:19.096306    2563 generic.go:356] "Generic (PLEG): container finished" podID="af77ba01-d870-408b-badb-3910b3fc4e0e" containerID="5ff424813499c012358514c54d8dc8170f56910d313bcafc4f10823242e20842" exitCode=0
Jul 20 19:01:19.594293 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:19.594101    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:01:19.696484 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:19.696452    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:01:19.923117 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:19.923043    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/056c4b09-fdec-4f12-bcb2-e1fe989dec49-metrics-tls\") pod \"dns-default-f9znr\" (UID: \"056c4b09-fdec-4f12-bcb2-e1fe989dec49\") " pod="openshift-dns/dns-default-f9znr"
Jul 20 19:01:19.923117 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:19.923091    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ee2de18c-442c-479c-9fe1-1bf28182217f-registry-tls\") pod \"image-registry-55f89b56-jbvgr\" (UID: \"ee2de18c-442c-479c-9fe1-1bf28182217f\") " pod="openshift-image-registry/image-registry-55f89b56-jbvgr"
Jul 20 19:01:19.923338 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:01:19.923187    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 20 19:01:19.923338 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:01:19.923199    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-55f89b56-jbvgr: secret "image-registry-tls" not found
Jul 20 19:01:19.923338 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:01:19.923202    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 19:01:19.923338 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:01:19.923256    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ee2de18c-442c-479c-9fe1-1bf28182217f-registry-tls podName:ee2de18c-442c-479c-9fe1-1bf28182217f nodeName:}" failed. No retries permitted until 2026-07-20 19:01:23.92323699 +0000 UTC m=+43.606765013 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ee2de18c-442c-479c-9fe1-1bf28182217f-registry-tls") pod "image-registry-55f89b56-jbvgr" (UID: "ee2de18c-442c-479c-9fe1-1bf28182217f") : secret "image-registry-tls" not found
Jul 20 19:01:19.923338 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:01:19.923282    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/056c4b09-fdec-4f12-bcb2-e1fe989dec49-metrics-tls podName:056c4b09-fdec-4f12-bcb2-e1fe989dec49 nodeName:}" failed. No retries permitted until 2026-07-20 19:01:23.923263402 +0000 UTC m=+43.606791416 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/056c4b09-fdec-4f12-bcb2-e1fe989dec49-metrics-tls") pod "dns-default-f9znr" (UID: "056c4b09-fdec-4f12-bcb2-e1fe989dec49") : secret "dns-default-metrics-tls" not found
Jul 20 19:01:20.102469 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:20.102432    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j6vb4" event={"ID":"af77ba01-d870-408b-badb-3910b3fc4e0e","Type":"ContainerStarted","Data":"b51adb8897319e63f1eff280634417075c3cf012d08388c2c837c135fe06c660"}
Jul 20 19:01:20.129392 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:20.129315    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-j6vb4" podStartSLOduration=6.667478623 podStartE2EDuration="39.129296612s" totalImagesPullingTime="32.461817989s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:00:41 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:01:20.128236268 +0000 UTC m=+39.811764290" watchObservedRunningTime="2026-07-20 19:01:20.129296612 +0000 UTC m=+39.812824634"
Jul 20 19:01:20.257156 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:20.257123    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:01:20.357839 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:20.357808    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:01:20.419385 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:20.419335    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:01:20.855909 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:20.855883    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:01:20.944367 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:20.944330    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:01:22.111375 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:22.109303    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-z8fvx" event={"ID":"57f10f00-c288-4363-8126-1c278a8d249d","Type":"ContainerStarted","Data":"1aef7484be70d4174903ec0f830ab74505aae81162824ce9fc10b41adf126c2f"}
Jul 20 19:01:22.126155 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:22.126111    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-z8fvx" podStartSLOduration=2.659836943 podStartE2EDuration="6.126096076s" totalImagesPullingTime="3.466259133s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:01:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:01:22.125384128 +0000 UTC m=+41.808912151" watchObservedRunningTime="2026-07-20 19:01:22.126096076 +0000 UTC m=+41.809624076"
Jul 20 19:01:23.952279 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:23.952247    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/056c4b09-fdec-4f12-bcb2-e1fe989dec49-metrics-tls\") pod \"dns-default-f9znr\" (UID: \"056c4b09-fdec-4f12-bcb2-e1fe989dec49\") " pod="openshift-dns/dns-default-f9znr"
Jul 20 19:01:23.952655 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:23.952292    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ee2de18c-442c-479c-9fe1-1bf28182217f-registry-tls\") pod \"image-registry-55f89b56-jbvgr\" (UID: \"ee2de18c-442c-479c-9fe1-1bf28182217f\") " pod="openshift-image-registry/image-registry-55f89b56-jbvgr"
Jul 20 19:01:23.952655 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:01:23.952422    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 20 19:01:23.952655 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:01:23.952419    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 19:01:23.952655 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:01:23.952435    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-55f89b56-jbvgr: secret "image-registry-tls" not found
Jul 20 19:01:23.952655 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:01:23.952500    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/056c4b09-fdec-4f12-bcb2-e1fe989dec49-metrics-tls podName:056c4b09-fdec-4f12-bcb2-e1fe989dec49 nodeName:}" failed. No retries permitted until 2026-07-20 19:01:31.95248209 +0000 UTC m=+51.636010089 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/056c4b09-fdec-4f12-bcb2-e1fe989dec49-metrics-tls") pod "dns-default-f9znr" (UID: "056c4b09-fdec-4f12-bcb2-e1fe989dec49") : secret "dns-default-metrics-tls" not found
Jul 20 19:01:23.952655 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:01:23.952519    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ee2de18c-442c-479c-9fe1-1bf28182217f-registry-tls podName:ee2de18c-442c-479c-9fe1-1bf28182217f nodeName:}" failed. No retries permitted until 2026-07-20 19:01:31.952510508 +0000 UTC m=+51.636038510 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ee2de18c-442c-479c-9fe1-1bf28182217f-registry-tls") pod "image-registry-55f89b56-jbvgr" (UID: "ee2de18c-442c-479c-9fe1-1bf28182217f") : secret "image-registry-tls" not found
Jul 20 19:01:25.092177 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:25.092143    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:01:25.159964 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:25.159939    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:01:25.397586 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:25.397517    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-h8vpg"]
Jul 20 19:01:25.428935 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:25.428896    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:01:25.429634 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:25.429618    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-h8vpg"]
Jul 20 19:01:25.429721 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:25.429710    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-h8vpg"
Jul 20 19:01:25.431611 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:25.431591    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 20 19:01:25.432554 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:25.432535    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 20 19:01:25.432650 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:25.432557    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 20 19:01:25.432650 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:25.432581    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-skgq8\""
Jul 20 19:01:25.432650 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:25.432603    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 20 19:01:25.497428 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:25.497402    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:01:25.561503 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:25.561474    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7f6ea8d6-0900-4dde-8fd7-299e106bb611-crio-socket\") pod \"insights-runtime-extractor-h8vpg\" (UID: \"7f6ea8d6-0900-4dde-8fd7-299e106bb611\") " pod="openshift-insights/insights-runtime-extractor-h8vpg"
Jul 20 19:01:25.561584 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:25.561516    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7f6ea8d6-0900-4dde-8fd7-299e106bb611-data-volume\") pod \"insights-runtime-extractor-h8vpg\" (UID: \"7f6ea8d6-0900-4dde-8fd7-299e106bb611\") " pod="openshift-insights/insights-runtime-extractor-h8vpg"
Jul 20 19:01:25.561584 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:25.561567    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmw27\" (UniqueName: \"kubernetes.io/projected/7f6ea8d6-0900-4dde-8fd7-299e106bb611-kube-api-access-dmw27\") pod \"insights-runtime-extractor-h8vpg\" (UID: \"7f6ea8d6-0900-4dde-8fd7-299e106bb611\") " pod="openshift-insights/insights-runtime-extractor-h8vpg"
Jul 20 19:01:25.561670 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:25.561588    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7f6ea8d6-0900-4dde-8fd7-299e106bb611-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h8vpg\" (UID: \"7f6ea8d6-0900-4dde-8fd7-299e106bb611\") " pod="openshift-insights/insights-runtime-extractor-h8vpg"
Jul 20 19:01:25.561670 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:25.561602    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7f6ea8d6-0900-4dde-8fd7-299e106bb611-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h8vpg\" (UID: \"7f6ea8d6-0900-4dde-8fd7-299e106bb611\") " pod="openshift-insights/insights-runtime-extractor-h8vpg"
Jul 20 19:01:25.662858 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:25.662801    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7f6ea8d6-0900-4dde-8fd7-299e106bb611-crio-socket\") pod \"insights-runtime-extractor-h8vpg\" (UID: \"7f6ea8d6-0900-4dde-8fd7-299e106bb611\") " pod="openshift-insights/insights-runtime-extractor-h8vpg"
Jul 20 19:01:25.662858 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:25.662838    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7f6ea8d6-0900-4dde-8fd7-299e106bb611-data-volume\") pod \"insights-runtime-extractor-h8vpg\" (UID: \"7f6ea8d6-0900-4dde-8fd7-299e106bb611\") " pod="openshift-insights/insights-runtime-extractor-h8vpg"
Jul 20 19:01:25.662977 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:25.662887    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmw27\" (UniqueName: \"kubernetes.io/projected/7f6ea8d6-0900-4dde-8fd7-299e106bb611-kube-api-access-dmw27\") pod \"insights-runtime-extractor-h8vpg\" (UID: \"7f6ea8d6-0900-4dde-8fd7-299e106bb611\") " pod="openshift-insights/insights-runtime-extractor-h8vpg"
Jul 20 19:01:25.662977 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:25.662913    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7f6ea8d6-0900-4dde-8fd7-299e106bb611-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h8vpg\" (UID: \"7f6ea8d6-0900-4dde-8fd7-299e106bb611\") " pod="openshift-insights/insights-runtime-extractor-h8vpg"
Jul 20 19:01:25.662977 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:25.662930    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7f6ea8d6-0900-4dde-8fd7-299e106bb611-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h8vpg\" (UID: \"7f6ea8d6-0900-4dde-8fd7-299e106bb611\") " pod="openshift-insights/insights-runtime-extractor-h8vpg"
Jul 20 19:01:25.663071 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:25.662998    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7f6ea8d6-0900-4dde-8fd7-299e106bb611-crio-socket\") pod \"insights-runtime-extractor-h8vpg\" (UID: \"7f6ea8d6-0900-4dde-8fd7-299e106bb611\") " pod="openshift-insights/insights-runtime-extractor-h8vpg"
Jul 20 19:01:25.663071 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:01:25.663007    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 20 19:01:25.663071 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:01:25.663038    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 20 19:01:25.663156 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:01:25.663080    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7f6ea8d6-0900-4dde-8fd7-299e106bb611-kube-rbac-proxy-cm podName:7f6ea8d6-0900-4dde-8fd7-299e106bb611 nodeName:}" failed. No retries permitted until 2026-07-20 19:01:26.163061201 +0000 UTC m=+45.846589206 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7f6ea8d6-0900-4dde-8fd7-299e106bb611-kube-rbac-proxy-cm") pod "insights-runtime-extractor-h8vpg" (UID: "7f6ea8d6-0900-4dde-8fd7-299e106bb611") : configmap "kube-rbac-proxy" not found
Jul 20 19:01:25.663156 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:01:25.663104    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f6ea8d6-0900-4dde-8fd7-299e106bb611-insights-runtime-extractor-tls podName:7f6ea8d6-0900-4dde-8fd7-299e106bb611 nodeName:}" failed. No retries permitted until 2026-07-20 19:01:26.163087735 +0000 UTC m=+45.846615734 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7f6ea8d6-0900-4dde-8fd7-299e106bb611-insights-runtime-extractor-tls") pod "insights-runtime-extractor-h8vpg" (UID: "7f6ea8d6-0900-4dde-8fd7-299e106bb611") : secret "insights-runtime-extractor-tls" not found
Jul 20 19:01:25.663273 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:25.663255    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7f6ea8d6-0900-4dde-8fd7-299e106bb611-data-volume\") pod \"insights-runtime-extractor-h8vpg\" (UID: \"7f6ea8d6-0900-4dde-8fd7-299e106bb611\") " pod="openshift-insights/insights-runtime-extractor-h8vpg"
Jul 20 19:01:25.672125 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:25.672104    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmw27\" (UniqueName: \"kubernetes.io/projected/7f6ea8d6-0900-4dde-8fd7-299e106bb611-kube-api-access-dmw27\") pod \"insights-runtime-extractor-h8vpg\" (UID: \"7f6ea8d6-0900-4dde-8fd7-299e106bb611\") " pod="openshift-insights/insights-runtime-extractor-h8vpg"
Jul 20 19:01:26.166345 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:26.166310    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7f6ea8d6-0900-4dde-8fd7-299e106bb611-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h8vpg\" (UID: \"7f6ea8d6-0900-4dde-8fd7-299e106bb611\") " pod="openshift-insights/insights-runtime-extractor-h8vpg"
Jul 20 19:01:26.166345 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:26.166343    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7f6ea8d6-0900-4dde-8fd7-299e106bb611-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h8vpg\" (UID: \"7f6ea8d6-0900-4dde-8fd7-299e106bb611\") " pod="openshift-insights/insights-runtime-extractor-h8vpg"
Jul 20 19:01:26.166747 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:01:26.166421    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 20 19:01:26.166747 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:01:26.166475    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7f6ea8d6-0900-4dde-8fd7-299e106bb611-kube-rbac-proxy-cm podName:7f6ea8d6-0900-4dde-8fd7-299e106bb611 nodeName:}" failed. No retries permitted until 2026-07-20 19:01:27.166461908 +0000 UTC m=+46.849989907 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7f6ea8d6-0900-4dde-8fd7-299e106bb611-kube-rbac-proxy-cm") pod "insights-runtime-extractor-h8vpg" (UID: "7f6ea8d6-0900-4dde-8fd7-299e106bb611") : configmap "kube-rbac-proxy" not found
Jul 20 19:01:26.166747 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:01:26.166489    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 20 19:01:26.166747 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:01:26.166524    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f6ea8d6-0900-4dde-8fd7-299e106bb611-insights-runtime-extractor-tls podName:7f6ea8d6-0900-4dde-8fd7-299e106bb611 nodeName:}" failed. No retries permitted until 2026-07-20 19:01:27.166513526 +0000 UTC m=+46.850041527 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7f6ea8d6-0900-4dde-8fd7-299e106bb611-insights-runtime-extractor-tls") pod "insights-runtime-extractor-h8vpg" (UID: "7f6ea8d6-0900-4dde-8fd7-299e106bb611") : secret "insights-runtime-extractor-tls" not found
Jul 20 19:01:26.346027 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:26.345991    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:01:26.401925 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:26.401901    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:01:27.165420 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:27.165389    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:01:27.173434 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:27.173405    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7f6ea8d6-0900-4dde-8fd7-299e106bb611-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h8vpg\" (UID: \"7f6ea8d6-0900-4dde-8fd7-299e106bb611\") " pod="openshift-insights/insights-runtime-extractor-h8vpg"
Jul 20 19:01:27.173813 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:27.173443    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7f6ea8d6-0900-4dde-8fd7-299e106bb611-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h8vpg\" (UID: \"7f6ea8d6-0900-4dde-8fd7-299e106bb611\") " pod="openshift-insights/insights-runtime-extractor-h8vpg"
Jul 20 19:01:27.173813 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:01:27.173528    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 20 19:01:27.173813 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:01:27.173588    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7f6ea8d6-0900-4dde-8fd7-299e106bb611-kube-rbac-proxy-cm podName:7f6ea8d6-0900-4dde-8fd7-299e106bb611 nodeName:}" failed. No retries permitted until 2026-07-20 19:01:29.173572966 +0000 UTC m=+48.857100967 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7f6ea8d6-0900-4dde-8fd7-299e106bb611-kube-rbac-proxy-cm") pod "insights-runtime-extractor-h8vpg" (UID: "7f6ea8d6-0900-4dde-8fd7-299e106bb611") : configmap "kube-rbac-proxy" not found
Jul 20 19:01:27.173813 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:01:27.173614    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 20 19:01:27.173813 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:01:27.173652    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f6ea8d6-0900-4dde-8fd7-299e106bb611-insights-runtime-extractor-tls podName:7f6ea8d6-0900-4dde-8fd7-299e106bb611 nodeName:}" failed. No retries permitted until 2026-07-20 19:01:29.173641182 +0000 UTC m=+48.857169182 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7f6ea8d6-0900-4dde-8fd7-299e106bb611-insights-runtime-extractor-tls") pod "insights-runtime-extractor-h8vpg" (UID: "7f6ea8d6-0900-4dde-8fd7-299e106bb611") : secret "insights-runtime-extractor-tls" not found
Jul 20 19:01:27.186897 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:27.186876    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-fz2dc_25f85dbe-c3b0-41a1-8c59-a68cc45c1306/dns-node-resolver/0.log"
Jul 20 19:01:27.267196 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:27.267157    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:01:28.587242 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:28.587215    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-dz7gc_c43a2dd8-3638-4e80-ba88-bc0d0ea5f866/node-ca/0.log"
Jul 20 19:01:28.754577 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:28.754544    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:01:29.188741 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:29.188703    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7f6ea8d6-0900-4dde-8fd7-299e106bb611-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h8vpg\" (UID: \"7f6ea8d6-0900-4dde-8fd7-299e106bb611\") " pod="openshift-insights/insights-runtime-extractor-h8vpg"
Jul 20 19:01:29.188741 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:29.188744    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7f6ea8d6-0900-4dde-8fd7-299e106bb611-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h8vpg\" (UID: \"7f6ea8d6-0900-4dde-8fd7-299e106bb611\") " pod="openshift-insights/insights-runtime-extractor-h8vpg"
Jul 20 19:01:29.188990 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:01:29.188821    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 20 19:01:29.188990 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:01:29.188883    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7f6ea8d6-0900-4dde-8fd7-299e106bb611-kube-rbac-proxy-cm podName:7f6ea8d6-0900-4dde-8fd7-299e106bb611 nodeName:}" failed. No retries permitted until 2026-07-20 19:01:33.188865931 +0000 UTC m=+52.872393930 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7f6ea8d6-0900-4dde-8fd7-299e106bb611-kube-rbac-proxy-cm") pod "insights-runtime-extractor-h8vpg" (UID: "7f6ea8d6-0900-4dde-8fd7-299e106bb611") : configmap "kube-rbac-proxy" not found
Jul 20 19:01:29.188990 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:01:29.188891    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 20 19:01:29.188990 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:01:29.188939    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f6ea8d6-0900-4dde-8fd7-299e106bb611-insights-runtime-extractor-tls podName:7f6ea8d6-0900-4dde-8fd7-299e106bb611 nodeName:}" failed. No retries permitted until 2026-07-20 19:01:33.188924845 +0000 UTC m=+52.872452845 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7f6ea8d6-0900-4dde-8fd7-299e106bb611-insights-runtime-extractor-tls") pod "insights-runtime-extractor-h8vpg" (UID: "7f6ea8d6-0900-4dde-8fd7-299e106bb611") : secret "insights-runtime-extractor-tls" not found
Jul 20 19:01:29.388801 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:29.388775    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-z8fvx_57f10f00-c288-4363-8126-1c278a8d249d/serve-healthcheck-canary/0.log"
Jul 20 19:01:29.500265 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:29.500234    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:01:29.604832 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:29.604803    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:01:30.942737 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:30.942705    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:01:31.008707 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:31.008683    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:01:32.008928 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:32.008894    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/056c4b09-fdec-4f12-bcb2-e1fe989dec49-metrics-tls\") pod \"dns-default-f9znr\" (UID: \"056c4b09-fdec-4f12-bcb2-e1fe989dec49\") " pod="openshift-dns/dns-default-f9znr"
Jul 20 19:01:32.009377 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:32.008940    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ee2de18c-442c-479c-9fe1-1bf28182217f-registry-tls\") pod \"image-registry-55f89b56-jbvgr\" (UID: \"ee2de18c-442c-479c-9fe1-1bf28182217f\") " pod="openshift-image-registry/image-registry-55f89b56-jbvgr"
Jul 20 19:01:32.009377 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:01:32.009048    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 20 19:01:32.009377 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:01:32.009058    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-55f89b56-jbvgr: secret "image-registry-tls" not found
Jul 20 19:01:32.009377 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:01:32.009070    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 19:01:32.009377 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:01:32.009109    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ee2de18c-442c-479c-9fe1-1bf28182217f-registry-tls podName:ee2de18c-442c-479c-9fe1-1bf28182217f nodeName:}" failed. No retries permitted until 2026-07-20 19:01:48.009093411 +0000 UTC m=+67.692621411 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ee2de18c-442c-479c-9fe1-1bf28182217f-registry-tls") pod "image-registry-55f89b56-jbvgr" (UID: "ee2de18c-442c-479c-9fe1-1bf28182217f") : secret "image-registry-tls" not found
Jul 20 19:01:32.009377 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:01:32.009132    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/056c4b09-fdec-4f12-bcb2-e1fe989dec49-metrics-tls podName:056c4b09-fdec-4f12-bcb2-e1fe989dec49 nodeName:}" failed. No retries permitted until 2026-07-20 19:01:48.009115586 +0000 UTC m=+67.692643588 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/056c4b09-fdec-4f12-bcb2-e1fe989dec49-metrics-tls") pod "dns-default-f9znr" (UID: "056c4b09-fdec-4f12-bcb2-e1fe989dec49") : secret "dns-default-metrics-tls" not found
Jul 20 19:01:33.140819 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:33.140787    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:01:33.216662 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:33.216635    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7f6ea8d6-0900-4dde-8fd7-299e106bb611-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h8vpg\" (UID: \"7f6ea8d6-0900-4dde-8fd7-299e106bb611\") " pod="openshift-insights/insights-runtime-extractor-h8vpg"
Jul 20 19:01:33.216662 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:33.216664    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7f6ea8d6-0900-4dde-8fd7-299e106bb611-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h8vpg\" (UID: \"7f6ea8d6-0900-4dde-8fd7-299e106bb611\") " pod="openshift-insights/insights-runtime-extractor-h8vpg"
Jul 20 19:01:33.216818 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:01:33.216788    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 20 19:01:33.216862 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:01:33.216837    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f6ea8d6-0900-4dde-8fd7-299e106bb611-insights-runtime-extractor-tls podName:7f6ea8d6-0900-4dde-8fd7-299e106bb611 nodeName:}" failed. No retries permitted until 2026-07-20 19:01:41.216824078 +0000 UTC m=+60.900352078 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7f6ea8d6-0900-4dde-8fd7-299e106bb611-insights-runtime-extractor-tls") pod "insights-runtime-extractor-h8vpg" (UID: "7f6ea8d6-0900-4dde-8fd7-299e106bb611") : secret "insights-runtime-extractor-tls" not found
Jul 20 19:01:33.217398 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:33.217380    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7f6ea8d6-0900-4dde-8fd7-299e106bb611-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h8vpg\" (UID: \"7f6ea8d6-0900-4dde-8fd7-299e106bb611\") " pod="openshift-insights/insights-runtime-extractor-h8vpg"
Jul 20 19:01:33.313046 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:33.313013    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:01:33.475751 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:33.475719    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:01:33.571732 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:33.571705    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:01:33.674308 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:33.674274    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:01:34.704544 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:34.704508    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:01:34.797210 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:34.797181    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:01:35.359914 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:35.359881    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:01:35.633574 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:35.633501    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:01:35.871036 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:35.870999    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:01:36.027765 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:36.027742    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:01:36.430651 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:36.430585    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:01:36.836675 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:36.836631    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:01:36.890801 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:36.890772    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:01:37.033136 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:37.033106    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:01:37.687075 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:37.687044    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:01:37.740865 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:37.740838    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:01:37.839237 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:37.839212    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:01:38.029312 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:38.029282    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:01:38.432375 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:38.432289    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:01:39.029202 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:39.029171    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:01:39.432880 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:39.432787    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:01:39.534010 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:39.533979    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:01:39.841909 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:39.841877    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:01:40.231017 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:40.230982    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:01:40.431513 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:40.431483    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:01:41.053827 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:41.053785    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:01:41.169372 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:41.169328    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:01:41.272385 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:41.272340    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7f6ea8d6-0900-4dde-8fd7-299e106bb611-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h8vpg\" (UID: \"7f6ea8d6-0900-4dde-8fd7-299e106bb611\") " pod="openshift-insights/insights-runtime-extractor-h8vpg"
Jul 20 19:01:41.274713 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:41.274692    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7f6ea8d6-0900-4dde-8fd7-299e106bb611-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h8vpg\" (UID: \"7f6ea8d6-0900-4dde-8fd7-299e106bb611\") " pod="openshift-insights/insights-runtime-extractor-h8vpg"
Jul 20 19:01:41.340800 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:41.340741    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-skgq8\""
Jul 20 19:01:41.349649 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:41.349628    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-h8vpg"
Jul 20 19:01:41.493914 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:41.493884    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-h8vpg"]
Jul 20 19:01:41.497085 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:01:41.497058    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f6ea8d6_0900_4dde_8fd7_299e106bb611.slice/crio-bd1a8e4d37da265310ea6b16027eada6f24348b3126b044831a2e31ab9e2508f WatchSource:0}: Error finding container bd1a8e4d37da265310ea6b16027eada6f24348b3126b044831a2e31ab9e2508f: Status 404 returned error can't find the container with id bd1a8e4d37da265310ea6b16027eada6f24348b3126b044831a2e31ab9e2508f
Jul 20 19:01:41.505286 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:41.505219    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:01:41.837879 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:41.837848    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:01:42.065008 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:42.064980    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:01:42.083257 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:42.083236    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5j2qh"
Jul 20 19:01:42.153543 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:42.153482    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h8vpg" event={"ID":"7f6ea8d6-0900-4dde-8fd7-299e106bb611","Type":"ContainerStarted","Data":"bd1a8e4d37da265310ea6b16027eada6f24348b3126b044831a2e31ab9e2508f"}
Jul 20 19:01:42.433159 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:42.433074    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:01:43.030540 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:43.030475    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:01:43.952368 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:43.952311    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:01:44.053518 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:44.053482    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:01:45.956628 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:45.956595    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:01:46.024819 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:46.024784    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:01:46.510388 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:46.510183    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/073c7302-c5d7-4bfc-87fa-993163c6fd01-metrics-certs\") pod \"network-metrics-daemon-cd24s\" (UID: \"073c7302-c5d7-4bfc-87fa-993163c6fd01\") " pod="openshift-multus/network-metrics-daemon-cd24s"
Jul 20 19:01:46.513216 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:46.513201    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 20 19:01:46.523377 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:46.523339    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/073c7302-c5d7-4bfc-87fa-993163c6fd01-metrics-certs\") pod \"network-metrics-daemon-cd24s\" (UID: \"073c7302-c5d7-4bfc-87fa-993163c6fd01\") " pod="openshift-multus/network-metrics-daemon-cd24s"
Jul 20 19:01:46.609164 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:46.609132    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-74mbs\""
Jul 20 19:01:46.611336 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:46.611318    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/08e8b8dd-1dde-4bb0-863b-1322d836d18c-original-pull-secret\") pod \"global-pull-secret-syncer-ng85c\" (UID: \"08e8b8dd-1dde-4bb0-863b-1322d836d18c\") " pod="kube-system/global-pull-secret-syncer-ng85c"
Jul 20 19:01:46.611413 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:46.611377    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5576p\" (UniqueName: \"kubernetes.io/projected/4cf9f593-d26c-43c1-a246-259d0b23f251-kube-api-access-5576p\") pod \"network-check-target-8r6m4\" (UID: \"4cf9f593-d26c-43c1-a246-259d0b23f251\") " pod="openshift-network-diagnostics/network-check-target-8r6m4"
Jul 20 19:01:46.613476 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:46.613454    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 20 19:01:46.613570 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:46.613512    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 20 19:01:46.617277 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:46.617262    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cd24s"
Jul 20 19:01:46.623997 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:46.623980    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 20 19:01:46.624262 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:46.624244    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/08e8b8dd-1dde-4bb0-863b-1322d836d18c-original-pull-secret\") pod \"global-pull-secret-syncer-ng85c\" (UID: \"08e8b8dd-1dde-4bb0-863b-1322d836d18c\") " pod="kube-system/global-pull-secret-syncer-ng85c"
Jul 20 19:01:46.634959 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:46.634941    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5576p\" (UniqueName: \"kubernetes.io/projected/4cf9f593-d26c-43c1-a246-259d0b23f251-kube-api-access-5576p\") pod \"network-check-target-8r6m4\" (UID: \"4cf9f593-d26c-43c1-a246-259d0b23f251\") " pod="openshift-network-diagnostics/network-check-target-8r6m4"
Jul 20 19:01:46.732495 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:46.732466    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-cd24s"]
Jul 20 19:01:46.735045 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:01:46.735025    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod073c7302_c5d7_4bfc_87fa_993163c6fd01.slice/crio-d9b4e5ac6db2c081f151ca096c626904b6b0843baafa43448db2a9a225906ed8 WatchSource:0}: Error finding container d9b4e5ac6db2c081f151ca096c626904b6b0843baafa43448db2a9a225906ed8: Status 404 returned error can't find the container with id d9b4e5ac6db2c081f151ca096c626904b6b0843baafa43448db2a9a225906ed8
Jul 20 19:01:46.901918 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:46.901862    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-s7pj6\""
Jul 20 19:01:46.910028 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:46.910013    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8r6m4"
Jul 20 19:01:46.911947 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:46.911932    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ng85c"
Jul 20 19:01:47.038579 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:47.038548    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8r6m4"]
Jul 20 19:01:47.041184 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:01:47.041155    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4cf9f593_d26c_43c1_a246_259d0b23f251.slice/crio-6952028fbac50f51c304f899ccd6cf0e49cf0e3908fc04f2d42236340c6e0b82 WatchSource:0}: Error finding container 6952028fbac50f51c304f899ccd6cf0e49cf0e3908fc04f2d42236340c6e0b82: Status 404 returned error can't find the container with id 6952028fbac50f51c304f899ccd6cf0e49cf0e3908fc04f2d42236340c6e0b82
Jul 20 19:01:47.054980 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:47.054955    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-ng85c"]
Jul 20 19:01:47.058827 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:01:47.058803    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08e8b8dd_1dde_4bb0_863b_1322d836d18c.slice/crio-1e15beb263782ffdc8a7e313b92d299014c6af64f7716b549334dd3328c6ab57 WatchSource:0}: Error finding container 1e15beb263782ffdc8a7e313b92d299014c6af64f7716b549334dd3328c6ab57: Status 404 returned error can't find the container with id 1e15beb263782ffdc8a7e313b92d299014c6af64f7716b549334dd3328c6ab57
Jul 20 19:01:47.168472 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:47.168390    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-ng85c" event={"ID":"08e8b8dd-1dde-4bb0-863b-1322d836d18c","Type":"ContainerStarted","Data":"1e15beb263782ffdc8a7e313b92d299014c6af64f7716b549334dd3328c6ab57"}
Jul 20 19:01:47.170094 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:47.170069    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h8vpg" event={"ID":"7f6ea8d6-0900-4dde-8fd7-299e106bb611","Type":"ContainerStarted","Data":"12401a2aabfb5212359e9f489b58b5bf4c1390f8ed8ae73f2708ec1e7d569067"}
Jul 20 19:01:47.171413 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:47.171384    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8r6m4" event={"ID":"4cf9f593-d26c-43c1-a246-259d0b23f251","Type":"ContainerStarted","Data":"6952028fbac50f51c304f899ccd6cf0e49cf0e3908fc04f2d42236340c6e0b82"}
Jul 20 19:01:47.172515 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:47.172490    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-cd24s" event={"ID":"073c7302-c5d7-4bfc-87fa-993163c6fd01","Type":"ContainerStarted","Data":"d9b4e5ac6db2c081f151ca096c626904b6b0843baafa43448db2a9a225906ed8"}
Jul 20 19:01:48.021937 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:48.021902    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/056c4b09-fdec-4f12-bcb2-e1fe989dec49-metrics-tls\") pod \"dns-default-f9znr\" (UID: \"056c4b09-fdec-4f12-bcb2-e1fe989dec49\") " pod="openshift-dns/dns-default-f9znr"
Jul 20 19:01:48.022227 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:48.021963    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ee2de18c-442c-479c-9fe1-1bf28182217f-registry-tls\") pod \"image-registry-55f89b56-jbvgr\" (UID: \"ee2de18c-442c-479c-9fe1-1bf28182217f\") " pod="openshift-image-registry/image-registry-55f89b56-jbvgr"
Jul 20 19:01:48.026281 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:48.026251    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/056c4b09-fdec-4f12-bcb2-e1fe989dec49-metrics-tls\") pod \"dns-default-f9znr\" (UID: \"056c4b09-fdec-4f12-bcb2-e1fe989dec49\") " pod="openshift-dns/dns-default-f9znr"
Jul 20 19:01:48.039256 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:48.039228    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ee2de18c-442c-479c-9fe1-1bf28182217f-registry-tls\") pod \"image-registry-55f89b56-jbvgr\" (UID: \"ee2de18c-442c-479c-9fe1-1bf28182217f\") " pod="openshift-image-registry/image-registry-55f89b56-jbvgr"
Jul 20 19:01:48.270084 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:48.270057    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-shkhq\""
Jul 20 19:01:48.277895 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:48.277807    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-f9znr"
Jul 20 19:01:48.282888 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:48.282863    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-kl4lh\""
Jul 20 19:01:48.291696 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:48.291441    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-55f89b56-jbvgr"
Jul 20 19:01:48.459460 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:48.459422    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-f9znr"]
Jul 20 19:01:48.464418 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:01:48.464378    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod056c4b09_fdec_4f12_bcb2_e1fe989dec49.slice/crio-7084ca1de28412c1843b8d9dfeee6b8e21073fdadc086a5b596f437534168a27 WatchSource:0}: Error finding container 7084ca1de28412c1843b8d9dfeee6b8e21073fdadc086a5b596f437534168a27: Status 404 returned error can't find the container with id 7084ca1de28412c1843b8d9dfeee6b8e21073fdadc086a5b596f437534168a27
Jul 20 19:01:48.480595 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:48.480500    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-55f89b56-jbvgr"]
Jul 20 19:01:48.483106 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:01:48.483079    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee2de18c_442c_479c_9fe1_1bf28182217f.slice/crio-b9cacd3f9da95e1a4285e59fc5c2a47d517a561e1b03732d9af7d9ad006339f9 WatchSource:0}: Error finding container b9cacd3f9da95e1a4285e59fc5c2a47d517a561e1b03732d9af7d9ad006339f9: Status 404 returned error can't find the container with id b9cacd3f9da95e1a4285e59fc5c2a47d517a561e1b03732d9af7d9ad006339f9
Jul 20 19:01:49.181967 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:49.181930    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-55f89b56-jbvgr" event={"ID":"ee2de18c-442c-479c-9fe1-1bf28182217f","Type":"ContainerStarted","Data":"c3b234110abd79c7b278380550f49517fa6f78a591c88c0d73417f5bc7908b90"}
Jul 20 19:01:49.182495 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:49.181995    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-55f89b56-jbvgr" event={"ID":"ee2de18c-442c-479c-9fe1-1bf28182217f","Type":"ContainerStarted","Data":"b9cacd3f9da95e1a4285e59fc5c2a47d517a561e1b03732d9af7d9ad006339f9"}
Jul 20 19:01:49.182495 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:49.182209    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-55f89b56-jbvgr"
Jul 20 19:01:49.185931 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:49.185449    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-cd24s" event={"ID":"073c7302-c5d7-4bfc-87fa-993163c6fd01","Type":"ContainerStarted","Data":"5d9b2f1f509916e13f22d78e1d57f2f1e92a20e5c1a501dcc4c1352b787a4b11"}
Jul 20 19:01:49.185931 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:49.185502    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-cd24s" event={"ID":"073c7302-c5d7-4bfc-87fa-993163c6fd01","Type":"ContainerStarted","Data":"90dac4de452cd74d944b9668a042fd2fcc5e9ed21c4396ff35dbe5ef9555d54d"}
Jul 20 19:01:49.187682 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:49.187612    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-f9znr" event={"ID":"056c4b09-fdec-4f12-bcb2-e1fe989dec49","Type":"ContainerStarted","Data":"7084ca1de28412c1843b8d9dfeee6b8e21073fdadc086a5b596f437534168a27"}
Jul 20 19:01:49.211114 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:49.211062    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-55f89b56-jbvgr" podStartSLOduration=51.211042695 podStartE2EDuration="51.211042695s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:00:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:01:49.208958059 +0000 UTC m=+68.892486075" watchObservedRunningTime="2026-07-20 19:01:49.211042695 +0000 UTC m=+68.894570718"
Jul 20 19:01:49.228261 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:49.228214    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-cd24s" podStartSLOduration=67.890941993 podStartE2EDuration="1m9.228197684s" totalImagesPullingTime="1.337255691s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:00:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:01:49.227263868 +0000 UTC m=+68.910791891" watchObservedRunningTime="2026-07-20 19:01:49.228197684 +0000 UTC m=+68.911725709"
Jul 20 19:01:53.294845 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:53.294767    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:01:53.494397 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:53.494363    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:01:53.723635 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:53.723571    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:01:54.207018 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:54.206912    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h8vpg" event={"ID":"7f6ea8d6-0900-4dde-8fd7-299e106bb611","Type":"ContainerStarted","Data":"0ae0808e25d8d91c90154c3ee9101c5106b7b743913a5340d01817075df1c02f"}
Jul 20 19:01:54.210065 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:54.209441    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8r6m4" event={"ID":"4cf9f593-d26c-43c1-a246-259d0b23f251","Type":"ContainerStarted","Data":"3cb65be660e7c5f5a30fb19bb592ad9fb29f2d3d9da51076838470c723611873"}
Jul 20 19:01:54.210065 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:54.210006    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-8r6m4"
Jul 20 19:01:54.212148 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:54.212125    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-f9znr" event={"ID":"056c4b09-fdec-4f12-bcb2-e1fe989dec49","Type":"ContainerStarted","Data":"4376ac024121573dd907ca7adc6eacbcb2db6f6b62ef300e268c7b3fb7a132c2"}
Jul 20 19:01:54.278839 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:54.278653    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-8r6m4" podStartSLOduration=66.217309362 podStartE2EDuration="1m13.278555063s" totalImagesPullingTime="7.061245701s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:00:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:01:54.250259084 +0000 UTC m=+73.933787107" watchObservedRunningTime="2026-07-20 19:01:54.278555063 +0000 UTC m=+73.962083090"
Jul 20 19:01:54.279331 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:54.279309    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7bb8d57dcd-x6fs6"]
Jul 20 19:01:54.282214 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:54.282191    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7bb8d57dcd-x6fs6"
Jul 20 19:01:54.283751 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:54.283714    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-ng85c" podStartSLOduration=66.269660592 podStartE2EDuration="1m13.28370184s" totalImagesPullingTime="7.014041248s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:00:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:01:54.282776554 +0000 UTC m=+73.966304577" watchObservedRunningTime="2026-07-20 19:01:54.28370184 +0000 UTC m=+73.967229858"
Jul 20 19:01:54.287453 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:54.287305    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 20 19:01:54.287577 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:54.287560    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 20 19:01:54.288790 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:54.288632    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 20 19:01:54.289297 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:54.289255    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 20 19:01:54.314687 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:54.314650    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7bb8d57dcd-x6fs6"]
Jul 20 19:01:54.315700 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:54.315604    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8fbdbcddb-nzl76"]
Jul 20 19:01:54.320639 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:54.320617    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8fbdbcddb-nzl76"
Jul 20 19:01:54.324746 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:54.324517    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 20 19:01:54.324746 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:54.324729    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-4b6bf\""
Jul 20 19:01:54.344965 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:54.344938    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8fbdbcddb-nzl76"]
Jul 20 19:01:54.373078 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:54.373053    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-55f89b56-jbvgr"]
Jul 20 19:01:54.373948 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:54.373924    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ddb870f4-49e7-4b52-9290-a99bb2bba147-tmp\") pod \"klusterlet-addon-workmgr-7bb8d57dcd-x6fs6\" (UID: \"ddb870f4-49e7-4b52-9290-a99bb2bba147\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7bb8d57dcd-x6fs6"
Jul 20 19:01:54.374067 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:54.373971    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ksnkt\" (UniqueName: \"kubernetes.io/projected/ddb870f4-49e7-4b52-9290-a99bb2bba147-kube-api-access-ksnkt\") pod \"klusterlet-addon-workmgr-7bb8d57dcd-x6fs6\" (UID: \"ddb870f4-49e7-4b52-9290-a99bb2bba147\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7bb8d57dcd-x6fs6"
Jul 20 19:01:54.374067 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:54.374039    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/ddb870f4-49e7-4b52-9290-a99bb2bba147-klusterlet-config\") pod \"klusterlet-addon-workmgr-7bb8d57dcd-x6fs6\" (UID: \"ddb870f4-49e7-4b52-9290-a99bb2bba147\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7bb8d57dcd-x6fs6"
Jul 20 19:01:54.374149 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:54.374090    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xq5n4\" (UniqueName: \"kubernetes.io/projected/1a8bca01-c7a6-475c-92cb-6cd14533bab6-kube-api-access-xq5n4\") pod \"managed-serviceaccount-addon-agent-8fbdbcddb-nzl76\" (UID: \"1a8bca01-c7a6-475c-92cb-6cd14533bab6\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8fbdbcddb-nzl76"
Jul 20 19:01:54.374149 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:54.374126    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1a8bca01-c7a6-475c-92cb-6cd14533bab6-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-8fbdbcddb-nzl76\" (UID: \"1a8bca01-c7a6-475c-92cb-6cd14533bab6\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8fbdbcddb-nzl76"
Jul 20 19:01:54.426981 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:54.426950    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:01:54.466326 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:54.466304    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5bc96949dd-d2ptw"]
Jul 20 19:01:54.468258 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:54.468243    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5bc96949dd-d2ptw"
Jul 20 19:01:54.474524 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:54.474501    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xq5n4\" (UniqueName: \"kubernetes.io/projected/1a8bca01-c7a6-475c-92cb-6cd14533bab6-kube-api-access-xq5n4\") pod \"managed-serviceaccount-addon-agent-8fbdbcddb-nzl76\" (UID: \"1a8bca01-c7a6-475c-92cb-6cd14533bab6\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8fbdbcddb-nzl76"
Jul 20 19:01:54.474630 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:54.474532    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1a8bca01-c7a6-475c-92cb-6cd14533bab6-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-8fbdbcddb-nzl76\" (UID: \"1a8bca01-c7a6-475c-92cb-6cd14533bab6\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8fbdbcddb-nzl76"
Jul 20 19:01:54.474630 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:54.474558    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ddb870f4-49e7-4b52-9290-a99bb2bba147-tmp\") pod \"klusterlet-addon-workmgr-7bb8d57dcd-x6fs6\" (UID: \"ddb870f4-49e7-4b52-9290-a99bb2bba147\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7bb8d57dcd-x6fs6"
Jul 20 19:01:54.474630 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:54.474622    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ksnkt\" (UniqueName: \"kubernetes.io/projected/ddb870f4-49e7-4b52-9290-a99bb2bba147-kube-api-access-ksnkt\") pod \"klusterlet-addon-workmgr-7bb8d57dcd-x6fs6\" (UID: \"ddb870f4-49e7-4b52-9290-a99bb2bba147\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7bb8d57dcd-x6fs6"
Jul 20 19:01:54.474787 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:54.474655    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/ddb870f4-49e7-4b52-9290-a99bb2bba147-klusterlet-config\") pod \"klusterlet-addon-workmgr-7bb8d57dcd-x6fs6\" (UID: \"ddb870f4-49e7-4b52-9290-a99bb2bba147\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7bb8d57dcd-x6fs6"
Jul 20 19:01:54.475005 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:54.474972    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ddb870f4-49e7-4b52-9290-a99bb2bba147-tmp\") pod \"klusterlet-addon-workmgr-7bb8d57dcd-x6fs6\" (UID: \"ddb870f4-49e7-4b52-9290-a99bb2bba147\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7bb8d57dcd-x6fs6"
Jul 20 19:01:54.477195 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:54.477174    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1a8bca01-c7a6-475c-92cb-6cd14533bab6-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-8fbdbcddb-nzl76\" (UID: \"1a8bca01-c7a6-475c-92cb-6cd14533bab6\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8fbdbcddb-nzl76"
Jul 20 19:01:54.477289 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:54.477223    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/ddb870f4-49e7-4b52-9290-a99bb2bba147-klusterlet-config\") pod \"klusterlet-addon-workmgr-7bb8d57dcd-x6fs6\" (UID: \"ddb870f4-49e7-4b52-9290-a99bb2bba147\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7bb8d57dcd-x6fs6"
Jul 20 19:01:54.491424 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:54.491404    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5bc96949dd-d2ptw"]
Jul 20 19:01:54.501730 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:54.501712    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ksnkt\" (UniqueName: \"kubernetes.io/projected/ddb870f4-49e7-4b52-9290-a99bb2bba147-kube-api-access-ksnkt\") pod \"klusterlet-addon-workmgr-7bb8d57dcd-x6fs6\" (UID: \"ddb870f4-49e7-4b52-9290-a99bb2bba147\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7bb8d57dcd-x6fs6"
Jul 20 19:01:54.501867 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:54.501852    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xq5n4\" (UniqueName: \"kubernetes.io/projected/1a8bca01-c7a6-475c-92cb-6cd14533bab6-kube-api-access-xq5n4\") pod \"managed-serviceaccount-addon-agent-8fbdbcddb-nzl76\" (UID: \"1a8bca01-c7a6-475c-92cb-6cd14533bab6\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8fbdbcddb-nzl76"
Jul 20 19:01:54.534984 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:54.534959    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:01:54.575417 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:54.575395    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/79a69811-c32f-42da-861d-cf144cc63105-registry-tls\") pod \"image-registry-5bc96949dd-d2ptw\" (UID: \"79a69811-c32f-42da-861d-cf144cc63105\") " pod="openshift-image-registry/image-registry-5bc96949dd-d2ptw"
Jul 20 19:01:54.575498 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:54.575420    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67dx5\" (UniqueName: \"kubernetes.io/projected/79a69811-c32f-42da-861d-cf144cc63105-kube-api-access-67dx5\") pod \"image-registry-5bc96949dd-d2ptw\" (UID: \"79a69811-c32f-42da-861d-cf144cc63105\") " pod="openshift-image-registry/image-registry-5bc96949dd-d2ptw"
Jul 20 19:01:54.575498 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:54.575438    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/79a69811-c32f-42da-861d-cf144cc63105-ca-trust-extracted\") pod \"image-registry-5bc96949dd-d2ptw\" (UID: \"79a69811-c32f-42da-861d-cf144cc63105\") " pod="openshift-image-registry/image-registry-5bc96949dd-d2ptw"
Jul 20 19:01:54.575498 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:54.575458    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/79a69811-c32f-42da-861d-cf144cc63105-installation-pull-secrets\") pod \"image-registry-5bc96949dd-d2ptw\" (UID: \"79a69811-c32f-42da-861d-cf144cc63105\") " pod="openshift-image-registry/image-registry-5bc96949dd-d2ptw"
Jul 20 19:01:54.575622 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:54.575541    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/79a69811-c32f-42da-861d-cf144cc63105-bound-sa-token\") pod \"image-registry-5bc96949dd-d2ptw\" (UID: \"79a69811-c32f-42da-861d-cf144cc63105\") " pod="openshift-image-registry/image-registry-5bc96949dd-d2ptw"
Jul 20 19:01:54.575622 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:54.575574    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/79a69811-c32f-42da-861d-cf144cc63105-image-registry-private-configuration\") pod \"image-registry-5bc96949dd-d2ptw\" (UID: \"79a69811-c32f-42da-861d-cf144cc63105\") " pod="openshift-image-registry/image-registry-5bc96949dd-d2ptw"
Jul 20 19:01:54.575622 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:54.575592    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/79a69811-c32f-42da-861d-cf144cc63105-trusted-ca\") pod \"image-registry-5bc96949dd-d2ptw\" (UID: \"79a69811-c32f-42da-861d-cf144cc63105\") " pod="openshift-image-registry/image-registry-5bc96949dd-d2ptw"
Jul 20 19:01:54.575622 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:54.575613    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/79a69811-c32f-42da-861d-cf144cc63105-registry-certificates\") pod \"image-registry-5bc96949dd-d2ptw\" (UID: \"79a69811-c32f-42da-861d-cf144cc63105\") " pod="openshift-image-registry/image-registry-5bc96949dd-d2ptw"
Jul 20 19:01:54.595487 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:54.595443    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7bb8d57dcd-x6fs6"
Jul 20 19:01:54.629633 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:54.629597    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:01:54.639704 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:54.639461    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8fbdbcddb-nzl76"
Jul 20 19:01:54.677007 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:54.676975    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/79a69811-c32f-42da-861d-cf144cc63105-registry-certificates\") pod \"image-registry-5bc96949dd-d2ptw\" (UID: \"79a69811-c32f-42da-861d-cf144cc63105\") " pod="openshift-image-registry/image-registry-5bc96949dd-d2ptw"
Jul 20 19:01:54.677140 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:54.677026    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/79a69811-c32f-42da-861d-cf144cc63105-registry-tls\") pod \"image-registry-5bc96949dd-d2ptw\" (UID: \"79a69811-c32f-42da-861d-cf144cc63105\") " pod="openshift-image-registry/image-registry-5bc96949dd-d2ptw"
Jul 20 19:01:54.677140 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:54.677096    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67dx5\" (UniqueName: \"kubernetes.io/projected/79a69811-c32f-42da-861d-cf144cc63105-kube-api-access-67dx5\") pod \"image-registry-5bc96949dd-d2ptw\" (UID: \"79a69811-c32f-42da-861d-cf144cc63105\") " pod="openshift-image-registry/image-registry-5bc96949dd-d2ptw"
Jul 20 19:01:54.677237 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:54.677147    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/79a69811-c32f-42da-861d-cf144cc63105-ca-trust-extracted\") pod \"image-registry-5bc96949dd-d2ptw\" (UID: \"79a69811-c32f-42da-861d-cf144cc63105\") " pod="openshift-image-registry/image-registry-5bc96949dd-d2ptw"
Jul 20 19:01:54.677717 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:54.677365    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/79a69811-c32f-42da-861d-cf144cc63105-installation-pull-secrets\") pod \"image-registry-5bc96949dd-d2ptw\" (UID: \"79a69811-c32f-42da-861d-cf144cc63105\") " pod="openshift-image-registry/image-registry-5bc96949dd-d2ptw"
Jul 20 19:01:54.677717 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:54.677439    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/79a69811-c32f-42da-861d-cf144cc63105-bound-sa-token\") pod \"image-registry-5bc96949dd-d2ptw\" (UID: \"79a69811-c32f-42da-861d-cf144cc63105\") " pod="openshift-image-registry/image-registry-5bc96949dd-d2ptw"
Jul 20 19:01:54.677717 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:54.677495    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/79a69811-c32f-42da-861d-cf144cc63105-image-registry-private-configuration\") pod \"image-registry-5bc96949dd-d2ptw\" (UID: \"79a69811-c32f-42da-861d-cf144cc63105\") " pod="openshift-image-registry/image-registry-5bc96949dd-d2ptw"
Jul 20 19:01:54.677717 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:54.677523    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/79a69811-c32f-42da-861d-cf144cc63105-trusted-ca\") pod \"image-registry-5bc96949dd-d2ptw\" (UID: \"79a69811-c32f-42da-861d-cf144cc63105\") " pod="openshift-image-registry/image-registry-5bc96949dd-d2ptw"
Jul 20 19:01:54.677717 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:54.677610    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/79a69811-c32f-42da-861d-cf144cc63105-ca-trust-extracted\") pod \"image-registry-5bc96949dd-d2ptw\" (UID: \"79a69811-c32f-42da-861d-cf144cc63105\") " pod="openshift-image-registry/image-registry-5bc96949dd-d2ptw"
Jul 20 19:01:54.678461 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:54.678324    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/79a69811-c32f-42da-861d-cf144cc63105-registry-certificates\") pod \"image-registry-5bc96949dd-d2ptw\" (UID: \"79a69811-c32f-42da-861d-cf144cc63105\") " pod="openshift-image-registry/image-registry-5bc96949dd-d2ptw"
Jul 20 19:01:54.678958 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:54.678935    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/79a69811-c32f-42da-861d-cf144cc63105-trusted-ca\") pod \"image-registry-5bc96949dd-d2ptw\" (UID: \"79a69811-c32f-42da-861d-cf144cc63105\") " pod="openshift-image-registry/image-registry-5bc96949dd-d2ptw"
Jul 20 19:01:54.680485 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:54.680460    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/79a69811-c32f-42da-861d-cf144cc63105-image-registry-private-configuration\") pod \"image-registry-5bc96949dd-d2ptw\" (UID: \"79a69811-c32f-42da-861d-cf144cc63105\") " pod="openshift-image-registry/image-registry-5bc96949dd-d2ptw"
Jul 20 19:01:54.680700 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:54.680680    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/79a69811-c32f-42da-861d-cf144cc63105-registry-tls\") pod \"image-registry-5bc96949dd-d2ptw\" (UID: \"79a69811-c32f-42da-861d-cf144cc63105\") " pod="openshift-image-registry/image-registry-5bc96949dd-d2ptw"
Jul 20 19:01:54.680938 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:54.680914    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/79a69811-c32f-42da-861d-cf144cc63105-installation-pull-secrets\") pod \"image-registry-5bc96949dd-d2ptw\" (UID: \"79a69811-c32f-42da-861d-cf144cc63105\") " pod="openshift-image-registry/image-registry-5bc96949dd-d2ptw"
Jul 20 19:01:54.693176 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:54.692742    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-67dx5\" (UniqueName: \"kubernetes.io/projected/79a69811-c32f-42da-861d-cf144cc63105-kube-api-access-67dx5\") pod \"image-registry-5bc96949dd-d2ptw\" (UID: \"79a69811-c32f-42da-861d-cf144cc63105\") " pod="openshift-image-registry/image-registry-5bc96949dd-d2ptw"
Jul 20 19:01:54.693868 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:54.693810    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/79a69811-c32f-42da-861d-cf144cc63105-bound-sa-token\") pod \"image-registry-5bc96949dd-d2ptw\" (UID: \"79a69811-c32f-42da-861d-cf144cc63105\") " pod="openshift-image-registry/image-registry-5bc96949dd-d2ptw"
Jul 20 19:01:54.731255 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:54.731226    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7bb8d57dcd-x6fs6"]
Jul 20 19:01:54.734853 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:01:54.734830    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podddb870f4_49e7_4b52_9290_a99bb2bba147.slice/crio-52b98db87a64c733ff75924d3cc0b8f99371345e3ff945da03e9428b2f4aef66 WatchSource:0}: Error finding container 52b98db87a64c733ff75924d3cc0b8f99371345e3ff945da03e9428b2f4aef66: Status 404 returned error can't find the container with id 52b98db87a64c733ff75924d3cc0b8f99371345e3ff945da03e9428b2f4aef66
Jul 20 19:01:54.774241 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:54.774218    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8fbdbcddb-nzl76"]
Jul 20 19:01:54.776372 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:54.776335    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5bc96949dd-d2ptw"
Jul 20 19:01:54.777215 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:01:54.777193    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1a8bca01_c7a6_475c_92cb_6cd14533bab6.slice/crio-e97e98e213129445468f508d315ca4a87daa3a161522cad6925a7819fb9ef7a5 WatchSource:0}: Error finding container e97e98e213129445468f508d315ca4a87daa3a161522cad6925a7819fb9ef7a5: Status 404 returned error can't find the container with id e97e98e213129445468f508d315ca4a87daa3a161522cad6925a7819fb9ef7a5
Jul 20 19:01:54.911656 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:54.911630    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5bc96949dd-d2ptw"]
Jul 20 19:01:54.914761 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:01:54.914738    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79a69811_c32f_42da_861d_cf144cc63105.slice/crio-e5d8a4d8154f852d8a4e116c16e4e6ecfedcaa8cfaf675007e23f954294baf7a WatchSource:0}: Error finding container e5d8a4d8154f852d8a4e116c16e4e6ecfedcaa8cfaf675007e23f954294baf7a: Status 404 returned error can't find the container with id e5d8a4d8154f852d8a4e116c16e4e6ecfedcaa8cfaf675007e23f954294baf7a
Jul 20 19:01:55.037536 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:55.037501    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:01:55.137843 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:55.137724    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:01:55.192397 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:55.192340    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:01:55.222260 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:55.222223    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5bc96949dd-d2ptw" event={"ID":"79a69811-c32f-42da-861d-cf144cc63105","Type":"ContainerStarted","Data":"eaafb07c9518f73d273c989f02c2d4c079b188d742844cca691b821d70dcd2f1"}
Jul 20 19:01:55.222434 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:55.222327    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5bc96949dd-d2ptw" event={"ID":"79a69811-c32f-42da-861d-cf144cc63105","Type":"ContainerStarted","Data":"e5d8a4d8154f852d8a4e116c16e4e6ecfedcaa8cfaf675007e23f954294baf7a"}
Jul 20 19:01:55.222669 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:55.222652    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5bc96949dd-d2ptw"
Jul 20 19:01:55.224649 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:55.224615    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-f9znr" event={"ID":"056c4b09-fdec-4f12-bcb2-e1fe989dec49","Type":"ContainerStarted","Data":"41556e73e08724c00905d4f40eabb6764a8aecb96fa17d60ec24976947ca67f7"}
Jul 20 19:01:55.224777 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:55.224674    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-f9znr"
Jul 20 19:01:55.226055 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:55.226031    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-ng85c" event={"ID":"08e8b8dd-1dde-4bb0-863b-1322d836d18c","Type":"ContainerStarted","Data":"58e01588e54dff99ec4b980d7b4d9e87d3be43af73566032d80f890ebe631777"}
Jul 20 19:01:55.227257 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:55.227223    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8fbdbcddb-nzl76" event={"ID":"1a8bca01-c7a6-475c-92cb-6cd14533bab6","Type":"ContainerStarted","Data":"e97e98e213129445468f508d315ca4a87daa3a161522cad6925a7819fb9ef7a5"}
Jul 20 19:01:55.228533 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:55.228511    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7bb8d57dcd-x6fs6" event={"ID":"ddb870f4-49e7-4b52-9290-a99bb2bba147","Type":"ContainerStarted","Data":"52b98db87a64c733ff75924d3cc0b8f99371345e3ff945da03e9428b2f4aef66"}
Jul 20 19:01:55.244918 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:55.244875    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5bc96949dd-d2ptw" podStartSLOduration=1.244858512 podStartE2EDuration="1.244858512s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:01:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:01:55.243329305 +0000 UTC m=+74.926857327" watchObservedRunningTime="2026-07-20 19:01:55.244858512 +0000 UTC m=+74.928386534"
Jul 20 19:01:55.262107 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:55.262053    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-f9znr" podStartSLOduration=33.614205788 podStartE2EDuration="39.262037626s" totalImagesPullingTime="5.647831838s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:01:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:01:55.261371078 +0000 UTC m=+74.944899102" watchObservedRunningTime="2026-07-20 19:01:55.262037626 +0000 UTC m=+74.945565648"
Jul 20 19:01:55.539008 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:55.538969    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:01:55.763268 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:55.763188    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:01:55.965876 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:55.965843    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:01:56.023591 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:56.023543    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:01:56.168955 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:56.168922    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:01:56.240883 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:56.240806    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:01:56.592335 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:56.592254    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:01:59.492501 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:59.492468    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:01:59.563421 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:59.563381    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:01:59.615852 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:01:59.615815    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:02:01.254732 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:01.254693    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h8vpg" event={"ID":"7f6ea8d6-0900-4dde-8fd7-299e106bb611","Type":"ContainerStarted","Data":"cdce105b862d9b11b6d7c500d8b016205c537aa870b4241c6164285e42f9a766"}
Jul 20 19:02:01.256206 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:01.256183    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7bb8d57dcd-x6fs6" event={"ID":"ddb870f4-49e7-4b52-9290-a99bb2bba147","Type":"ContainerStarted","Data":"e19baf6f674f54add342ca14a0edcbf65df0d4afcda2bb4dc89a56cdb253ef69"}
Jul 20 19:02:01.256329 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:01.256310    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7bb8d57dcd-x6fs6"
Jul 20 19:02:01.257753 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:01.257725    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8fbdbcddb-nzl76" event={"ID":"1a8bca01-c7a6-475c-92cb-6cd14533bab6","Type":"ContainerStarted","Data":"7213b1bbce485a747a49e960a3ff8f9ceb20a20d75ae84eb7f656569b044033a"}
Jul 20 19:02:01.258051 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:01.258036    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7bb8d57dcd-x6fs6"
Jul 20 19:02:01.272609 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:01.272574    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-h8vpg" podStartSLOduration=17.204401757 podStartE2EDuration="36.272562766s" totalImagesPullingTime="19.068161009s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:01:25 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:02:01.271206918 +0000 UTC m=+80.954734951" watchObservedRunningTime="2026-07-20 19:02:01.272562766 +0000 UTC m=+80.956090787"
Jul 20 19:02:01.285858 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:01.285820    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8fbdbcddb-nzl76" podStartSLOduration=1.35542951 podStartE2EDuration="7.28580674s" totalImagesPullingTime="5.93037723s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:01:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:02:01.284877339 +0000 UTC m=+80.968405363" watchObservedRunningTime="2026-07-20 19:02:01.28580674 +0000 UTC m=+80.969334740"
Jul 20 19:02:01.300033 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:01.299984    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7bb8d57dcd-x6fs6" podStartSLOduration=1.308044681 podStartE2EDuration="7.299971123s" totalImagesPullingTime="5.991926442s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:01:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:02:01.299539356 +0000 UTC m=+80.983067378" watchObservedRunningTime="2026-07-20 19:02:01.299971123 +0000 UTC m=+80.983499146"
Jul 20 19:02:01.773748 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:01.773715    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:02:03.643206 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:03.643170    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:02:03.857255 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:03.857221    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:02:04.003588 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:04.003559    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-q6s9t"]
Jul 20 19:02:04.006679 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:04.006657    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-q6s9t"
Jul 20 19:02:04.010313 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:04.010285    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 20 19:02:04.010594 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:04.010578    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 20 19:02:04.011447 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:04.011428    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 20 19:02:04.011750 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:04.011731    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 20 19:02:04.012456 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:04.012435    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 20 19:02:04.012558 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:04.012518    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-9chdd\""
Jul 20 19:02:04.012632 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:04.012571    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 20 19:02:04.055269 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:04.055248    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/92f211d1-b875-45d0-8f3f-d28d298b97e7-root\") pod \"node-exporter-q6s9t\" (UID: \"92f211d1-b875-45d0-8f3f-d28d298b97e7\") " pod="openshift-monitoring/node-exporter-q6s9t"
Jul 20 19:02:04.055379 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:04.055275    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/92f211d1-b875-45d0-8f3f-d28d298b97e7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-q6s9t\" (UID: \"92f211d1-b875-45d0-8f3f-d28d298b97e7\") " pod="openshift-monitoring/node-exporter-q6s9t"
Jul 20 19:02:04.055379 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:04.055295    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/92f211d1-b875-45d0-8f3f-d28d298b97e7-node-exporter-tls\") pod \"node-exporter-q6s9t\" (UID: \"92f211d1-b875-45d0-8f3f-d28d298b97e7\") " pod="openshift-monitoring/node-exporter-q6s9t"
Jul 20 19:02:04.055379 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:04.055309    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/92f211d1-b875-45d0-8f3f-d28d298b97e7-metrics-client-ca\") pod \"node-exporter-q6s9t\" (UID: \"92f211d1-b875-45d0-8f3f-d28d298b97e7\") " pod="openshift-monitoring/node-exporter-q6s9t"
Jul 20 19:02:04.055379 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:04.055324    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/92f211d1-b875-45d0-8f3f-d28d298b97e7-node-exporter-wtmp\") pod \"node-exporter-q6s9t\" (UID: \"92f211d1-b875-45d0-8f3f-d28d298b97e7\") " pod="openshift-monitoring/node-exporter-q6s9t"
Jul 20 19:02:04.055379 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:04.055344    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/92f211d1-b875-45d0-8f3f-d28d298b97e7-sys\") pod \"node-exporter-q6s9t\" (UID: \"92f211d1-b875-45d0-8f3f-d28d298b97e7\") " pod="openshift-monitoring/node-exporter-q6s9t"
Jul 20 19:02:04.055549 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:04.055394    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ms5hp\" (UniqueName: \"kubernetes.io/projected/92f211d1-b875-45d0-8f3f-d28d298b97e7-kube-api-access-ms5hp\") pod \"node-exporter-q6s9t\" (UID: \"92f211d1-b875-45d0-8f3f-d28d298b97e7\") " pod="openshift-monitoring/node-exporter-q6s9t"
Jul 20 19:02:04.055549 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:04.055474    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/92f211d1-b875-45d0-8f3f-d28d298b97e7-node-exporter-textfile\") pod \"node-exporter-q6s9t\" (UID: \"92f211d1-b875-45d0-8f3f-d28d298b97e7\") " pod="openshift-monitoring/node-exporter-q6s9t"
Jul 20 19:02:04.055549 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:04.055499    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/92f211d1-b875-45d0-8f3f-d28d298b97e7-node-exporter-accelerators-collector-config\") pod \"node-exporter-q6s9t\" (UID: \"92f211d1-b875-45d0-8f3f-d28d298b97e7\") " pod="openshift-monitoring/node-exporter-q6s9t"
Jul 20 19:02:04.101477 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:04.101456    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:02:04.155962 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:04.155940    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/92f211d1-b875-45d0-8f3f-d28d298b97e7-node-exporter-tls\") pod \"node-exporter-q6s9t\" (UID: \"92f211d1-b875-45d0-8f3f-d28d298b97e7\") " pod="openshift-monitoring/node-exporter-q6s9t"
Jul 20 19:02:04.156062 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:04.155967    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/92f211d1-b875-45d0-8f3f-d28d298b97e7-metrics-client-ca\") pod \"node-exporter-q6s9t\" (UID: \"92f211d1-b875-45d0-8f3f-d28d298b97e7\") " pod="openshift-monitoring/node-exporter-q6s9t"
Jul 20 19:02:04.156062 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:04.155987    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/92f211d1-b875-45d0-8f3f-d28d298b97e7-node-exporter-wtmp\") pod \"node-exporter-q6s9t\" (UID: \"92f211d1-b875-45d0-8f3f-d28d298b97e7\") " pod="openshift-monitoring/node-exporter-q6s9t"
Jul 20 19:02:04.156062 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:04.156005    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/92f211d1-b875-45d0-8f3f-d28d298b97e7-sys\") pod \"node-exporter-q6s9t\" (UID: \"92f211d1-b875-45d0-8f3f-d28d298b97e7\") " pod="openshift-monitoring/node-exporter-q6s9t"
Jul 20 19:02:04.156062 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:04.156025    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ms5hp\" (UniqueName: \"kubernetes.io/projected/92f211d1-b875-45d0-8f3f-d28d298b97e7-kube-api-access-ms5hp\") pod \"node-exporter-q6s9t\" (UID: \"92f211d1-b875-45d0-8f3f-d28d298b97e7\") " pod="openshift-monitoring/node-exporter-q6s9t"
Jul 20 19:02:04.156258 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:04.156054    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/92f211d1-b875-45d0-8f3f-d28d298b97e7-node-exporter-textfile\") pod \"node-exporter-q6s9t\" (UID: \"92f211d1-b875-45d0-8f3f-d28d298b97e7\") " pod="openshift-monitoring/node-exporter-q6s9t"
Jul 20 19:02:04.156258 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:04.156108    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/92f211d1-b875-45d0-8f3f-d28d298b97e7-node-exporter-accelerators-collector-config\") pod \"node-exporter-q6s9t\" (UID: \"92f211d1-b875-45d0-8f3f-d28d298b97e7\") " pod="openshift-monitoring/node-exporter-q6s9t"
Jul 20 19:02:04.156258 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:04.156110    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/92f211d1-b875-45d0-8f3f-d28d298b97e7-sys\") pod \"node-exporter-q6s9t\" (UID: \"92f211d1-b875-45d0-8f3f-d28d298b97e7\") " pod="openshift-monitoring/node-exporter-q6s9t"
Jul 20 19:02:04.156258 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:04.156160    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/92f211d1-b875-45d0-8f3f-d28d298b97e7-node-exporter-wtmp\") pod \"node-exporter-q6s9t\" (UID: \"92f211d1-b875-45d0-8f3f-d28d298b97e7\") " pod="openshift-monitoring/node-exporter-q6s9t"
Jul 20 19:02:04.156258 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:04.156164    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/92f211d1-b875-45d0-8f3f-d28d298b97e7-root\") pod \"node-exporter-q6s9t\" (UID: \"92f211d1-b875-45d0-8f3f-d28d298b97e7\") " pod="openshift-monitoring/node-exporter-q6s9t"
Jul 20 19:02:04.156258 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:04.156191    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/92f211d1-b875-45d0-8f3f-d28d298b97e7-root\") pod \"node-exporter-q6s9t\" (UID: \"92f211d1-b875-45d0-8f3f-d28d298b97e7\") " pod="openshift-monitoring/node-exporter-q6s9t"
Jul 20 19:02:04.156258 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:04.156221    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/92f211d1-b875-45d0-8f3f-d28d298b97e7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-q6s9t\" (UID: \"92f211d1-b875-45d0-8f3f-d28d298b97e7\") " pod="openshift-monitoring/node-exporter-q6s9t"
Jul 20 19:02:04.156605 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:04.156520    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/92f211d1-b875-45d0-8f3f-d28d298b97e7-node-exporter-textfile\") pod \"node-exporter-q6s9t\" (UID: \"92f211d1-b875-45d0-8f3f-d28d298b97e7\") " pod="openshift-monitoring/node-exporter-q6s9t"
Jul 20 19:02:04.156656 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:04.156643    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/92f211d1-b875-45d0-8f3f-d28d298b97e7-metrics-client-ca\") pod \"node-exporter-q6s9t\" (UID: \"92f211d1-b875-45d0-8f3f-d28d298b97e7\") " pod="openshift-monitoring/node-exporter-q6s9t"
Jul 20 19:02:04.156750 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:04.156724    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/92f211d1-b875-45d0-8f3f-d28d298b97e7-node-exporter-accelerators-collector-config\") pod \"node-exporter-q6s9t\" (UID: \"92f211d1-b875-45d0-8f3f-d28d298b97e7\") " pod="openshift-monitoring/node-exporter-q6s9t"
Jul 20 19:02:04.158565 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:04.158547    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/92f211d1-b875-45d0-8f3f-d28d298b97e7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-q6s9t\" (UID: \"92f211d1-b875-45d0-8f3f-d28d298b97e7\") " pod="openshift-monitoring/node-exporter-q6s9t"
Jul 20 19:02:04.158761 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:04.158745    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/92f211d1-b875-45d0-8f3f-d28d298b97e7-node-exporter-tls\") pod \"node-exporter-q6s9t\" (UID: \"92f211d1-b875-45d0-8f3f-d28d298b97e7\") " pod="openshift-monitoring/node-exporter-q6s9t"
Jul 20 19:02:04.164608 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:04.164589    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ms5hp\" (UniqueName: \"kubernetes.io/projected/92f211d1-b875-45d0-8f3f-d28d298b97e7-kube-api-access-ms5hp\") pod \"node-exporter-q6s9t\" (UID: \"92f211d1-b875-45d0-8f3f-d28d298b97e7\") " pod="openshift-monitoring/node-exporter-q6s9t"
Jul 20 19:02:04.196756 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:04.196729    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:02:04.315899 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:04.315839    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-q6s9t"
Jul 20 19:02:04.325566 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:02:04.325542    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92f211d1_b875_45d0_8f3f_d28d298b97e7.slice/crio-d15a1e6b6d8955035e3e6cfe79c667870e142c5a8d160ad3936ebae860e0688d WatchSource:0}: Error finding container d15a1e6b6d8955035e3e6cfe79c667870e142c5a8d160ad3936ebae860e0688d: Status 404 returned error can't find the container with id d15a1e6b6d8955035e3e6cfe79c667870e142c5a8d160ad3936ebae860e0688d
Jul 20 19:02:04.379026 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:04.378989    2563 patch_prober.go:28] interesting pod/image-registry-55f89b56-jbvgr container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 20 19:02:04.379116 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:04.379053    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-55f89b56-jbvgr" podUID="ee2de18c-442c-479c-9fe1-1bf28182217f" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 20 19:02:04.640613 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:04.640535    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:02:04.747337 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:04.747304    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:02:04.845939 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:04.845906    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:02:04.937488 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:04.937407    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 20 19:02:04.939686 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:04.939660    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:02:04.940505 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:04.940481    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 20 19:02:04.943229 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:04.943207    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 20 19:02:04.943521 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:04.943493    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 20 19:02:04.943737 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:04.943503    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 20 19:02:04.943737 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:04.943731    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 20 19:02:04.943893 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:04.943572    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 20 19:02:04.943893 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:04.943791    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 20 19:02:04.943893 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:04.943601    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-x4f8g\""
Jul 20 19:02:04.943893 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:04.943614    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 20 19:02:04.944219 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:04.944093    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 20 19:02:04.944219 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:04.944170    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 20 19:02:04.958133 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:04.958113    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 20 19:02:05.047759 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:05.047713    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:02:05.062864 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:05.062800    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9jrgb\" (UniqueName: \"kubernetes.io/projected/d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb-kube-api-access-9jrgb\") pod \"alertmanager-main-0\" (UID: \"d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 19:02:05.062864 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:05.062845    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 19:02:05.062864 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:05.062868    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 19:02:05.063198 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:05.062927    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 19:02:05.063198 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:05.062978    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 19:02:05.063198 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:05.063029    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb-web-config\") pod \"alertmanager-main-0\" (UID: \"d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 19:02:05.063198 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:05.063079    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 19:02:05.063198 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:05.063113    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 19:02:05.063198 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:05.063140    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 19:02:05.063198 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:05.063160    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb-config-volume\") pod \"alertmanager-main-0\" (UID: \"d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 19:02:05.063198 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:05.063180    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb-config-out\") pod \"alertmanager-main-0\" (UID: \"d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 19:02:05.063641 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:05.063228    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 19:02:05.063641 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:05.063274    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 19:02:05.164471 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:05.164440    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 19:02:05.164471 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:05.164472    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 19:02:05.164691 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:05.164497    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb-config-volume\") pod \"alertmanager-main-0\" (UID: \"d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 19:02:05.164691 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:05.164528    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb-config-out\") pod \"alertmanager-main-0\" (UID: \"d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 19:02:05.164691 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:05.164556    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 19:02:05.164691 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:05.164584    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 19:02:05.164691 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:05.164604    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9jrgb\" (UniqueName: \"kubernetes.io/projected/d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb-kube-api-access-9jrgb\") pod \"alertmanager-main-0\" (UID: \"d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 19:02:05.164691 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:05.164632    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 19:02:05.164691 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:05.164654    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 19:02:05.165017 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:05.164697    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 19:02:05.165017 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:05.164725    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 19:02:05.165017 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:05.164777    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb-web-config\") pod \"alertmanager-main-0\" (UID: \"d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 19:02:05.165017 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:05.164821    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 19:02:05.165951 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:05.165623    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 19:02:05.165951 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:05.165700    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 19:02:05.166127 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:05.165988    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 19:02:05.168251 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:05.168228    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb-config-volume\") pod \"alertmanager-main-0\" (UID: \"d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 19:02:05.168949 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:05.168846    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 19:02:05.168949 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:05.168854    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb-web-config\") pod \"alertmanager-main-0\" (UID: \"d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 19:02:05.168949 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:05.168872    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 19:02:05.169134 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:05.169020    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 19:02:05.169584 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:05.169511    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 19:02:05.169761 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:05.169743    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 19:02:05.169897 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:05.169861    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 19:02:05.170193 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:05.170173    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb-config-out\") pod \"alertmanager-main-0\" (UID: \"d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 19:02:05.173993 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:05.173974    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jrgb\" (UniqueName: \"kubernetes.io/projected/d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb-kube-api-access-9jrgb\") pod \"alertmanager-main-0\" (UID: \"d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 19:02:05.238065 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:05.238041    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-f9znr"
Jul 20 19:02:05.252012 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:05.251806    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 20 19:02:05.276375 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:05.275955    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-q6s9t" event={"ID":"92f211d1-b875-45d0-8f3f-d28d298b97e7","Type":"ContainerStarted","Data":"d15a1e6b6d8955035e3e6cfe79c667870e142c5a8d160ad3936ebae860e0688d"}
Jul 20 19:02:05.469852 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:05.469812    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 20 19:02:05.473052 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:02:05.473020    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4ffac01_2bd8_4729_9f5d_d2cb7c3844cb.slice/crio-9f2a183b32b6d83cb681126db685c4ef90a0f5a539383afb28fe8c29d5ad71c8 WatchSource:0}: Error finding container 9f2a183b32b6d83cb681126db685c4ef90a0f5a539383afb28fe8c29d5ad71c8: Status 404 returned error can't find the container with id 9f2a183b32b6d83cb681126db685c4ef90a0f5a539383afb28fe8c29d5ad71c8
Jul 20 19:02:05.820715 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:05.820630    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:02:05.915452 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:05.915422    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:02:06.280494 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:06.280455    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb","Type":"ContainerStarted","Data":"9f2a183b32b6d83cb681126db685c4ef90a0f5a539383afb28fe8c29d5ad71c8"}
Jul 20 19:02:06.281902 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:06.281876    2563 generic.go:356] "Generic (PLEG): container finished" podID="92f211d1-b875-45d0-8f3f-d28d298b97e7" containerID="f5e9c8b11e8b5dd88d622fbf0a7eabe70821196703c32e1152272bd82dfdeb3a" exitCode=0
Jul 20 19:02:06.281995 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:06.281933    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-q6s9t" event={"ID":"92f211d1-b875-45d0-8f3f-d28d298b97e7","Type":"ContainerDied","Data":"f5e9c8b11e8b5dd88d622fbf0a7eabe70821196703c32e1152272bd82dfdeb3a"}
Jul 20 19:02:06.830588 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:06.830553    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:02:06.946243 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:06.946205    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:02:07.123245 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:07.123157    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:02:07.223611 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:07.223586    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:02:07.287174 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:07.287132    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-q6s9t" event={"ID":"92f211d1-b875-45d0-8f3f-d28d298b97e7","Type":"ContainerStarted","Data":"aa1a2033a386d311c51ee13c21962baaa11b4fbabc1bbdc27f9cfdb796a36e60"}
Jul 20 19:02:07.287366 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:07.287193    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-q6s9t" event={"ID":"92f211d1-b875-45d0-8f3f-d28d298b97e7","Type":"ContainerStarted","Data":"088ab0121b40ebea38210a5a5fbf66357f41231643c675ea48fefa4b9b782f81"}
Jul 20 19:02:07.288641 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:07.288615    2563 generic.go:356] "Generic (PLEG): container finished" podID="d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb" containerID="d59f1f0fd41ae8c60d6bf8bde8aeca6324760b28c004eaafa3302b08469d3a37" exitCode=0
Jul 20 19:02:07.288718 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:07.288686    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb","Type":"ContainerDied","Data":"d59f1f0fd41ae8c60d6bf8bde8aeca6324760b28c004eaafa3302b08469d3a37"}
Jul 20 19:02:07.307822 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:07.307783    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-q6s9t" podStartSLOduration=3.199797438 podStartE2EDuration="4.307770938s" totalImagesPullingTime="1.030630857s" totalInitContainerRuntime="77.342643ms" isStatefulPod=true podCreationTimestamp="2026-07-20 19:02:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:02:07.306161865 +0000 UTC m=+86.989689889" watchObservedRunningTime="2026-07-20 19:02:07.307770938 +0000 UTC m=+86.991298995"
Jul 20 19:02:08.381269 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:08.381236    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:02:08.482053 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:08.482018    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:02:08.654986 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:08.654911    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:02:08.666138 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:08.666109    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-pqzvv"]
Jul 20 19:02:08.668365 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:08.668324    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-pqzvv"
Jul 20 19:02:08.670598 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:08.670572    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 20 19:02:08.670934 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:08.670908    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-rl5gf\""
Jul 20 19:02:08.677267 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:08.677244    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-pqzvv"]
Jul 20 19:02:08.752370 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:08.752331    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:02:08.791991 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:08.791960    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtbg9\" (UniqueName: \"kubernetes.io/projected/318006fd-48dd-4a24-9f66-2a6c0e958177-kube-api-access-jtbg9\") pod \"monitoring-plugin-7b7b7bc8bf-pqzvv\" (UID: \"318006fd-48dd-4a24-9f66-2a6c0e958177\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-pqzvv"
Jul 20 19:02:08.792136 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:08.792013    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/318006fd-48dd-4a24-9f66-2a6c0e958177-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-pqzvv\" (UID: \"318006fd-48dd-4a24-9f66-2a6c0e958177\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-pqzvv"
Jul 20 19:02:08.893280 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:08.893253    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtbg9\" (UniqueName: \"kubernetes.io/projected/318006fd-48dd-4a24-9f66-2a6c0e958177-kube-api-access-jtbg9\") pod \"monitoring-plugin-7b7b7bc8bf-pqzvv\" (UID: \"318006fd-48dd-4a24-9f66-2a6c0e958177\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-pqzvv"
Jul 20 19:02:08.893445 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:08.893304    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/318006fd-48dd-4a24-9f66-2a6c0e958177-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-pqzvv\" (UID: \"318006fd-48dd-4a24-9f66-2a6c0e958177\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-pqzvv"
Jul 20 19:02:08.893445 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:02:08.893429    2563 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Jul 20 19:02:08.893521 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:02:08.893490    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/318006fd-48dd-4a24-9f66-2a6c0e958177-monitoring-plugin-cert podName:318006fd-48dd-4a24-9f66-2a6c0e958177 nodeName:}" failed. No retries permitted until 2026-07-20 19:02:09.393471489 +0000 UTC m=+89.076999489 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/318006fd-48dd-4a24-9f66-2a6c0e958177-monitoring-plugin-cert") pod "monitoring-plugin-7b7b7bc8bf-pqzvv" (UID: "318006fd-48dd-4a24-9f66-2a6c0e958177") : secret "monitoring-plugin-cert" not found
Jul 20 19:02:08.903933 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:08.903904    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtbg9\" (UniqueName: \"kubernetes.io/projected/318006fd-48dd-4a24-9f66-2a6c0e958177-kube-api-access-jtbg9\") pod \"monitoring-plugin-7b7b7bc8bf-pqzvv\" (UID: \"318006fd-48dd-4a24-9f66-2a6c0e958177\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-pqzvv"
Jul 20 19:02:09.161902 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:09.161870    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-84c9498bf-x4bg2"]
Jul 20 19:02:09.164887 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:09.164857    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-84c9498bf-x4bg2"
Jul 20 19:02:09.167627 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:09.167601    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 20 19:02:09.167764 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:09.167637    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 20 19:02:09.167897 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:09.167876    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 20 19:02:09.168017 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:09.167998    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-gbzgw\""
Jul 20 19:02:09.168128 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:09.168110    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 20 19:02:09.168292 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:09.168267    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 20 19:02:09.175339 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:09.175321    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 20 19:02:09.188694 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:09.188672    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-84c9498bf-x4bg2"]
Jul 20 19:02:09.296206 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:09.296174    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96d1d05c-dd89-409f-b46d-08af47201282-serving-certs-ca-bundle\") pod \"telemeter-client-84c9498bf-x4bg2\" (UID: \"96d1d05c-dd89-409f-b46d-08af47201282\") " pod="openshift-monitoring/telemeter-client-84c9498bf-x4bg2"
Jul 20 19:02:09.296206 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:09.296210    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/96d1d05c-dd89-409f-b46d-08af47201282-metrics-client-ca\") pod \"telemeter-client-84c9498bf-x4bg2\" (UID: \"96d1d05c-dd89-409f-b46d-08af47201282\") " pod="openshift-monitoring/telemeter-client-84c9498bf-x4bg2"
Jul 20 19:02:09.296427 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:09.296245    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/96d1d05c-dd89-409f-b46d-08af47201282-federate-client-tls\") pod \"telemeter-client-84c9498bf-x4bg2\" (UID: \"96d1d05c-dd89-409f-b46d-08af47201282\") " pod="openshift-monitoring/telemeter-client-84c9498bf-x4bg2"
Jul 20 19:02:09.296427 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:09.296313    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/96d1d05c-dd89-409f-b46d-08af47201282-secret-telemeter-client\") pod \"telemeter-client-84c9498bf-x4bg2\" (UID: \"96d1d05c-dd89-409f-b46d-08af47201282\") " pod="openshift-monitoring/telemeter-client-84c9498bf-x4bg2"
Jul 20 19:02:09.296427 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:09.296379    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96d1d05c-dd89-409f-b46d-08af47201282-telemeter-trusted-ca-bundle\") pod \"telemeter-client-84c9498bf-x4bg2\" (UID: \"96d1d05c-dd89-409f-b46d-08af47201282\") " pod="openshift-monitoring/telemeter-client-84c9498bf-x4bg2"
Jul 20 19:02:09.296427 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:09.296416    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/96d1d05c-dd89-409f-b46d-08af47201282-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-84c9498bf-x4bg2\" (UID: \"96d1d05c-dd89-409f-b46d-08af47201282\") " pod="openshift-monitoring/telemeter-client-84c9498bf-x4bg2"
Jul 20 19:02:09.296557 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:09.296433    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/96d1d05c-dd89-409f-b46d-08af47201282-telemeter-client-tls\") pod \"telemeter-client-84c9498bf-x4bg2\" (UID: \"96d1d05c-dd89-409f-b46d-08af47201282\") " pod="openshift-monitoring/telemeter-client-84c9498bf-x4bg2"
Jul 20 19:02:09.296557 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:09.296457    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85gs5\" (UniqueName: \"kubernetes.io/projected/96d1d05c-dd89-409f-b46d-08af47201282-kube-api-access-85gs5\") pod \"telemeter-client-84c9498bf-x4bg2\" (UID: \"96d1d05c-dd89-409f-b46d-08af47201282\") " pod="openshift-monitoring/telemeter-client-84c9498bf-x4bg2"
Jul 20 19:02:09.337460 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:09.337425    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:02:09.397673 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:09.397631    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/96d1d05c-dd89-409f-b46d-08af47201282-telemeter-client-tls\") pod \"telemeter-client-84c9498bf-x4bg2\" (UID: \"96d1d05c-dd89-409f-b46d-08af47201282\") " pod="openshift-monitoring/telemeter-client-84c9498bf-x4bg2"
Jul 20 19:02:09.397673 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:09.397676    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85gs5\" (UniqueName: \"kubernetes.io/projected/96d1d05c-dd89-409f-b46d-08af47201282-kube-api-access-85gs5\") pod \"telemeter-client-84c9498bf-x4bg2\" (UID: \"96d1d05c-dd89-409f-b46d-08af47201282\") " pod="openshift-monitoring/telemeter-client-84c9498bf-x4bg2"
Jul 20 19:02:09.398185 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:09.397864    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96d1d05c-dd89-409f-b46d-08af47201282-serving-certs-ca-bundle\") pod \"telemeter-client-84c9498bf-x4bg2\" (UID: \"96d1d05c-dd89-409f-b46d-08af47201282\") " pod="openshift-monitoring/telemeter-client-84c9498bf-x4bg2"
Jul 20 19:02:09.398185 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:09.397897    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/96d1d05c-dd89-409f-b46d-08af47201282-metrics-client-ca\") pod \"telemeter-client-84c9498bf-x4bg2\" (UID: \"96d1d05c-dd89-409f-b46d-08af47201282\") " pod="openshift-monitoring/telemeter-client-84c9498bf-x4bg2"
Jul 20 19:02:09.398185 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:09.397934    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/96d1d05c-dd89-409f-b46d-08af47201282-federate-client-tls\") pod \"telemeter-client-84c9498bf-x4bg2\" (UID: \"96d1d05c-dd89-409f-b46d-08af47201282\") " pod="openshift-monitoring/telemeter-client-84c9498bf-x4bg2"
Jul 20 19:02:09.398185 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:09.397979    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/96d1d05c-dd89-409f-b46d-08af47201282-secret-telemeter-client\") pod \"telemeter-client-84c9498bf-x4bg2\" (UID: \"96d1d05c-dd89-409f-b46d-08af47201282\") " pod="openshift-monitoring/telemeter-client-84c9498bf-x4bg2"
Jul 20 19:02:09.398185 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:09.398029    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/318006fd-48dd-4a24-9f66-2a6c0e958177-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-pqzvv\" (UID: \"318006fd-48dd-4a24-9f66-2a6c0e958177\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-pqzvv"
Jul 20 19:02:09.398185 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:09.398055    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96d1d05c-dd89-409f-b46d-08af47201282-telemeter-trusted-ca-bundle\") pod \"telemeter-client-84c9498bf-x4bg2\" (UID: \"96d1d05c-dd89-409f-b46d-08af47201282\") " pod="openshift-monitoring/telemeter-client-84c9498bf-x4bg2"
Jul 20 19:02:09.398185 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:09.398110    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/96d1d05c-dd89-409f-b46d-08af47201282-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-84c9498bf-x4bg2\" (UID: \"96d1d05c-dd89-409f-b46d-08af47201282\") " pod="openshift-monitoring/telemeter-client-84c9498bf-x4bg2"
Jul 20 19:02:09.398928 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:09.398706    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96d1d05c-dd89-409f-b46d-08af47201282-serving-certs-ca-bundle\") pod \"telemeter-client-84c9498bf-x4bg2\" (UID: \"96d1d05c-dd89-409f-b46d-08af47201282\") " pod="openshift-monitoring/telemeter-client-84c9498bf-x4bg2"
Jul 20 19:02:09.398928 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:09.398732    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/96d1d05c-dd89-409f-b46d-08af47201282-metrics-client-ca\") pod \"telemeter-client-84c9498bf-x4bg2\" (UID: \"96d1d05c-dd89-409f-b46d-08af47201282\") " pod="openshift-monitoring/telemeter-client-84c9498bf-x4bg2"
Jul 20 19:02:09.399486 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:09.399459    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96d1d05c-dd89-409f-b46d-08af47201282-telemeter-trusted-ca-bundle\") pod \"telemeter-client-84c9498bf-x4bg2\" (UID: \"96d1d05c-dd89-409f-b46d-08af47201282\") " pod="openshift-monitoring/telemeter-client-84c9498bf-x4bg2"
Jul 20 19:02:09.400862 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:09.400829    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/96d1d05c-dd89-409f-b46d-08af47201282-secret-telemeter-client\") pod \"telemeter-client-84c9498bf-x4bg2\" (UID: \"96d1d05c-dd89-409f-b46d-08af47201282\") " pod="openshift-monitoring/telemeter-client-84c9498bf-x4bg2"
Jul 20 19:02:09.400955 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:09.400858    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/318006fd-48dd-4a24-9f66-2a6c0e958177-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-pqzvv\" (UID: \"318006fd-48dd-4a24-9f66-2a6c0e958177\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-pqzvv"
Jul 20 19:02:09.400955 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:09.400886    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/96d1d05c-dd89-409f-b46d-08af47201282-telemeter-client-tls\") pod \"telemeter-client-84c9498bf-x4bg2\" (UID: \"96d1d05c-dd89-409f-b46d-08af47201282\") " pod="openshift-monitoring/telemeter-client-84c9498bf-x4bg2"
Jul 20 19:02:09.401060 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:09.401039    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/96d1d05c-dd89-409f-b46d-08af47201282-federate-client-tls\") pod \"telemeter-client-84c9498bf-x4bg2\" (UID: \"96d1d05c-dd89-409f-b46d-08af47201282\") " pod="openshift-monitoring/telemeter-client-84c9498bf-x4bg2"
Jul 20 19:02:09.401113 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:09.401096    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/96d1d05c-dd89-409f-b46d-08af47201282-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-84c9498bf-x4bg2\" (UID: \"96d1d05c-dd89-409f-b46d-08af47201282\") " pod="openshift-monitoring/telemeter-client-84c9498bf-x4bg2"
Jul 20 19:02:09.406104 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:09.406081    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-85gs5\" (UniqueName: \"kubernetes.io/projected/96d1d05c-dd89-409f-b46d-08af47201282-kube-api-access-85gs5\") pod \"telemeter-client-84c9498bf-x4bg2\" (UID: \"96d1d05c-dd89-409f-b46d-08af47201282\") " pod="openshift-monitoring/telemeter-client-84c9498bf-x4bg2"
Jul 20 19:02:09.477410 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:09.477384    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-84c9498bf-x4bg2"
Jul 20 19:02:09.579261 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:09.579238    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-pqzvv"
Jul 20 19:02:09.623842 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:09.623811    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-84c9498bf-x4bg2"]
Jul 20 19:02:09.628597 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:02:09.628463    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96d1d05c_dd89_409f_b46d_08af47201282.slice/crio-b92f74d6d892b679e91f42cd824e5eb06ea64c0706a7d2d31e3efaa2a5a6a83b WatchSource:0}: Error finding container b92f74d6d892b679e91f42cd824e5eb06ea64c0706a7d2d31e3efaa2a5a6a83b: Status 404 returned error can't find the container with id b92f74d6d892b679e91f42cd824e5eb06ea64c0706a7d2d31e3efaa2a5a6a83b
Jul 20 19:02:09.720835 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:09.720810    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-pqzvv"]
Jul 20 19:02:09.723092 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:02:09.723058    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod318006fd_48dd_4a24_9f66_2a6c0e958177.slice/crio-e1b653d61e9775ac796b9eb59fe29efa846fc6f46a038979c07d3de1a4430dfe WatchSource:0}: Error finding container e1b653d61e9775ac796b9eb59fe29efa846fc6f46a038979c07d3de1a4430dfe: Status 404 returned error can't find the container with id e1b653d61e9775ac796b9eb59fe29efa846fc6f46a038979c07d3de1a4430dfe
Jul 20 19:02:10.113809 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:10.113776    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 20 19:02:10.116517 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:10.116502    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:02:10.119805 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:10.119780    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 20 19:02:10.119931 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:10.119866    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 20 19:02:10.119931 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:10.119907    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 20 19:02:10.119931 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:10.119910    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 20 19:02:10.120107 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:10.119914    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 20 19:02:10.120107 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:10.119914    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 20 19:02:10.120107 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:10.120049    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 20 19:02:10.120880 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:10.120839    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-bbvuvpmeadq3c\""
Jul 20 19:02:10.121026 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:10.120936    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 20 19:02:10.121026 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:10.120945    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-mmdbp\""
Jul 20 19:02:10.121026 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:10.120938    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 20 19:02:10.121026 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:10.120988    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 20 19:02:10.121237 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:10.121056    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 20 19:02:10.121429 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:10.121416    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 20 19:02:10.123329 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:10.123307    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 20 19:02:10.123778 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:10.123753    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 20 19:02:10.124545 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:10.124520    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:02:10.127268 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:10.127251    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 20 19:02:10.143171 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:10.143140    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 20 19:02:10.203672 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:10.203644    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f841476b-570f-4a2b-844d-4e7434cd83a2-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f841476b-570f-4a2b-844d-4e7434cd83a2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:02:10.203672 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:10.203674    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f841476b-570f-4a2b-844d-4e7434cd83a2-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f841476b-570f-4a2b-844d-4e7434cd83a2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:02:10.203858 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:10.203699    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f841476b-570f-4a2b-844d-4e7434cd83a2-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f841476b-570f-4a2b-844d-4e7434cd83a2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:02:10.203858 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:10.203769    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f841476b-570f-4a2b-844d-4e7434cd83a2-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f841476b-570f-4a2b-844d-4e7434cd83a2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:02:10.203858 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:10.203793    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2lll6\" (UniqueName: \"kubernetes.io/projected/f841476b-570f-4a2b-844d-4e7434cd83a2-kube-api-access-2lll6\") pod \"prometheus-k8s-0\" (UID: \"f841476b-570f-4a2b-844d-4e7434cd83a2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:02:10.203858 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:10.203819    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f841476b-570f-4a2b-844d-4e7434cd83a2-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f841476b-570f-4a2b-844d-4e7434cd83a2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:02:10.203858 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:10.203843    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f841476b-570f-4a2b-844d-4e7434cd83a2-web-config\") pod \"prometheus-k8s-0\" (UID: \"f841476b-570f-4a2b-844d-4e7434cd83a2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:02:10.204066 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:10.203871    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f841476b-570f-4a2b-844d-4e7434cd83a2-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f841476b-570f-4a2b-844d-4e7434cd83a2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:02:10.204066 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:10.203935    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f841476b-570f-4a2b-844d-4e7434cd83a2-config-out\") pod \"prometheus-k8s-0\" (UID: \"f841476b-570f-4a2b-844d-4e7434cd83a2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:02:10.204066 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:10.203966    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f841476b-570f-4a2b-844d-4e7434cd83a2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f841476b-570f-4a2b-844d-4e7434cd83a2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:02:10.204066 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:10.203994    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f841476b-570f-4a2b-844d-4e7434cd83a2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f841476b-570f-4a2b-844d-4e7434cd83a2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:02:10.204066 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:10.204040    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f841476b-570f-4a2b-844d-4e7434cd83a2-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f841476b-570f-4a2b-844d-4e7434cd83a2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:02:10.204066 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:10.204059    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f841476b-570f-4a2b-844d-4e7434cd83a2-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f841476b-570f-4a2b-844d-4e7434cd83a2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:02:10.204268 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:10.204080    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f841476b-570f-4a2b-844d-4e7434cd83a2-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f841476b-570f-4a2b-844d-4e7434cd83a2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:02:10.204268 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:10.204103    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f841476b-570f-4a2b-844d-4e7434cd83a2-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f841476b-570f-4a2b-844d-4e7434cd83a2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:02:10.204268 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:10.204181    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f841476b-570f-4a2b-844d-4e7434cd83a2-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f841476b-570f-4a2b-844d-4e7434cd83a2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:02:10.204268 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:10.204216    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f841476b-570f-4a2b-844d-4e7434cd83a2-config\") pod \"prometheus-k8s-0\" (UID: \"f841476b-570f-4a2b-844d-4e7434cd83a2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:02:10.204268 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:10.204233    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f841476b-570f-4a2b-844d-4e7434cd83a2-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f841476b-570f-4a2b-844d-4e7434cd83a2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:02:10.204268 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:10.204253    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f841476b-570f-4a2b-844d-4e7434cd83a2-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f841476b-570f-4a2b-844d-4e7434cd83a2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:02:10.204470 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:10.204278    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f841476b-570f-4a2b-844d-4e7434cd83a2-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f841476b-570f-4a2b-844d-4e7434cd83a2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:02:10.291188 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:10.291165    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:02:10.301002 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:10.300978    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-84c9498bf-x4bg2" event={"ID":"96d1d05c-dd89-409f-b46d-08af47201282","Type":"ContainerStarted","Data":"b92f74d6d892b679e91f42cd824e5eb06ea64c0706a7d2d31e3efaa2a5a6a83b"}
Jul 20 19:02:10.303774 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:10.303752    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb","Type":"ContainerStarted","Data":"ac8c0762c5908d68048741b979f35917696fd9548a4987c8a578d968604881fe"}
Jul 20 19:02:10.303866 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:10.303818    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb","Type":"ContainerStarted","Data":"7214497a97025a9d021aa21ee7f37ffad4bf102a48cc8000e7aca7e31ee24a5b"}
Jul 20 19:02:10.303927 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:10.303865    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb","Type":"ContainerStarted","Data":"474f037c82af2e77300c1ecef214402a859d3befd12fe93a17daa484afdcd50f"}
Jul 20 19:02:10.303927 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:10.303905    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb","Type":"ContainerStarted","Data":"e76a24d3dbb563305fe1d751c8e78359ab37fed8b8d1465cbcfa57892ab6dea5"}
Jul 20 19:02:10.304017 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:10.303945    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb","Type":"ContainerStarted","Data":"65d6e02cab98043acc2df8dbc8517806e46e877ee2e53cb4bc0e1d54085cacf7"}
Jul 20 19:02:10.304638 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:10.304615    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f841476b-570f-4a2b-844d-4e7434cd83a2-config-out\") pod \"prometheus-k8s-0\" (UID: \"f841476b-570f-4a2b-844d-4e7434cd83a2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:02:10.304697 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:10.304648    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f841476b-570f-4a2b-844d-4e7434cd83a2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f841476b-570f-4a2b-844d-4e7434cd83a2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:02:10.304697 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:10.304672    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f841476b-570f-4a2b-844d-4e7434cd83a2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f841476b-570f-4a2b-844d-4e7434cd83a2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:02:10.304792 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:10.304702    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f841476b-570f-4a2b-844d-4e7434cd83a2-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f841476b-570f-4a2b-844d-4e7434cd83a2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:02:10.304792 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:10.304733    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f841476b-570f-4a2b-844d-4e7434cd83a2-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f841476b-570f-4a2b-844d-4e7434cd83a2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:02:10.304792 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:10.304760    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f841476b-570f-4a2b-844d-4e7434cd83a2-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f841476b-570f-4a2b-844d-4e7434cd83a2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:02:10.304930 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:10.304792    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f841476b-570f-4a2b-844d-4e7434cd83a2-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f841476b-570f-4a2b-844d-4e7434cd83a2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:02:10.304930 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:10.304824    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f841476b-570f-4a2b-844d-4e7434cd83a2-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f841476b-570f-4a2b-844d-4e7434cd83a2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:02:10.304930 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:10.304861    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f841476b-570f-4a2b-844d-4e7434cd83a2-config\") pod \"prometheus-k8s-0\" (UID: \"f841476b-570f-4a2b-844d-4e7434cd83a2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:02:10.304930 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:10.304884    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f841476b-570f-4a2b-844d-4e7434cd83a2-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f841476b-570f-4a2b-844d-4e7434cd83a2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:02:10.304930 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:10.304891    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-pqzvv" event={"ID":"318006fd-48dd-4a24-9f66-2a6c0e958177","Type":"ContainerStarted","Data":"e1b653d61e9775ac796b9eb59fe29efa846fc6f46a038979c07d3de1a4430dfe"}
Jul 20 19:02:10.304930 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:10.304909    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f841476b-570f-4a2b-844d-4e7434cd83a2-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f841476b-570f-4a2b-844d-4e7434cd83a2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:02:10.304930 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:10.304930    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f841476b-570f-4a2b-844d-4e7434cd83a2-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f841476b-570f-4a2b-844d-4e7434cd83a2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:02:10.305259 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:10.304965    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f841476b-570f-4a2b-844d-4e7434cd83a2-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f841476b-570f-4a2b-844d-4e7434cd83a2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:02:10.305259 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:10.304986    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f841476b-570f-4a2b-844d-4e7434cd83a2-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f841476b-570f-4a2b-844d-4e7434cd83a2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:02:10.305259 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:10.305009    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f841476b-570f-4a2b-844d-4e7434cd83a2-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f841476b-570f-4a2b-844d-4e7434cd83a2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:02:10.305259 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:10.305043    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f841476b-570f-4a2b-844d-4e7434cd83a2-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f841476b-570f-4a2b-844d-4e7434cd83a2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:02:10.305259 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:10.305069    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2lll6\" (UniqueName: \"kubernetes.io/projected/f841476b-570f-4a2b-844d-4e7434cd83a2-kube-api-access-2lll6\") pod \"prometheus-k8s-0\" (UID: \"f841476b-570f-4a2b-844d-4e7434cd83a2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:02:10.305259 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:10.305103    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f841476b-570f-4a2b-844d-4e7434cd83a2-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f841476b-570f-4a2b-844d-4e7434cd83a2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:02:10.305259 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:10.305141    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f841476b-570f-4a2b-844d-4e7434cd83a2-web-config\") pod \"prometheus-k8s-0\" (UID: \"f841476b-570f-4a2b-844d-4e7434cd83a2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:02:10.305259 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:10.305166    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f841476b-570f-4a2b-844d-4e7434cd83a2-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f841476b-570f-4a2b-844d-4e7434cd83a2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:02:10.305814 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:10.305529    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f841476b-570f-4a2b-844d-4e7434cd83a2-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f841476b-570f-4a2b-844d-4e7434cd83a2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:02:10.305872 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:10.305855    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f841476b-570f-4a2b-844d-4e7434cd83a2-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f841476b-570f-4a2b-844d-4e7434cd83a2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:02:10.307270 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:10.306247    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f841476b-570f-4a2b-844d-4e7434cd83a2-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f841476b-570f-4a2b-844d-4e7434cd83a2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:02:10.307270 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:10.306270    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f841476b-570f-4a2b-844d-4e7434cd83a2-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f841476b-570f-4a2b-844d-4e7434cd83a2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:02:10.307270 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:10.306960    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f841476b-570f-4a2b-844d-4e7434cd83a2-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f841476b-570f-4a2b-844d-4e7434cd83a2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:02:10.308051 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:10.308004    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f841476b-570f-4a2b-844d-4e7434cd83a2-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f841476b-570f-4a2b-844d-4e7434cd83a2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:02:10.308806 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:10.308459    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f841476b-570f-4a2b-844d-4e7434cd83a2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f841476b-570f-4a2b-844d-4e7434cd83a2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:02:10.309337 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:10.308922    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f841476b-570f-4a2b-844d-4e7434cd83a2-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f841476b-570f-4a2b-844d-4e7434cd83a2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:02:10.309337 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:10.309289    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f841476b-570f-4a2b-844d-4e7434cd83a2-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f841476b-570f-4a2b-844d-4e7434cd83a2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:02:10.309503 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:10.309418    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f841476b-570f-4a2b-844d-4e7434cd83a2-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f841476b-570f-4a2b-844d-4e7434cd83a2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:02:10.309556 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:10.309514    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f841476b-570f-4a2b-844d-4e7434cd83a2-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f841476b-570f-4a2b-844d-4e7434cd83a2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:02:10.310584 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:10.310566    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/f841476b-570f-4a2b-844d-4e7434cd83a2-config\") pod \"prometheus-k8s-0\" (UID: \"f841476b-570f-4a2b-844d-4e7434cd83a2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:02:10.310693 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:10.310581    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f841476b-570f-4a2b-844d-4e7434cd83a2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f841476b-570f-4a2b-844d-4e7434cd83a2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:02:10.310866 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:10.310843    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f841476b-570f-4a2b-844d-4e7434cd83a2-config-out\") pod \"prometheus-k8s-0\" (UID: \"f841476b-570f-4a2b-844d-4e7434cd83a2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:02:10.310975 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:10.310959    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f841476b-570f-4a2b-844d-4e7434cd83a2-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f841476b-570f-4a2b-844d-4e7434cd83a2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:02:10.311164 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:10.311142    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f841476b-570f-4a2b-844d-4e7434cd83a2-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f841476b-570f-4a2b-844d-4e7434cd83a2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:02:10.311295 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:10.311275    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f841476b-570f-4a2b-844d-4e7434cd83a2-web-config\") pod \"prometheus-k8s-0\" (UID: \"f841476b-570f-4a2b-844d-4e7434cd83a2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:02:10.311529 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:10.311514    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f841476b-570f-4a2b-844d-4e7434cd83a2-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f841476b-570f-4a2b-844d-4e7434cd83a2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:02:10.312788 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:10.312765    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f841476b-570f-4a2b-844d-4e7434cd83a2-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f841476b-570f-4a2b-844d-4e7434cd83a2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:02:10.314020 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:10.314004    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2lll6\" (UniqueName: \"kubernetes.io/projected/f841476b-570f-4a2b-844d-4e7434cd83a2-kube-api-access-2lll6\") pod \"prometheus-k8s-0\" (UID: \"f841476b-570f-4a2b-844d-4e7434cd83a2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:02:10.348717 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:10.348686    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:02:10.427139 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:10.427064    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:02:10.576281 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:10.576259    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 20 19:02:10.629270 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:02:10.629241    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf841476b_570f_4a2b_844d_4e7434cd83a2.slice/crio-7fed6d4facb997d0d71eb9748202c3d6ea144dab1a076b72c879dce5ac34f5b3 WatchSource:0}: Error finding container 7fed6d4facb997d0d71eb9748202c3d6ea144dab1a076b72c879dce5ac34f5b3: Status 404 returned error can't find the container with id 7fed6d4facb997d0d71eb9748202c3d6ea144dab1a076b72c879dce5ac34f5b3
Jul 20 19:02:11.310763 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:11.310725    2563 generic.go:356] "Generic (PLEG): container finished" podID="f841476b-570f-4a2b-844d-4e7434cd83a2" containerID="b5e1aa9f35a5849ece1e073f0d63c6be01ffaac5ea8a156e47a63635445cef26" exitCode=0
Jul 20 19:02:11.311089 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:11.310822    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f841476b-570f-4a2b-844d-4e7434cd83a2","Type":"ContainerDied","Data":"b5e1aa9f35a5849ece1e073f0d63c6be01ffaac5ea8a156e47a63635445cef26"}
Jul 20 19:02:11.311089 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:11.310907    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f841476b-570f-4a2b-844d-4e7434cd83a2","Type":"ContainerStarted","Data":"7fed6d4facb997d0d71eb9748202c3d6ea144dab1a076b72c879dce5ac34f5b3"}
Jul 20 19:02:11.315101 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:11.315074    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb","Type":"ContainerStarted","Data":"6d38f4bd087aee61b8d0ecdd5fa0758a8c4054f9435e3b0d01a507b400523dc7"}
Jul 20 19:02:11.367876 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:11.367818    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.05645878 podStartE2EDuration="7.367793459s" totalImagesPullingTime="4.294531158s" totalInitContainerRuntime="16.803521ms" isStatefulPod=false podCreationTimestamp="2026-07-20 19:02:04 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:02:11.367147887 +0000 UTC m=+91.050675909" watchObservedRunningTime="2026-07-20 19:02:11.367793459 +0000 UTC m=+91.051321485"
Jul 20 19:02:12.320785 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:12.319928    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-pqzvv" event={"ID":"318006fd-48dd-4a24-9f66-2a6c0e958177","Type":"ContainerStarted","Data":"48ec994fc2f46b99e6059a6334ad6d1a4a06b2eb8558909adcae522c438e469d"}
Jul 20 19:02:12.324435 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:12.322097    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-pqzvv"
Jul 20 19:02:12.328173 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:12.328151    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-pqzvv"
Jul 20 19:02:12.337597 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:12.337544    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-pqzvv" podStartSLOduration=2.346375974 podStartE2EDuration="4.337526752s" totalImagesPullingTime="1.991150778s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:02:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:02:12.33703794 +0000 UTC m=+92.020565962" watchObservedRunningTime="2026-07-20 19:02:12.337526752 +0000 UTC m=+92.021054774"
Jul 20 19:02:13.177302 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:13.177221    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:02:13.246990 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:13.246958    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:02:13.326065 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:13.326022    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-84c9498bf-x4bg2" event={"ID":"96d1d05c-dd89-409f-b46d-08af47201282","Type":"ContainerStarted","Data":"ed2895bfc870ffd2efcceaa796d1c5335e67e4888150b571a902a7bc0b05cf00"}
Jul 20 19:02:13.326528 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:13.326096    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-84c9498bf-x4bg2" event={"ID":"96d1d05c-dd89-409f-b46d-08af47201282","Type":"ContainerStarted","Data":"652f525421c3cab36d0be63008ef095ce57f143db0d849e0762d9d0de7a6fd49"}
Jul 20 19:02:13.326528 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:13.326131    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-84c9498bf-x4bg2" event={"ID":"96d1d05c-dd89-409f-b46d-08af47201282","Type":"ContainerStarted","Data":"ea1d865de8aa7707d0e82b6318917756346ad9fbc9f068e0a1f3a24ef220978b"}
Jul 20 19:02:13.349232 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:13.349205    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:02:13.349770 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:13.349734    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-84c9498bf-x4bg2" podStartSLOduration=1.117644289 podStartE2EDuration="4.349718475s" totalImagesPullingTime="3.232074186s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:02:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:02:13.347558957 +0000 UTC m=+93.031086991" watchObservedRunningTime="2026-07-20 19:02:13.349718475 +0000 UTC m=+93.033246496"
Jul 20 19:02:14.379226 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:14.379194    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-55f89b56-jbvgr"
Jul 20 19:02:15.943939 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:15.943844    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:02:16.185979 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:16.185946    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:02:16.238452 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:16.238426    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5bc96949dd-d2ptw"
Jul 20 19:02:16.339648 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:16.339610    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f841476b-570f-4a2b-844d-4e7434cd83a2","Type":"ContainerStarted","Data":"3ca46ceb40f10e665988b8834e1b0a1f9dc5dd9c6d4ec16b463b34173076f419"}
Jul 20 19:02:16.339818 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:16.339692    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f841476b-570f-4a2b-844d-4e7434cd83a2","Type":"ContainerStarted","Data":"c39f310305190a933038a46cc324d7f3980950ccb3751dad3a0e2f5205b2fdee"}
Jul 20 19:02:16.371056 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:16.371030    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:02:16.473166 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:16.473130    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:02:16.573679 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:16.573593    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:02:18.351690 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:18.351610    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f841476b-570f-4a2b-844d-4e7434cd83a2","Type":"ContainerStarted","Data":"9d8aff00c78379f8087bdce5afe10f53197b7c4b1b4d79f33223924201248e5c"}
Jul 20 19:02:18.351690 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:18.351668    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f841476b-570f-4a2b-844d-4e7434cd83a2","Type":"ContainerStarted","Data":"240632a6882f2668ad03bab78a2571b5b7494273a6a1da8a9a2a305b35d24b2c"}
Jul 20 19:02:18.352075 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:18.351696    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f841476b-570f-4a2b-844d-4e7434cd83a2","Type":"ContainerStarted","Data":"490adb6f721370bae5e05becd60b27ee2394c92e741d63c894f87953833377ac"}
Jul 20 19:02:18.352075 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:18.351720    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f841476b-570f-4a2b-844d-4e7434cd83a2","Type":"ContainerStarted","Data":"db52388b111b592a9195389ad8cccff3624e73c1f6a8de1b2c09f038928187e7"}
Jul 20 19:02:18.381616 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:18.381566    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=1.9867206099999999 podStartE2EDuration="8.381549797s" totalImagesPullingTime="6.374812877s" totalInitContainerRuntime="20.01631ms" isStatefulPod=false podCreationTimestamp="2026-07-20 19:02:10 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:02:18.379607166 +0000 UTC m=+98.063135205" watchObservedRunningTime="2026-07-20 19:02:18.381549797 +0000 UTC m=+98.065077819"
Jul 20 19:02:19.128290 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:19.128250    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:02:19.229099 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:19.229065    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:02:19.395388 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:19.395287    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-55f89b56-jbvgr" podUID="ee2de18c-442c-479c-9fe1-1bf28182217f" containerName="registry" containerID="cri-o://c3b234110abd79c7b278380550f49517fa6f78a591c88c0d73417f5bc7908b90" gracePeriod=30
Jul 20 19:02:19.669268 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:19.669214    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-55f89b56-jbvgr"
Jul 20 19:02:19.791149 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:19.791117    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ee2de18c-442c-479c-9fe1-1bf28182217f-registry-certificates\") pod \"ee2de18c-442c-479c-9fe1-1bf28182217f\" (UID: \"ee2de18c-442c-479c-9fe1-1bf28182217f\") "
Jul 20 19:02:19.791300 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:19.791158    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ee2de18c-442c-479c-9fe1-1bf28182217f-registry-tls\") pod \"ee2de18c-442c-479c-9fe1-1bf28182217f\" (UID: \"ee2de18c-442c-479c-9fe1-1bf28182217f\") "
Jul 20 19:02:19.791341 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:19.791302    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ee2de18c-442c-479c-9fe1-1bf28182217f-trusted-ca\") pod \"ee2de18c-442c-479c-9fe1-1bf28182217f\" (UID: \"ee2de18c-442c-479c-9fe1-1bf28182217f\") "
Jul 20 19:02:19.791403 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:19.791342    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ee2de18c-442c-479c-9fe1-1bf28182217f-bound-sa-token\") pod \"ee2de18c-442c-479c-9fe1-1bf28182217f\" (UID: \"ee2de18c-442c-479c-9fe1-1bf28182217f\") "
Jul 20 19:02:19.791434 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:19.791404    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ee2de18c-442c-479c-9fe1-1bf28182217f-ca-trust-extracted\") pod \"ee2de18c-442c-479c-9fe1-1bf28182217f\" (UID: \"ee2de18c-442c-479c-9fe1-1bf28182217f\") "
Jul 20 19:02:19.791477 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:19.791439    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ee2de18c-442c-479c-9fe1-1bf28182217f-image-registry-private-configuration\") pod \"ee2de18c-442c-479c-9fe1-1bf28182217f\" (UID: \"ee2de18c-442c-479c-9fe1-1bf28182217f\") "
Jul 20 19:02:19.791522 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:19.791483    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ee2de18c-442c-479c-9fe1-1bf28182217f-installation-pull-secrets\") pod \"ee2de18c-442c-479c-9fe1-1bf28182217f\" (UID: \"ee2de18c-442c-479c-9fe1-1bf28182217f\") "
Jul 20 19:02:19.791522 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:19.791516    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7799p\" (UniqueName: \"kubernetes.io/projected/ee2de18c-442c-479c-9fe1-1bf28182217f-kube-api-access-7799p\") pod \"ee2de18c-442c-479c-9fe1-1bf28182217f\" (UID: \"ee2de18c-442c-479c-9fe1-1bf28182217f\") "
Jul 20 19:02:19.791853 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:19.791658    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ee2de18c-442c-479c-9fe1-1bf28182217f-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "ee2de18c-442c-479c-9fe1-1bf28182217f" (UID: "ee2de18c-442c-479c-9fe1-1bf28182217f"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 19:02:19.791853 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:19.791760    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ee2de18c-442c-479c-9fe1-1bf28182217f-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "ee2de18c-442c-479c-9fe1-1bf28182217f" (UID: "ee2de18c-442c-479c-9fe1-1bf28182217f"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 19:02:19.791853 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:19.791832    2563 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ee2de18c-442c-479c-9fe1-1bf28182217f-registry-certificates\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\""
Jul 20 19:02:19.794290 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:19.794265    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ee2de18c-442c-479c-9fe1-1bf28182217f-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "ee2de18c-442c-479c-9fe1-1bf28182217f" (UID: "ee2de18c-442c-479c-9fe1-1bf28182217f"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 19:02:19.794427 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:19.794299    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ee2de18c-442c-479c-9fe1-1bf28182217f-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "ee2de18c-442c-479c-9fe1-1bf28182217f" (UID: "ee2de18c-442c-479c-9fe1-1bf28182217f"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 19:02:19.794427 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:19.794418    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee2de18c-442c-479c-9fe1-1bf28182217f-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "ee2de18c-442c-479c-9fe1-1bf28182217f" (UID: "ee2de18c-442c-479c-9fe1-1bf28182217f"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:02:19.794525 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:19.794467    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee2de18c-442c-479c-9fe1-1bf28182217f-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "ee2de18c-442c-479c-9fe1-1bf28182217f" (UID: "ee2de18c-442c-479c-9fe1-1bf28182217f"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:02:19.794563 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:19.794530    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee2de18c-442c-479c-9fe1-1bf28182217f-kube-api-access-7799p" (OuterVolumeSpecName: "kube-api-access-7799p") pod "ee2de18c-442c-479c-9fe1-1bf28182217f" (UID: "ee2de18c-442c-479c-9fe1-1bf28182217f"). InnerVolumeSpecName "kube-api-access-7799p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:02:19.800181 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:19.800154    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee2de18c-442c-479c-9fe1-1bf28182217f-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "ee2de18c-442c-479c-9fe1-1bf28182217f" (UID: "ee2de18c-442c-479c-9fe1-1bf28182217f"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:02:19.892433 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:19.892404    2563 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ee2de18c-442c-479c-9fe1-1bf28182217f-registry-tls\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\""
Jul 20 19:02:19.892433 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:19.892432    2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ee2de18c-442c-479c-9fe1-1bf28182217f-trusted-ca\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\""
Jul 20 19:02:19.892611 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:19.892443    2563 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ee2de18c-442c-479c-9fe1-1bf28182217f-bound-sa-token\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\""
Jul 20 19:02:19.892611 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:19.892455    2563 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ee2de18c-442c-479c-9fe1-1bf28182217f-ca-trust-extracted\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\""
Jul 20 19:02:19.892611 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:19.892468    2563 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ee2de18c-442c-479c-9fe1-1bf28182217f-image-registry-private-configuration\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\""
Jul 20 19:02:19.892611 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:19.892481    2563 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ee2de18c-442c-479c-9fe1-1bf28182217f-installation-pull-secrets\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\""
Jul 20 19:02:19.892611 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:19.892494    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7799p\" (UniqueName: \"kubernetes.io/projected/ee2de18c-442c-479c-9fe1-1bf28182217f-kube-api-access-7799p\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\""
Jul 20 19:02:20.361048 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:20.361012    2563 generic.go:356] "Generic (PLEG): container finished" podID="ee2de18c-442c-479c-9fe1-1bf28182217f" containerID="c3b234110abd79c7b278380550f49517fa6f78a591c88c0d73417f5bc7908b90" exitCode=0
Jul 20 19:02:20.361215 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:20.361081    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-55f89b56-jbvgr"
Jul 20 19:02:20.361215 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:20.361099    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-55f89b56-jbvgr" event={"ID":"ee2de18c-442c-479c-9fe1-1bf28182217f","Type":"ContainerDied","Data":"c3b234110abd79c7b278380550f49517fa6f78a591c88c0d73417f5bc7908b90"}
Jul 20 19:02:20.361215 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:20.361164    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-55f89b56-jbvgr" event={"ID":"ee2de18c-442c-479c-9fe1-1bf28182217f","Type":"ContainerDied","Data":"b9cacd3f9da95e1a4285e59fc5c2a47d517a561e1b03732d9af7d9ad006339f9"}
Jul 20 19:02:20.361215 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:20.361209    2563 scope.go:117] "RemoveContainer" containerID="c3b234110abd79c7b278380550f49517fa6f78a591c88c0d73417f5bc7908b90"
Jul 20 19:02:20.370025 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:20.370012    2563 scope.go:117] "RemoveContainer" containerID="c3b234110abd79c7b278380550f49517fa6f78a591c88c0d73417f5bc7908b90"
Jul 20 19:02:20.370291 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:02:20.370273    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c3b234110abd79c7b278380550f49517fa6f78a591c88c0d73417f5bc7908b90\": container with ID starting with c3b234110abd79c7b278380550f49517fa6f78a591c88c0d73417f5bc7908b90 not found: ID does not exist" containerID="c3b234110abd79c7b278380550f49517fa6f78a591c88c0d73417f5bc7908b90"
Jul 20 19:02:20.370330 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:20.370304    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3b234110abd79c7b278380550f49517fa6f78a591c88c0d73417f5bc7908b90"} err="failed to get container status \"c3b234110abd79c7b278380550f49517fa6f78a591c88c0d73417f5bc7908b90\": rpc error: code = NotFound desc = could not find container \"c3b234110abd79c7b278380550f49517fa6f78a591c88c0d73417f5bc7908b90\": container with ID starting with c3b234110abd79c7b278380550f49517fa6f78a591c88c0d73417f5bc7908b90 not found: ID does not exist"
Jul 20 19:02:20.382138 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:20.382107    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-55f89b56-jbvgr"]
Jul 20 19:02:20.385813 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:20.385793    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-55f89b56-jbvgr"]
Jul 20 19:02:20.427651 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:20.427634    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:02:20.890704 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:20.890672    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ee2de18c-442c-479c-9fe1-1bf28182217f" path="/var/lib/kubelet/pods/ee2de18c-442c-479c-9fe1-1bf28182217f/volumes"
Jul 20 19:02:22.293243 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:22.293203    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:02:22.391509 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:22.391475    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:02:25.485277 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:25.485237    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:02:25.591644 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:25.591602    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:02:25.689982 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:25.689949    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:02:26.237016 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:26.236990    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-8r6m4"
Jul 20 19:02:26.382765 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:26.382736    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:02:27.007653 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:27.007611    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:02:27.074258 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:27.074229    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:02:30.940515 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:30.940475    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:02:31.041767 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:31.041739    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:02:45.945003 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:45.944967    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:02:46.008835 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:46.008803    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:02:58.372037 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:02:58.371991    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:03:10.428290 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:10.428234    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:03:10.448504 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:10.448465    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:03:10.563706 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:10.563677    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:03:20.038769 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:20.038733    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:03:20.105978 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:20.105950    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:03:24.293075 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:24.293044    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 20 19:03:24.293461 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:24.293375    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb" containerName="alertmanager" containerID="cri-o://65d6e02cab98043acc2df8dbc8517806e46e877ee2e53cb4bc0e1d54085cacf7" gracePeriod=120
Jul 20 19:03:24.293461 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:24.293417    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb" containerName="kube-rbac-proxy-metric" containerID="cri-o://ac8c0762c5908d68048741b979f35917696fd9548a4987c8a578d968604881fe" gracePeriod=120
Jul 20 19:03:24.293461 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:24.293423    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb" containerName="kube-rbac-proxy" containerID="cri-o://7214497a97025a9d021aa21ee7f37ffad4bf102a48cc8000e7aca7e31ee24a5b" gracePeriod=120
Jul 20 19:03:24.293633 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:24.293467    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb" containerName="config-reloader" containerID="cri-o://e76a24d3dbb563305fe1d751c8e78359ab37fed8b8d1465cbcfa57892ab6dea5" gracePeriod=120
Jul 20 19:03:24.293633 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:24.293485    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb" containerName="prom-label-proxy" containerID="cri-o://6d38f4bd087aee61b8d0ecdd5fa0758a8c4054f9435e3b0d01a507b400523dc7" gracePeriod=120
Jul 20 19:03:24.293633 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:24.293549    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb" containerName="kube-rbac-proxy-web" containerID="cri-o://474f037c82af2e77300c1ecef214402a859d3befd12fe93a17daa484afdcd50f" gracePeriod=120
Jul 20 19:03:24.604753 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:24.604689    2563 generic.go:356] "Generic (PLEG): container finished" podID="d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb" containerID="6d38f4bd087aee61b8d0ecdd5fa0758a8c4054f9435e3b0d01a507b400523dc7" exitCode=0
Jul 20 19:03:24.604753 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:24.604712    2563 generic.go:356] "Generic (PLEG): container finished" podID="d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb" containerID="7214497a97025a9d021aa21ee7f37ffad4bf102a48cc8000e7aca7e31ee24a5b" exitCode=0
Jul 20 19:03:24.604753 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:24.604719    2563 generic.go:356] "Generic (PLEG): container finished" podID="d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb" containerID="e76a24d3dbb563305fe1d751c8e78359ab37fed8b8d1465cbcfa57892ab6dea5" exitCode=0
Jul 20 19:03:24.604753 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:24.604724    2563 generic.go:356] "Generic (PLEG): container finished" podID="d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb" containerID="65d6e02cab98043acc2df8dbc8517806e46e877ee2e53cb4bc0e1d54085cacf7" exitCode=0
Jul 20 19:03:24.604934 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:24.604758    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb","Type":"ContainerDied","Data":"6d38f4bd087aee61b8d0ecdd5fa0758a8c4054f9435e3b0d01a507b400523dc7"}
Jul 20 19:03:24.604934 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:24.604817    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb","Type":"ContainerDied","Data":"7214497a97025a9d021aa21ee7f37ffad4bf102a48cc8000e7aca7e31ee24a5b"}
Jul 20 19:03:24.604934 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:24.604843    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb","Type":"ContainerDied","Data":"e76a24d3dbb563305fe1d751c8e78359ab37fed8b8d1465cbcfa57892ab6dea5"}
Jul 20 19:03:24.604934 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:24.604869    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb","Type":"ContainerDied","Data":"65d6e02cab98043acc2df8dbc8517806e46e877ee2e53cb4bc0e1d54085cacf7"}
Jul 20 19:03:25.610962 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:25.610933    2563 generic.go:356] "Generic (PLEG): container finished" podID="d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb" containerID="ac8c0762c5908d68048741b979f35917696fd9548a4987c8a578d968604881fe" exitCode=0
Jul 20 19:03:25.610962 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:25.610957    2563 generic.go:356] "Generic (PLEG): container finished" podID="d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb" containerID="474f037c82af2e77300c1ecef214402a859d3befd12fe93a17daa484afdcd50f" exitCode=0
Jul 20 19:03:25.611383 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:25.611018    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb","Type":"ContainerDied","Data":"ac8c0762c5908d68048741b979f35917696fd9548a4987c8a578d968604881fe"}
Jul 20 19:03:25.611383 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:25.611108    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb","Type":"ContainerDied","Data":"474f037c82af2e77300c1ecef214402a859d3befd12fe93a17daa484afdcd50f"}
Jul 20 19:03:26.053680 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:26.053659    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 20 19:03:26.226519 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:26.226485    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb-cluster-tls-config\") pod \"d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb\" (UID: \"d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb\") "
Jul 20 19:03:26.226688 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:26.226534    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb-metrics-client-ca\") pod \"d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb\" (UID: \"d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb\") "
Jul 20 19:03:26.226688 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:26.226558    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb-config-volume\") pod \"d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb\" (UID: \"d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb\") "
Jul 20 19:03:26.226688 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:26.226592    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9jrgb\" (UniqueName: \"kubernetes.io/projected/d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb-kube-api-access-9jrgb\") pod \"d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb\" (UID: \"d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb\") "
Jul 20 19:03:26.226688 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:26.226620    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb-alertmanager-trusted-ca-bundle\") pod \"d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb\" (UID: \"d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb\") "
Jul 20 19:03:26.226688 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:26.226648    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb-tls-assets\") pod \"d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb\" (UID: \"d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb\") "
Jul 20 19:03:26.226938 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:26.226800    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb-secret-alertmanager-kube-rbac-proxy-metric\") pod \"d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb\" (UID: \"d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb\") "
Jul 20 19:03:26.226938 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:26.226853    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb-web-config\") pod \"d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb\" (UID: \"d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb\") "
Jul 20 19:03:26.226938 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:26.226926    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb-secret-alertmanager-kube-rbac-proxy\") pod \"d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb\" (UID: \"d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb\") "
Jul 20 19:03:26.227098 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:26.226957    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb-secret-alertmanager-main-tls\") pod \"d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb\" (UID: \"d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb\") "
Jul 20 19:03:26.227098 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:26.226958    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb" (UID: "d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 19:03:26.227098 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:26.226984    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb-alertmanager-main-db\") pod \"d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb\" (UID: \"d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb\") "
Jul 20 19:03:26.227098 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:26.227013    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb-config-out\") pod \"d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb\" (UID: \"d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb\") "
Jul 20 19:03:26.227098 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:26.227061    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb" (UID: "d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 19:03:26.227535 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:26.227110    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb-secret-alertmanager-kube-rbac-proxy-web\") pod \"d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb\" (UID: \"d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb\") "
Jul 20 19:03:26.227535 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:26.227506    2563 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\""
Jul 20 19:03:26.227535 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:26.227527    2563 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb-metrics-client-ca\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\""
Jul 20 19:03:26.229817 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:26.229750    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb-kube-api-access-9jrgb" (OuterVolumeSpecName: "kube-api-access-9jrgb") pod "d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb" (UID: "d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb"). InnerVolumeSpecName "kube-api-access-9jrgb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:03:26.230105 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:26.230070    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb" (UID: "d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 19:03:26.230486 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:26.230456    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb" (UID: "d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:03:26.230577 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:26.230512    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb" (UID: "d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 19:03:26.230577 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:26.230499    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb-config-volume" (OuterVolumeSpecName: "config-volume") pod "d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb" (UID: "d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 19:03:26.230806 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:26.230784    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb" (UID: "d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:03:26.231153 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:26.231124    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb" (UID: "d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 19:03:26.232498 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:26.232473    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb-config-out" (OuterVolumeSpecName: "config-out") pod "d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb" (UID: "d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:03:26.232582 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:26.232493    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb" (UID: "d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 19:03:26.233991 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:26.233965    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb" (UID: "d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 19:03:26.240277 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:26.240256    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb-web-config" (OuterVolumeSpecName: "web-config") pod "d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb" (UID: "d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 19:03:26.328366 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:26.328314    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9jrgb\" (UniqueName: \"kubernetes.io/projected/d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb-kube-api-access-9jrgb\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\""
Jul 20 19:03:26.328366 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:26.328345    2563 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb-tls-assets\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\""
Jul 20 19:03:26.328366 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:26.328375    2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\""
Jul 20 19:03:26.328525 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:26.328385    2563 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb-web-config\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\""
Jul 20 19:03:26.328525 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:26.328393    2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\""
Jul 20 19:03:26.328525 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:26.328402    2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb-secret-alertmanager-main-tls\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\""
Jul 20 19:03:26.328525 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:26.328411    2563 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb-alertmanager-main-db\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\""
Jul 20 19:03:26.328525 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:26.328419    2563 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb-config-out\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\""
Jul 20 19:03:26.328525 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:26.328427    2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\""
Jul 20 19:03:26.328525 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:26.328435    2563 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb-cluster-tls-config\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\""
Jul 20 19:03:26.328525 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:26.328443    2563 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb-config-volume\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\""
Jul 20 19:03:26.617981 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:26.617914    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb","Type":"ContainerDied","Data":"9f2a183b32b6d83cb681126db685c4ef90a0f5a539383afb28fe8c29d5ad71c8"}
Jul 20 19:03:26.618315 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:26.617986    2563 scope.go:117] "RemoveContainer" containerID="6d38f4bd087aee61b8d0ecdd5fa0758a8c4054f9435e3b0d01a507b400523dc7"
Jul 20 19:03:26.618315 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:26.617923    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 20 19:03:26.626547 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:26.626529    2563 scope.go:117] "RemoveContainer" containerID="ac8c0762c5908d68048741b979f35917696fd9548a4987c8a578d968604881fe"
Jul 20 19:03:26.633388 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:26.633372    2563 scope.go:117] "RemoveContainer" containerID="7214497a97025a9d021aa21ee7f37ffad4bf102a48cc8000e7aca7e31ee24a5b"
Jul 20 19:03:26.640634 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:26.640584    2563 scope.go:117] "RemoveContainer" containerID="474f037c82af2e77300c1ecef214402a859d3befd12fe93a17daa484afdcd50f"
Jul 20 19:03:26.641410 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:26.641385    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 20 19:03:26.647416 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:26.647399    2563 scope.go:117] "RemoveContainer" containerID="e76a24d3dbb563305fe1d751c8e78359ab37fed8b8d1465cbcfa57892ab6dea5"
Jul 20 19:03:26.650013 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:26.649985    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 20 19:03:26.654884 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:26.654869    2563 scope.go:117] "RemoveContainer" containerID="65d6e02cab98043acc2df8dbc8517806e46e877ee2e53cb4bc0e1d54085cacf7"
Jul 20 19:03:26.661446 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:26.661433    2563 scope.go:117] "RemoveContainer" containerID="d59f1f0fd41ae8c60d6bf8bde8aeca6324760b28c004eaafa3302b08469d3a37"
Jul 20 19:03:26.892727 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:26.892648    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb" path="/var/lib/kubelet/pods/d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb/volumes"
Jul 20 19:03:28.565235 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:28.565199    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 20 19:03:28.565754 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:28.565609    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f841476b-570f-4a2b-844d-4e7434cd83a2" containerName="prometheus" containerID="cri-o://c39f310305190a933038a46cc324d7f3980950ccb3751dad3a0e2f5205b2fdee" gracePeriod=600
Jul 20 19:03:28.565754 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:28.565659    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f841476b-570f-4a2b-844d-4e7434cd83a2" containerName="kube-rbac-proxy-thanos" containerID="cri-o://9d8aff00c78379f8087bdce5afe10f53197b7c4b1b4d79f33223924201248e5c" gracePeriod=600
Jul 20 19:03:28.565754 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:28.565681    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f841476b-570f-4a2b-844d-4e7434cd83a2" containerName="kube-rbac-proxy-web" containerID="cri-o://490adb6f721370bae5e05becd60b27ee2394c92e741d63c894f87953833377ac" gracePeriod=600
Jul 20 19:03:28.565913 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:28.565717    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f841476b-570f-4a2b-844d-4e7434cd83a2" containerName="kube-rbac-proxy" containerID="cri-o://240632a6882f2668ad03bab78a2571b5b7494273a6a1da8a9a2a305b35d24b2c" gracePeriod=600
Jul 20 19:03:28.565913 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:28.565745    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f841476b-570f-4a2b-844d-4e7434cd83a2" containerName="config-reloader" containerID="cri-o://3ca46ceb40f10e665988b8834e1b0a1f9dc5dd9c6d4ec16b463b34173076f419" gracePeriod=600
Jul 20 19:03:28.565913 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:28.565722    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f841476b-570f-4a2b-844d-4e7434cd83a2" containerName="thanos-sidecar" containerID="cri-o://db52388b111b592a9195389ad8cccff3624e73c1f6a8de1b2c09f038928187e7" gracePeriod=600
Jul 20 19:03:28.816479 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:28.816425    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:03:28.950800 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:28.950773    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f841476b-570f-4a2b-844d-4e7434cd83a2-configmap-kubelet-serving-ca-bundle\") pod \"f841476b-570f-4a2b-844d-4e7434cd83a2\" (UID: \"f841476b-570f-4a2b-844d-4e7434cd83a2\") "
Jul 20 19:03:28.950946 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:28.950846    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f841476b-570f-4a2b-844d-4e7434cd83a2-config-out\") pod \"f841476b-570f-4a2b-844d-4e7434cd83a2\" (UID: \"f841476b-570f-4a2b-844d-4e7434cd83a2\") "
Jul 20 19:03:28.950946 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:28.950871    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f841476b-570f-4a2b-844d-4e7434cd83a2-secret-prometheus-k8s-tls\") pod \"f841476b-570f-4a2b-844d-4e7434cd83a2\" (UID: \"f841476b-570f-4a2b-844d-4e7434cd83a2\") "
Jul 20 19:03:28.950946 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:28.950890    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f841476b-570f-4a2b-844d-4e7434cd83a2-prometheus-k8s-rulefiles-1\") pod \"f841476b-570f-4a2b-844d-4e7434cd83a2\" (UID: \"f841476b-570f-4a2b-844d-4e7434cd83a2\") "
Jul 20 19:03:28.950946 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:28.950906    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f841476b-570f-4a2b-844d-4e7434cd83a2-secret-kube-rbac-proxy\") pod \"f841476b-570f-4a2b-844d-4e7434cd83a2\" (UID: \"f841476b-570f-4a2b-844d-4e7434cd83a2\") "
Jul 20 19:03:28.950946 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:28.950922    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f841476b-570f-4a2b-844d-4e7434cd83a2-prometheus-trusted-ca-bundle\") pod \"f841476b-570f-4a2b-844d-4e7434cd83a2\" (UID: \"f841476b-570f-4a2b-844d-4e7434cd83a2\") "
Jul 20 19:03:28.950946 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:28.950941    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f841476b-570f-4a2b-844d-4e7434cd83a2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"f841476b-570f-4a2b-844d-4e7434cd83a2\" (UID: \"f841476b-570f-4a2b-844d-4e7434cd83a2\") "
Jul 20 19:03:28.951218 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:28.950982    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f841476b-570f-4a2b-844d-4e7434cd83a2-tls-assets\") pod \"f841476b-570f-4a2b-844d-4e7434cd83a2\" (UID: \"f841476b-570f-4a2b-844d-4e7434cd83a2\") "
Jul 20 19:03:28.951218 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:28.951017    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f841476b-570f-4a2b-844d-4e7434cd83a2-web-config\") pod \"f841476b-570f-4a2b-844d-4e7434cd83a2\" (UID: \"f841476b-570f-4a2b-844d-4e7434cd83a2\") "
Jul 20 19:03:28.951218 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:28.951042    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f841476b-570f-4a2b-844d-4e7434cd83a2-configmap-metrics-client-ca\") pod \"f841476b-570f-4a2b-844d-4e7434cd83a2\" (UID: \"f841476b-570f-4a2b-844d-4e7434cd83a2\") "
Jul 20 19:03:28.951218 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:28.951066    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f841476b-570f-4a2b-844d-4e7434cd83a2-prometheus-k8s-rulefiles-2\") pod \"f841476b-570f-4a2b-844d-4e7434cd83a2\" (UID: \"f841476b-570f-4a2b-844d-4e7434cd83a2\") "
Jul 20 19:03:28.951218 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:28.951094    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f841476b-570f-4a2b-844d-4e7434cd83a2-secret-metrics-client-certs\") pod \"f841476b-570f-4a2b-844d-4e7434cd83a2\" (UID: \"f841476b-570f-4a2b-844d-4e7434cd83a2\") "
Jul 20 19:03:28.951218 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:28.951112    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f841476b-570f-4a2b-844d-4e7434cd83a2-prometheus-k8s-db\") pod \"f841476b-570f-4a2b-844d-4e7434cd83a2\" (UID: \"f841476b-570f-4a2b-844d-4e7434cd83a2\") "
Jul 20 19:03:28.951218 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:28.951130    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f841476b-570f-4a2b-844d-4e7434cd83a2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"f841476b-570f-4a2b-844d-4e7434cd83a2\" (UID: \"f841476b-570f-4a2b-844d-4e7434cd83a2\") "
Jul 20 19:03:28.951218 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:28.951150    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f841476b-570f-4a2b-844d-4e7434cd83a2-secret-grpc-tls\") pod \"f841476b-570f-4a2b-844d-4e7434cd83a2\" (UID: \"f841476b-570f-4a2b-844d-4e7434cd83a2\") "
Jul 20 19:03:28.951218 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:28.951159    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f841476b-570f-4a2b-844d-4e7434cd83a2-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "f841476b-570f-4a2b-844d-4e7434cd83a2" (UID: "f841476b-570f-4a2b-844d-4e7434cd83a2"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 19:03:28.951218 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:28.951173    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f841476b-570f-4a2b-844d-4e7434cd83a2-prometheus-k8s-rulefiles-0\") pod \"f841476b-570f-4a2b-844d-4e7434cd83a2\" (UID: \"f841476b-570f-4a2b-844d-4e7434cd83a2\") "
Jul 20 19:03:28.951218 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:28.951197    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f841476b-570f-4a2b-844d-4e7434cd83a2-configmap-serving-certs-ca-bundle\") pod \"f841476b-570f-4a2b-844d-4e7434cd83a2\" (UID: \"f841476b-570f-4a2b-844d-4e7434cd83a2\") "
Jul 20 19:03:28.951947 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:28.951654    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f841476b-570f-4a2b-844d-4e7434cd83a2-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "f841476b-570f-4a2b-844d-4e7434cd83a2" (UID: "f841476b-570f-4a2b-844d-4e7434cd83a2"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 19:03:28.951947 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:28.951720    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f841476b-570f-4a2b-844d-4e7434cd83a2-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "f841476b-570f-4a2b-844d-4e7434cd83a2" (UID: "f841476b-570f-4a2b-844d-4e7434cd83a2"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 19:03:28.952888 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:28.952194    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f841476b-570f-4a2b-844d-4e7434cd83a2-config\") pod \"f841476b-570f-4a2b-844d-4e7434cd83a2\" (UID: \"f841476b-570f-4a2b-844d-4e7434cd83a2\") "
Jul 20 19:03:28.952888 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:28.952206    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f841476b-570f-4a2b-844d-4e7434cd83a2-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "f841476b-570f-4a2b-844d-4e7434cd83a2" (UID: "f841476b-570f-4a2b-844d-4e7434cd83a2"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 19:03:28.952888 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:28.952240    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2lll6\" (UniqueName: \"kubernetes.io/projected/f841476b-570f-4a2b-844d-4e7434cd83a2-kube-api-access-2lll6\") pod \"f841476b-570f-4a2b-844d-4e7434cd83a2\" (UID: \"f841476b-570f-4a2b-844d-4e7434cd83a2\") "
Jul 20 19:03:28.952888 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:28.952277    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f841476b-570f-4a2b-844d-4e7434cd83a2-thanos-prometheus-http-client-file\") pod \"f841476b-570f-4a2b-844d-4e7434cd83a2\" (UID: \"f841476b-570f-4a2b-844d-4e7434cd83a2\") "
Jul 20 19:03:28.952888 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:28.952576    2563 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f841476b-570f-4a2b-844d-4e7434cd83a2-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\""
Jul 20 19:03:28.952888 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:28.952596    2563 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f841476b-570f-4a2b-844d-4e7434cd83a2-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\""
Jul 20 19:03:28.952888 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:28.952613    2563 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f841476b-570f-4a2b-844d-4e7434cd83a2-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\""
Jul 20 19:03:28.952888 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:28.952626    2563 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f841476b-570f-4a2b-844d-4e7434cd83a2-prometheus-trusted-ca-bundle\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\""
Jul 20 19:03:28.952888 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:28.952673    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f841476b-570f-4a2b-844d-4e7434cd83a2-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "f841476b-570f-4a2b-844d-4e7434cd83a2" (UID: "f841476b-570f-4a2b-844d-4e7434cd83a2"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 19:03:28.952888 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:28.952719    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f841476b-570f-4a2b-844d-4e7434cd83a2-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "f841476b-570f-4a2b-844d-4e7434cd83a2" (UID: "f841476b-570f-4a2b-844d-4e7434cd83a2"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 19:03:28.953593 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:28.953435    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f841476b-570f-4a2b-844d-4e7434cd83a2-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "f841476b-570f-4a2b-844d-4e7434cd83a2" (UID: "f841476b-570f-4a2b-844d-4e7434cd83a2"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:03:28.953981 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:28.953932    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f841476b-570f-4a2b-844d-4e7434cd83a2-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "f841476b-570f-4a2b-844d-4e7434cd83a2" (UID: "f841476b-570f-4a2b-844d-4e7434cd83a2"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 19:03:28.954414 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:28.954379    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f841476b-570f-4a2b-844d-4e7434cd83a2-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "f841476b-570f-4a2b-844d-4e7434cd83a2" (UID: "f841476b-570f-4a2b-844d-4e7434cd83a2"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 19:03:28.954932 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:28.954835    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f841476b-570f-4a2b-844d-4e7434cd83a2-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "f841476b-570f-4a2b-844d-4e7434cd83a2" (UID: "f841476b-570f-4a2b-844d-4e7434cd83a2"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 19:03:28.954932 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:28.954900    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f841476b-570f-4a2b-844d-4e7434cd83a2-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "f841476b-570f-4a2b-844d-4e7434cd83a2" (UID: "f841476b-570f-4a2b-844d-4e7434cd83a2"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 19:03:28.955176 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:28.955150    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f841476b-570f-4a2b-844d-4e7434cd83a2-config-out" (OuterVolumeSpecName: "config-out") pod "f841476b-570f-4a2b-844d-4e7434cd83a2" (UID: "f841476b-570f-4a2b-844d-4e7434cd83a2"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:03:28.955905 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:28.955877    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f841476b-570f-4a2b-844d-4e7434cd83a2-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "f841476b-570f-4a2b-844d-4e7434cd83a2" (UID: "f841476b-570f-4a2b-844d-4e7434cd83a2"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 19:03:28.956005 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:28.955973    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f841476b-570f-4a2b-844d-4e7434cd83a2-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "f841476b-570f-4a2b-844d-4e7434cd83a2" (UID: "f841476b-570f-4a2b-844d-4e7434cd83a2"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 19:03:28.956061 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:28.955995    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f841476b-570f-4a2b-844d-4e7434cd83a2-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "f841476b-570f-4a2b-844d-4e7434cd83a2" (UID: "f841476b-570f-4a2b-844d-4e7434cd83a2"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 19:03:28.956888 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:28.956865    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f841476b-570f-4a2b-844d-4e7434cd83a2-kube-api-access-2lll6" (OuterVolumeSpecName: "kube-api-access-2lll6") pod "f841476b-570f-4a2b-844d-4e7434cd83a2" (UID: "f841476b-570f-4a2b-844d-4e7434cd83a2"). InnerVolumeSpecName "kube-api-access-2lll6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:03:28.957052 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:28.957029    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f841476b-570f-4a2b-844d-4e7434cd83a2-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "f841476b-570f-4a2b-844d-4e7434cd83a2" (UID: "f841476b-570f-4a2b-844d-4e7434cd83a2"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 19:03:28.957265 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:28.957246    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f841476b-570f-4a2b-844d-4e7434cd83a2-config" (OuterVolumeSpecName: "config") pod "f841476b-570f-4a2b-844d-4e7434cd83a2" (UID: "f841476b-570f-4a2b-844d-4e7434cd83a2"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 19:03:28.957482 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:28.957457    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f841476b-570f-4a2b-844d-4e7434cd83a2-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "f841476b-570f-4a2b-844d-4e7434cd83a2" (UID: "f841476b-570f-4a2b-844d-4e7434cd83a2"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:03:28.964676 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:28.964654    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f841476b-570f-4a2b-844d-4e7434cd83a2-web-config" (OuterVolumeSpecName: "web-config") pod "f841476b-570f-4a2b-844d-4e7434cd83a2" (UID: "f841476b-570f-4a2b-844d-4e7434cd83a2"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 19:03:29.053625 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.053590    2563 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f841476b-570f-4a2b-844d-4e7434cd83a2-config-out\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\""
Jul 20 19:03:29.053625 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.053623    2563 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f841476b-570f-4a2b-844d-4e7434cd83a2-secret-prometheus-k8s-tls\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\""
Jul 20 19:03:29.053784 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.053639    2563 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f841476b-570f-4a2b-844d-4e7434cd83a2-secret-kube-rbac-proxy\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\""
Jul 20 19:03:29.053784 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.053653    2563 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f841476b-570f-4a2b-844d-4e7434cd83a2-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\""
Jul 20 19:03:29.053784 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.053666    2563 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f841476b-570f-4a2b-844d-4e7434cd83a2-tls-assets\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\""
Jul 20 19:03:29.053784 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.053678    2563 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f841476b-570f-4a2b-844d-4e7434cd83a2-web-config\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\""
Jul 20 19:03:29.053784 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.053690    2563 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f841476b-570f-4a2b-844d-4e7434cd83a2-configmap-metrics-client-ca\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\""
Jul 20 19:03:29.053784 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.053702    2563 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f841476b-570f-4a2b-844d-4e7434cd83a2-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\""
Jul 20 19:03:29.053784 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.053715    2563 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f841476b-570f-4a2b-844d-4e7434cd83a2-secret-metrics-client-certs\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\""
Jul 20 19:03:29.053784 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.053728    2563 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f841476b-570f-4a2b-844d-4e7434cd83a2-prometheus-k8s-db\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\""
Jul 20 19:03:29.053784 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.053742    2563 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f841476b-570f-4a2b-844d-4e7434cd83a2-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\""
Jul 20 19:03:29.053784 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.053755    2563 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f841476b-570f-4a2b-844d-4e7434cd83a2-secret-grpc-tls\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\""
Jul 20 19:03:29.053784 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.053769    2563 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f841476b-570f-4a2b-844d-4e7434cd83a2-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\""
Jul 20 19:03:29.053784 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.053782    2563 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/f841476b-570f-4a2b-844d-4e7434cd83a2-config\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\""
Jul 20 19:03:29.054133 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.053795    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2lll6\" (UniqueName: \"kubernetes.io/projected/f841476b-570f-4a2b-844d-4e7434cd83a2-kube-api-access-2lll6\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\""
Jul 20 19:03:29.054133 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.053809    2563 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f841476b-570f-4a2b-844d-4e7434cd83a2-thanos-prometheus-http-client-file\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\""
Jul 20 19:03:29.632433 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.632404    2563 generic.go:356] "Generic (PLEG): container finished" podID="f841476b-570f-4a2b-844d-4e7434cd83a2" containerID="9d8aff00c78379f8087bdce5afe10f53197b7c4b1b4d79f33223924201248e5c" exitCode=0
Jul 20 19:03:29.632433 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.632428    2563 generic.go:356] "Generic (PLEG): container finished" podID="f841476b-570f-4a2b-844d-4e7434cd83a2" containerID="240632a6882f2668ad03bab78a2571b5b7494273a6a1da8a9a2a305b35d24b2c" exitCode=0
Jul 20 19:03:29.632433 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.632434    2563 generic.go:356] "Generic (PLEG): container finished" podID="f841476b-570f-4a2b-844d-4e7434cd83a2" containerID="490adb6f721370bae5e05becd60b27ee2394c92e741d63c894f87953833377ac" exitCode=0
Jul 20 19:03:29.632433 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.632440    2563 generic.go:356] "Generic (PLEG): container finished" podID="f841476b-570f-4a2b-844d-4e7434cd83a2" containerID="db52388b111b592a9195389ad8cccff3624e73c1f6a8de1b2c09f038928187e7" exitCode=0
Jul 20 19:03:29.632834 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.632445    2563 generic.go:356] "Generic (PLEG): container finished" podID="f841476b-570f-4a2b-844d-4e7434cd83a2" containerID="3ca46ceb40f10e665988b8834e1b0a1f9dc5dd9c6d4ec16b463b34173076f419" exitCode=0
Jul 20 19:03:29.632834 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.632449    2563 generic.go:356] "Generic (PLEG): container finished" podID="f841476b-570f-4a2b-844d-4e7434cd83a2" containerID="c39f310305190a933038a46cc324d7f3980950ccb3751dad3a0e2f5205b2fdee" exitCode=0
Jul 20 19:03:29.632834 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.632489    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:03:29.632834 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.632485    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f841476b-570f-4a2b-844d-4e7434cd83a2","Type":"ContainerDied","Data":"9d8aff00c78379f8087bdce5afe10f53197b7c4b1b4d79f33223924201248e5c"}
Jul 20 19:03:29.632834 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.632619    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f841476b-570f-4a2b-844d-4e7434cd83a2","Type":"ContainerDied","Data":"240632a6882f2668ad03bab78a2571b5b7494273a6a1da8a9a2a305b35d24b2c"}
Jul 20 19:03:29.632834 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.632649    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f841476b-570f-4a2b-844d-4e7434cd83a2","Type":"ContainerDied","Data":"490adb6f721370bae5e05becd60b27ee2394c92e741d63c894f87953833377ac"}
Jul 20 19:03:29.632834 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.632672    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f841476b-570f-4a2b-844d-4e7434cd83a2","Type":"ContainerDied","Data":"db52388b111b592a9195389ad8cccff3624e73c1f6a8de1b2c09f038928187e7"}
Jul 20 19:03:29.632834 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.632688    2563 scope.go:117] "RemoveContainer" containerID="9d8aff00c78379f8087bdce5afe10f53197b7c4b1b4d79f33223924201248e5c"
Jul 20 19:03:29.632834 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.632697    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f841476b-570f-4a2b-844d-4e7434cd83a2","Type":"ContainerDied","Data":"3ca46ceb40f10e665988b8834e1b0a1f9dc5dd9c6d4ec16b463b34173076f419"}
Jul 20 19:03:29.632834 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.632721    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f841476b-570f-4a2b-844d-4e7434cd83a2","Type":"ContainerDied","Data":"c39f310305190a933038a46cc324d7f3980950ccb3751dad3a0e2f5205b2fdee"}
Jul 20 19:03:29.632834 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.632747    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f841476b-570f-4a2b-844d-4e7434cd83a2","Type":"ContainerDied","Data":"7fed6d4facb997d0d71eb9748202c3d6ea144dab1a076b72c879dce5ac34f5b3"}
Jul 20 19:03:29.640692 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.640641    2563 scope.go:117] "RemoveContainer" containerID="240632a6882f2668ad03bab78a2571b5b7494273a6a1da8a9a2a305b35d24b2c"
Jul 20 19:03:29.647413 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.647395    2563 scope.go:117] "RemoveContainer" containerID="490adb6f721370bae5e05becd60b27ee2394c92e741d63c894f87953833377ac"
Jul 20 19:03:29.653837 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.653815    2563 scope.go:117] "RemoveContainer" containerID="db52388b111b592a9195389ad8cccff3624e73c1f6a8de1b2c09f038928187e7"
Jul 20 19:03:29.655293 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.655273    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 20 19:03:29.661160 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.661139    2563 scope.go:117] "RemoveContainer" containerID="3ca46ceb40f10e665988b8834e1b0a1f9dc5dd9c6d4ec16b463b34173076f419"
Jul 20 19:03:29.662231 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.662213    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 20 19:03:29.667617 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.667599    2563 scope.go:117] "RemoveContainer" containerID="c39f310305190a933038a46cc324d7f3980950ccb3751dad3a0e2f5205b2fdee"
Jul 20 19:03:29.674212 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.674195    2563 scope.go:117] "RemoveContainer" containerID="b5e1aa9f35a5849ece1e073f0d63c6be01ffaac5ea8a156e47a63635445cef26"
Jul 20 19:03:29.680616 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.680600    2563 scope.go:117] "RemoveContainer" containerID="9d8aff00c78379f8087bdce5afe10f53197b7c4b1b4d79f33223924201248e5c"
Jul 20 19:03:29.680825 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:03:29.680807    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d8aff00c78379f8087bdce5afe10f53197b7c4b1b4d79f33223924201248e5c\": container with ID starting with 9d8aff00c78379f8087bdce5afe10f53197b7c4b1b4d79f33223924201248e5c not found: ID does not exist" containerID="9d8aff00c78379f8087bdce5afe10f53197b7c4b1b4d79f33223924201248e5c"
Jul 20 19:03:29.680868 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.680834    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d8aff00c78379f8087bdce5afe10f53197b7c4b1b4d79f33223924201248e5c"} err="failed to get container status \"9d8aff00c78379f8087bdce5afe10f53197b7c4b1b4d79f33223924201248e5c\": rpc error: code = NotFound desc = could not find container \"9d8aff00c78379f8087bdce5afe10f53197b7c4b1b4d79f33223924201248e5c\": container with ID starting with 9d8aff00c78379f8087bdce5afe10f53197b7c4b1b4d79f33223924201248e5c not found: ID does not exist"
Jul 20 19:03:29.680868 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.680858    2563 scope.go:117] "RemoveContainer" containerID="240632a6882f2668ad03bab78a2571b5b7494273a6a1da8a9a2a305b35d24b2c"
Jul 20 19:03:29.681056 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:03:29.681040    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"240632a6882f2668ad03bab78a2571b5b7494273a6a1da8a9a2a305b35d24b2c\": container with ID starting with 240632a6882f2668ad03bab78a2571b5b7494273a6a1da8a9a2a305b35d24b2c not found: ID does not exist" containerID="240632a6882f2668ad03bab78a2571b5b7494273a6a1da8a9a2a305b35d24b2c"
Jul 20 19:03:29.681099 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.681061    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"240632a6882f2668ad03bab78a2571b5b7494273a6a1da8a9a2a305b35d24b2c"} err="failed to get container status \"240632a6882f2668ad03bab78a2571b5b7494273a6a1da8a9a2a305b35d24b2c\": rpc error: code = NotFound desc = could not find container \"240632a6882f2668ad03bab78a2571b5b7494273a6a1da8a9a2a305b35d24b2c\": container with ID starting with 240632a6882f2668ad03bab78a2571b5b7494273a6a1da8a9a2a305b35d24b2c not found: ID does not exist"
Jul 20 19:03:29.681099 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.681076    2563 scope.go:117] "RemoveContainer" containerID="490adb6f721370bae5e05becd60b27ee2394c92e741d63c894f87953833377ac"
Jul 20 19:03:29.681280 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:03:29.681266    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"490adb6f721370bae5e05becd60b27ee2394c92e741d63c894f87953833377ac\": container with ID starting with 490adb6f721370bae5e05becd60b27ee2394c92e741d63c894f87953833377ac not found: ID does not exist" containerID="490adb6f721370bae5e05becd60b27ee2394c92e741d63c894f87953833377ac"
Jul 20 19:03:29.681322 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.681282    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"490adb6f721370bae5e05becd60b27ee2394c92e741d63c894f87953833377ac"} err="failed to get container status \"490adb6f721370bae5e05becd60b27ee2394c92e741d63c894f87953833377ac\": rpc error: code = NotFound desc = could not find container \"490adb6f721370bae5e05becd60b27ee2394c92e741d63c894f87953833377ac\": container with ID starting with 490adb6f721370bae5e05becd60b27ee2394c92e741d63c894f87953833377ac not found: ID does not exist"
Jul 20 19:03:29.681322 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.681294    2563 scope.go:117] "RemoveContainer" containerID="db52388b111b592a9195389ad8cccff3624e73c1f6a8de1b2c09f038928187e7"
Jul 20 19:03:29.681564 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:03:29.681546    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db52388b111b592a9195389ad8cccff3624e73c1f6a8de1b2c09f038928187e7\": container with ID starting with db52388b111b592a9195389ad8cccff3624e73c1f6a8de1b2c09f038928187e7 not found: ID does not exist" containerID="db52388b111b592a9195389ad8cccff3624e73c1f6a8de1b2c09f038928187e7"
Jul 20 19:03:29.681605 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.681574    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db52388b111b592a9195389ad8cccff3624e73c1f6a8de1b2c09f038928187e7"} err="failed to get container status \"db52388b111b592a9195389ad8cccff3624e73c1f6a8de1b2c09f038928187e7\": rpc error: code = NotFound desc = could not find container \"db52388b111b592a9195389ad8cccff3624e73c1f6a8de1b2c09f038928187e7\": container with ID starting with db52388b111b592a9195389ad8cccff3624e73c1f6a8de1b2c09f038928187e7 not found: ID does not exist"
Jul 20 19:03:29.681605 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.681597    2563 scope.go:117] "RemoveContainer" containerID="3ca46ceb40f10e665988b8834e1b0a1f9dc5dd9c6d4ec16b463b34173076f419"
Jul 20 19:03:29.681787 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:03:29.681774    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ca46ceb40f10e665988b8834e1b0a1f9dc5dd9c6d4ec16b463b34173076f419\": container with ID starting with 3ca46ceb40f10e665988b8834e1b0a1f9dc5dd9c6d4ec16b463b34173076f419 not found: ID does not exist" containerID="3ca46ceb40f10e665988b8834e1b0a1f9dc5dd9c6d4ec16b463b34173076f419"
Jul 20 19:03:29.681824 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.681789    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ca46ceb40f10e665988b8834e1b0a1f9dc5dd9c6d4ec16b463b34173076f419"} err="failed to get container status \"3ca46ceb40f10e665988b8834e1b0a1f9dc5dd9c6d4ec16b463b34173076f419\": rpc error: code = NotFound desc = could not find container \"3ca46ceb40f10e665988b8834e1b0a1f9dc5dd9c6d4ec16b463b34173076f419\": container with ID starting with 3ca46ceb40f10e665988b8834e1b0a1f9dc5dd9c6d4ec16b463b34173076f419 not found: ID does not exist"
Jul 20 19:03:29.681824 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.681800    2563 scope.go:117] "RemoveContainer" containerID="c39f310305190a933038a46cc324d7f3980950ccb3751dad3a0e2f5205b2fdee"
Jul 20 19:03:29.681992 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:03:29.681977    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c39f310305190a933038a46cc324d7f3980950ccb3751dad3a0e2f5205b2fdee\": container with ID starting with c39f310305190a933038a46cc324d7f3980950ccb3751dad3a0e2f5205b2fdee not found: ID does not exist" containerID="c39f310305190a933038a46cc324d7f3980950ccb3751dad3a0e2f5205b2fdee"
Jul 20 19:03:29.682027 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.681994    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c39f310305190a933038a46cc324d7f3980950ccb3751dad3a0e2f5205b2fdee"} err="failed to get container status \"c39f310305190a933038a46cc324d7f3980950ccb3751dad3a0e2f5205b2fdee\": rpc error: code = NotFound desc = could not find container \"c39f310305190a933038a46cc324d7f3980950ccb3751dad3a0e2f5205b2fdee\": container with ID starting with c39f310305190a933038a46cc324d7f3980950ccb3751dad3a0e2f5205b2fdee not found: ID does not exist"
Jul 20 19:03:29.682027 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.682006    2563 scope.go:117] "RemoveContainer" containerID="b5e1aa9f35a5849ece1e073f0d63c6be01ffaac5ea8a156e47a63635445cef26"
Jul 20 19:03:29.682218 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:03:29.682202    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b5e1aa9f35a5849ece1e073f0d63c6be01ffaac5ea8a156e47a63635445cef26\": container with ID starting with b5e1aa9f35a5849ece1e073f0d63c6be01ffaac5ea8a156e47a63635445cef26 not found: ID does not exist" containerID="b5e1aa9f35a5849ece1e073f0d63c6be01ffaac5ea8a156e47a63635445cef26"
Jul 20 19:03:29.682254 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.682222    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5e1aa9f35a5849ece1e073f0d63c6be01ffaac5ea8a156e47a63635445cef26"} err="failed to get container status \"b5e1aa9f35a5849ece1e073f0d63c6be01ffaac5ea8a156e47a63635445cef26\": rpc error: code = NotFound desc = could not find container \"b5e1aa9f35a5849ece1e073f0d63c6be01ffaac5ea8a156e47a63635445cef26\": container with ID starting with b5e1aa9f35a5849ece1e073f0d63c6be01ffaac5ea8a156e47a63635445cef26 not found: ID does not exist"
Jul 20 19:03:29.682254 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.682233    2563 scope.go:117] "RemoveContainer" containerID="9d8aff00c78379f8087bdce5afe10f53197b7c4b1b4d79f33223924201248e5c"
Jul 20 19:03:29.682559 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.682541    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d8aff00c78379f8087bdce5afe10f53197b7c4b1b4d79f33223924201248e5c"} err="failed to get container status \"9d8aff00c78379f8087bdce5afe10f53197b7c4b1b4d79f33223924201248e5c\": rpc error: code = NotFound desc = could not find container \"9d8aff00c78379f8087bdce5afe10f53197b7c4b1b4d79f33223924201248e5c\": container with ID starting with 9d8aff00c78379f8087bdce5afe10f53197b7c4b1b4d79f33223924201248e5c not found: ID does not exist"
Jul 20 19:03:29.682604 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.682559    2563 scope.go:117] "RemoveContainer" containerID="240632a6882f2668ad03bab78a2571b5b7494273a6a1da8a9a2a305b35d24b2c"
Jul 20 19:03:29.682788 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.682769    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"240632a6882f2668ad03bab78a2571b5b7494273a6a1da8a9a2a305b35d24b2c"} err="failed to get container status \"240632a6882f2668ad03bab78a2571b5b7494273a6a1da8a9a2a305b35d24b2c\": rpc error: code = NotFound desc = could not find container \"240632a6882f2668ad03bab78a2571b5b7494273a6a1da8a9a2a305b35d24b2c\": container with ID starting with 240632a6882f2668ad03bab78a2571b5b7494273a6a1da8a9a2a305b35d24b2c not found: ID does not exist"
Jul 20 19:03:29.682847 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.682790    2563 scope.go:117] "RemoveContainer" containerID="490adb6f721370bae5e05becd60b27ee2394c92e741d63c894f87953833377ac"
Jul 20 19:03:29.683031 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.683014    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"490adb6f721370bae5e05becd60b27ee2394c92e741d63c894f87953833377ac"} err="failed to get container status \"490adb6f721370bae5e05becd60b27ee2394c92e741d63c894f87953833377ac\": rpc error: code = NotFound desc = could not find container \"490adb6f721370bae5e05becd60b27ee2394c92e741d63c894f87953833377ac\": container with ID starting with 490adb6f721370bae5e05becd60b27ee2394c92e741d63c894f87953833377ac not found: ID does not exist"
Jul 20 19:03:29.683080 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.683032    2563 scope.go:117] "RemoveContainer" containerID="db52388b111b592a9195389ad8cccff3624e73c1f6a8de1b2c09f038928187e7"
Jul 20 19:03:29.683215 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.683200    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db52388b111b592a9195389ad8cccff3624e73c1f6a8de1b2c09f038928187e7"} err="failed to get container status \"db52388b111b592a9195389ad8cccff3624e73c1f6a8de1b2c09f038928187e7\": rpc error: code = NotFound desc = could not find container \"db52388b111b592a9195389ad8cccff3624e73c1f6a8de1b2c09f038928187e7\": container with ID starting with db52388b111b592a9195389ad8cccff3624e73c1f6a8de1b2c09f038928187e7 not found: ID does not exist"
Jul 20 19:03:29.683256 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.683215    2563 scope.go:117] "RemoveContainer" containerID="3ca46ceb40f10e665988b8834e1b0a1f9dc5dd9c6d4ec16b463b34173076f419"
Jul 20 19:03:29.683481 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.683463    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ca46ceb40f10e665988b8834e1b0a1f9dc5dd9c6d4ec16b463b34173076f419"} err="failed to get container status \"3ca46ceb40f10e665988b8834e1b0a1f9dc5dd9c6d4ec16b463b34173076f419\": rpc error: code = NotFound desc = could not find container \"3ca46ceb40f10e665988b8834e1b0a1f9dc5dd9c6d4ec16b463b34173076f419\": container with ID starting with 3ca46ceb40f10e665988b8834e1b0a1f9dc5dd9c6d4ec16b463b34173076f419 not found: ID does not exist"
Jul 20 19:03:29.683550 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.683482    2563 scope.go:117] "RemoveContainer" containerID="c39f310305190a933038a46cc324d7f3980950ccb3751dad3a0e2f5205b2fdee"
Jul 20 19:03:29.683688 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.683670    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c39f310305190a933038a46cc324d7f3980950ccb3751dad3a0e2f5205b2fdee"} err="failed to get container status \"c39f310305190a933038a46cc324d7f3980950ccb3751dad3a0e2f5205b2fdee\": rpc error: code = NotFound desc = could not find container \"c39f310305190a933038a46cc324d7f3980950ccb3751dad3a0e2f5205b2fdee\": container with ID starting with c39f310305190a933038a46cc324d7f3980950ccb3751dad3a0e2f5205b2fdee not found: ID does not exist"
Jul 20 19:03:29.683726 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.683690    2563 scope.go:117] "RemoveContainer" containerID="b5e1aa9f35a5849ece1e073f0d63c6be01ffaac5ea8a156e47a63635445cef26"
Jul 20 19:03:29.683900 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.683884    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5e1aa9f35a5849ece1e073f0d63c6be01ffaac5ea8a156e47a63635445cef26"} err="failed to get container status \"b5e1aa9f35a5849ece1e073f0d63c6be01ffaac5ea8a156e47a63635445cef26\": rpc error: code = NotFound desc = could not find container \"b5e1aa9f35a5849ece1e073f0d63c6be01ffaac5ea8a156e47a63635445cef26\": container with ID starting with b5e1aa9f35a5849ece1e073f0d63c6be01ffaac5ea8a156e47a63635445cef26 not found: ID does not exist"
Jul 20 19:03:29.683937 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.683900    2563 scope.go:117] "RemoveContainer" containerID="9d8aff00c78379f8087bdce5afe10f53197b7c4b1b4d79f33223924201248e5c"
Jul 20 19:03:29.684100 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.684080    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d8aff00c78379f8087bdce5afe10f53197b7c4b1b4d79f33223924201248e5c"} err="failed to get container status \"9d8aff00c78379f8087bdce5afe10f53197b7c4b1b4d79f33223924201248e5c\": rpc error: code = NotFound desc = could not find container \"9d8aff00c78379f8087bdce5afe10f53197b7c4b1b4d79f33223924201248e5c\": container with ID starting with 9d8aff00c78379f8087bdce5afe10f53197b7c4b1b4d79f33223924201248e5c not found: ID does not exist"
Jul 20 19:03:29.684139 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.684101    2563 scope.go:117] "RemoveContainer" containerID="240632a6882f2668ad03bab78a2571b5b7494273a6a1da8a9a2a305b35d24b2c"
Jul 20 19:03:29.684291 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.684274    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"240632a6882f2668ad03bab78a2571b5b7494273a6a1da8a9a2a305b35d24b2c"} err="failed to get container status \"240632a6882f2668ad03bab78a2571b5b7494273a6a1da8a9a2a305b35d24b2c\": rpc error: code = NotFound desc = could not find container \"240632a6882f2668ad03bab78a2571b5b7494273a6a1da8a9a2a305b35d24b2c\": container with ID starting with 240632a6882f2668ad03bab78a2571b5b7494273a6a1da8a9a2a305b35d24b2c not found: ID does not exist"
Jul 20 19:03:29.684332 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.684292    2563 scope.go:117] "RemoveContainer" containerID="490adb6f721370bae5e05becd60b27ee2394c92e741d63c894f87953833377ac"
Jul 20 19:03:29.684514 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.684497    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"490adb6f721370bae5e05becd60b27ee2394c92e741d63c894f87953833377ac"} err="failed to get container status \"490adb6f721370bae5e05becd60b27ee2394c92e741d63c894f87953833377ac\": rpc error: code = NotFound desc = could not find container \"490adb6f721370bae5e05becd60b27ee2394c92e741d63c894f87953833377ac\": container with ID starting with 490adb6f721370bae5e05becd60b27ee2394c92e741d63c894f87953833377ac not found: ID does not exist"
Jul 20 19:03:29.684575 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.684515    2563 scope.go:117] "RemoveContainer" containerID="db52388b111b592a9195389ad8cccff3624e73c1f6a8de1b2c09f038928187e7"
Jul 20 19:03:29.684737 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.684720    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db52388b111b592a9195389ad8cccff3624e73c1f6a8de1b2c09f038928187e7"} err="failed to get container status \"db52388b111b592a9195389ad8cccff3624e73c1f6a8de1b2c09f038928187e7\": rpc error: code = NotFound desc = could not find container \"db52388b111b592a9195389ad8cccff3624e73c1f6a8de1b2c09f038928187e7\": container with ID starting with db52388b111b592a9195389ad8cccff3624e73c1f6a8de1b2c09f038928187e7 not found: ID does not exist"
Jul 20 19:03:29.684782 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.684738    2563 scope.go:117] "RemoveContainer" containerID="3ca46ceb40f10e665988b8834e1b0a1f9dc5dd9c6d4ec16b463b34173076f419"
Jul 20 19:03:29.684967 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.684936    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ca46ceb40f10e665988b8834e1b0a1f9dc5dd9c6d4ec16b463b34173076f419"} err="failed to get container status \"3ca46ceb40f10e665988b8834e1b0a1f9dc5dd9c6d4ec16b463b34173076f419\": rpc error: code = NotFound desc = could not find container \"3ca46ceb40f10e665988b8834e1b0a1f9dc5dd9c6d4ec16b463b34173076f419\": container with ID starting with 3ca46ceb40f10e665988b8834e1b0a1f9dc5dd9c6d4ec16b463b34173076f419 not found: ID does not exist"
Jul 20 19:03:29.684967 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.684956    2563 scope.go:117] "RemoveContainer" containerID="c39f310305190a933038a46cc324d7f3980950ccb3751dad3a0e2f5205b2fdee"
Jul 20 19:03:29.685257 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.685232    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c39f310305190a933038a46cc324d7f3980950ccb3751dad3a0e2f5205b2fdee"} err="failed to get container status \"c39f310305190a933038a46cc324d7f3980950ccb3751dad3a0e2f5205b2fdee\": rpc error: code = NotFound desc = could not find container \"c39f310305190a933038a46cc324d7f3980950ccb3751dad3a0e2f5205b2fdee\": container with ID starting with c39f310305190a933038a46cc324d7f3980950ccb3751dad3a0e2f5205b2fdee not found: ID does not exist"
Jul 20 19:03:29.685365 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.685258    2563 scope.go:117] "RemoveContainer" containerID="b5e1aa9f35a5849ece1e073f0d63c6be01ffaac5ea8a156e47a63635445cef26"
Jul 20 19:03:29.685583 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.685564    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5e1aa9f35a5849ece1e073f0d63c6be01ffaac5ea8a156e47a63635445cef26"} err="failed to get container status \"b5e1aa9f35a5849ece1e073f0d63c6be01ffaac5ea8a156e47a63635445cef26\": rpc error: code = NotFound desc = could not find container \"b5e1aa9f35a5849ece1e073f0d63c6be01ffaac5ea8a156e47a63635445cef26\": container with ID starting with b5e1aa9f35a5849ece1e073f0d63c6be01ffaac5ea8a156e47a63635445cef26 not found: ID does not exist"
Jul 20 19:03:29.685642 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.685584    2563 scope.go:117] "RemoveContainer" containerID="9d8aff00c78379f8087bdce5afe10f53197b7c4b1b4d79f33223924201248e5c"
Jul 20 19:03:29.685844 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.685820    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d8aff00c78379f8087bdce5afe10f53197b7c4b1b4d79f33223924201248e5c"} err="failed to get container status \"9d8aff00c78379f8087bdce5afe10f53197b7c4b1b4d79f33223924201248e5c\": rpc error: code = NotFound desc = could not find container \"9d8aff00c78379f8087bdce5afe10f53197b7c4b1b4d79f33223924201248e5c\": container with ID starting with 9d8aff00c78379f8087bdce5afe10f53197b7c4b1b4d79f33223924201248e5c not found: ID does not exist"
Jul 20 19:03:29.685928 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.685846    2563 scope.go:117] "RemoveContainer" containerID="240632a6882f2668ad03bab78a2571b5b7494273a6a1da8a9a2a305b35d24b2c"
Jul 20 19:03:29.686109 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.686089    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"240632a6882f2668ad03bab78a2571b5b7494273a6a1da8a9a2a305b35d24b2c"} err="failed to get container status \"240632a6882f2668ad03bab78a2571b5b7494273a6a1da8a9a2a305b35d24b2c\": rpc error: code = NotFound desc = could not find container \"240632a6882f2668ad03bab78a2571b5b7494273a6a1da8a9a2a305b35d24b2c\": container with ID starting with 240632a6882f2668ad03bab78a2571b5b7494273a6a1da8a9a2a305b35d24b2c not found: ID does not exist"
Jul 20 19:03:29.686174 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.686113    2563 scope.go:117] "RemoveContainer" containerID="490adb6f721370bae5e05becd60b27ee2394c92e741d63c894f87953833377ac"
Jul 20 19:03:29.686393 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.686373    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"490adb6f721370bae5e05becd60b27ee2394c92e741d63c894f87953833377ac"} err="failed to get container status \"490adb6f721370bae5e05becd60b27ee2394c92e741d63c894f87953833377ac\": rpc error: code = NotFound desc = could not find container \"490adb6f721370bae5e05becd60b27ee2394c92e741d63c894f87953833377ac\": container with ID starting with 490adb6f721370bae5e05becd60b27ee2394c92e741d63c894f87953833377ac not found: ID does not exist"
Jul 20 19:03:29.686474 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.686394    2563 scope.go:117] "RemoveContainer" containerID="db52388b111b592a9195389ad8cccff3624e73c1f6a8de1b2c09f038928187e7"
Jul 20 19:03:29.686675 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.686617    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db52388b111b592a9195389ad8cccff3624e73c1f6a8de1b2c09f038928187e7"} err="failed to get container status \"db52388b111b592a9195389ad8cccff3624e73c1f6a8de1b2c09f038928187e7\": rpc error: code = NotFound desc = could not find container \"db52388b111b592a9195389ad8cccff3624e73c1f6a8de1b2c09f038928187e7\": container with ID starting with db52388b111b592a9195389ad8cccff3624e73c1f6a8de1b2c09f038928187e7 not found: ID does not exist"
Jul 20 19:03:29.686675 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.686637    2563 scope.go:117] "RemoveContainer" containerID="3ca46ceb40f10e665988b8834e1b0a1f9dc5dd9c6d4ec16b463b34173076f419"
Jul 20 19:03:29.686938 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.686852    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ca46ceb40f10e665988b8834e1b0a1f9dc5dd9c6d4ec16b463b34173076f419"} err="failed to get container status \"3ca46ceb40f10e665988b8834e1b0a1f9dc5dd9c6d4ec16b463b34173076f419\": rpc error: code = NotFound desc = could not find container \"3ca46ceb40f10e665988b8834e1b0a1f9dc5dd9c6d4ec16b463b34173076f419\": container with ID starting with 3ca46ceb40f10e665988b8834e1b0a1f9dc5dd9c6d4ec16b463b34173076f419 not found: ID does not exist"
Jul 20 19:03:29.686938 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.686877    2563 scope.go:117] "RemoveContainer" containerID="c39f310305190a933038a46cc324d7f3980950ccb3751dad3a0e2f5205b2fdee"
Jul 20 19:03:29.687055 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.686979    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 20 19:03:29.687146 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.687127    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c39f310305190a933038a46cc324d7f3980950ccb3751dad3a0e2f5205b2fdee"} err="failed to get container status \"c39f310305190a933038a46cc324d7f3980950ccb3751dad3a0e2f5205b2fdee\": rpc error: code = NotFound desc = could not find container \"c39f310305190a933038a46cc324d7f3980950ccb3751dad3a0e2f5205b2fdee\": container with ID starting with c39f310305190a933038a46cc324d7f3980950ccb3751dad3a0e2f5205b2fdee not found: ID does not exist"
Jul 20 19:03:29.687188 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.687147    2563 scope.go:117] "RemoveContainer" containerID="b5e1aa9f35a5849ece1e073f0d63c6be01ffaac5ea8a156e47a63635445cef26"
Jul 20 19:03:29.687251 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.687233    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb" containerName="config-reloader"
Jul 20 19:03:29.687251 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.687253    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb" containerName="config-reloader"
Jul 20 19:03:29.687429 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.687266    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f841476b-570f-4a2b-844d-4e7434cd83a2" containerName="prometheus"
Jul 20 19:03:29.687429 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.687273    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="f841476b-570f-4a2b-844d-4e7434cd83a2" containerName="prometheus"
Jul 20 19:03:29.687429 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.687283    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb" containerName="alertmanager"
Jul 20 19:03:29.687429 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.687290    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb" containerName="alertmanager"
Jul 20 19:03:29.687429 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.687296    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb" containerName="prom-label-proxy"
Jul 20 19:03:29.687429 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.687301    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb" containerName="prom-label-proxy"
Jul 20 19:03:29.687429 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.687308    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee2de18c-442c-479c-9fe1-1bf28182217f" containerName="registry"
Jul 20 19:03:29.687429 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.687315    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee2de18c-442c-479c-9fe1-1bf28182217f" containerName="registry"
Jul 20 19:03:29.687429 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.687324    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f841476b-570f-4a2b-844d-4e7434cd83a2" containerName="config-reloader"
Jul 20 19:03:29.687429 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.687331    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="f841476b-570f-4a2b-844d-4e7434cd83a2" containerName="config-reloader"
Jul 20 19:03:29.687429 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.687338    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f841476b-570f-4a2b-844d-4e7434cd83a2" containerName="kube-rbac-proxy"
Jul 20 19:03:29.687429 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.687360    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="f841476b-570f-4a2b-844d-4e7434cd83a2" containerName="kube-rbac-proxy"
Jul 20 19:03:29.687429 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.687376    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb" containerName="kube-rbac-proxy"
Jul 20 19:03:29.687429 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.687384    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb" containerName="kube-rbac-proxy"
Jul 20 19:03:29.687429 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.687394    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5e1aa9f35a5849ece1e073f0d63c6be01ffaac5ea8a156e47a63635445cef26"} err="failed to get container status \"b5e1aa9f35a5849ece1e073f0d63c6be01ffaac5ea8a156e47a63635445cef26\": rpc error: code = NotFound desc = could not find container \"b5e1aa9f35a5849ece1e073f0d63c6be01ffaac5ea8a156e47a63635445cef26\": container with ID starting with b5e1aa9f35a5849ece1e073f0d63c6be01ffaac5ea8a156e47a63635445cef26 not found: ID does not exist"
Jul 20 19:03:29.687429 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.687408    2563 scope.go:117] "RemoveContainer" containerID="9d8aff00c78379f8087bdce5afe10f53197b7c4b1b4d79f33223924201248e5c"
Jul 20 19:03:29.687429 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.687392    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb" containerName="kube-rbac-proxy-metric"
Jul 20 19:03:29.687429 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.687418    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb" containerName="kube-rbac-proxy-metric"
Jul 20 19:03:29.687429 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.687426    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f841476b-570f-4a2b-844d-4e7434cd83a2" containerName="thanos-sidecar"
Jul 20 19:03:29.687429 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.687431    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="f841476b-570f-4a2b-844d-4e7434cd83a2" containerName="thanos-sidecar"
Jul 20 19:03:29.687429 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.687437    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f841476b-570f-4a2b-844d-4e7434cd83a2" containerName="init-config-reloader"
Jul 20 19:03:29.688069 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.687443    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="f841476b-570f-4a2b-844d-4e7434cd83a2" containerName="init-config-reloader"
Jul 20 19:03:29.688069 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.687449    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb" containerName="init-config-reloader"
Jul 20 19:03:29.688069 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.687454    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb" containerName="init-config-reloader"
Jul 20 19:03:29.688069 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.687461    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb" containerName="kube-rbac-proxy-web"
Jul 20 19:03:29.688069 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.687469    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb" containerName="kube-rbac-proxy-web"
Jul 20 19:03:29.688069 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.687478    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f841476b-570f-4a2b-844d-4e7434cd83a2" containerName="kube-rbac-proxy-thanos"
Jul 20 19:03:29.688069 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.687483    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="f841476b-570f-4a2b-844d-4e7434cd83a2" containerName="kube-rbac-proxy-thanos"
Jul 20 19:03:29.688069 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.687493    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f841476b-570f-4a2b-844d-4e7434cd83a2" containerName="kube-rbac-proxy-web"
Jul 20 19:03:29.688069 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.687501    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="f841476b-570f-4a2b-844d-4e7434cd83a2" containerName="kube-rbac-proxy-web"
Jul 20 19:03:29.688069 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.687561    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb" containerName="prom-label-proxy"
Jul 20 19:03:29.688069 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.687572    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="f841476b-570f-4a2b-844d-4e7434cd83a2" containerName="thanos-sidecar"
Jul 20 19:03:29.688069 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.687582    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb" containerName="alertmanager"
Jul 20 19:03:29.688069 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.687588    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb" containerName="config-reloader"
Jul 20 19:03:29.688069 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.687595    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="f841476b-570f-4a2b-844d-4e7434cd83a2" containerName="kube-rbac-proxy-thanos"
Jul 20 19:03:29.688069 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.687613    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="f841476b-570f-4a2b-844d-4e7434cd83a2" containerName="config-reloader"
Jul 20 19:03:29.688069 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.687618    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee2de18c-442c-479c-9fe1-1bf28182217f" containerName="registry"
Jul 20 19:03:29.688069 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.687623    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb" containerName="kube-rbac-proxy-web"
Jul 20 19:03:29.688069 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.687628    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb" containerName="kube-rbac-proxy-metric"
Jul 20 19:03:29.688069 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.687593    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d8aff00c78379f8087bdce5afe10f53197b7c4b1b4d79f33223924201248e5c"} err="failed to get container status \"9d8aff00c78379f8087bdce5afe10f53197b7c4b1b4d79f33223924201248e5c\": rpc error: code = NotFound desc = could not find container \"9d8aff00c78379f8087bdce5afe10f53197b7c4b1b4d79f33223924201248e5c\": container with ID starting with 9d8aff00c78379f8087bdce5afe10f53197b7c4b1b4d79f33223924201248e5c not found: ID does not exist"
Jul 20 19:03:29.688069 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.687634    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="f841476b-570f-4a2b-844d-4e7434cd83a2" containerName="kube-rbac-proxy-web"
Jul 20 19:03:29.688069 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.687639    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="f841476b-570f-4a2b-844d-4e7434cd83a2" containerName="kube-rbac-proxy"
Jul 20 19:03:29.688069 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.687640    2563 scope.go:117] "RemoveContainer" containerID="240632a6882f2668ad03bab78a2571b5b7494273a6a1da8a9a2a305b35d24b2c"
Jul 20 19:03:29.688069 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.687643    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4ffac01-2bd8-4729-9f5d-d2cb7c3844cb" containerName="kube-rbac-proxy"
Jul 20 19:03:29.688069 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.687650    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="f841476b-570f-4a2b-844d-4e7434cd83a2" containerName="prometheus"
Jul 20 19:03:29.688069 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.687830    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"240632a6882f2668ad03bab78a2571b5b7494273a6a1da8a9a2a305b35d24b2c"} err="failed to get container status \"240632a6882f2668ad03bab78a2571b5b7494273a6a1da8a9a2a305b35d24b2c\": rpc error: code = NotFound desc = could not find container \"240632a6882f2668ad03bab78a2571b5b7494273a6a1da8a9a2a305b35d24b2c\": container with ID starting with 240632a6882f2668ad03bab78a2571b5b7494273a6a1da8a9a2a305b35d24b2c not found: ID does not exist"
Jul 20 19:03:29.688069 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.687849    2563 scope.go:117] "RemoveContainer" containerID="490adb6f721370bae5e05becd60b27ee2394c92e741d63c894f87953833377ac"
Jul 20 19:03:29.688069 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.688053    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"490adb6f721370bae5e05becd60b27ee2394c92e741d63c894f87953833377ac"} err="failed to get container status \"490adb6f721370bae5e05becd60b27ee2394c92e741d63c894f87953833377ac\": rpc error: code = NotFound desc = could not find container \"490adb6f721370bae5e05becd60b27ee2394c92e741d63c894f87953833377ac\": container with ID starting with 490adb6f721370bae5e05becd60b27ee2394c92e741d63c894f87953833377ac not found: ID does not exist"
Jul 20 19:03:29.688069 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.688067    2563 scope.go:117] "RemoveContainer" containerID="db52388b111b592a9195389ad8cccff3624e73c1f6a8de1b2c09f038928187e7"
Jul 20 19:03:29.689066 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.688299    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db52388b111b592a9195389ad8cccff3624e73c1f6a8de1b2c09f038928187e7"} err="failed to get container status \"db52388b111b592a9195389ad8cccff3624e73c1f6a8de1b2c09f038928187e7\": rpc error: code = NotFound desc = could not find container \"db52388b111b592a9195389ad8cccff3624e73c1f6a8de1b2c09f038928187e7\": container with ID starting with db52388b111b592a9195389ad8cccff3624e73c1f6a8de1b2c09f038928187e7 not found: ID does not exist"
Jul 20 19:03:29.689066 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.688324    2563 scope.go:117] "RemoveContainer" containerID="3ca46ceb40f10e665988b8834e1b0a1f9dc5dd9c6d4ec16b463b34173076f419"
Jul 20 19:03:29.689066 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.688575    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ca46ceb40f10e665988b8834e1b0a1f9dc5dd9c6d4ec16b463b34173076f419"} err="failed to get container status \"3ca46ceb40f10e665988b8834e1b0a1f9dc5dd9c6d4ec16b463b34173076f419\": rpc error: code = NotFound desc = could not find container \"3ca46ceb40f10e665988b8834e1b0a1f9dc5dd9c6d4ec16b463b34173076f419\": container with ID starting with 3ca46ceb40f10e665988b8834e1b0a1f9dc5dd9c6d4ec16b463b34173076f419 not found: ID does not exist"
Jul 20 19:03:29.689066 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.688589    2563 scope.go:117] "RemoveContainer" containerID="c39f310305190a933038a46cc324d7f3980950ccb3751dad3a0e2f5205b2fdee"
Jul 20 19:03:29.689066 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.688781    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c39f310305190a933038a46cc324d7f3980950ccb3751dad3a0e2f5205b2fdee"} err="failed to get container status \"c39f310305190a933038a46cc324d7f3980950ccb3751dad3a0e2f5205b2fdee\": rpc error: code = NotFound desc = could not find container \"c39f310305190a933038a46cc324d7f3980950ccb3751dad3a0e2f5205b2fdee\": container with ID starting with c39f310305190a933038a46cc324d7f3980950ccb3751dad3a0e2f5205b2fdee not found: ID does not exist"
Jul 20 19:03:29.689066 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.688794    2563 scope.go:117] "RemoveContainer" containerID="b5e1aa9f35a5849ece1e073f0d63c6be01ffaac5ea8a156e47a63635445cef26"
Jul 20 19:03:29.689066 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.688984    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5e1aa9f35a5849ece1e073f0d63c6be01ffaac5ea8a156e47a63635445cef26"} err="failed to get container status \"b5e1aa9f35a5849ece1e073f0d63c6be01ffaac5ea8a156e47a63635445cef26\": rpc error: code = NotFound desc = could not find container \"b5e1aa9f35a5849ece1e073f0d63c6be01ffaac5ea8a156e47a63635445cef26\": container with ID starting with b5e1aa9f35a5849ece1e073f0d63c6be01ffaac5ea8a156e47a63635445cef26 not found: ID does not exist"
Jul 20 19:03:29.689066 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.689002    2563 scope.go:117] "RemoveContainer" containerID="9d8aff00c78379f8087bdce5afe10f53197b7c4b1b4d79f33223924201248e5c"
Jul 20 19:03:29.689376 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.689189    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d8aff00c78379f8087bdce5afe10f53197b7c4b1b4d79f33223924201248e5c"} err="failed to get container status \"9d8aff00c78379f8087bdce5afe10f53197b7c4b1b4d79f33223924201248e5c\": rpc error: code = NotFound desc = could not find container \"9d8aff00c78379f8087bdce5afe10f53197b7c4b1b4d79f33223924201248e5c\": container with ID starting with 9d8aff00c78379f8087bdce5afe10f53197b7c4b1b4d79f33223924201248e5c not found: ID does not exist"
Jul 20 19:03:29.689376 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.689201    2563 scope.go:117] "RemoveContainer" containerID="240632a6882f2668ad03bab78a2571b5b7494273a6a1da8a9a2a305b35d24b2c"
Jul 20 19:03:29.689447 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.689421    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"240632a6882f2668ad03bab78a2571b5b7494273a6a1da8a9a2a305b35d24b2c"} err="failed to get container status \"240632a6882f2668ad03bab78a2571b5b7494273a6a1da8a9a2a305b35d24b2c\": rpc error: code = NotFound desc = could not find container \"240632a6882f2668ad03bab78a2571b5b7494273a6a1da8a9a2a305b35d24b2c\": container with ID starting with 240632a6882f2668ad03bab78a2571b5b7494273a6a1da8a9a2a305b35d24b2c not found: ID does not exist"
Jul 20 19:03:29.689447 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.689437    2563 scope.go:117] "RemoveContainer" containerID="490adb6f721370bae5e05becd60b27ee2394c92e741d63c894f87953833377ac"
Jul 20 19:03:29.689703 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.689686    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"490adb6f721370bae5e05becd60b27ee2394c92e741d63c894f87953833377ac"} err="failed to get container status \"490adb6f721370bae5e05becd60b27ee2394c92e741d63c894f87953833377ac\": rpc error: code = NotFound desc = could not find container \"490adb6f721370bae5e05becd60b27ee2394c92e741d63c894f87953833377ac\": container with ID starting with 490adb6f721370bae5e05becd60b27ee2394c92e741d63c894f87953833377ac not found: ID does not exist"
Jul 20 19:03:29.689743 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.689704    2563 scope.go:117] "RemoveContainer" containerID="db52388b111b592a9195389ad8cccff3624e73c1f6a8de1b2c09f038928187e7"
Jul 20 19:03:29.689926 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.689905    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db52388b111b592a9195389ad8cccff3624e73c1f6a8de1b2c09f038928187e7"} err="failed to get container status \"db52388b111b592a9195389ad8cccff3624e73c1f6a8de1b2c09f038928187e7\": rpc error: code = NotFound desc = could not find container \"db52388b111b592a9195389ad8cccff3624e73c1f6a8de1b2c09f038928187e7\": container with ID starting with db52388b111b592a9195389ad8cccff3624e73c1f6a8de1b2c09f038928187e7 not found: ID does not exist"
Jul 20 19:03:29.689977 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.689927    2563 scope.go:117] "RemoveContainer" containerID="3ca46ceb40f10e665988b8834e1b0a1f9dc5dd9c6d4ec16b463b34173076f419"
Jul 20 19:03:29.690146 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.690128    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ca46ceb40f10e665988b8834e1b0a1f9dc5dd9c6d4ec16b463b34173076f419"} err="failed to get container status \"3ca46ceb40f10e665988b8834e1b0a1f9dc5dd9c6d4ec16b463b34173076f419\": rpc error: code = NotFound desc = could not find container \"3ca46ceb40f10e665988b8834e1b0a1f9dc5dd9c6d4ec16b463b34173076f419\": container with ID starting with 3ca46ceb40f10e665988b8834e1b0a1f9dc5dd9c6d4ec16b463b34173076f419 not found: ID does not exist"
Jul 20 19:03:29.690196 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.690146    2563 scope.go:117] "RemoveContainer" containerID="c39f310305190a933038a46cc324d7f3980950ccb3751dad3a0e2f5205b2fdee"
Jul 20 19:03:29.690369 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.690335    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c39f310305190a933038a46cc324d7f3980950ccb3751dad3a0e2f5205b2fdee"} err="failed to get container status \"c39f310305190a933038a46cc324d7f3980950ccb3751dad3a0e2f5205b2fdee\": rpc error: code = NotFound desc = could not find container \"c39f310305190a933038a46cc324d7f3980950ccb3751dad3a0e2f5205b2fdee\": container with ID starting with c39f310305190a933038a46cc324d7f3980950ccb3751dad3a0e2f5205b2fdee not found: ID does not exist"
Jul 20 19:03:29.690407 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.690386    2563 scope.go:117] "RemoveContainer" containerID="b5e1aa9f35a5849ece1e073f0d63c6be01ffaac5ea8a156e47a63635445cef26"
Jul 20 19:03:29.690602 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.690587    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5e1aa9f35a5849ece1e073f0d63c6be01ffaac5ea8a156e47a63635445cef26"} err="failed to get container status \"b5e1aa9f35a5849ece1e073f0d63c6be01ffaac5ea8a156e47a63635445cef26\": rpc error: code = NotFound desc = could not find container \"b5e1aa9f35a5849ece1e073f0d63c6be01ffaac5ea8a156e47a63635445cef26\": container with ID starting with b5e1aa9f35a5849ece1e073f0d63c6be01ffaac5ea8a156e47a63635445cef26 not found: ID does not exist"
Jul 20 19:03:29.691942 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.691925    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:03:29.694680 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.694658    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 20 19:03:29.694680 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.694669    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 20 19:03:29.694805 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.694672    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 20 19:03:29.694805 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.694771    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 20 19:03:29.694967 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.694951    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 20 19:03:29.695024 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.694958    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-bbvuvpmeadq3c\""
Jul 20 19:03:29.695073 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.695031    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 20 19:03:29.695073 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.695038    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-mmdbp\""
Jul 20 19:03:29.695171 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.695032    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 20 19:03:29.695171 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.695110    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 20 19:03:29.695171 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.695163    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 20 19:03:29.695382 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.695343    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 20 19:03:29.695470 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.695401    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 20 19:03:29.695542 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.695532    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 20 19:03:29.695663 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.695648    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 20 19:03:29.703929 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.701953    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 20 19:03:29.705774 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.705757    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 20 19:03:29.712860 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.712823    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 20 19:03:29.857839 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.857736    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80939d52-573a-4955-b069-3a5808d47fee-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"80939d52-573a-4955-b069-3a5808d47fee\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:03:29.857839 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.857795    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80939d52-573a-4955-b069-3a5808d47fee-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"80939d52-573a-4955-b069-3a5808d47fee\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:03:29.858028 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.857854    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/80939d52-573a-4955-b069-3a5808d47fee-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"80939d52-573a-4955-b069-3a5808d47fee\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:03:29.858028 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.857878    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/80939d52-573a-4955-b069-3a5808d47fee-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"80939d52-573a-4955-b069-3a5808d47fee\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:03:29.858028 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.857909    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/80939d52-573a-4955-b069-3a5808d47fee-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"80939d52-573a-4955-b069-3a5808d47fee\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:03:29.858028 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.857925    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/80939d52-573a-4955-b069-3a5808d47fee-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"80939d52-573a-4955-b069-3a5808d47fee\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:03:29.858028 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.857970    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/80939d52-573a-4955-b069-3a5808d47fee-config\") pod \"prometheus-k8s-0\" (UID: \"80939d52-573a-4955-b069-3a5808d47fee\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:03:29.858028 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.857989    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/80939d52-573a-4955-b069-3a5808d47fee-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"80939d52-573a-4955-b069-3a5808d47fee\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:03:29.858028 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.858003    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/80939d52-573a-4955-b069-3a5808d47fee-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"80939d52-573a-4955-b069-3a5808d47fee\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:03:29.858028 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.858025    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/80939d52-573a-4955-b069-3a5808d47fee-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"80939d52-573a-4955-b069-3a5808d47fee\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:03:29.858402 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.858048    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/80939d52-573a-4955-b069-3a5808d47fee-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"80939d52-573a-4955-b069-3a5808d47fee\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:03:29.858402 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.858102    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80939d52-573a-4955-b069-3a5808d47fee-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"80939d52-573a-4955-b069-3a5808d47fee\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:03:29.858402 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.858138    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/80939d52-573a-4955-b069-3a5808d47fee-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"80939d52-573a-4955-b069-3a5808d47fee\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:03:29.858402 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.858167    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vmmlt\" (UniqueName: \"kubernetes.io/projected/80939d52-573a-4955-b069-3a5808d47fee-kube-api-access-vmmlt\") pod \"prometheus-k8s-0\" (UID: \"80939d52-573a-4955-b069-3a5808d47fee\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:03:29.858402 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.858194    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/80939d52-573a-4955-b069-3a5808d47fee-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"80939d52-573a-4955-b069-3a5808d47fee\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:03:29.858402 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.858226    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/80939d52-573a-4955-b069-3a5808d47fee-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"80939d52-573a-4955-b069-3a5808d47fee\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:03:29.858402 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.858247    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/80939d52-573a-4955-b069-3a5808d47fee-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"80939d52-573a-4955-b069-3a5808d47fee\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:03:29.858402 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.858269    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/80939d52-573a-4955-b069-3a5808d47fee-web-config\") pod \"prometheus-k8s-0\" (UID: \"80939d52-573a-4955-b069-3a5808d47fee\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:03:29.858402 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.858317    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/80939d52-573a-4955-b069-3a5808d47fee-config-out\") pod \"prometheus-k8s-0\" (UID: \"80939d52-573a-4955-b069-3a5808d47fee\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:03:29.858402 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.858371    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/80939d52-573a-4955-b069-3a5808d47fee-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"80939d52-573a-4955-b069-3a5808d47fee\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:03:29.959342 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.959308    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80939d52-573a-4955-b069-3a5808d47fee-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"80939d52-573a-4955-b069-3a5808d47fee\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:03:29.959342 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.959362    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80939d52-573a-4955-b069-3a5808d47fee-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"80939d52-573a-4955-b069-3a5808d47fee\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:03:29.959598 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.959490    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/80939d52-573a-4955-b069-3a5808d47fee-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"80939d52-573a-4955-b069-3a5808d47fee\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:03:29.959598 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.959527    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/80939d52-573a-4955-b069-3a5808d47fee-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"80939d52-573a-4955-b069-3a5808d47fee\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:03:29.959598 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.959576    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/80939d52-573a-4955-b069-3a5808d47fee-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"80939d52-573a-4955-b069-3a5808d47fee\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:03:29.959745 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.959598    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/80939d52-573a-4955-b069-3a5808d47fee-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"80939d52-573a-4955-b069-3a5808d47fee\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:03:29.959745 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.959643    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/80939d52-573a-4955-b069-3a5808d47fee-config\") pod \"prometheus-k8s-0\" (UID: \"80939d52-573a-4955-b069-3a5808d47fee\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:03:29.959745 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.959670    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/80939d52-573a-4955-b069-3a5808d47fee-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"80939d52-573a-4955-b069-3a5808d47fee\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:03:29.959745 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.959693    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/80939d52-573a-4955-b069-3a5808d47fee-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"80939d52-573a-4955-b069-3a5808d47fee\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:03:29.959745 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.959729    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/80939d52-573a-4955-b069-3a5808d47fee-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"80939d52-573a-4955-b069-3a5808d47fee\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:03:29.959988 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.959754    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/80939d52-573a-4955-b069-3a5808d47fee-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"80939d52-573a-4955-b069-3a5808d47fee\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:03:29.959988 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.959787    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80939d52-573a-4955-b069-3a5808d47fee-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"80939d52-573a-4955-b069-3a5808d47fee\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:03:29.959988 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.959810    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/80939d52-573a-4955-b069-3a5808d47fee-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"80939d52-573a-4955-b069-3a5808d47fee\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:03:29.959988 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.959850    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vmmlt\" (UniqueName: \"kubernetes.io/projected/80939d52-573a-4955-b069-3a5808d47fee-kube-api-access-vmmlt\") pod \"prometheus-k8s-0\" (UID: \"80939d52-573a-4955-b069-3a5808d47fee\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:03:29.959988 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.959877    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/80939d52-573a-4955-b069-3a5808d47fee-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"80939d52-573a-4955-b069-3a5808d47fee\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:03:29.959988 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.959902    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/80939d52-573a-4955-b069-3a5808d47fee-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"80939d52-573a-4955-b069-3a5808d47fee\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:03:29.959988 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.959931    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/80939d52-573a-4955-b069-3a5808d47fee-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"80939d52-573a-4955-b069-3a5808d47fee\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:03:29.959988 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.959958    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/80939d52-573a-4955-b069-3a5808d47fee-web-config\") pod \"prometheus-k8s-0\" (UID: \"80939d52-573a-4955-b069-3a5808d47fee\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:03:29.959988 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.959988    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/80939d52-573a-4955-b069-3a5808d47fee-config-out\") pod \"prometheus-k8s-0\" (UID: \"80939d52-573a-4955-b069-3a5808d47fee\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:03:29.960438 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.960015    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/80939d52-573a-4955-b069-3a5808d47fee-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"80939d52-573a-4955-b069-3a5808d47fee\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:03:29.960438 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.960061    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80939d52-573a-4955-b069-3a5808d47fee-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"80939d52-573a-4955-b069-3a5808d47fee\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:03:29.960438 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.960176    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/80939d52-573a-4955-b069-3a5808d47fee-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"80939d52-573a-4955-b069-3a5808d47fee\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:03:29.960438 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.960305    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80939d52-573a-4955-b069-3a5808d47fee-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"80939d52-573a-4955-b069-3a5808d47fee\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:03:29.960857 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.960826    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/80939d52-573a-4955-b069-3a5808d47fee-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"80939d52-573a-4955-b069-3a5808d47fee\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:03:29.960984 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.960960    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/80939d52-573a-4955-b069-3a5808d47fee-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"80939d52-573a-4955-b069-3a5808d47fee\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:03:29.962984 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.962956    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/80939d52-573a-4955-b069-3a5808d47fee-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"80939d52-573a-4955-b069-3a5808d47fee\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:03:29.963162 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.963134    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/80939d52-573a-4955-b069-3a5808d47fee-config\") pod \"prometheus-k8s-0\" (UID: \"80939d52-573a-4955-b069-3a5808d47fee\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:03:29.963426 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.963404    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/80939d52-573a-4955-b069-3a5808d47fee-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"80939d52-573a-4955-b069-3a5808d47fee\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:03:29.963690 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.963595    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/80939d52-573a-4955-b069-3a5808d47fee-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"80939d52-573a-4955-b069-3a5808d47fee\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:03:29.964285 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.963780    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/80939d52-573a-4955-b069-3a5808d47fee-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"80939d52-573a-4955-b069-3a5808d47fee\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:03:29.964285 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.963983    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/80939d52-573a-4955-b069-3a5808d47fee-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"80939d52-573a-4955-b069-3a5808d47fee\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:03:29.964285 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.964102    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/80939d52-573a-4955-b069-3a5808d47fee-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"80939d52-573a-4955-b069-3a5808d47fee\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:03:29.964507 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.964297    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80939d52-573a-4955-b069-3a5808d47fee-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"80939d52-573a-4955-b069-3a5808d47fee\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:03:29.964507 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.964486    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/80939d52-573a-4955-b069-3a5808d47fee-web-config\") pod \"prometheus-k8s-0\" (UID: \"80939d52-573a-4955-b069-3a5808d47fee\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:03:29.964781 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.964762    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/80939d52-573a-4955-b069-3a5808d47fee-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"80939d52-573a-4955-b069-3a5808d47fee\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:03:29.965091 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.965073    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/80939d52-573a-4955-b069-3a5808d47fee-config-out\") pod \"prometheus-k8s-0\" (UID: \"80939d52-573a-4955-b069-3a5808d47fee\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:03:29.965867 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.965830    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/80939d52-573a-4955-b069-3a5808d47fee-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"80939d52-573a-4955-b069-3a5808d47fee\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:03:29.965947 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.965892    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/80939d52-573a-4955-b069-3a5808d47fee-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"80939d52-573a-4955-b069-3a5808d47fee\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:03:29.966267 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.966249    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/80939d52-573a-4955-b069-3a5808d47fee-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"80939d52-573a-4955-b069-3a5808d47fee\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:03:29.969418 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:29.969400    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vmmlt\" (UniqueName: \"kubernetes.io/projected/80939d52-573a-4955-b069-3a5808d47fee-kube-api-access-vmmlt\") pod \"prometheus-k8s-0\" (UID: \"80939d52-573a-4955-b069-3a5808d47fee\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:03:30.003389 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:30.003364    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:03:30.134428 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:30.134336    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 20 19:03:30.137544 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:03:30.137520    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80939d52_573a_4955_b069_3a5808d47fee.slice/crio-39e9028e5814cb406de92ac2a9571e355b9890d44fafb6efe818b1a691e314f7 WatchSource:0}: Error finding container 39e9028e5814cb406de92ac2a9571e355b9890d44fafb6efe818b1a691e314f7: Status 404 returned error can't find the container with id 39e9028e5814cb406de92ac2a9571e355b9890d44fafb6efe818b1a691e314f7
Jul 20 19:03:30.637021 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:30.636986    2563 generic.go:356] "Generic (PLEG): container finished" podID="80939d52-573a-4955-b069-3a5808d47fee" containerID="f5fb5322a51445eede8f011975e8468dbbbbfe339468661bcec63dc1c3146c0d" exitCode=0
Jul 20 19:03:30.637436 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:30.637074    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"80939d52-573a-4955-b069-3a5808d47fee","Type":"ContainerDied","Data":"f5fb5322a51445eede8f011975e8468dbbbbfe339468661bcec63dc1c3146c0d"}
Jul 20 19:03:30.637436 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:30.637149    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"80939d52-573a-4955-b069-3a5808d47fee","Type":"ContainerStarted","Data":"39e9028e5814cb406de92ac2a9571e355b9890d44fafb6efe818b1a691e314f7"}
Jul 20 19:03:30.893687 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:30.893644    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f841476b-570f-4a2b-844d-4e7434cd83a2" path="/var/lib/kubelet/pods/f841476b-570f-4a2b-844d-4e7434cd83a2/volumes"
Jul 20 19:03:31.644751 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:31.644718    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"80939d52-573a-4955-b069-3a5808d47fee","Type":"ContainerStarted","Data":"80453eda9edbaa35ed6e085f38eaedda3e00e3e3567be78f9cf871626282b70e"}
Jul 20 19:03:31.645102 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:31.644805    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"80939d52-573a-4955-b069-3a5808d47fee","Type":"ContainerStarted","Data":"79edacd47932fde2e5635df91708ed325580b14a9adf20f3d2534779487eeb1d"}
Jul 20 19:03:31.645102 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:31.644832    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"80939d52-573a-4955-b069-3a5808d47fee","Type":"ContainerStarted","Data":"fc16b1bc5e6c207353273671e7919586f7f6e28cf9da664ecf29da504bf187fa"}
Jul 20 19:03:31.645102 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:31.644859    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"80939d52-573a-4955-b069-3a5808d47fee","Type":"ContainerStarted","Data":"66ec5f5656b48004d9266d368038c5dbe759bda1638b0a765e4b72b17e001072"}
Jul 20 19:03:31.645102 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:31.644882    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"80939d52-573a-4955-b069-3a5808d47fee","Type":"ContainerStarted","Data":"92e6d237b8137f6bae9114f3a4e591314811da20e4706b569d4a9b3b4ba52ecf"}
Jul 20 19:03:31.645102 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:31.644904    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"80939d52-573a-4955-b069-3a5808d47fee","Type":"ContainerStarted","Data":"0164dcf1e4eb1170fcf0d3fe741634a75051a47da44b6e579c3fc721d3d45dce"}
Jul 20 19:03:31.677752 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:31.677698    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.659480444 podStartE2EDuration="2.677678894s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.19845ms" isStatefulPod=false podCreationTimestamp="2026-07-20 19:03:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:03:31.676798588 +0000 UTC m=+171.360326644" watchObservedRunningTime="2026-07-20 19:03:31.677678894 +0000 UTC m=+171.361206917"
Jul 20 19:03:32.010560 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:32.010527    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:03:32.067765 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:32.067737    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:03:35.004319 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:35.004280    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:03:44.183419 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:44.183376    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:03:44.246869 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:44.246841    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:03:44.319658 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:44.319626    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:03:45.044992 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:45.044953    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:03:45.146198 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:45.146164    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:03:45.936889 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:45.936860    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:03:46.036689 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:46.036658    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:03:54.932192 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:54.932155    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:03:54.987207 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:54.987179    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:03:55.142485 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:03:55.142458    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:04:16.286802 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:04:16.286767    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:04:16.342239 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:04:16.342209    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:04:19.345287 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:04:19.345257    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:04:19.435948 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:04:19.435917    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:04:30.004584 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:04:30.004538    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:04:30.019844 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:04:30.019820    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:04:30.871865 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:04:30.871839    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:04:30.885764 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:04:30.885741    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:04:46.036261 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:04:46.036227    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:04:46.847266 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:04:46.847231    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:04:49.682534 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:04:49.682497    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:04:49.784770 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:04:49.784740    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:04:50.942803 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:04:50.942768    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:04:51.060648 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:04:51.060606    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:04:51.813052 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:04:51.813014    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:04:51.908977 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:04:51.908938    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:04:53.823734 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:04:53.823699    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:04:54.232621 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:04:54.232594    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:04:56.246214 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:04:56.246178    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:04:56.346551 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:04:56.346524    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:05:02.430559 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:05:02.430477    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:05:02.667201 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:05:02.667162    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:05:02.779525 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:05:02.779495    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:05:06.916960 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:05:06.916924    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:05:10.336673 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:05:10.336633    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:05:10.400719 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:05:10.400691    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:05:12.346882 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:05:12.346850    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:05:13.936084 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:05:13.936050    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:05:13.992065 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:05:13.992034    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:05:24.268553 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:05:24.268516    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:05:24.367626 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:05:24.367592    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:05:25.037267 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:05:25.037235    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:05:25.263129 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:05:25.263095    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:05:25.360871 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:05:25.360797    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:05:25.430597 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:05:25.430564    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6dc69fccc8-qqqqf"]
Jul 20 19:05:25.433127 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:05:25.433113    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6dc69fccc8-qqqqf"
Jul 20 19:05:25.437694 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:05:25.437672    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 20 19:05:25.437805 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:05:25.437733    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 20 19:05:25.437853 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:05:25.437806    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 20 19:05:25.438080 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:05:25.438062    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 20 19:05:25.438189 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:05:25.438175    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-wsgrw\""
Jul 20 19:05:25.454602 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:05:25.454579    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6dc69fccc8-qqqqf"]
Jul 20 19:05:25.559736 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:05:25.559714    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:05:25.561701 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:05:25.561678    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2d6f1300-3ae0-46be-8df6-0b996c694722-manifests\") pod \"opendatahub-operator-controller-manager-6dc69fccc8-qqqqf\" (UID: \"2d6f1300-3ae0-46be-8df6-0b996c694722\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc69fccc8-qqqqf"
Jul 20 19:05:25.561796 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:05:25.561712    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2d6f1300-3ae0-46be-8df6-0b996c694722-tmp\") pod \"opendatahub-operator-controller-manager-6dc69fccc8-qqqqf\" (UID: \"2d6f1300-3ae0-46be-8df6-0b996c694722\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc69fccc8-qqqqf"
Jul 20 19:05:25.561796 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:05:25.561775    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2d6f1300-3ae0-46be-8df6-0b996c694722-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6dc69fccc8-qqqqf\" (UID: \"2d6f1300-3ae0-46be-8df6-0b996c694722\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc69fccc8-qqqqf"
Jul 20 19:05:25.561908 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:05:25.561827    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mkx94\" (UniqueName: \"kubernetes.io/projected/2d6f1300-3ae0-46be-8df6-0b996c694722-kube-api-access-mkx94\") pod \"opendatahub-operator-controller-manager-6dc69fccc8-qqqqf\" (UID: \"2d6f1300-3ae0-46be-8df6-0b996c694722\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc69fccc8-qqqqf"
Jul 20 19:05:25.561908 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:05:25.561882    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2d6f1300-3ae0-46be-8df6-0b996c694722-webhook-cert\") pod \"opendatahub-operator-controller-manager-6dc69fccc8-qqqqf\" (UID: \"2d6f1300-3ae0-46be-8df6-0b996c694722\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc69fccc8-qqqqf"
Jul 20 19:05:25.659658 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:05:25.659592    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:05:25.662654 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:05:25.662628    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2d6f1300-3ae0-46be-8df6-0b996c694722-manifests\") pod \"opendatahub-operator-controller-manager-6dc69fccc8-qqqqf\" (UID: \"2d6f1300-3ae0-46be-8df6-0b996c694722\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc69fccc8-qqqqf"
Jul 20 19:05:25.662762 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:05:25.662663    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2d6f1300-3ae0-46be-8df6-0b996c694722-tmp\") pod \"opendatahub-operator-controller-manager-6dc69fccc8-qqqqf\" (UID: \"2d6f1300-3ae0-46be-8df6-0b996c694722\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc69fccc8-qqqqf"
Jul 20 19:05:25.662762 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:05:25.662698    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2d6f1300-3ae0-46be-8df6-0b996c694722-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6dc69fccc8-qqqqf\" (UID: \"2d6f1300-3ae0-46be-8df6-0b996c694722\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc69fccc8-qqqqf"
Jul 20 19:05:25.662762 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:05:25.662729    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mkx94\" (UniqueName: \"kubernetes.io/projected/2d6f1300-3ae0-46be-8df6-0b996c694722-kube-api-access-mkx94\") pod \"opendatahub-operator-controller-manager-6dc69fccc8-qqqqf\" (UID: \"2d6f1300-3ae0-46be-8df6-0b996c694722\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc69fccc8-qqqqf"
Jul 20 19:05:25.662964 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:05:25.662768    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2d6f1300-3ae0-46be-8df6-0b996c694722-webhook-cert\") pod \"opendatahub-operator-controller-manager-6dc69fccc8-qqqqf\" (UID: \"2d6f1300-3ae0-46be-8df6-0b996c694722\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc69fccc8-qqqqf"
Jul 20 19:05:25.663034 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:05:25.663009    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2d6f1300-3ae0-46be-8df6-0b996c694722-manifests\") pod \"opendatahub-operator-controller-manager-6dc69fccc8-qqqqf\" (UID: \"2d6f1300-3ae0-46be-8df6-0b996c694722\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc69fccc8-qqqqf"
Jul 20 19:05:25.665192 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:05:25.665169    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2d6f1300-3ae0-46be-8df6-0b996c694722-tmp\") pod \"opendatahub-operator-controller-manager-6dc69fccc8-qqqqf\" (UID: \"2d6f1300-3ae0-46be-8df6-0b996c694722\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc69fccc8-qqqqf"
Jul 20 19:05:25.665631 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:05:25.665611    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2d6f1300-3ae0-46be-8df6-0b996c694722-webhook-cert\") pod \"opendatahub-operator-controller-manager-6dc69fccc8-qqqqf\" (UID: \"2d6f1300-3ae0-46be-8df6-0b996c694722\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc69fccc8-qqqqf"
Jul 20 19:05:25.665682 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:05:25.665647    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2d6f1300-3ae0-46be-8df6-0b996c694722-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6dc69fccc8-qqqqf\" (UID: \"2d6f1300-3ae0-46be-8df6-0b996c694722\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc69fccc8-qqqqf"
Jul 20 19:05:25.671340 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:05:25.671315    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mkx94\" (UniqueName: \"kubernetes.io/projected/2d6f1300-3ae0-46be-8df6-0b996c694722-kube-api-access-mkx94\") pod \"opendatahub-operator-controller-manager-6dc69fccc8-qqqqf\" (UID: \"2d6f1300-3ae0-46be-8df6-0b996c694722\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc69fccc8-qqqqf"
Jul 20 19:05:25.743299 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:05:25.743265    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6dc69fccc8-qqqqf"
Jul 20 19:05:25.761414 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:05:25.761392    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:05:25.855370 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:05:25.855300    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:05:25.882375 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:05:25.882334    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6dc69fccc8-qqqqf"]
Jul 20 19:05:25.885091 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:05:25.885067    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d6f1300_3ae0_46be_8df6_0b996c694722.slice/crio-d91a3c32fa74dc1e7250842014c7bae7a83a86c400c61d819db18aa08096aabf WatchSource:0}: Error finding container d91a3c32fa74dc1e7250842014c7bae7a83a86c400c61d819db18aa08096aabf: Status 404 returned error can't find the container with id d91a3c32fa74dc1e7250842014c7bae7a83a86c400c61d819db18aa08096aabf
Jul 20 19:05:25.936533 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:05:25.936477    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:05:26.042476 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:05:26.042451    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6dc69fccc8-qqqqf" event={"ID":"2d6f1300-3ae0-46be-8df6-0b996c694722","Type":"ContainerStarted","Data":"d91a3c32fa74dc1e7250842014c7bae7a83a86c400c61d819db18aa08096aabf"}
Jul 20 19:05:30.060553 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:05:30.060515    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6dc69fccc8-qqqqf" event={"ID":"2d6f1300-3ae0-46be-8df6-0b996c694722","Type":"ContainerStarted","Data":"201e313fa1351c4823feb48eaa736a4ea2218edb3a3dc52f78e3a70d34775021"}
Jul 20 19:05:31.065361 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:05:31.065327    2563 generic.go:356] "Generic (PLEG): container finished" podID="2d6f1300-3ae0-46be-8df6-0b996c694722" containerID="201e313fa1351c4823feb48eaa736a4ea2218edb3a3dc52f78e3a70d34775021" exitCode=0
Jul 20 19:05:31.065759 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:05:31.065416    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6dc69fccc8-qqqqf" event={"ID":"2d6f1300-3ae0-46be-8df6-0b996c694722","Type":"ContainerDied","Data":"201e313fa1351c4823feb48eaa736a4ea2218edb3a3dc52f78e3a70d34775021"}
Jul 20 19:05:31.775759 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:05:31.775726    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:05:32.071092 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:05:32.071010    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6dc69fccc8-qqqqf" event={"ID":"2d6f1300-3ae0-46be-8df6-0b996c694722","Type":"ContainerStarted","Data":"6b7f28913d6212c9dedfd5f4baa3446681e2ee36209f7d0d2eef4c36f07373d0"}
Jul 20 19:05:32.071466 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:05:32.071121    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6dc69fccc8-qqqqf"
Jul 20 19:05:32.109652 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:05:32.109594    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6dc69fccc8-qqqqf" podStartSLOduration=2.406562732 podStartE2EDuration="7.109577048s" totalImagesPullingTime="3.669379815s" totalInitContainerRuntime="1.033634501s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:05:25 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:05:32.108750311 +0000 UTC m=+291.792278333" watchObservedRunningTime="2026-07-20 19:05:32.109577048 +0000 UTC m=+291.793105071"
Jul 20 19:05:40.734494 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:05:40.734463    2563 kubelet.go:1648] "Image garbage collection succeeded"
Jul 20 19:05:43.077338 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:05:43.077308    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6dc69fccc8-qqqqf"
Jul 20 19:05:45.058321 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:05:45.058276    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:05:45.758636 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:05:45.758603    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-569f4dcc7-mzsr8"]
Jul 20 19:05:45.760872 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:05:45.760855    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-569f4dcc7-mzsr8"
Jul 20 19:05:45.773365 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:05:45.773328    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 20 19:05:45.773517 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:05:45.773413    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 20 19:05:45.773517 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:05:45.773481    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 20 19:05:45.773638 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:05:45.773523    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 20 19:05:45.773638 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:05:45.773526    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 20 19:05:45.773747 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:05:45.773672    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-q9849\""
Jul 20 19:05:45.776325 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:05:45.776306    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-569f4dcc7-mzsr8"]
Jul 20 19:05:45.818955 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:05:45.818931    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/b17eec12-8d7d-4b9f-8b85-15f5118aee60-manager-config\") pod \"lws-controller-manager-569f4dcc7-mzsr8\" (UID: \"b17eec12-8d7d-4b9f-8b85-15f5118aee60\") " pod="openshift-lws-operator/lws-controller-manager-569f4dcc7-mzsr8"
Jul 20 19:05:45.819087 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:05:45.818961    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2pqr\" (UniqueName: \"kubernetes.io/projected/b17eec12-8d7d-4b9f-8b85-15f5118aee60-kube-api-access-z2pqr\") pod \"lws-controller-manager-569f4dcc7-mzsr8\" (UID: \"b17eec12-8d7d-4b9f-8b85-15f5118aee60\") " pod="openshift-lws-operator/lws-controller-manager-569f4dcc7-mzsr8"
Jul 20 19:05:45.819087 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:05:45.818989    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b17eec12-8d7d-4b9f-8b85-15f5118aee60-cert\") pod \"lws-controller-manager-569f4dcc7-mzsr8\" (UID: \"b17eec12-8d7d-4b9f-8b85-15f5118aee60\") " pod="openshift-lws-operator/lws-controller-manager-569f4dcc7-mzsr8"
Jul 20 19:05:45.819087 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:05:45.819013    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/b17eec12-8d7d-4b9f-8b85-15f5118aee60-metrics-cert\") pod \"lws-controller-manager-569f4dcc7-mzsr8\" (UID: \"b17eec12-8d7d-4b9f-8b85-15f5118aee60\") " pod="openshift-lws-operator/lws-controller-manager-569f4dcc7-mzsr8"
Jul 20 19:05:45.832396 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:05:45.832370    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-566bb86f76-76sh9"]
Jul 20 19:05:45.834804 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:05:45.834784    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-566bb86f76-76sh9"
Jul 20 19:05:45.838795 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:05:45.838765    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 20 19:05:45.838890 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:05:45.838806    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 20 19:05:45.838965 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:05:45.838952    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 20 19:05:45.839518 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:05:45.839500    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 20 19:05:45.840851 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:05:45.840835    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-c4h44\""
Jul 20 19:05:45.855166 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:05:45.855148    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-566bb86f76-76sh9"]
Jul 20 19:05:45.920310 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:05:45.920282    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0f6d7218-88e0-45ab-a3fd-c0e89976d06a-tls-certs\") pod \"kube-auth-proxy-566bb86f76-76sh9\" (UID: \"0f6d7218-88e0-45ab-a3fd-c0e89976d06a\") " pod="openshift-ingress/kube-auth-proxy-566bb86f76-76sh9"
Jul 20 19:05:45.920525 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:05:45.920343    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/b17eec12-8d7d-4b9f-8b85-15f5118aee60-manager-config\") pod \"lws-controller-manager-569f4dcc7-mzsr8\" (UID: \"b17eec12-8d7d-4b9f-8b85-15f5118aee60\") " pod="openshift-lws-operator/lws-controller-manager-569f4dcc7-mzsr8"
Jul 20 19:05:45.920525 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:05:45.920398    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2pqr\" (UniqueName: \"kubernetes.io/projected/b17eec12-8d7d-4b9f-8b85-15f5118aee60-kube-api-access-z2pqr\") pod \"lws-controller-manager-569f4dcc7-mzsr8\" (UID: \"b17eec12-8d7d-4b9f-8b85-15f5118aee60\") " pod="openshift-lws-operator/lws-controller-manager-569f4dcc7-mzsr8"
Jul 20 19:05:45.920525 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:05:45.920452    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b17eec12-8d7d-4b9f-8b85-15f5118aee60-cert\") pod \"lws-controller-manager-569f4dcc7-mzsr8\" (UID: \"b17eec12-8d7d-4b9f-8b85-15f5118aee60\") " pod="openshift-lws-operator/lws-controller-manager-569f4dcc7-mzsr8"
Jul 20 19:05:45.920525 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:05:45.920478    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/b17eec12-8d7d-4b9f-8b85-15f5118aee60-metrics-cert\") pod \"lws-controller-manager-569f4dcc7-mzsr8\" (UID: \"b17eec12-8d7d-4b9f-8b85-15f5118aee60\") " pod="openshift-lws-operator/lws-controller-manager-569f4dcc7-mzsr8"
Jul 20 19:05:45.920525 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:05:45.920502    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0f6d7218-88e0-45ab-a3fd-c0e89976d06a-tmp\") pod \"kube-auth-proxy-566bb86f76-76sh9\" (UID: \"0f6d7218-88e0-45ab-a3fd-c0e89976d06a\") " pod="openshift-ingress/kube-auth-proxy-566bb86f76-76sh9"
Jul 20 19:05:45.920826 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:05:45.920590    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tcwn\" (UniqueName: \"kubernetes.io/projected/0f6d7218-88e0-45ab-a3fd-c0e89976d06a-kube-api-access-5tcwn\") pod \"kube-auth-proxy-566bb86f76-76sh9\" (UID: \"0f6d7218-88e0-45ab-a3fd-c0e89976d06a\") " pod="openshift-ingress/kube-auth-proxy-566bb86f76-76sh9"
Jul 20 19:05:45.921061 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:05:45.921041    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/b17eec12-8d7d-4b9f-8b85-15f5118aee60-manager-config\") pod \"lws-controller-manager-569f4dcc7-mzsr8\" (UID: \"b17eec12-8d7d-4b9f-8b85-15f5118aee60\") " pod="openshift-lws-operator/lws-controller-manager-569f4dcc7-mzsr8"
Jul 20 19:05:45.923089 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:05:45.923066    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b17eec12-8d7d-4b9f-8b85-15f5118aee60-cert\") pod \"lws-controller-manager-569f4dcc7-mzsr8\" (UID: \"b17eec12-8d7d-4b9f-8b85-15f5118aee60\") " pod="openshift-lws-operator/lws-controller-manager-569f4dcc7-mzsr8"
Jul 20 19:05:45.923190 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:05:45.923092    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/b17eec12-8d7d-4b9f-8b85-15f5118aee60-metrics-cert\") pod \"lws-controller-manager-569f4dcc7-mzsr8\" (UID: \"b17eec12-8d7d-4b9f-8b85-15f5118aee60\") " pod="openshift-lws-operator/lws-controller-manager-569f4dcc7-mzsr8"
Jul 20 19:05:45.934703 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:05:45.934678    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2pqr\" (UniqueName: \"kubernetes.io/projected/b17eec12-8d7d-4b9f-8b85-15f5118aee60-kube-api-access-z2pqr\") pod \"lws-controller-manager-569f4dcc7-mzsr8\" (UID: \"b17eec12-8d7d-4b9f-8b85-15f5118aee60\") " pod="openshift-lws-operator/lws-controller-manager-569f4dcc7-mzsr8"
Jul 20 19:05:46.022086 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:05:46.022007    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0f6d7218-88e0-45ab-a3fd-c0e89976d06a-tmp\") pod \"kube-auth-proxy-566bb86f76-76sh9\" (UID: \"0f6d7218-88e0-45ab-a3fd-c0e89976d06a\") " pod="openshift-ingress/kube-auth-proxy-566bb86f76-76sh9"
Jul 20 19:05:46.022086 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:05:46.022049    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5tcwn\" (UniqueName: \"kubernetes.io/projected/0f6d7218-88e0-45ab-a3fd-c0e89976d06a-kube-api-access-5tcwn\") pod \"kube-auth-proxy-566bb86f76-76sh9\" (UID: \"0f6d7218-88e0-45ab-a3fd-c0e89976d06a\") " pod="openshift-ingress/kube-auth-proxy-566bb86f76-76sh9"
Jul 20 19:05:46.022251 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:05:46.022098    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0f6d7218-88e0-45ab-a3fd-c0e89976d06a-tls-certs\") pod \"kube-auth-proxy-566bb86f76-76sh9\" (UID: \"0f6d7218-88e0-45ab-a3fd-c0e89976d06a\") " pod="openshift-ingress/kube-auth-proxy-566bb86f76-76sh9"
Jul 20 19:05:46.022251 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:05:46.022216    2563 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Jul 20 19:05:46.022314 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:05:46.022290    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f6d7218-88e0-45ab-a3fd-c0e89976d06a-tls-certs podName:0f6d7218-88e0-45ab-a3fd-c0e89976d06a nodeName:}" failed. No retries permitted until 2026-07-20 19:05:46.522269885 +0000 UTC m=+306.205797888 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/0f6d7218-88e0-45ab-a3fd-c0e89976d06a-tls-certs") pod "kube-auth-proxy-566bb86f76-76sh9" (UID: "0f6d7218-88e0-45ab-a3fd-c0e89976d06a") : secret "kube-auth-proxy-tls" not found
Jul 20 19:05:46.024383 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:05:46.024335    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0f6d7218-88e0-45ab-a3fd-c0e89976d06a-tmp\") pod \"kube-auth-proxy-566bb86f76-76sh9\" (UID: \"0f6d7218-88e0-45ab-a3fd-c0e89976d06a\") " pod="openshift-ingress/kube-auth-proxy-566bb86f76-76sh9"
Jul 20 19:05:46.035261 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:05:46.035233    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tcwn\" (UniqueName: \"kubernetes.io/projected/0f6d7218-88e0-45ab-a3fd-c0e89976d06a-kube-api-access-5tcwn\") pod \"kube-auth-proxy-566bb86f76-76sh9\" (UID: \"0f6d7218-88e0-45ab-a3fd-c0e89976d06a\") " pod="openshift-ingress/kube-auth-proxy-566bb86f76-76sh9"
Jul 20 19:05:46.070133 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:05:46.070107    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-569f4dcc7-mzsr8"
Jul 20 19:05:46.218272 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:05:46.218248    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-569f4dcc7-mzsr8"]
Jul 20 19:05:46.220259 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:05:46.220232    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb17eec12_8d7d_4b9f_8b85_15f5118aee60.slice/crio-f57263fbc2199771bc2832653944645a3723a8dcabb17cc1af1d534e36252074 WatchSource:0}: Error finding container f57263fbc2199771bc2832653944645a3723a8dcabb17cc1af1d534e36252074: Status 404 returned error can't find the container with id f57263fbc2199771bc2832653944645a3723a8dcabb17cc1af1d534e36252074
Jul 20 19:05:46.222109 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:05:46.222094    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 19:05:46.526188 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:05:46.526159    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0f6d7218-88e0-45ab-a3fd-c0e89976d06a-tls-certs\") pod \"kube-auth-proxy-566bb86f76-76sh9\" (UID: \"0f6d7218-88e0-45ab-a3fd-c0e89976d06a\") " pod="openshift-ingress/kube-auth-proxy-566bb86f76-76sh9"
Jul 20 19:05:46.528683 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:05:46.528664    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0f6d7218-88e0-45ab-a3fd-c0e89976d06a-tls-certs\") pod \"kube-auth-proxy-566bb86f76-76sh9\" (UID: \"0f6d7218-88e0-45ab-a3fd-c0e89976d06a\") " pod="openshift-ingress/kube-auth-proxy-566bb86f76-76sh9"
Jul 20 19:05:46.744321 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:05:46.744291    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-566bb86f76-76sh9"
Jul 20 19:05:46.878225 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:05:46.878197    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-566bb86f76-76sh9"]
Jul 20 19:05:46.880409 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:05:46.880377    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f6d7218_88e0_45ab_a3fd_c0e89976d06a.slice/crio-3a545630195b95ce9d3149bd8a0b3fd44da1697ccc07e7ef134791f683898b1a WatchSource:0}: Error finding container 3a545630195b95ce9d3149bd8a0b3fd44da1697ccc07e7ef134791f683898b1a: Status 404 returned error can't find the container with id 3a545630195b95ce9d3149bd8a0b3fd44da1697ccc07e7ef134791f683898b1a
Jul 20 19:05:46.882222 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:05:46.882201    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:05:47.131168 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:05:47.131079    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-569f4dcc7-mzsr8" event={"ID":"b17eec12-8d7d-4b9f-8b85-15f5118aee60","Type":"ContainerStarted","Data":"f57263fbc2199771bc2832653944645a3723a8dcabb17cc1af1d534e36252074"}
Jul 20 19:05:47.132699 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:05:47.132669    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-566bb86f76-76sh9" event={"ID":"0f6d7218-88e0-45ab-a3fd-c0e89976d06a","Type":"ContainerStarted","Data":"3a545630195b95ce9d3149bd8a0b3fd44da1697ccc07e7ef134791f683898b1a"}
Jul 20 19:05:47.299336 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:05:47.299298    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:05:47.610755 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:05:47.610720    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:05:47.678568 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:05:47.678525    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:05:49.141085 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:05:49.140995    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-569f4dcc7-mzsr8" event={"ID":"b17eec12-8d7d-4b9f-8b85-15f5118aee60","Type":"ContainerStarted","Data":"0b9b3cd34759d385deaef5e1fd5b9d4a139303e1fc0e620989c5af1ab7d5ca0b"}
Jul 20 19:05:49.141537 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:05:49.141107    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-569f4dcc7-mzsr8"
Jul 20 19:05:49.158093 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:05:49.158020    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-569f4dcc7-mzsr8" podStartSLOduration=1.6059857119999998 podStartE2EDuration="4.15800281s" totalImagesPullingTime="2.552017098s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:05:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:05:49.157281565 +0000 UTC m=+308.840809589" watchObservedRunningTime="2026-07-20 19:05:49.15800281 +0000 UTC m=+308.841530846"
Jul 20 19:05:50.140233 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:05:50.140206    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:05:50.240014 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:05:50.239981    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:05:51.149213 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:05:51.149176    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-566bb86f76-76sh9" event={"ID":"0f6d7218-88e0-45ab-a3fd-c0e89976d06a","Type":"ContainerStarted","Data":"55027fcd27d6c312cf79b7db406c1dd8e5f756bf9d0b2eec5c1725c1757998e4"}
Jul 20 19:05:51.166145 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:05:51.166097    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-566bb86f76-76sh9" podStartSLOduration=2.9440467249999998 podStartE2EDuration="6.166083261s" totalImagesPullingTime="3.222036536s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:05:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:05:51.165202932 +0000 UTC m=+310.848730957" watchObservedRunningTime="2026-07-20 19:05:51.166083261 +0000 UTC m=+310.849611283"
Jul 20 19:05:57.096464 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:05:57.096415    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:05:57.186245 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:05:57.186210    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:05:57.254647 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:05:57.254617    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:05:57.387866 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:05:57.387786    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:05:57.576291 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:05:57.576261    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:05:57.803160 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:05:57.803126    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:06:00.146757 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:06:00.146726    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-569f4dcc7-mzsr8"
Jul 20 19:06:01.457642 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:06:01.457609    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:06:01.779712 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:06:01.779639    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:06:01.881591 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:06:01.881556    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:06:01.973284 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:06:01.973254    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:06:46.593443 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:06:46.593328    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:06:46.692691 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:06:46.692661    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:06:46.791561 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:06:46.791520    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:07:15.096944 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:07:15.096903    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:07:16.303214 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:07:16.303178    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:07:16.402608 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:07:16.402573    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:07:16.508180 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:07:16.508143    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:07:17.043491 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:07:17.043438    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:07:17.137326 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:07:17.137291    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:07:18.578415 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:07:18.578343    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:07:20.529814 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:07:20.529777    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:07:22.356799 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:07:22.356765    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:07:22.504595 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:07:22.504564    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:07:24.770887 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:07:24.770855    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:07:24.990537 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:07:24.990505    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:07:25.693242 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:07:25.693207    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:07:27.172187 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:07:27.172159    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:07:27.271758 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:07:27.271730    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:07:27.509614 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:07:27.509580    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:07:27.613675 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:07:27.613641    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:07:27.709421 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:07:27.709385    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:07:27.810480 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:07:27.810415    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:07:30.108116 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:07:30.108083    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:07:30.165980 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:07:30.165957    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:07:31.066561 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:07:31.066528    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-cttsp"]
Jul 20 19:07:31.068550 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:07:31.068535    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cttsp"
Jul 20 19:07:31.070966 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:07:31.070943    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-rdzrm\""
Jul 20 19:07:31.071092 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:07:31.070972    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 20 19:07:31.071092 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:07:31.070943    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 20 19:07:31.071681 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:07:31.071666    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 20 19:07:31.071735 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:07:31.071666    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 20 19:07:31.082267 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:07:31.080798    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:07:31.084527 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:07:31.084506    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-cttsp"]
Jul 20 19:07:31.156154 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:07:31.156130    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6d0fdd39-b077-4c3a-ac25-e48e65221eba-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-cttsp\" (UID: \"6d0fdd39-b077-4c3a-ac25-e48e65221eba\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cttsp"
Jul 20 19:07:31.156459 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:07:31.156173    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vc9qt\" (UniqueName: \"kubernetes.io/projected/6d0fdd39-b077-4c3a-ac25-e48e65221eba-kube-api-access-vc9qt\") pod \"kuadrant-console-plugin-66b5774985-cttsp\" (UID: \"6d0fdd39-b077-4c3a-ac25-e48e65221eba\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cttsp"
Jul 20 19:07:31.156459 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:07:31.156194    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/6d0fdd39-b077-4c3a-ac25-e48e65221eba-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-cttsp\" (UID: \"6d0fdd39-b077-4c3a-ac25-e48e65221eba\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cttsp"
Jul 20 19:07:31.257094 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:07:31.257074    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6d0fdd39-b077-4c3a-ac25-e48e65221eba-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-cttsp\" (UID: \"6d0fdd39-b077-4c3a-ac25-e48e65221eba\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cttsp"
Jul 20 19:07:31.257205 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:07:31.257135    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vc9qt\" (UniqueName: \"kubernetes.io/projected/6d0fdd39-b077-4c3a-ac25-e48e65221eba-kube-api-access-vc9qt\") pod \"kuadrant-console-plugin-66b5774985-cttsp\" (UID: \"6d0fdd39-b077-4c3a-ac25-e48e65221eba\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cttsp"
Jul 20 19:07:31.257205 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:07:31.257167    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/6d0fdd39-b077-4c3a-ac25-e48e65221eba-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-cttsp\" (UID: \"6d0fdd39-b077-4c3a-ac25-e48e65221eba\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cttsp"
Jul 20 19:07:31.257705 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:07:31.257684    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6d0fdd39-b077-4c3a-ac25-e48e65221eba-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-cttsp\" (UID: \"6d0fdd39-b077-4c3a-ac25-e48e65221eba\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cttsp"
Jul 20 19:07:31.259820 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:07:31.259796    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/6d0fdd39-b077-4c3a-ac25-e48e65221eba-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-cttsp\" (UID: \"6d0fdd39-b077-4c3a-ac25-e48e65221eba\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cttsp"
Jul 20 19:07:31.265566 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:07:31.265547    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vc9qt\" (UniqueName: \"kubernetes.io/projected/6d0fdd39-b077-4c3a-ac25-e48e65221eba-kube-api-access-vc9qt\") pod \"kuadrant-console-plugin-66b5774985-cttsp\" (UID: \"6d0fdd39-b077-4c3a-ac25-e48e65221eba\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cttsp"
Jul 20 19:07:31.269474 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:07:31.269454    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:07:31.377517 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:07:31.377449    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cttsp"
Jul 20 19:07:31.501264 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:07:31.501238    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-cttsp"]
Jul 20 19:07:31.503782 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:07:31.503755    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6d0fdd39_b077_4c3a_ac25_e48e65221eba.slice/crio-eb5866f0806170cd3f824db71e58c3be45b82c1b55d3aed485cb68b2448832e4 WatchSource:0}: Error finding container eb5866f0806170cd3f824db71e58c3be45b82c1b55d3aed485cb68b2448832e4: Status 404 returned error can't find the container with id eb5866f0806170cd3f824db71e58c3be45b82c1b55d3aed485cb68b2448832e4
Jul 20 19:07:31.510734 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:07:31.510708    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cttsp" event={"ID":"6d0fdd39-b077-4c3a-ac25-e48e65221eba","Type":"ContainerStarted","Data":"eb5866f0806170cd3f824db71e58c3be45b82c1b55d3aed485cb68b2448832e4"}
Jul 20 19:07:37.754405 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:07:37.754271    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:07:37.857787 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:07:37.857752    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:07:40.653043 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:07:40.653004    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ncq46"]
Jul 20 19:07:40.656145 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:07:40.656117    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ncq46"
Jul 20 19:07:40.658661 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:07:40.658638    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-6rzbt\""
Jul 20 19:07:40.671203 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:07:40.671176    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ncq46"]
Jul 20 19:07:40.731443 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:07:40.731395    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f4385c2b-107a-464f-8813-cf3efd104630-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-ncq46\" (UID: \"f4385c2b-107a-464f-8813-cf3efd104630\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ncq46"
Jul 20 19:07:40.731598 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:07:40.731463    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjl67\" (UniqueName: \"kubernetes.io/projected/f4385c2b-107a-464f-8813-cf3efd104630-kube-api-access-bjl67\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-ncq46\" (UID: \"f4385c2b-107a-464f-8813-cf3efd104630\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ncq46"
Jul 20 19:07:40.776016 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:07:40.775990    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ncq46"]
Jul 20 19:07:40.776253 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:07:40.776232    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-bjl67], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ncq46" podUID="f4385c2b-107a-464f-8813-cf3efd104630"
Jul 20 19:07:40.832108 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:07:40.832078    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f4385c2b-107a-464f-8813-cf3efd104630-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-ncq46\" (UID: \"f4385c2b-107a-464f-8813-cf3efd104630\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ncq46"
Jul 20 19:07:40.832230 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:07:40.832129    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bjl67\" (UniqueName: \"kubernetes.io/projected/f4385c2b-107a-464f-8813-cf3efd104630-kube-api-access-bjl67\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-ncq46\" (UID: \"f4385c2b-107a-464f-8813-cf3efd104630\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ncq46"
Jul 20 19:07:40.832487 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:07:40.832461    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f4385c2b-107a-464f-8813-cf3efd104630-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-ncq46\" (UID: \"f4385c2b-107a-464f-8813-cf3efd104630\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ncq46"
Jul 20 19:07:40.844196 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:07:40.844171    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjl67\" (UniqueName: \"kubernetes.io/projected/f4385c2b-107a-464f-8813-cf3efd104630-kube-api-access-bjl67\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-ncq46\" (UID: \"f4385c2b-107a-464f-8813-cf3efd104630\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ncq46"
Jul 20 19:07:41.341427 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:07:41.341395    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ncq46"]
Jul 20 19:07:41.346986 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:07:41.346947    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ncq46"]
Jul 20 19:07:41.387631 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:07:41.387601    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nr6j2"]
Jul 20 19:07:41.390895 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:07:41.390876    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nr6j2"
Jul 20 19:07:41.408643 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:07:41.408562    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nr6j2"]
Jul 20 19:07:41.437212 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:07:41.437181    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c59f9dfa-3828-4a51-bc12-ca68e9db2efa-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-nr6j2\" (UID: \"c59f9dfa-3828-4a51-bc12-ca68e9db2efa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nr6j2"
Jul 20 19:07:41.437337 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:07:41.437299    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7962m\" (UniqueName: \"kubernetes.io/projected/c59f9dfa-3828-4a51-bc12-ca68e9db2efa-kube-api-access-7962m\") pod \"kuadrant-operator-controller-manager-8684c9ff49-nr6j2\" (UID: \"c59f9dfa-3828-4a51-bc12-ca68e9db2efa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nr6j2"
Jul 20 19:07:41.538664 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:07:41.538635    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7962m\" (UniqueName: \"kubernetes.io/projected/c59f9dfa-3828-4a51-bc12-ca68e9db2efa-kube-api-access-7962m\") pod \"kuadrant-operator-controller-manager-8684c9ff49-nr6j2\" (UID: \"c59f9dfa-3828-4a51-bc12-ca68e9db2efa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nr6j2"
Jul 20 19:07:41.538782 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:07:41.538675    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c59f9dfa-3828-4a51-bc12-ca68e9db2efa-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-nr6j2\" (UID: \"c59f9dfa-3828-4a51-bc12-ca68e9db2efa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nr6j2"
Jul 20 19:07:41.539039 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:07:41.539024    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c59f9dfa-3828-4a51-bc12-ca68e9db2efa-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-nr6j2\" (UID: \"c59f9dfa-3828-4a51-bc12-ca68e9db2efa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nr6j2"
Jul 20 19:07:41.547366 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:07:41.547327    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7962m\" (UniqueName: \"kubernetes.io/projected/c59f9dfa-3828-4a51-bc12-ca68e9db2efa-kube-api-access-7962m\") pod \"kuadrant-operator-controller-manager-8684c9ff49-nr6j2\" (UID: \"c59f9dfa-3828-4a51-bc12-ca68e9db2efa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nr6j2"
Jul 20 19:07:41.553158 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:07:41.553131    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ncq46"
Jul 20 19:07:41.555475 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:07:41.555442    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-ncq46\" is forbidden: User \"system:node:ip-10-0-139-141.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-141.ec2.internal' and this object" podUID="f4385c2b-107a-464f-8813-cf3efd104630" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ncq46"
Jul 20 19:07:41.562097 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:07:41.562079    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ncq46"
Jul 20 19:07:41.564581 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:07:41.564553    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-ncq46\" is forbidden: User \"system:node:ip-10-0-139-141.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-141.ec2.internal' and this object" podUID="f4385c2b-107a-464f-8813-cf3efd104630" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ncq46"
Jul 20 19:07:41.639650 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:07:41.639583    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bjl67\" (UniqueName: \"kubernetes.io/projected/f4385c2b-107a-464f-8813-cf3efd104630-kube-api-access-bjl67\") pod \"f4385c2b-107a-464f-8813-cf3efd104630\" (UID: \"f4385c2b-107a-464f-8813-cf3efd104630\") "
Jul 20 19:07:41.639762 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:07:41.639697    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f4385c2b-107a-464f-8813-cf3efd104630-extensions-socket-volume\") pod \"f4385c2b-107a-464f-8813-cf3efd104630\" (UID: \"f4385c2b-107a-464f-8813-cf3efd104630\") "
Jul 20 19:07:41.640047 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:07:41.640010    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4385c2b-107a-464f-8813-cf3efd104630-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "f4385c2b-107a-464f-8813-cf3efd104630" (UID: "f4385c2b-107a-464f-8813-cf3efd104630"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:07:41.641979 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:07:41.641954    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4385c2b-107a-464f-8813-cf3efd104630-kube-api-access-bjl67" (OuterVolumeSpecName: "kube-api-access-bjl67") pod "f4385c2b-107a-464f-8813-cf3efd104630" (UID: "f4385c2b-107a-464f-8813-cf3efd104630"). InnerVolumeSpecName "kube-api-access-bjl67". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:07:41.704390 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:07:41.704364    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-6rzbt\""
Jul 20 19:07:41.712264 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:07:41.712245    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nr6j2"
Jul 20 19:07:41.741156 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:07:41.741131    2563 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f4385c2b-107a-464f-8813-cf3efd104630-extensions-socket-volume\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\""
Jul 20 19:07:41.741263 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:07:41.741158    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bjl67\" (UniqueName: \"kubernetes.io/projected/f4385c2b-107a-464f-8813-cf3efd104630-kube-api-access-bjl67\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\""
Jul 20 19:07:41.857895 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:07:41.857845    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nr6j2"]
Jul 20 19:07:42.524717 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:07:42.524675    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:07:42.558200 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:07:42.558175    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ncq46"
Jul 20 19:07:42.561634 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:07:42.561600    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-ncq46\" is forbidden: User \"system:node:ip-10-0-139-141.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-141.ec2.internal' and this object" podUID="f4385c2b-107a-464f-8813-cf3efd104630" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ncq46"
Jul 20 19:07:42.567841 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:07:42.567799    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-ncq46\" is forbidden: User \"system:node:ip-10-0-139-141.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-141.ec2.internal' and this object" podUID="f4385c2b-107a-464f-8813-cf3efd104630" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ncq46"
Jul 20 19:07:42.629612 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:07:42.629580    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:07:42.892882 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:07:42.892810    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f4385c2b-107a-464f-8813-cf3efd104630" path="/var/lib/kubelet/pods/f4385c2b-107a-464f-8813-cf3efd104630/volumes"
Jul 20 19:07:47.323603 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:07:47.323568    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:07:47.424147 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:07:47.424113    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:07:51.522127 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:07:51.522086    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:07:51.588579 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:07:51.588545    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:07:53.512815 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:07:53.512768    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nr6j2"]
Jul 20 19:07:54.264790 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:07:54.264739    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:07:54.368840 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:07:54.368807    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:07:55.733337 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:07:55.733300    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc59f9dfa_3828_4a51_bc12_ca68e9db2efa.slice/crio-bd6462b0be787a3755432bca8de975aa52eada0fe783091d680121669abf19bd WatchSource:0}: Error finding container bd6462b0be787a3755432bca8de975aa52eada0fe783091d680121669abf19bd: Status 404 returned error can't find the container with id bd6462b0be787a3755432bca8de975aa52eada0fe783091d680121669abf19bd
Jul 20 19:07:56.617056 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:07:56.617026    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nr6j2" event={"ID":"c59f9dfa-3828-4a51-bc12-ca68e9db2efa","Type":"ContainerStarted","Data":"bd6462b0be787a3755432bca8de975aa52eada0fe783091d680121669abf19bd"}
Jul 20 19:07:56.618619 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:07:56.618593    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cttsp" event={"ID":"6d0fdd39-b077-4c3a-ac25-e48e65221eba","Type":"ContainerStarted","Data":"0bcffab889bf4fb87c477f5112ddd800e87d354b952ba867da98e4add8d560b5"}
Jul 20 19:07:56.634880 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:07:56.634837    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cttsp" podStartSLOduration=1.339505578 podStartE2EDuration="25.634818059s" totalImagesPullingTime="24.295312481s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:07:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:07:56.633199209 +0000 UTC m=+436.316727230" watchObservedRunningTime="2026-07-20 19:07:56.634818059 +0000 UTC m=+436.318346088"
Jul 20 19:07:58.709787 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:07:58.709740    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:07:58.763165 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:07:58.763128    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:08:01.645572 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:08:01.645065    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nr6j2" event={"ID":"c59f9dfa-3828-4a51-bc12-ca68e9db2efa","Type":"ContainerStarted","Data":"84f746f4b19b170f27e51c57707d8eb85951aef63da2dbc6c3202bb3baab61b0"}
Jul 20 19:08:01.645572 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:08:01.645487    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nr6j2"
Jul 20 19:08:01.646961 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:08:01.646907    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nr6j2" podUID="c59f9dfa-3828-4a51-bc12-ca68e9db2efa" containerName="manager" containerID="cri-o://84f746f4b19b170f27e51c57707d8eb85951aef63da2dbc6c3202bb3baab61b0" gracePeriod=10
Jul 20 19:08:01.681219 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:08:01.681171    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nr6j2" podStartSLOduration=15.22284413 podStartE2EDuration="20.681155545s" totalImagesPullingTime="5.458311415s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:07:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:08:01.67780804 +0000 UTC m=+441.361336062" watchObservedRunningTime="2026-07-20 19:08:01.681155545 +0000 UTC m=+441.364683568"
Jul 20 19:08:01.889417 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:08:01.889393    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nr6j2"
Jul 20 19:08:02.029720 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:08:02.029683    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c59f9dfa-3828-4a51-bc12-ca68e9db2efa-extensions-socket-volume\") pod \"c59f9dfa-3828-4a51-bc12-ca68e9db2efa\" (UID: \"c59f9dfa-3828-4a51-bc12-ca68e9db2efa\") "
Jul 20 19:08:02.029889 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:08:02.029767    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7962m\" (UniqueName: \"kubernetes.io/projected/c59f9dfa-3828-4a51-bc12-ca68e9db2efa-kube-api-access-7962m\") pod \"c59f9dfa-3828-4a51-bc12-ca68e9db2efa\" (UID: \"c59f9dfa-3828-4a51-bc12-ca68e9db2efa\") "
Jul 20 19:08:02.030298 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:08:02.030262    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c59f9dfa-3828-4a51-bc12-ca68e9db2efa-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "c59f9dfa-3828-4a51-bc12-ca68e9db2efa" (UID: "c59f9dfa-3828-4a51-bc12-ca68e9db2efa"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:08:02.032139 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:08:02.032111    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c59f9dfa-3828-4a51-bc12-ca68e9db2efa-kube-api-access-7962m" (OuterVolumeSpecName: "kube-api-access-7962m") pod "c59f9dfa-3828-4a51-bc12-ca68e9db2efa" (UID: "c59f9dfa-3828-4a51-bc12-ca68e9db2efa"). InnerVolumeSpecName "kube-api-access-7962m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:08:02.130813 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:08:02.130770    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7962m\" (UniqueName: \"kubernetes.io/projected/c59f9dfa-3828-4a51-bc12-ca68e9db2efa-kube-api-access-7962m\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\""
Jul 20 19:08:02.130813 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:08:02.130810    2563 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c59f9dfa-3828-4a51-bc12-ca68e9db2efa-extensions-socket-volume\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\""
Jul 20 19:08:02.650722 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:08:02.650691    2563 generic.go:356] "Generic (PLEG): container finished" podID="c59f9dfa-3828-4a51-bc12-ca68e9db2efa" containerID="84f746f4b19b170f27e51c57707d8eb85951aef63da2dbc6c3202bb3baab61b0" exitCode=0
Jul 20 19:08:02.651116 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:08:02.650735    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nr6j2" event={"ID":"c59f9dfa-3828-4a51-bc12-ca68e9db2efa","Type":"ContainerDied","Data":"84f746f4b19b170f27e51c57707d8eb85951aef63da2dbc6c3202bb3baab61b0"}
Jul 20 19:08:02.651116 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:08:02.650737    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nr6j2"
Jul 20 19:08:02.651116 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:08:02.650776    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nr6j2" event={"ID":"c59f9dfa-3828-4a51-bc12-ca68e9db2efa","Type":"ContainerDied","Data":"bd6462b0be787a3755432bca8de975aa52eada0fe783091d680121669abf19bd"}
Jul 20 19:08:02.651116 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:08:02.650799    2563 scope.go:117] "RemoveContainer" containerID="84f746f4b19b170f27e51c57707d8eb85951aef63da2dbc6c3202bb3baab61b0"
Jul 20 19:08:02.659613 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:08:02.659597    2563 scope.go:117] "RemoveContainer" containerID="84f746f4b19b170f27e51c57707d8eb85951aef63da2dbc6c3202bb3baab61b0"
Jul 20 19:08:02.659852 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:08:02.659827    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"84f746f4b19b170f27e51c57707d8eb85951aef63da2dbc6c3202bb3baab61b0\": container with ID starting with 84f746f4b19b170f27e51c57707d8eb85951aef63da2dbc6c3202bb3baab61b0 not found: ID does not exist" containerID="84f746f4b19b170f27e51c57707d8eb85951aef63da2dbc6c3202bb3baab61b0"
Jul 20 19:08:02.659899 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:08:02.659861    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84f746f4b19b170f27e51c57707d8eb85951aef63da2dbc6c3202bb3baab61b0"} err="failed to get container status \"84f746f4b19b170f27e51c57707d8eb85951aef63da2dbc6c3202bb3baab61b0\": rpc error: code = NotFound desc = could not find container \"84f746f4b19b170f27e51c57707d8eb85951aef63da2dbc6c3202bb3baab61b0\": container with ID starting with 84f746f4b19b170f27e51c57707d8eb85951aef63da2dbc6c3202bb3baab61b0 not found: ID does not exist"
Jul 20 19:08:02.678876 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:08:02.678851    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nr6j2"]
Jul 20 19:08:02.686917 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:08:02.686896    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nr6j2"]
Jul 20 19:08:02.891463 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:08:02.891433    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c59f9dfa-3828-4a51-bc12-ca68e9db2efa" path="/var/lib/kubelet/pods/c59f9dfa-3828-4a51-bc12-ca68e9db2efa/volumes"
Jul 20 19:08:02.930427 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:08:02.930361    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:08:03.032181 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:08:03.032152    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:08:07.732870 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:08:07.732839    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:08:07.832843 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:08:07.832815    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:08:10.009512 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:08:10.009478    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:08:10.650164 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:08:10.650129    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:08:19.767588 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:08:19.767554    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:08:21.984512 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:08:21.984479    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:08:25.204723 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:08:25.204687    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-b6gd8"]
Jul 20 19:08:25.205103 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:08:25.204976    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c59f9dfa-3828-4a51-bc12-ca68e9db2efa" containerName="manager"
Jul 20 19:08:25.205103 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:08:25.204987    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c59f9dfa-3828-4a51-bc12-ca68e9db2efa" containerName="manager"
Jul 20 19:08:25.205103 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:08:25.205039    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="c59f9dfa-3828-4a51-bc12-ca68e9db2efa" containerName="manager"
Jul 20 19:08:25.208466 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:08:25.208440    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:08:25.223995 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:08:25.223965    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-b6gd8"]
Jul 20 19:08:25.224101 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:08:25.224056    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-b6gd8"
Jul 20 19:08:25.226877 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:08:25.226855    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 20 19:08:25.302856 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:08:25.302826    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-b6gd8"]
Jul 20 19:08:25.306066 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:08:25.306042    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6frh\" (UniqueName: \"kubernetes.io/projected/faca4bc2-a119-4d56-9766-04f96118e1ec-kube-api-access-c6frh\") pod \"limitador-limitador-64c94fd64f-b6gd8\" (UID: \"faca4bc2-a119-4d56-9766-04f96118e1ec\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-b6gd8"
Jul 20 19:08:25.306183 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:08:25.306099    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/faca4bc2-a119-4d56-9766-04f96118e1ec-config-file\") pod \"limitador-limitador-64c94fd64f-b6gd8\" (UID: \"faca4bc2-a119-4d56-9766-04f96118e1ec\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-b6gd8"
Jul 20 19:08:25.310417 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:08:25.310396    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:08:25.370945 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:08:25.370924    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:08:25.406628 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:08:25.406603    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/faca4bc2-a119-4d56-9766-04f96118e1ec-config-file\") pod \"limitador-limitador-64c94fd64f-b6gd8\" (UID: \"faca4bc2-a119-4d56-9766-04f96118e1ec\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-b6gd8"
Jul 20 19:08:25.406735 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:08:25.406675    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6frh\" (UniqueName: \"kubernetes.io/projected/faca4bc2-a119-4d56-9766-04f96118e1ec-kube-api-access-c6frh\") pod \"limitador-limitador-64c94fd64f-b6gd8\" (UID: \"faca4bc2-a119-4d56-9766-04f96118e1ec\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-b6gd8"
Jul 20 19:08:25.407202 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:08:25.407183    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/faca4bc2-a119-4d56-9766-04f96118e1ec-config-file\") pod \"limitador-limitador-64c94fd64f-b6gd8\" (UID: \"faca4bc2-a119-4d56-9766-04f96118e1ec\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-b6gd8"
Jul 20 19:08:25.415213 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:08:25.415186    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6frh\" (UniqueName: \"kubernetes.io/projected/faca4bc2-a119-4d56-9766-04f96118e1ec-kube-api-access-c6frh\") pod \"limitador-limitador-64c94fd64f-b6gd8\" (UID: \"faca4bc2-a119-4d56-9766-04f96118e1ec\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-b6gd8"
Jul 20 19:08:25.533558 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:08:25.533486    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-b6gd8"
Jul 20 19:08:25.663458 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:08:25.663434    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-b6gd8"]
Jul 20 19:08:25.665952 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:08:25.665922    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfaca4bc2_a119_4d56_9766_04f96118e1ec.slice/crio-82098ba8d2a75b184825c1611da5ce60b40f0e6691a7e73ebf67e784a834c410 WatchSource:0}: Error finding container 82098ba8d2a75b184825c1611da5ce60b40f0e6691a7e73ebf67e784a834c410: Status 404 returned error can't find the container with id 82098ba8d2a75b184825c1611da5ce60b40f0e6691a7e73ebf67e784a834c410
Jul 20 19:08:25.743168 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:08:25.743135    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-b6gd8" event={"ID":"faca4bc2-a119-4d56-9766-04f96118e1ec","Type":"ContainerStarted","Data":"82098ba8d2a75b184825c1611da5ce60b40f0e6691a7e73ebf67e784a834c410"}
Jul 20 19:08:26.097638 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:08:26.097608    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:08:26.200639 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:08:26.200611    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:08:28.764454 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:08:28.764416    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-b6gd8" event={"ID":"faca4bc2-a119-4d56-9766-04f96118e1ec","Type":"ContainerStarted","Data":"3a3ce5a073e94f0463ed7b8a875cc0dd4b9922c4d22627ca5fb6e7245147945b"}
Jul 20 19:08:28.764864 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:08:28.764537    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-b6gd8"
Jul 20 19:08:28.783955 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:08:28.783915    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-b6gd8" podStartSLOduration=1.054225234 podStartE2EDuration="3.78390338s" totalImagesPullingTime="2.729678146s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:08:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:08:28.783161339 +0000 UTC m=+468.466689356" watchObservedRunningTime="2026-07-20 19:08:28.78390338 +0000 UTC m=+468.467431403"
Jul 20 19:08:39.769453 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:08:39.769424    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-b6gd8"
Jul 20 19:08:40.049598 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:08:40.049518    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:08:41.129233 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:08:41.129130    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-b6gd8"]
Jul 20 19:08:41.129632 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:08:41.129339    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-b6gd8" podUID="faca4bc2-a119-4d56-9766-04f96118e1ec" containerName="limitador" containerID="cri-o://3a3ce5a073e94f0463ed7b8a875cc0dd4b9922c4d22627ca5fb6e7245147945b" gracePeriod=30
Jul 20 19:08:41.682396 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:08:41.682374    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-b6gd8"
Jul 20 19:08:41.735951 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:08:41.735917    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/faca4bc2-a119-4d56-9766-04f96118e1ec-config-file\") pod \"faca4bc2-a119-4d56-9766-04f96118e1ec\" (UID: \"faca4bc2-a119-4d56-9766-04f96118e1ec\") "
Jul 20 19:08:41.736071 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:08:41.735979    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c6frh\" (UniqueName: \"kubernetes.io/projected/faca4bc2-a119-4d56-9766-04f96118e1ec-kube-api-access-c6frh\") pod \"faca4bc2-a119-4d56-9766-04f96118e1ec\" (UID: \"faca4bc2-a119-4d56-9766-04f96118e1ec\") "
Jul 20 19:08:41.736205 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:08:41.736185    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/faca4bc2-a119-4d56-9766-04f96118e1ec-config-file" (OuterVolumeSpecName: "config-file") pod "faca4bc2-a119-4d56-9766-04f96118e1ec" (UID: "faca4bc2-a119-4d56-9766-04f96118e1ec"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 19:08:41.738016 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:08:41.737994    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/faca4bc2-a119-4d56-9766-04f96118e1ec-kube-api-access-c6frh" (OuterVolumeSpecName: "kube-api-access-c6frh") pod "faca4bc2-a119-4d56-9766-04f96118e1ec" (UID: "faca4bc2-a119-4d56-9766-04f96118e1ec"). InnerVolumeSpecName "kube-api-access-c6frh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:08:41.822058 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:08:41.822032    2563 generic.go:356] "Generic (PLEG): container finished" podID="faca4bc2-a119-4d56-9766-04f96118e1ec" containerID="3a3ce5a073e94f0463ed7b8a875cc0dd4b9922c4d22627ca5fb6e7245147945b" exitCode=0
Jul 20 19:08:41.822176 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:08:41.822080    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-b6gd8"
Jul 20 19:08:41.822176 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:08:41.822122    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-b6gd8" event={"ID":"faca4bc2-a119-4d56-9766-04f96118e1ec","Type":"ContainerDied","Data":"3a3ce5a073e94f0463ed7b8a875cc0dd4b9922c4d22627ca5fb6e7245147945b"}
Jul 20 19:08:41.822176 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:08:41.822168    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-b6gd8" event={"ID":"faca4bc2-a119-4d56-9766-04f96118e1ec","Type":"ContainerDied","Data":"82098ba8d2a75b184825c1611da5ce60b40f0e6691a7e73ebf67e784a834c410"}
Jul 20 19:08:41.822278 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:08:41.822190    2563 scope.go:117] "RemoveContainer" containerID="3a3ce5a073e94f0463ed7b8a875cc0dd4b9922c4d22627ca5fb6e7245147945b"
Jul 20 19:08:41.830589 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:08:41.830568    2563 scope.go:117] "RemoveContainer" containerID="3a3ce5a073e94f0463ed7b8a875cc0dd4b9922c4d22627ca5fb6e7245147945b"
Jul 20 19:08:41.830852 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:08:41.830832    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a3ce5a073e94f0463ed7b8a875cc0dd4b9922c4d22627ca5fb6e7245147945b\": container with ID starting with 3a3ce5a073e94f0463ed7b8a875cc0dd4b9922c4d22627ca5fb6e7245147945b not found: ID does not exist" containerID="3a3ce5a073e94f0463ed7b8a875cc0dd4b9922c4d22627ca5fb6e7245147945b"
Jul 20 19:08:41.830919 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:08:41.830865    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a3ce5a073e94f0463ed7b8a875cc0dd4b9922c4d22627ca5fb6e7245147945b"} err="failed to get container status \"3a3ce5a073e94f0463ed7b8a875cc0dd4b9922c4d22627ca5fb6e7245147945b\": rpc error: code = NotFound desc = could not find container \"3a3ce5a073e94f0463ed7b8a875cc0dd4b9922c4d22627ca5fb6e7245147945b\": container with ID starting with 3a3ce5a073e94f0463ed7b8a875cc0dd4b9922c4d22627ca5fb6e7245147945b not found: ID does not exist"
Jul 20 19:08:41.836484 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:08:41.836462    2563 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/faca4bc2-a119-4d56-9766-04f96118e1ec-config-file\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\""
Jul 20 19:08:41.836484 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:08:41.836486    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c6frh\" (UniqueName: \"kubernetes.io/projected/faca4bc2-a119-4d56-9766-04f96118e1ec-kube-api-access-c6frh\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\""
Jul 20 19:08:41.841533 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:08:41.841513    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-b6gd8"]
Jul 20 19:08:41.848268 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:08:41.848245    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-b6gd8"]
Jul 20 19:08:42.890234 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:08:42.890202    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="faca4bc2-a119-4d56-9766-04f96118e1ec" path="/var/lib/kubelet/pods/faca4bc2-a119-4d56-9766-04f96118e1ec/volumes"
Jul 20 19:08:43.452892 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:08:43.452857    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:08:43.544060 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:08:43.544027    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:08:43.929977 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:08:43.929907    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-zqlwr"]
Jul 20 19:08:43.930323 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:08:43.930309    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="faca4bc2-a119-4d56-9766-04f96118e1ec" containerName="limitador"
Jul 20 19:08:43.930388 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:08:43.930329    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="faca4bc2-a119-4d56-9766-04f96118e1ec" containerName="limitador"
Jul 20 19:08:43.930449 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:08:43.930437    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="faca4bc2-a119-4d56-9766-04f96118e1ec" containerName="limitador"
Jul 20 19:08:43.933097 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:08:43.933081    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-zqlwr"
Jul 20 19:08:43.935868 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:08:43.935829    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 20 19:08:43.936225 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:08:43.936207    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-jvd6b\""
Jul 20 19:08:43.936305 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:08:43.936223    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 20 19:08:43.936529 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:08:43.936514    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 20 19:08:43.943241 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:08:43.943222    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-zqlwr"]
Jul 20 19:08:43.963976 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:08:43.963954    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:08:44.053145 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:08:44.053120    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tnlx2\" (UniqueName: \"kubernetes.io/projected/784f297d-f341-495c-8caa-8e631796df30-kube-api-access-tnlx2\") pod \"postgres-69fb4594cf-zqlwr\" (UID: \"784f297d-f341-495c-8caa-8e631796df30\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-zqlwr"
Jul 20 19:08:44.053294 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:08:44.053176    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/784f297d-f341-495c-8caa-8e631796df30-data\") pod \"postgres-69fb4594cf-zqlwr\" (UID: \"784f297d-f341-495c-8caa-8e631796df30\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-zqlwr"
Jul 20 19:08:44.154209 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:08:44.154171    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tnlx2\" (UniqueName: \"kubernetes.io/projected/784f297d-f341-495c-8caa-8e631796df30-kube-api-access-tnlx2\") pod \"postgres-69fb4594cf-zqlwr\" (UID: \"784f297d-f341-495c-8caa-8e631796df30\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-zqlwr"
Jul 20 19:08:44.154336 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:08:44.154246    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/784f297d-f341-495c-8caa-8e631796df30-data\") pod \"postgres-69fb4594cf-zqlwr\" (UID: \"784f297d-f341-495c-8caa-8e631796df30\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-zqlwr"
Jul 20 19:08:44.154573 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:08:44.154558    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/784f297d-f341-495c-8caa-8e631796df30-data\") pod \"postgres-69fb4594cf-zqlwr\" (UID: \"784f297d-f341-495c-8caa-8e631796df30\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-zqlwr"
Jul 20 19:08:44.163922 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:08:44.163905    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tnlx2\" (UniqueName: \"kubernetes.io/projected/784f297d-f341-495c-8caa-8e631796df30-kube-api-access-tnlx2\") pod \"postgres-69fb4594cf-zqlwr\" (UID: \"784f297d-f341-495c-8caa-8e631796df30\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-zqlwr"
Jul 20 19:08:44.244187 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:08:44.244158    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-zqlwr"
Jul 20 19:08:44.368276 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:08:44.368253    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-zqlwr"]
Jul 20 19:08:44.370721 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:08:44.370696    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod784f297d_f341_495c_8caa_8e631796df30.slice/crio-eb36ef674bce8c881eed14654248326da95f90a64e7c386477266ddfbe54467d WatchSource:0}: Error finding container eb36ef674bce8c881eed14654248326da95f90a64e7c386477266ddfbe54467d: Status 404 returned error can't find the container with id eb36ef674bce8c881eed14654248326da95f90a64e7c386477266ddfbe54467d
Jul 20 19:08:44.834814 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:08:44.834782    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-zqlwr" event={"ID":"784f297d-f341-495c-8caa-8e631796df30","Type":"ContainerStarted","Data":"eb36ef674bce8c881eed14654248326da95f90a64e7c386477266ddfbe54467d"}
Jul 20 19:08:49.861107 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:08:49.861070    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-zqlwr" event={"ID":"784f297d-f341-495c-8caa-8e631796df30","Type":"ContainerStarted","Data":"01f3f688809dbe909cb68fe2d396e0d3ad6ff18d7184f5f771017d1ee6db017a"}
Jul 20 19:08:49.861575 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:08:49.861149    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-zqlwr"
Jul 20 19:08:49.877675 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:08:49.877629    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-zqlwr" podStartSLOduration=2.234405271 podStartE2EDuration="6.877613726s" totalImagesPullingTime="4.643208455s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:08:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:08:49.875798118 +0000 UTC m=+489.559326152" watchObservedRunningTime="2026-07-20 19:08:49.877613726 +0000 UTC m=+489.561141748"
Jul 20 19:08:55.894119 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:08:55.894093    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-zqlwr"
Jul 20 19:08:56.268743 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:08:56.268685    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:08:56.558460 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:08:56.558374    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:09:03.418880 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:03.418847    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-76859c6dfb-scxbt"]
Jul 20 19:09:03.422128 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:03.422107    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76859c6dfb-scxbt"
Jul 20 19:09:03.425268 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:03.425244    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 20 19:09:03.425268 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:03.425247    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-f4nrb\""
Jul 20 19:09:03.426017 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:03.426002    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 20 19:09:03.442908 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:03.442879    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-76859c6dfb-scxbt"]
Jul 20 19:09:03.468423 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:03.468401    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:09:03.516699 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:03.516673    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/87e4549f-b814-4b1b-b596-5a7fd7c358a4-webhook-cert\") pod \"maas-controller-76859c6dfb-scxbt\" (UID: \"87e4549f-b814-4b1b-b596-5a7fd7c358a4\") " pod="opendatahub/maas-controller-76859c6dfb-scxbt"
Jul 20 19:09:03.516806 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:03.516710    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6drjc\" (UniqueName: \"kubernetes.io/projected/87e4549f-b814-4b1b-b596-5a7fd7c358a4-kube-api-access-6drjc\") pod \"maas-controller-76859c6dfb-scxbt\" (UID: \"87e4549f-b814-4b1b-b596-5a7fd7c358a4\") " pod="opendatahub/maas-controller-76859c6dfb-scxbt"
Jul 20 19:09:03.593704 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:03.593682    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:09:03.617956 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:03.617935    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/87e4549f-b814-4b1b-b596-5a7fd7c358a4-webhook-cert\") pod \"maas-controller-76859c6dfb-scxbt\" (UID: \"87e4549f-b814-4b1b-b596-5a7fd7c358a4\") " pod="opendatahub/maas-controller-76859c6dfb-scxbt"
Jul 20 19:09:03.618038 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:03.617963    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6drjc\" (UniqueName: \"kubernetes.io/projected/87e4549f-b814-4b1b-b596-5a7fd7c358a4-kube-api-access-6drjc\") pod \"maas-controller-76859c6dfb-scxbt\" (UID: \"87e4549f-b814-4b1b-b596-5a7fd7c358a4\") " pod="opendatahub/maas-controller-76859c6dfb-scxbt"
Jul 20 19:09:03.618089 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:09:03.618073    2563 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Jul 20 19:09:03.618148 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:09:03.618139    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87e4549f-b814-4b1b-b596-5a7fd7c358a4-webhook-cert podName:87e4549f-b814-4b1b-b596-5a7fd7c358a4 nodeName:}" failed. No retries permitted until 2026-07-20 19:09:04.118123635 +0000 UTC m=+503.801651635 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/87e4549f-b814-4b1b-b596-5a7fd7c358a4-webhook-cert") pod "maas-controller-76859c6dfb-scxbt" (UID: "87e4549f-b814-4b1b-b596-5a7fd7c358a4") : secret "maas-controller-webhook-cert" not found
Jul 20 19:09:03.625059 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:03.625038    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-55476c59db-dpdnc"]
Jul 20 19:09:03.628104 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:03.628091    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55476c59db-dpdnc"
Jul 20 19:09:03.636522 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:03.636503    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6drjc\" (UniqueName: \"kubernetes.io/projected/87e4549f-b814-4b1b-b596-5a7fd7c358a4-kube-api-access-6drjc\") pod \"maas-controller-76859c6dfb-scxbt\" (UID: \"87e4549f-b814-4b1b-b596-5a7fd7c358a4\") " pod="opendatahub/maas-controller-76859c6dfb-scxbt"
Jul 20 19:09:03.642215 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:03.642192    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-55476c59db-dpdnc"]
Jul 20 19:09:03.688801 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:03.688732    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:09:03.718956 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:03.718932    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fc6faac9-8b0b-4a80-a20b-b7161e23e0e1-webhook-cert\") pod \"maas-controller-55476c59db-dpdnc\" (UID: \"fc6faac9-8b0b-4a80-a20b-b7161e23e0e1\") " pod="opendatahub/maas-controller-55476c59db-dpdnc"
Jul 20 19:09:03.719072 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:03.719057    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvnnj\" (UniqueName: \"kubernetes.io/projected/fc6faac9-8b0b-4a80-a20b-b7161e23e0e1-kube-api-access-jvnnj\") pod \"maas-controller-55476c59db-dpdnc\" (UID: \"fc6faac9-8b0b-4a80-a20b-b7161e23e0e1\") " pod="opendatahub/maas-controller-55476c59db-dpdnc"
Jul 20 19:09:03.820470 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:03.820437    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvnnj\" (UniqueName: \"kubernetes.io/projected/fc6faac9-8b0b-4a80-a20b-b7161e23e0e1-kube-api-access-jvnnj\") pod \"maas-controller-55476c59db-dpdnc\" (UID: \"fc6faac9-8b0b-4a80-a20b-b7161e23e0e1\") " pod="opendatahub/maas-controller-55476c59db-dpdnc"
Jul 20 19:09:03.820600 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:03.820486    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fc6faac9-8b0b-4a80-a20b-b7161e23e0e1-webhook-cert\") pod \"maas-controller-55476c59db-dpdnc\" (UID: \"fc6faac9-8b0b-4a80-a20b-b7161e23e0e1\") " pod="opendatahub/maas-controller-55476c59db-dpdnc"
Jul 20 19:09:03.822956 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:03.822934    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fc6faac9-8b0b-4a80-a20b-b7161e23e0e1-webhook-cert\") pod \"maas-controller-55476c59db-dpdnc\" (UID: \"fc6faac9-8b0b-4a80-a20b-b7161e23e0e1\") " pod="opendatahub/maas-controller-55476c59db-dpdnc"
Jul 20 19:09:03.830718 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:03.830695    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvnnj\" (UniqueName: \"kubernetes.io/projected/fc6faac9-8b0b-4a80-a20b-b7161e23e0e1-kube-api-access-jvnnj\") pod \"maas-controller-55476c59db-dpdnc\" (UID: \"fc6faac9-8b0b-4a80-a20b-b7161e23e0e1\") " pod="opendatahub/maas-controller-55476c59db-dpdnc"
Jul 20 19:09:03.938645 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:03.938618    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55476c59db-dpdnc"
Jul 20 19:09:04.079922 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:04.079889    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-55476c59db-dpdnc"]
Jul 20 19:09:04.082739 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:09:04.082714    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc6faac9_8b0b_4a80_a20b_b7161e23e0e1.slice/crio-fab2e03f2143fdaeef7281334dfa3019643cd6f7ee72528b3a37eb63db8ac45c WatchSource:0}: Error finding container fab2e03f2143fdaeef7281334dfa3019643cd6f7ee72528b3a37eb63db8ac45c: Status 404 returned error can't find the container with id fab2e03f2143fdaeef7281334dfa3019643cd6f7ee72528b3a37eb63db8ac45c
Jul 20 19:09:04.124121 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:04.124097    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/87e4549f-b814-4b1b-b596-5a7fd7c358a4-webhook-cert\") pod \"maas-controller-76859c6dfb-scxbt\" (UID: \"87e4549f-b814-4b1b-b596-5a7fd7c358a4\") " pod="opendatahub/maas-controller-76859c6dfb-scxbt"
Jul 20 19:09:04.126508 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:04.126486    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/87e4549f-b814-4b1b-b596-5a7fd7c358a4-webhook-cert\") pod \"maas-controller-76859c6dfb-scxbt\" (UID: \"87e4549f-b814-4b1b-b596-5a7fd7c358a4\") " pod="opendatahub/maas-controller-76859c6dfb-scxbt"
Jul 20 19:09:04.331454 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:04.331427    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76859c6dfb-scxbt"
Jul 20 19:09:04.474101 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:04.474078    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-76859c6dfb-scxbt"]
Jul 20 19:09:04.475800 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:09:04.475766    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87e4549f_b814_4b1b_b596_5a7fd7c358a4.slice/crio-c21b52c267a2b1ab072dea562b82a684e5d8f345e3a8e78a76d3bcd2aabb9dd5 WatchSource:0}: Error finding container c21b52c267a2b1ab072dea562b82a684e5d8f345e3a8e78a76d3bcd2aabb9dd5: Status 404 returned error can't find the container with id c21b52c267a2b1ab072dea562b82a684e5d8f345e3a8e78a76d3bcd2aabb9dd5
Jul 20 19:09:04.921527 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:04.921493    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76859c6dfb-scxbt" event={"ID":"87e4549f-b814-4b1b-b596-5a7fd7c358a4","Type":"ContainerStarted","Data":"c21b52c267a2b1ab072dea562b82a684e5d8f345e3a8e78a76d3bcd2aabb9dd5"}
Jul 20 19:09:04.923859 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:04.923831    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55476c59db-dpdnc" event={"ID":"fc6faac9-8b0b-4a80-a20b-b7161e23e0e1","Type":"ContainerStarted","Data":"fab2e03f2143fdaeef7281334dfa3019643cd6f7ee72528b3a37eb63db8ac45c"}
Jul 20 19:09:06.761545 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:06.761513    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:09:06.861018 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:06.860937    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:09:06.934681 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:06.934646    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76859c6dfb-scxbt" event={"ID":"87e4549f-b814-4b1b-b596-5a7fd7c358a4","Type":"ContainerStarted","Data":"ce15785f1c245fe8897c2b4f43c2600e8453ce05e3b5748c1e000bca17e58e08"}
Jul 20 19:09:06.934886 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:06.934728    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-76859c6dfb-scxbt"
Jul 20 19:09:06.936439 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:06.936411    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55476c59db-dpdnc" event={"ID":"fc6faac9-8b0b-4a80-a20b-b7161e23e0e1","Type":"ContainerStarted","Data":"e17f98a100a70332125329d0f719e0b271ed31434ab2610b5a8f0d1d714383c4"}
Jul 20 19:09:06.936577 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:06.936538    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-55476c59db-dpdnc"
Jul 20 19:09:06.971929 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:06.971881    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-76859c6dfb-scxbt" podStartSLOduration=1.877738864 podStartE2EDuration="3.971865351s" totalImagesPullingTime="2.094126487s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:09:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:09:06.966402056 +0000 UTC m=+506.649930073" watchObservedRunningTime="2026-07-20 19:09:06.971865351 +0000 UTC m=+506.655393401"
Jul 20 19:09:17.942977 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:17.942947    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-55476c59db-dpdnc"
Jul 20 19:09:17.943476 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:17.943027    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-76859c6dfb-scxbt"
Jul 20 19:09:17.961864 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:17.961816    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-55476c59db-dpdnc" podStartSLOduration=12.483081395 podStartE2EDuration="14.961802451s" totalImagesPullingTime="2.478721056s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:09:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:09:07.049006246 +0000 UTC m=+506.732534268" watchObservedRunningTime="2026-07-20 19:09:17.961802451 +0000 UTC m=+517.645330532"
Jul 20 19:09:18.007754 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:18.007725    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-76859c6dfb-scxbt"]
Jul 20 19:09:18.007953 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:18.007907    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-76859c6dfb-scxbt" podUID="87e4549f-b814-4b1b-b596-5a7fd7c358a4" containerName="manager" containerID="cri-o://ce15785f1c245fe8897c2b4f43c2600e8453ce05e3b5748c1e000bca17e58e08" gracePeriod=30
Jul 20 19:09:18.249806 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:18.249780    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76859c6dfb-scxbt"
Jul 20 19:09:18.437014 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:18.436988    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/87e4549f-b814-4b1b-b596-5a7fd7c358a4-webhook-cert\") pod \"87e4549f-b814-4b1b-b596-5a7fd7c358a4\" (UID: \"87e4549f-b814-4b1b-b596-5a7fd7c358a4\") "
Jul 20 19:09:18.437183 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:18.437078    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6drjc\" (UniqueName: \"kubernetes.io/projected/87e4549f-b814-4b1b-b596-5a7fd7c358a4-kube-api-access-6drjc\") pod \"87e4549f-b814-4b1b-b596-5a7fd7c358a4\" (UID: \"87e4549f-b814-4b1b-b596-5a7fd7c358a4\") "
Jul 20 19:09:18.439230 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:18.439201    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/87e4549f-b814-4b1b-b596-5a7fd7c358a4-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "87e4549f-b814-4b1b-b596-5a7fd7c358a4" (UID: "87e4549f-b814-4b1b-b596-5a7fd7c358a4"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 19:09:18.439230 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:18.439217    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87e4549f-b814-4b1b-b596-5a7fd7c358a4-kube-api-access-6drjc" (OuterVolumeSpecName: "kube-api-access-6drjc") pod "87e4549f-b814-4b1b-b596-5a7fd7c358a4" (UID: "87e4549f-b814-4b1b-b596-5a7fd7c358a4"). InnerVolumeSpecName "kube-api-access-6drjc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:09:18.538300 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:18.538244    2563 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/87e4549f-b814-4b1b-b596-5a7fd7c358a4-webhook-cert\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\""
Jul 20 19:09:18.538300 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:18.538266    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6drjc\" (UniqueName: \"kubernetes.io/projected/87e4549f-b814-4b1b-b596-5a7fd7c358a4-kube-api-access-6drjc\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\""
Jul 20 19:09:18.986237 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:18.986205    2563 generic.go:356] "Generic (PLEG): container finished" podID="87e4549f-b814-4b1b-b596-5a7fd7c358a4" containerID="ce15785f1c245fe8897c2b4f43c2600e8453ce05e3b5748c1e000bca17e58e08" exitCode=0
Jul 20 19:09:18.986638 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:18.986250    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76859c6dfb-scxbt"
Jul 20 19:09:18.986638 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:18.986274    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76859c6dfb-scxbt" event={"ID":"87e4549f-b814-4b1b-b596-5a7fd7c358a4","Type":"ContainerDied","Data":"ce15785f1c245fe8897c2b4f43c2600e8453ce05e3b5748c1e000bca17e58e08"}
Jul 20 19:09:18.986638 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:18.986322    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76859c6dfb-scxbt" event={"ID":"87e4549f-b814-4b1b-b596-5a7fd7c358a4","Type":"ContainerDied","Data":"c21b52c267a2b1ab072dea562b82a684e5d8f345e3a8e78a76d3bcd2aabb9dd5"}
Jul 20 19:09:18.986638 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:18.986345    2563 scope.go:117] "RemoveContainer" containerID="ce15785f1c245fe8897c2b4f43c2600e8453ce05e3b5748c1e000bca17e58e08"
Jul 20 19:09:18.994666 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:18.994651    2563 scope.go:117] "RemoveContainer" containerID="ce15785f1c245fe8897c2b4f43c2600e8453ce05e3b5748c1e000bca17e58e08"
Jul 20 19:09:18.994940 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:09:18.994923    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ce15785f1c245fe8897c2b4f43c2600e8453ce05e3b5748c1e000bca17e58e08\": container with ID starting with ce15785f1c245fe8897c2b4f43c2600e8453ce05e3b5748c1e000bca17e58e08 not found: ID does not exist" containerID="ce15785f1c245fe8897c2b4f43c2600e8453ce05e3b5748c1e000bca17e58e08"
Jul 20 19:09:18.994981 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:18.994950    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce15785f1c245fe8897c2b4f43c2600e8453ce05e3b5748c1e000bca17e58e08"} err="failed to get container status \"ce15785f1c245fe8897c2b4f43c2600e8453ce05e3b5748c1e000bca17e58e08\": rpc error: code = NotFound desc = could not find container \"ce15785f1c245fe8897c2b4f43c2600e8453ce05e3b5748c1e000bca17e58e08\": container with ID starting with ce15785f1c245fe8897c2b4f43c2600e8453ce05e3b5748c1e000bca17e58e08 not found: ID does not exist"
Jul 20 19:09:19.016278 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:19.016248    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-76859c6dfb-scxbt"]
Jul 20 19:09:19.018262 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:19.018244    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-76859c6dfb-scxbt"]
Jul 20 19:09:20.892649 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:20.892609    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="87e4549f-b814-4b1b-b596-5a7fd7c358a4" path="/var/lib/kubelet/pods/87e4549f-b814-4b1b-b596-5a7fd7c358a4/volumes"
Jul 20 19:09:25.890716 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:25.890683    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:09:38.299052 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:38.298958    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:09:38.423551 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:38.423509    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:09:38.802489 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:38.802456    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:09:38.855005 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:38.854976    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-7c69fff5cb-lv7qw"]
Jul 20 19:09:38.855292 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:38.855281    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87e4549f-b814-4b1b-b596-5a7fd7c358a4" containerName="manager"
Jul 20 19:09:38.855345 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:38.855295    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="87e4549f-b814-4b1b-b596-5a7fd7c358a4" containerName="manager"
Jul 20 19:09:38.855399 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:38.855385    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="87e4549f-b814-4b1b-b596-5a7fd7c358a4" containerName="manager"
Jul 20 19:09:38.858332 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:38.858313    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7c69fff5cb-lv7qw"
Jul 20 19:09:38.861404 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:38.861342    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-9tjtc\""
Jul 20 19:09:38.861515 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:38.861368    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 20 19:09:38.870010 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:38.869989    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7c69fff5cb-lv7qw"]
Jul 20 19:09:38.889672 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:38.889644    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e70508ad-5462-4ca0-ba7d-7e8649328dbc-maas-api-tls\") pod \"maas-api-7c69fff5cb-lv7qw\" (UID: \"e70508ad-5462-4ca0-ba7d-7e8649328dbc\") " pod="odh-ai-gateway-infra/maas-api-7c69fff5cb-lv7qw"
Jul 20 19:09:38.889787 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:38.889691    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmb4b\" (UniqueName: \"kubernetes.io/projected/e70508ad-5462-4ca0-ba7d-7e8649328dbc-kube-api-access-mmb4b\") pod \"maas-api-7c69fff5cb-lv7qw\" (UID: \"e70508ad-5462-4ca0-ba7d-7e8649328dbc\") " pod="odh-ai-gateway-infra/maas-api-7c69fff5cb-lv7qw"
Jul 20 19:09:38.889787 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:38.889731    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e70508ad-5462-4ca0-ba7d-7e8649328dbc-openshift-service-ca\") pod \"maas-api-7c69fff5cb-lv7qw\" (UID: \"e70508ad-5462-4ca0-ba7d-7e8649328dbc\") " pod="odh-ai-gateway-infra/maas-api-7c69fff5cb-lv7qw"
Jul 20 19:09:38.903183 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:38.903158    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:09:38.990558 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:38.990518    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmb4b\" (UniqueName: \"kubernetes.io/projected/e70508ad-5462-4ca0-ba7d-7e8649328dbc-kube-api-access-mmb4b\") pod \"maas-api-7c69fff5cb-lv7qw\" (UID: \"e70508ad-5462-4ca0-ba7d-7e8649328dbc\") " pod="odh-ai-gateway-infra/maas-api-7c69fff5cb-lv7qw"
Jul 20 19:09:38.990558 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:38.990563    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e70508ad-5462-4ca0-ba7d-7e8649328dbc-openshift-service-ca\") pod \"maas-api-7c69fff5cb-lv7qw\" (UID: \"e70508ad-5462-4ca0-ba7d-7e8649328dbc\") " pod="odh-ai-gateway-infra/maas-api-7c69fff5cb-lv7qw"
Jul 20 19:09:38.990798 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:38.990655    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e70508ad-5462-4ca0-ba7d-7e8649328dbc-maas-api-tls\") pod \"maas-api-7c69fff5cb-lv7qw\" (UID: \"e70508ad-5462-4ca0-ba7d-7e8649328dbc\") " pod="odh-ai-gateway-infra/maas-api-7c69fff5cb-lv7qw"
Jul 20 19:09:38.991193 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:38.991172    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e70508ad-5462-4ca0-ba7d-7e8649328dbc-openshift-service-ca\") pod \"maas-api-7c69fff5cb-lv7qw\" (UID: \"e70508ad-5462-4ca0-ba7d-7e8649328dbc\") " pod="odh-ai-gateway-infra/maas-api-7c69fff5cb-lv7qw"
Jul 20 19:09:38.993173 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:38.993156    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e70508ad-5462-4ca0-ba7d-7e8649328dbc-maas-api-tls\") pod \"maas-api-7c69fff5cb-lv7qw\" (UID: \"e70508ad-5462-4ca0-ba7d-7e8649328dbc\") " pod="odh-ai-gateway-infra/maas-api-7c69fff5cb-lv7qw"
Jul 20 19:09:38.999012 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:38.998991    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmb4b\" (UniqueName: \"kubernetes.io/projected/e70508ad-5462-4ca0-ba7d-7e8649328dbc-kube-api-access-mmb4b\") pod \"maas-api-7c69fff5cb-lv7qw\" (UID: \"e70508ad-5462-4ca0-ba7d-7e8649328dbc\") " pod="odh-ai-gateway-infra/maas-api-7c69fff5cb-lv7qw"
Jul 20 19:09:39.168176 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:39.168095    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7c69fff5cb-lv7qw"
Jul 20 19:09:39.307096 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:39.307061    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7c69fff5cb-lv7qw"]
Jul 20 19:09:39.310513 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:09:39.310473    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode70508ad_5462_4ca0_ba7d_7e8649328dbc.slice/crio-51d532a24fdbfcb3c8e577f01f975bc06d8c3eff2c4294f74b36290bce71665c WatchSource:0}: Error finding container 51d532a24fdbfcb3c8e577f01f975bc06d8c3eff2c4294f74b36290bce71665c: Status 404 returned error can't find the container with id 51d532a24fdbfcb3c8e577f01f975bc06d8c3eff2c4294f74b36290bce71665c
Jul 20 19:09:39.369327 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:39.369296    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:09:39.455448 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:39.455421    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:09:39.505003 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:39.504973    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-hscqk"]
Jul 20 19:09:39.509159 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:39.509143    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-hscqk"
Jul 20 19:09:39.512545 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:39.512524    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-mz7xd\""
Jul 20 19:09:39.512646 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:39.512589    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 20 19:09:39.519320 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:39.519299    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-hscqk"]
Jul 20 19:09:39.595800 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:39.595763    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8dld4\" (UniqueName: \"kubernetes.io/projected/711594ee-0175-47a4-91df-9aa8a4485a38-kube-api-access-8dld4\") pod \"payload-processing-5bf47cd988-hscqk\" (UID: \"711594ee-0175-47a4-91df-9aa8a4485a38\") " pod="openshift-ingress/payload-processing-5bf47cd988-hscqk"
Jul 20 19:09:39.595949 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:39.595818    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/711594ee-0175-47a4-91df-9aa8a4485a38-plugins-config-volume\") pod \"payload-processing-5bf47cd988-hscqk\" (UID: \"711594ee-0175-47a4-91df-9aa8a4485a38\") " pod="openshift-ingress/payload-processing-5bf47cd988-hscqk"
Jul 20 19:09:39.697212 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:39.697177    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8dld4\" (UniqueName: \"kubernetes.io/projected/711594ee-0175-47a4-91df-9aa8a4485a38-kube-api-access-8dld4\") pod \"payload-processing-5bf47cd988-hscqk\" (UID: \"711594ee-0175-47a4-91df-9aa8a4485a38\") " pod="openshift-ingress/payload-processing-5bf47cd988-hscqk"
Jul 20 19:09:39.697407 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:39.697241    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/711594ee-0175-47a4-91df-9aa8a4485a38-plugins-config-volume\") pod \"payload-processing-5bf47cd988-hscqk\" (UID: \"711594ee-0175-47a4-91df-9aa8a4485a38\") " pod="openshift-ingress/payload-processing-5bf47cd988-hscqk"
Jul 20 19:09:39.698183 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:39.698158    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/711594ee-0175-47a4-91df-9aa8a4485a38-plugins-config-volume\") pod \"payload-processing-5bf47cd988-hscqk\" (UID: \"711594ee-0175-47a4-91df-9aa8a4485a38\") " pod="openshift-ingress/payload-processing-5bf47cd988-hscqk"
Jul 20 19:09:39.709199 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:39.709144    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8dld4\" (UniqueName: \"kubernetes.io/projected/711594ee-0175-47a4-91df-9aa8a4485a38-kube-api-access-8dld4\") pod \"payload-processing-5bf47cd988-hscqk\" (UID: \"711594ee-0175-47a4-91df-9aa8a4485a38\") " pod="openshift-ingress/payload-processing-5bf47cd988-hscqk"
Jul 20 19:09:39.820149 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:39.820114    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-hscqk"
Jul 20 19:09:39.948047 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:39.948012    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-hscqk"]
Jul 20 19:09:39.950453 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:09:39.950426    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod711594ee_0175_47a4_91df_9aa8a4485a38.slice/crio-3586a60d07529e9a005940ec172a0197a73f7b088966f32b2d878e41822f3ba2 WatchSource:0}: Error finding container 3586a60d07529e9a005940ec172a0197a73f7b088966f32b2d878e41822f3ba2: Status 404 returned error can't find the container with id 3586a60d07529e9a005940ec172a0197a73f7b088966f32b2d878e41822f3ba2
Jul 20 19:09:40.069092 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:40.069019    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-hscqk" event={"ID":"711594ee-0175-47a4-91df-9aa8a4485a38","Type":"ContainerStarted","Data":"3586a60d07529e9a005940ec172a0197a73f7b088966f32b2d878e41822f3ba2"}
Jul 20 19:09:40.070196 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:40.070171    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7c69fff5cb-lv7qw" event={"ID":"e70508ad-5462-4ca0-ba7d-7e8649328dbc","Type":"ContainerStarted","Data":"51d532a24fdbfcb3c8e577f01f975bc06d8c3eff2c4294f74b36290bce71665c"}
Jul 20 19:09:43.085975 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:43.085943    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-hscqk" event={"ID":"711594ee-0175-47a4-91df-9aa8a4485a38","Type":"ContainerStarted","Data":"6b9a7dfc59af01a8609a8217b97ab177fdab35a82d281f04b33fdedb99be688e"}
Jul 20 19:09:43.086343 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:43.086051    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5bf47cd988-hscqk"
Jul 20 19:09:43.104900 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:43.104855    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5bf47cd988-hscqk" podStartSLOduration=1.7556922209999999 podStartE2EDuration="4.104842326s" totalImagesPullingTime="2.349150105s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:09:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:09:43.103263561 +0000 UTC m=+542.786791583" watchObservedRunningTime="2026-07-20 19:09:43.104842326 +0000 UTC m=+542.788370347"
Jul 20 19:09:45.097029 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:45.096990    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7c69fff5cb-lv7qw" event={"ID":"e70508ad-5462-4ca0-ba7d-7e8649328dbc","Type":"ContainerStarted","Data":"7e6ab7bd009682d36b0a0cdeb3294a27ed6e06f48f245ca2a8fb8504ce3f72e3"}
Jul 20 19:09:45.097435 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:45.097104    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-7c69fff5cb-lv7qw"
Jul 20 19:09:45.117129 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:45.117074    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-7c69fff5cb-lv7qw" podStartSLOduration=2.330219572 podStartE2EDuration="7.117056782s" totalImagesPullingTime="4.78683721s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:09:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:09:45.115044979 +0000 UTC m=+544.798573002" watchObservedRunningTime="2026-07-20 19:09:45.117056782 +0000 UTC m=+544.800584806"
Jul 20 19:09:51.106995 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:51.106967    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-7c69fff5cb-lv7qw"
Jul 20 19:09:52.185262 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:52.185226    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:09:52.285755 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:52.285719    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:09:54.092117 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:54.092084    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5bf47cd988-hscqk"
Jul 20 19:09:57.598075 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:57.598044    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-chrgn"]
Jul 20 19:09:57.600231 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:57.600215    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-chrgn"
Jul 20 19:09:57.602701 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:57.602677    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 20 19:09:57.603545 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:57.603524    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 20 19:09:57.603821 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:57.603683    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-87hgb\""
Jul 20 19:09:57.603821 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:57.603734    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 20 19:09:57.610976 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:57.610957    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-chrgn"]
Jul 20 19:09:57.640013 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:57.639986    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:09:57.749397 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:57.749339    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/56b3816d-3935-4bfe-b607-e034dda951b5-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-chrgn\" (UID: \"56b3816d-3935-4bfe-b607-e034dda951b5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-chrgn"
Jul 20 19:09:57.749584 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:57.749440    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/56b3816d-3935-4bfe-b607-e034dda951b5-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-chrgn\" (UID: \"56b3816d-3935-4bfe-b607-e034dda951b5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-chrgn"
Jul 20 19:09:57.749584 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:57.749473    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/56b3816d-3935-4bfe-b607-e034dda951b5-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-chrgn\" (UID: \"56b3816d-3935-4bfe-b607-e034dda951b5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-chrgn"
Jul 20 19:09:57.749584 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:57.749516    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/56b3816d-3935-4bfe-b607-e034dda951b5-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-chrgn\" (UID: \"56b3816d-3935-4bfe-b607-e034dda951b5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-chrgn"
Jul 20 19:09:57.749584 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:57.749561    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4dxvl\" (UniqueName: \"kubernetes.io/projected/56b3816d-3935-4bfe-b607-e034dda951b5-kube-api-access-4dxvl\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-chrgn\" (UID: \"56b3816d-3935-4bfe-b607-e034dda951b5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-chrgn"
Jul 20 19:09:57.749734 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:57.749638    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/56b3816d-3935-4bfe-b607-e034dda951b5-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-chrgn\" (UID: \"56b3816d-3935-4bfe-b607-e034dda951b5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-chrgn"
Jul 20 19:09:57.850698 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:57.850617    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/56b3816d-3935-4bfe-b607-e034dda951b5-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-chrgn\" (UID: \"56b3816d-3935-4bfe-b607-e034dda951b5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-chrgn"
Jul 20 19:09:57.850698 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:57.850659    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/56b3816d-3935-4bfe-b607-e034dda951b5-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-chrgn\" (UID: \"56b3816d-3935-4bfe-b607-e034dda951b5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-chrgn"
Jul 20 19:09:57.850914 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:57.850702    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/56b3816d-3935-4bfe-b607-e034dda951b5-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-chrgn\" (UID: \"56b3816d-3935-4bfe-b607-e034dda951b5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-chrgn"
Jul 20 19:09:57.850914 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:57.850749    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4dxvl\" (UniqueName: \"kubernetes.io/projected/56b3816d-3935-4bfe-b607-e034dda951b5-kube-api-access-4dxvl\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-chrgn\" (UID: \"56b3816d-3935-4bfe-b607-e034dda951b5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-chrgn"
Jul 20 19:09:57.850914 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:57.850780    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/56b3816d-3935-4bfe-b607-e034dda951b5-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-chrgn\" (UID: \"56b3816d-3935-4bfe-b607-e034dda951b5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-chrgn"
Jul 20 19:09:57.850914 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:57.850820    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/56b3816d-3935-4bfe-b607-e034dda951b5-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-chrgn\" (UID: \"56b3816d-3935-4bfe-b607-e034dda951b5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-chrgn"
Jul 20 19:09:57.851110 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:57.851052    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/56b3816d-3935-4bfe-b607-e034dda951b5-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-chrgn\" (UID: \"56b3816d-3935-4bfe-b607-e034dda951b5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-chrgn"
Jul 20 19:09:57.851159 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:57.851126    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/56b3816d-3935-4bfe-b607-e034dda951b5-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-chrgn\" (UID: \"56b3816d-3935-4bfe-b607-e034dda951b5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-chrgn"
Jul 20 19:09:57.851159 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:57.851145    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/56b3816d-3935-4bfe-b607-e034dda951b5-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-chrgn\" (UID: \"56b3816d-3935-4bfe-b607-e034dda951b5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-chrgn"
Jul 20 19:09:57.853181 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:57.853152    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/56b3816d-3935-4bfe-b607-e034dda951b5-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-chrgn\" (UID: \"56b3816d-3935-4bfe-b607-e034dda951b5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-chrgn"
Jul 20 19:09:57.853438 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:57.853421    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/56b3816d-3935-4bfe-b607-e034dda951b5-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-chrgn\" (UID: \"56b3816d-3935-4bfe-b607-e034dda951b5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-chrgn"
Jul 20 19:09:57.861191 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:57.861166    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4dxvl\" (UniqueName: \"kubernetes.io/projected/56b3816d-3935-4bfe-b607-e034dda951b5-kube-api-access-4dxvl\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-chrgn\" (UID: \"56b3816d-3935-4bfe-b607-e034dda951b5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-chrgn"
Jul 20 19:09:57.912042 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:57.912016    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-chrgn"
Jul 20 19:09:58.039377 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:58.039332    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-chrgn"]
Jul 20 19:09:58.041856 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:09:58.041834    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56b3816d_3935_4bfe_b607_e034dda951b5.slice/crio-41d0fe6144c1b20072a433af7f200b80372d25bfd7f98d9311fe4a8f6f49490b WatchSource:0}: Error finding container 41d0fe6144c1b20072a433af7f200b80372d25bfd7f98d9311fe4a8f6f49490b: Status 404 returned error can't find the container with id 41d0fe6144c1b20072a433af7f200b80372d25bfd7f98d9311fe4a8f6f49490b
Jul 20 19:09:58.150650 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:58.150574    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-chrgn" event={"ID":"56b3816d-3935-4bfe-b607-e034dda951b5","Type":"ContainerStarted","Data":"41d0fe6144c1b20072a433af7f200b80372d25bfd7f98d9311fe4a8f6f49490b"}
Jul 20 19:09:59.157334 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:59.157307    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-chrgn" event={"ID":"56b3816d-3935-4bfe-b607-e034dda951b5","Type":"ContainerStarted","Data":"7433dcb7242b4b5d4b925612aa5bc816fd5b06e8635b2e8489e33ade19fe528e"}
Jul 20 19:09:59.174489 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:09:59.174438    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-chrgn" podStartSLOduration=1.125345051 podStartE2EDuration="2.174418611s" totalImagesPullingTime="1.04907356s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:09:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:09:59.172960535 +0000 UTC m=+558.856488560" watchObservedRunningTime="2026-07-20 19:09:59.174418611 +0000 UTC m=+558.857946632"
Jul 20 19:10:07.912551 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:10:07.912518    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-chrgn"
Jul 20 19:10:07.912969 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:10:07.912572    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-chrgn"
Jul 20 19:10:07.925084 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:10:07.925060    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-chrgn"
Jul 20 19:10:08.207206 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:10:08.207180    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-chrgn"
Jul 20 19:10:14.427523 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:10:14.427494    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:10:36.854171 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:10:36.854133    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:10:42.962826 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:10:42.962794    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:10:47.911851 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:10:47.911815    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7wg25"]
Jul 20 19:10:47.913977 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:10:47.913959    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7wg25"
Jul 20 19:10:47.916939 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:10:47.916921    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 20 19:10:47.927549 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:10:47.927529    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7wg25"]
Jul 20 19:10:47.940218 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:10:47.940196    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d191c70b-84da-4d1d-a503-dd0ad89e614a-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7wg25\" (UID: \"d191c70b-84da-4d1d-a503-dd0ad89e614a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7wg25"
Jul 20 19:10:47.940344 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:10:47.940262    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6cnkj\" (UniqueName: \"kubernetes.io/projected/d191c70b-84da-4d1d-a503-dd0ad89e614a-kube-api-access-6cnkj\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7wg25\" (UID: \"d191c70b-84da-4d1d-a503-dd0ad89e614a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7wg25"
Jul 20 19:10:47.940344 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:10:47.940334    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d191c70b-84da-4d1d-a503-dd0ad89e614a-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7wg25\" (UID: \"d191c70b-84da-4d1d-a503-dd0ad89e614a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7wg25"
Jul 20 19:10:47.940491 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:10:47.940379    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d191c70b-84da-4d1d-a503-dd0ad89e614a-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7wg25\" (UID: \"d191c70b-84da-4d1d-a503-dd0ad89e614a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7wg25"
Jul 20 19:10:47.940491 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:10:47.940398    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d191c70b-84da-4d1d-a503-dd0ad89e614a-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7wg25\" (UID: \"d191c70b-84da-4d1d-a503-dd0ad89e614a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7wg25"
Jul 20 19:10:47.940491 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:10:47.940463    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d191c70b-84da-4d1d-a503-dd0ad89e614a-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7wg25\" (UID: \"d191c70b-84da-4d1d-a503-dd0ad89e614a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7wg25"
Jul 20 19:10:48.013161 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:10:48.013130    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:10:48.041214 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:10:48.041178    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d191c70b-84da-4d1d-a503-dd0ad89e614a-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7wg25\" (UID: \"d191c70b-84da-4d1d-a503-dd0ad89e614a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7wg25"
Jul 20 19:10:48.041214 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:10:48.041208    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d191c70b-84da-4d1d-a503-dd0ad89e614a-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7wg25\" (UID: \"d191c70b-84da-4d1d-a503-dd0ad89e614a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7wg25"
Jul 20 19:10:48.041422 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:10:48.041237    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d191c70b-84da-4d1d-a503-dd0ad89e614a-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7wg25\" (UID: \"d191c70b-84da-4d1d-a503-dd0ad89e614a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7wg25"
Jul 20 19:10:48.041422 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:10:48.041328    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d191c70b-84da-4d1d-a503-dd0ad89e614a-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7wg25\" (UID: \"d191c70b-84da-4d1d-a503-dd0ad89e614a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7wg25"
Jul 20 19:10:48.041500 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:10:48.041444    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6cnkj\" (UniqueName: \"kubernetes.io/projected/d191c70b-84da-4d1d-a503-dd0ad89e614a-kube-api-access-6cnkj\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7wg25\" (UID: \"d191c70b-84da-4d1d-a503-dd0ad89e614a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7wg25"
Jul 20 19:10:48.041500 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:10:48.041476    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d191c70b-84da-4d1d-a503-dd0ad89e614a-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7wg25\" (UID: \"d191c70b-84da-4d1d-a503-dd0ad89e614a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7wg25"
Jul 20 19:10:48.041602 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:10:48.041581    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d191c70b-84da-4d1d-a503-dd0ad89e614a-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7wg25\" (UID: \"d191c70b-84da-4d1d-a503-dd0ad89e614a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7wg25"
Jul 20 19:10:48.041675 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:10:48.041655    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d191c70b-84da-4d1d-a503-dd0ad89e614a-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7wg25\" (UID: \"d191c70b-84da-4d1d-a503-dd0ad89e614a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7wg25"
Jul 20 19:10:48.041740 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:10:48.041723    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d191c70b-84da-4d1d-a503-dd0ad89e614a-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7wg25\" (UID: \"d191c70b-84da-4d1d-a503-dd0ad89e614a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7wg25"
Jul 20 19:10:48.043569 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:10:48.043548    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d191c70b-84da-4d1d-a503-dd0ad89e614a-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7wg25\" (UID: \"d191c70b-84da-4d1d-a503-dd0ad89e614a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7wg25"
Jul 20 19:10:48.043907 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:10:48.043891    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d191c70b-84da-4d1d-a503-dd0ad89e614a-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7wg25\" (UID: \"d191c70b-84da-4d1d-a503-dd0ad89e614a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7wg25"
Jul 20 19:10:48.049649 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:10:48.049631    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6cnkj\" (UniqueName: \"kubernetes.io/projected/d191c70b-84da-4d1d-a503-dd0ad89e614a-kube-api-access-6cnkj\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7wg25\" (UID: \"d191c70b-84da-4d1d-a503-dd0ad89e614a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7wg25"
Jul 20 19:10:48.224461 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:10:48.224421    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7wg25"
Jul 20 19:10:48.351961 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:10:48.351938    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7wg25"]
Jul 20 19:10:48.353771 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:10:48.353741    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd191c70b_84da_4d1d_a503_dd0ad89e614a.slice/crio-fffc743e2a379a1927f6947f1f9c6660a459201e08235d98de75c26ec3f2a030 WatchSource:0}: Error finding container fffc743e2a379a1927f6947f1f9c6660a459201e08235d98de75c26ec3f2a030: Status 404 returned error can't find the container with id fffc743e2a379a1927f6947f1f9c6660a459201e08235d98de75c26ec3f2a030
Jul 20 19:10:48.355037 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:10:48.355018    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 19:10:48.369607 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:10:48.369583    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7wg25" event={"ID":"d191c70b-84da-4d1d-a503-dd0ad89e614a","Type":"ContainerStarted","Data":"fffc743e2a379a1927f6947f1f9c6660a459201e08235d98de75c26ec3f2a030"}
Jul 20 19:10:49.374542 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:10:49.374501    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7wg25" event={"ID":"d191c70b-84da-4d1d-a503-dd0ad89e614a","Type":"ContainerStarted","Data":"5b763ba79a417690d8b435718b818b8c97497187e53c346bc44e91c8a63c6cb0"}
Jul 20 19:10:49.397500 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:10:49.397451    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7wg25" podStartSLOduration=2.184793862 podStartE2EDuration="2.397434962s" totalImagesPullingTime="212.6411ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:10:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:10:49.395332044 +0000 UTC m=+609.078860069" watchObservedRunningTime="2026-07-20 19:10:49.397434962 +0000 UTC m=+609.080962984"
Jul 20 19:10:51.405370 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:10:51.405315    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:10:58.225184 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:10:58.225147    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7wg25"
Jul 20 19:10:58.225613 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:10:58.225230    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7wg25"
Jul 20 19:10:58.237510 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:10:58.237487    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7wg25"
Jul 20 19:10:58.420976 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:10:58.420942    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7wg25"
Jul 20 19:10:59.725631 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:10:59.725601    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-fxj2d"]
Jul 20 19:10:59.728037 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:10:59.728021    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fxj2d"
Jul 20 19:10:59.732876 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:10:59.732859    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 20 19:10:59.753399 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:10:59.753373    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-fxj2d"]
Jul 20 19:10:59.791987 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:10:59.791957    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:10:59.848328 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:10:59.848301    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pxm8g\" (UniqueName: \"kubernetes.io/projected/80f881a6-ddd9-4e36-9427-3a3d21fce54c-kube-api-access-pxm8g\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-fxj2d\" (UID: \"80f881a6-ddd9-4e36-9427-3a3d21fce54c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fxj2d"
Jul 20 19:10:59.848493 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:10:59.848336    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/80f881a6-ddd9-4e36-9427-3a3d21fce54c-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-fxj2d\" (UID: \"80f881a6-ddd9-4e36-9427-3a3d21fce54c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fxj2d"
Jul 20 19:10:59.848493 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:10:59.848457    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/80f881a6-ddd9-4e36-9427-3a3d21fce54c-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-fxj2d\" (UID: \"80f881a6-ddd9-4e36-9427-3a3d21fce54c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fxj2d"
Jul 20 19:10:59.848493 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:10:59.848488    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/80f881a6-ddd9-4e36-9427-3a3d21fce54c-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-fxj2d\" (UID: \"80f881a6-ddd9-4e36-9427-3a3d21fce54c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fxj2d"
Jul 20 19:10:59.848652 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:10:59.848593    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/80f881a6-ddd9-4e36-9427-3a3d21fce54c-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-fxj2d\" (UID: \"80f881a6-ddd9-4e36-9427-3a3d21fce54c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fxj2d"
Jul 20 19:10:59.848652 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:10:59.848630    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/80f881a6-ddd9-4e36-9427-3a3d21fce54c-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-fxj2d\" (UID: \"80f881a6-ddd9-4e36-9427-3a3d21fce54c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fxj2d"
Jul 20 19:10:59.949309 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:10:59.949277    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/80f881a6-ddd9-4e36-9427-3a3d21fce54c-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-fxj2d\" (UID: \"80f881a6-ddd9-4e36-9427-3a3d21fce54c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fxj2d"
Jul 20 19:10:59.949506 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:10:59.949394    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/80f881a6-ddd9-4e36-9427-3a3d21fce54c-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-fxj2d\" (UID: \"80f881a6-ddd9-4e36-9427-3a3d21fce54c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fxj2d"
Jul 20 19:10:59.949506 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:10:59.949420    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/80f881a6-ddd9-4e36-9427-3a3d21fce54c-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-fxj2d\" (UID: \"80f881a6-ddd9-4e36-9427-3a3d21fce54c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fxj2d"
Jul 20 19:10:59.949637 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:10:59.949524    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/80f881a6-ddd9-4e36-9427-3a3d21fce54c-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-fxj2d\" (UID: \"80f881a6-ddd9-4e36-9427-3a3d21fce54c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fxj2d"
Jul 20 19:10:59.949637 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:10:59.949577    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/80f881a6-ddd9-4e36-9427-3a3d21fce54c-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-fxj2d\" (UID: \"80f881a6-ddd9-4e36-9427-3a3d21fce54c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fxj2d"
Jul 20 19:10:59.949637 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:10:59.949610    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pxm8g\" (UniqueName: \"kubernetes.io/projected/80f881a6-ddd9-4e36-9427-3a3d21fce54c-kube-api-access-pxm8g\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-fxj2d\" (UID: \"80f881a6-ddd9-4e36-9427-3a3d21fce54c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fxj2d"
Jul 20 19:10:59.949782 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:10:59.949704    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/80f881a6-ddd9-4e36-9427-3a3d21fce54c-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-fxj2d\" (UID: \"80f881a6-ddd9-4e36-9427-3a3d21fce54c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fxj2d"
Jul 20 19:10:59.949782 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:10:59.949729    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/80f881a6-ddd9-4e36-9427-3a3d21fce54c-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-fxj2d\" (UID: \"80f881a6-ddd9-4e36-9427-3a3d21fce54c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fxj2d"
Jul 20 19:10:59.949782 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:10:59.949774    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/80f881a6-ddd9-4e36-9427-3a3d21fce54c-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-fxj2d\" (UID: \"80f881a6-ddd9-4e36-9427-3a3d21fce54c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fxj2d"
Jul 20 19:10:59.951992 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:10:59.951966    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/80f881a6-ddd9-4e36-9427-3a3d21fce54c-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-fxj2d\" (UID: \"80f881a6-ddd9-4e36-9427-3a3d21fce54c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fxj2d"
Jul 20 19:10:59.952149 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:10:59.952132    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/80f881a6-ddd9-4e36-9427-3a3d21fce54c-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-fxj2d\" (UID: \"80f881a6-ddd9-4e36-9427-3a3d21fce54c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fxj2d"
Jul 20 19:10:59.960959 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:10:59.960938    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pxm8g\" (UniqueName: \"kubernetes.io/projected/80f881a6-ddd9-4e36-9427-3a3d21fce54c-kube-api-access-pxm8g\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-fxj2d\" (UID: \"80f881a6-ddd9-4e36-9427-3a3d21fce54c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fxj2d"
Jul 20 19:11:00.038902 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:11:00.038838    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fxj2d"
Jul 20 19:11:00.166178 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:11:00.165967    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-fxj2d"]
Jul 20 19:11:00.168435 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:11:00.168408    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80f881a6_ddd9_4e36_9427_3a3d21fce54c.slice/crio-4449ac4000cd16ba1e7147af5a6ffd9293a2aec1fb8b431b9bdcd1167926591f WatchSource:0}: Error finding container 4449ac4000cd16ba1e7147af5a6ffd9293a2aec1fb8b431b9bdcd1167926591f: Status 404 returned error can't find the container with id 4449ac4000cd16ba1e7147af5a6ffd9293a2aec1fb8b431b9bdcd1167926591f
Jul 20 19:11:00.418955 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:11:00.418928    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fxj2d" event={"ID":"80f881a6-ddd9-4e36-9427-3a3d21fce54c","Type":"ContainerStarted","Data":"4449ac4000cd16ba1e7147af5a6ffd9293a2aec1fb8b431b9bdcd1167926591f"}
Jul 20 19:11:01.424301 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:11:01.424231    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fxj2d" event={"ID":"80f881a6-ddd9-4e36-9427-3a3d21fce54c","Type":"ContainerStarted","Data":"853c8d30e3c2b0c477a3abd25b194fcf2d3b0f981df5b5ffbedb984ad804d02e"}
Jul 20 19:11:01.442271 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:11:01.442226    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fxj2d" podStartSLOduration=2.216461704 podStartE2EDuration="2.442211763s" totalImagesPullingTime="225.750059ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:10:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:11:01.441490605 +0000 UTC m=+621.125018627" watchObservedRunningTime="2026-07-20 19:11:01.442211763 +0000 UTC m=+621.125739784"
Jul 20 19:11:10.039588 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:11:10.039551    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fxj2d"
Jul 20 19:11:10.040066 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:11:10.039625    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fxj2d"
Jul 20 19:11:10.052121 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:11:10.052084    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fxj2d"
Jul 20 19:11:10.474626 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:11:10.474596    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fxj2d"
Jul 20 19:11:10.818844 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:11:10.818764    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-h7p5h"]
Jul 20 19:11:10.821084 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:11:10.821064    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-h7p5h"
Jul 20 19:11:10.823478 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:11:10.823457    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 20 19:11:10.831933 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:11:10.831910    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-h7p5h"]
Jul 20 19:11:10.901591 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:11:10.901566    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:11:10.945393 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:11:10.945338    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e3210275-7413-40ab-8642-b34520406eb9-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-h7p5h\" (UID: \"e3210275-7413-40ab-8642-b34520406eb9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-h7p5h"
Jul 20 19:11:10.945531 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:11:10.945399    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e3210275-7413-40ab-8642-b34520406eb9-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-h7p5h\" (UID: \"e3210275-7413-40ab-8642-b34520406eb9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-h7p5h"
Jul 20 19:11:10.945531 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:11:10.945494    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9gwlx\" (UniqueName: \"kubernetes.io/projected/e3210275-7413-40ab-8642-b34520406eb9-kube-api-access-9gwlx\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-h7p5h\" (UID: \"e3210275-7413-40ab-8642-b34520406eb9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-h7p5h"
Jul 20 19:11:10.945611 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:11:10.945567    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e3210275-7413-40ab-8642-b34520406eb9-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-h7p5h\" (UID: \"e3210275-7413-40ab-8642-b34520406eb9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-h7p5h"
Jul 20 19:11:10.945653 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:11:10.945617    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e3210275-7413-40ab-8642-b34520406eb9-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-h7p5h\" (UID: \"e3210275-7413-40ab-8642-b34520406eb9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-h7p5h"
Jul 20 19:11:10.945653 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:11:10.945643    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e3210275-7413-40ab-8642-b34520406eb9-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-h7p5h\" (UID: \"e3210275-7413-40ab-8642-b34520406eb9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-h7p5h"
Jul 20 19:11:11.046393 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:11:11.046341    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e3210275-7413-40ab-8642-b34520406eb9-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-h7p5h\" (UID: \"e3210275-7413-40ab-8642-b34520406eb9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-h7p5h"
Jul 20 19:11:11.046806 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:11:11.046427    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9gwlx\" (UniqueName: \"kubernetes.io/projected/e3210275-7413-40ab-8642-b34520406eb9-kube-api-access-9gwlx\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-h7p5h\" (UID: \"e3210275-7413-40ab-8642-b34520406eb9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-h7p5h"
Jul 20 19:11:11.046806 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:11:11.046482    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e3210275-7413-40ab-8642-b34520406eb9-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-h7p5h\" (UID: \"e3210275-7413-40ab-8642-b34520406eb9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-h7p5h"
Jul 20 19:11:11.046806 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:11:11.046680    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e3210275-7413-40ab-8642-b34520406eb9-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-h7p5h\" (UID: \"e3210275-7413-40ab-8642-b34520406eb9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-h7p5h"
Jul 20 19:11:11.046806 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:11:11.046720    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e3210275-7413-40ab-8642-b34520406eb9-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-h7p5h\" (UID: \"e3210275-7413-40ab-8642-b34520406eb9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-h7p5h"
Jul 20 19:11:11.046806 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:11:11.046728    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e3210275-7413-40ab-8642-b34520406eb9-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-h7p5h\" (UID: \"e3210275-7413-40ab-8642-b34520406eb9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-h7p5h"
Jul 20 19:11:11.047136 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:11:11.046844    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e3210275-7413-40ab-8642-b34520406eb9-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-h7p5h\" (UID: \"e3210275-7413-40ab-8642-b34520406eb9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-h7p5h"
Jul 20 19:11:11.047136 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:11:11.046965    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e3210275-7413-40ab-8642-b34520406eb9-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-h7p5h\" (UID: \"e3210275-7413-40ab-8642-b34520406eb9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-h7p5h"
Jul 20 19:11:11.047136 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:11:11.046986    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e3210275-7413-40ab-8642-b34520406eb9-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-h7p5h\" (UID: \"e3210275-7413-40ab-8642-b34520406eb9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-h7p5h"
Jul 20 19:11:11.048790 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:11:11.048765    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e3210275-7413-40ab-8642-b34520406eb9-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-h7p5h\" (UID: \"e3210275-7413-40ab-8642-b34520406eb9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-h7p5h"
Jul 20 19:11:11.049209 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:11:11.049192    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e3210275-7413-40ab-8642-b34520406eb9-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-h7p5h\" (UID: \"e3210275-7413-40ab-8642-b34520406eb9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-h7p5h"
Jul 20 19:11:11.055460 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:11:11.055432    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9gwlx\" (UniqueName: \"kubernetes.io/projected/e3210275-7413-40ab-8642-b34520406eb9-kube-api-access-9gwlx\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-h7p5h\" (UID: \"e3210275-7413-40ab-8642-b34520406eb9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-h7p5h"
Jul 20 19:11:11.130489 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:11:11.130422    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-h7p5h"
Jul 20 19:11:11.259732 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:11:11.259711    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-h7p5h"]
Jul 20 19:11:11.261874 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:11:11.261848    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode3210275_7413_40ab_8642_b34520406eb9.slice/crio-0fe1e14151dda62ba4cd966d1b69b43d92ddf6d803f1073a418cb5c1a0d8d9a8 WatchSource:0}: Error finding container 0fe1e14151dda62ba4cd966d1b69b43d92ddf6d803f1073a418cb5c1a0d8d9a8: Status 404 returned error can't find the container with id 0fe1e14151dda62ba4cd966d1b69b43d92ddf6d803f1073a418cb5c1a0d8d9a8
Jul 20 19:11:11.467857 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:11:11.467827    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-h7p5h" event={"ID":"e3210275-7413-40ab-8642-b34520406eb9","Type":"ContainerStarted","Data":"0fe1e14151dda62ba4cd966d1b69b43d92ddf6d803f1073a418cb5c1a0d8d9a8"}
Jul 20 19:11:12.473214 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:11:12.473171    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-h7p5h" event={"ID":"e3210275-7413-40ab-8642-b34520406eb9","Type":"ContainerStarted","Data":"f72626ef18656fcec73560b7427c03151054be6e096d73565f3d9b6b2888127c"}
Jul 20 19:11:12.497433 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:11:12.497382    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-h7p5h" podStartSLOduration=2.324641576 podStartE2EDuration="2.497342458s" totalImagesPullingTime="172.700882ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:11:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:11:12.495953685 +0000 UTC m=+632.179481707" watchObservedRunningTime="2026-07-20 19:11:12.497342458 +0000 UTC m=+632.180870480"
Jul 20 19:11:21.131313 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:11:21.131275    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-h7p5h"
Jul 20 19:11:21.131785 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:11:21.131327    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-h7p5h"
Jul 20 19:11:21.144006 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:11:21.143985    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-h7p5h"
Jul 20 19:11:21.523363 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:11:21.523330    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-h7p5h"
Jul 20 19:11:50.947683 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:11:50.947650    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:11:51.187917 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:11:51.187876    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:11:58.464496 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:11:58.464464    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:11:58.557835 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:11:58.557806    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:11:59.760335 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:11:59.760306    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:11:59.873949 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:11:59.873921    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:12:48.751782 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:12:48.751688    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-55476c59db-dpdnc"]
Jul 20 19:12:48.752719 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:12:48.752658    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-55476c59db-dpdnc" podUID="fc6faac9-8b0b-4a80-a20b-b7161e23e0e1" containerName="manager" containerID="cri-o://e17f98a100a70332125329d0f719e0b271ed31434ab2610b5a8f0d1d714383c4" gracePeriod=30
Jul 20 19:12:48.881423 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:12:48.881392    2563 generic.go:356] "Generic (PLEG): container finished" podID="fc6faac9-8b0b-4a80-a20b-b7161e23e0e1" containerID="e17f98a100a70332125329d0f719e0b271ed31434ab2610b5a8f0d1d714383c4" exitCode=0
Jul 20 19:12:48.881524 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:12:48.881479    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55476c59db-dpdnc" event={"ID":"fc6faac9-8b0b-4a80-a20b-b7161e23e0e1","Type":"ContainerDied","Data":"e17f98a100a70332125329d0f719e0b271ed31434ab2610b5a8f0d1d714383c4"}
Jul 20 19:12:49.007886 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:12:49.007826    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55476c59db-dpdnc"
Jul 20 19:12:49.084252 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:12:49.084224    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jvnnj\" (UniqueName: \"kubernetes.io/projected/fc6faac9-8b0b-4a80-a20b-b7161e23e0e1-kube-api-access-jvnnj\") pod \"fc6faac9-8b0b-4a80-a20b-b7161e23e0e1\" (UID: \"fc6faac9-8b0b-4a80-a20b-b7161e23e0e1\") "
Jul 20 19:12:49.084415 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:12:49.084286    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fc6faac9-8b0b-4a80-a20b-b7161e23e0e1-webhook-cert\") pod \"fc6faac9-8b0b-4a80-a20b-b7161e23e0e1\" (UID: \"fc6faac9-8b0b-4a80-a20b-b7161e23e0e1\") "
Jul 20 19:12:49.086235 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:12:49.086207    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc6faac9-8b0b-4a80-a20b-b7161e23e0e1-kube-api-access-jvnnj" (OuterVolumeSpecName: "kube-api-access-jvnnj") pod "fc6faac9-8b0b-4a80-a20b-b7161e23e0e1" (UID: "fc6faac9-8b0b-4a80-a20b-b7161e23e0e1"). InnerVolumeSpecName "kube-api-access-jvnnj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:12:49.086235 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:12:49.086222    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fc6faac9-8b0b-4a80-a20b-b7161e23e0e1-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "fc6faac9-8b0b-4a80-a20b-b7161e23e0e1" (UID: "fc6faac9-8b0b-4a80-a20b-b7161e23e0e1"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 19:12:49.184983 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:12:49.184958    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jvnnj\" (UniqueName: \"kubernetes.io/projected/fc6faac9-8b0b-4a80-a20b-b7161e23e0e1-kube-api-access-jvnnj\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\""
Jul 20 19:12:49.184983 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:12:49.184982    2563 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fc6faac9-8b0b-4a80-a20b-b7161e23e0e1-webhook-cert\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\""
Jul 20 19:12:49.887246 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:12:49.887218    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55476c59db-dpdnc"
Jul 20 19:12:49.887708 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:12:49.887216    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55476c59db-dpdnc" event={"ID":"fc6faac9-8b0b-4a80-a20b-b7161e23e0e1","Type":"ContainerDied","Data":"fab2e03f2143fdaeef7281334dfa3019643cd6f7ee72528b3a37eb63db8ac45c"}
Jul 20 19:12:49.887708 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:12:49.887404    2563 scope.go:117] "RemoveContainer" containerID="e17f98a100a70332125329d0f719e0b271ed31434ab2610b5a8f0d1d714383c4"
Jul 20 19:12:49.908662 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:12:49.908639    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-55476c59db-dpdnc"]
Jul 20 19:12:49.912102 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:12:49.912081    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-55476c59db-dpdnc"]
Jul 20 19:12:50.892655 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:12:50.892627    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fc6faac9-8b0b-4a80-a20b-b7161e23e0e1" path="/var/lib/kubelet/pods/fc6faac9-8b0b-4a80-a20b-b7161e23e0e1/volumes"
Jul 20 19:13:41.109856 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:13:41.109773    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:13:41.198260 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:13:41.198232    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:13:50.773242 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:13:50.773207    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-55476c59db-msp52"]
Jul 20 19:13:50.773661 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:13:50.773557    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc6faac9-8b0b-4a80-a20b-b7161e23e0e1" containerName="manager"
Jul 20 19:13:50.773661 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:13:50.773568    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc6faac9-8b0b-4a80-a20b-b7161e23e0e1" containerName="manager"
Jul 20 19:13:50.773661 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:13:50.773631    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc6faac9-8b0b-4a80-a20b-b7161e23e0e1" containerName="manager"
Jul 20 19:13:50.775521 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:13:50.775506    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55476c59db-msp52"
Jul 20 19:13:50.778508 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:13:50.778484    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 20 19:13:50.779288 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:13:50.779270    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 20 19:13:50.779408 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:13:50.779329    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-f4nrb\""
Jul 20 19:13:50.790388 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:13:50.790344    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-55476c59db-msp52"]
Jul 20 19:13:50.895257 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:13:50.895232    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxwgp\" (UniqueName: \"kubernetes.io/projected/273fc7b9-4d9f-446e-914d-da174703936a-kube-api-access-gxwgp\") pod \"maas-controller-55476c59db-msp52\" (UID: \"273fc7b9-4d9f-446e-914d-da174703936a\") " pod="opendatahub/maas-controller-55476c59db-msp52"
Jul 20 19:13:50.895411 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:13:50.895380    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/273fc7b9-4d9f-446e-914d-da174703936a-webhook-cert\") pod \"maas-controller-55476c59db-msp52\" (UID: \"273fc7b9-4d9f-446e-914d-da174703936a\") " pod="opendatahub/maas-controller-55476c59db-msp52"
Jul 20 19:13:50.996141 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:13:50.996115    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/273fc7b9-4d9f-446e-914d-da174703936a-webhook-cert\") pod \"maas-controller-55476c59db-msp52\" (UID: \"273fc7b9-4d9f-446e-914d-da174703936a\") " pod="opendatahub/maas-controller-55476c59db-msp52"
Jul 20 19:13:50.996317 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:13:50.996151    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxwgp\" (UniqueName: \"kubernetes.io/projected/273fc7b9-4d9f-446e-914d-da174703936a-kube-api-access-gxwgp\") pod \"maas-controller-55476c59db-msp52\" (UID: \"273fc7b9-4d9f-446e-914d-da174703936a\") " pod="opendatahub/maas-controller-55476c59db-msp52"
Jul 20 19:13:50.998740 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:13:50.998706    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/273fc7b9-4d9f-446e-914d-da174703936a-webhook-cert\") pod \"maas-controller-55476c59db-msp52\" (UID: \"273fc7b9-4d9f-446e-914d-da174703936a\") " pod="opendatahub/maas-controller-55476c59db-msp52"
Jul 20 19:13:51.005449 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:13:51.005417    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxwgp\" (UniqueName: \"kubernetes.io/projected/273fc7b9-4d9f-446e-914d-da174703936a-kube-api-access-gxwgp\") pod \"maas-controller-55476c59db-msp52\" (UID: \"273fc7b9-4d9f-446e-914d-da174703936a\") " pod="opendatahub/maas-controller-55476c59db-msp52"
Jul 20 19:13:51.085473 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:13:51.085414    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55476c59db-msp52"
Jul 20 19:13:51.214447 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:13:51.214416    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-55476c59db-msp52"]
Jul 20 19:13:51.216875 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:13:51.216847    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod273fc7b9_4d9f_446e_914d_da174703936a.slice/crio-3a4f22a04a0ef4f563a5a3abfc354a19f026d472ae5c4d9906dd277723a5f06f WatchSource:0}: Error finding container 3a4f22a04a0ef4f563a5a3abfc354a19f026d472ae5c4d9906dd277723a5f06f: Status 404 returned error can't find the container with id 3a4f22a04a0ef4f563a5a3abfc354a19f026d472ae5c4d9906dd277723a5f06f
Jul 20 19:13:52.165885 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:13:52.165845    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55476c59db-msp52" event={"ID":"273fc7b9-4d9f-446e-914d-da174703936a","Type":"ContainerStarted","Data":"b7c29e37be676fa2214c3b089539167ca4ad262d1c418c16012425777163bc34"}
Jul 20 19:13:52.166293 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:13:52.165937    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55476c59db-msp52" event={"ID":"273fc7b9-4d9f-446e-914d-da174703936a","Type":"ContainerStarted","Data":"3a4f22a04a0ef4f563a5a3abfc354a19f026d472ae5c4d9906dd277723a5f06f"}
Jul 20 19:13:52.166293 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:13:52.165980    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-55476c59db-msp52"
Jul 20 19:13:52.195810 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:13:52.195764    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-55476c59db-msp52" podStartSLOduration=1.7165365430000001 podStartE2EDuration="2.195750723s" totalImagesPullingTime="479.21418ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:13:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:13:52.193479468 +0000 UTC m=+791.877007501" watchObservedRunningTime="2026-07-20 19:13:52.195750723 +0000 UTC m=+791.879278741"
Jul 20 19:14:03.171426 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:14:03.171330    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-55476c59db-msp52"
Jul 20 19:14:07.720992 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:14:07.720951    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:14:07.845378 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:14:07.845315    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-55476c59db-msp52"]
Jul 20 19:14:07.845662 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:14:07.845635    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-55476c59db-msp52" podUID="273fc7b9-4d9f-446e-914d-da174703936a" containerName="manager" containerID="cri-o://b7c29e37be676fa2214c3b089539167ca4ad262d1c418c16012425777163bc34" gracePeriod=30
Jul 20 19:14:08.083716 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:14:08.083691    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55476c59db-msp52"
Jul 20 19:14:08.146204 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:14:08.146167    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/273fc7b9-4d9f-446e-914d-da174703936a-webhook-cert\") pod \"273fc7b9-4d9f-446e-914d-da174703936a\" (UID: \"273fc7b9-4d9f-446e-914d-da174703936a\") "
Jul 20 19:14:08.146408 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:14:08.146213    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gxwgp\" (UniqueName: \"kubernetes.io/projected/273fc7b9-4d9f-446e-914d-da174703936a-kube-api-access-gxwgp\") pod \"273fc7b9-4d9f-446e-914d-da174703936a\" (UID: \"273fc7b9-4d9f-446e-914d-da174703936a\") "
Jul 20 19:14:08.148275 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:14:08.148245    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/273fc7b9-4d9f-446e-914d-da174703936a-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "273fc7b9-4d9f-446e-914d-da174703936a" (UID: "273fc7b9-4d9f-446e-914d-da174703936a"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 19:14:08.148611 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:14:08.148587    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/273fc7b9-4d9f-446e-914d-da174703936a-kube-api-access-gxwgp" (OuterVolumeSpecName: "kube-api-access-gxwgp") pod "273fc7b9-4d9f-446e-914d-da174703936a" (UID: "273fc7b9-4d9f-446e-914d-da174703936a"). InnerVolumeSpecName "kube-api-access-gxwgp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:14:08.232543 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:14:08.232511    2563 generic.go:356] "Generic (PLEG): container finished" podID="273fc7b9-4d9f-446e-914d-da174703936a" containerID="b7c29e37be676fa2214c3b089539167ca4ad262d1c418c16012425777163bc34" exitCode=0
Jul 20 19:14:08.232750 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:14:08.232559    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55476c59db-msp52"
Jul 20 19:14:08.232750 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:14:08.232592    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55476c59db-msp52" event={"ID":"273fc7b9-4d9f-446e-914d-da174703936a","Type":"ContainerDied","Data":"b7c29e37be676fa2214c3b089539167ca4ad262d1c418c16012425777163bc34"}
Jul 20 19:14:08.232750 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:14:08.232646    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55476c59db-msp52" event={"ID":"273fc7b9-4d9f-446e-914d-da174703936a","Type":"ContainerDied","Data":"3a4f22a04a0ef4f563a5a3abfc354a19f026d472ae5c4d9906dd277723a5f06f"}
Jul 20 19:14:08.232750 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:14:08.232670    2563 scope.go:117] "RemoveContainer" containerID="b7c29e37be676fa2214c3b089539167ca4ad262d1c418c16012425777163bc34"
Jul 20 19:14:08.241681 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:14:08.241662    2563 scope.go:117] "RemoveContainer" containerID="b7c29e37be676fa2214c3b089539167ca4ad262d1c418c16012425777163bc34"
Jul 20 19:14:08.241943 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:14:08.241924    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b7c29e37be676fa2214c3b089539167ca4ad262d1c418c16012425777163bc34\": container with ID starting with b7c29e37be676fa2214c3b089539167ca4ad262d1c418c16012425777163bc34 not found: ID does not exist" containerID="b7c29e37be676fa2214c3b089539167ca4ad262d1c418c16012425777163bc34"
Jul 20 19:14:08.241995 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:14:08.241953    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7c29e37be676fa2214c3b089539167ca4ad262d1c418c16012425777163bc34"} err="failed to get container status \"b7c29e37be676fa2214c3b089539167ca4ad262d1c418c16012425777163bc34\": rpc error: code = NotFound desc = could not find container \"b7c29e37be676fa2214c3b089539167ca4ad262d1c418c16012425777163bc34\": container with ID starting with b7c29e37be676fa2214c3b089539167ca4ad262d1c418c16012425777163bc34 not found: ID does not exist"
Jul 20 19:14:08.247557 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:14:08.247539    2563 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/273fc7b9-4d9f-446e-914d-da174703936a-webhook-cert\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\""
Jul 20 19:14:08.247557 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:14:08.247558    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gxwgp\" (UniqueName: \"kubernetes.io/projected/273fc7b9-4d9f-446e-914d-da174703936a-kube-api-access-gxwgp\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\""
Jul 20 19:14:08.253312 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:14:08.253291    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-55476c59db-msp52"]
Jul 20 19:14:08.256914 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:14:08.256894    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-55476c59db-msp52"]
Jul 20 19:14:08.892062 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:14:08.892020    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="273fc7b9-4d9f-446e-914d-da174703936a" path="/var/lib/kubelet/pods/273fc7b9-4d9f-446e-914d-da174703936a/volumes"
Jul 20 19:14:08.955367 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:14:08.955319    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:14:45.272718 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:14:45.272665    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:14:45.420668 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:14:45.420641    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:14:45.535737 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:14:45.535655    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:14:51.467655 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:14:51.467615    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:14:51.586584 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:14:51.586534    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:14:51.669261 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:14:51.669222    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:14:51.798585 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:14:51.798498    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:14:57.854901 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:14:57.854849    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:14:57.955283 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:14:57.955251    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:15:28.324924 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:15:28.324888    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:17:27.849577 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:17:27.849542    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:19:26.709607 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:19:26.709575    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:19:26.781516 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:19:26.781490    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:22:33.888412 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:22:33.888381    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:22:53.724929 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:22:53.724888    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:23:24.263773 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:23:24.263736    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:23:24.915598 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:23:24.915568    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:24:12.573499 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:24:12.573457    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:26:23.276939 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:26:23.276909    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:26:23.375104 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:26:23.375073    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:26:32.418913 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:26:32.418877    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:26:36.084183 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:26:36.084152    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:26:47.898309 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:26:47.898275    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:26:56.182422 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:26:56.182386    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:27:01.897633 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:27:01.897590    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:27:04.960718 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:27:04.960682    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:27:05.108924 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:27:05.108890    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:27:05.503565 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:27:05.503527    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:27:11.547947 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:27:11.547908    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:27:11.667809 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:27:11.667780    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:27:11.818708 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:27:11.818625    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:27:12.146943 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:27:12.146860    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:27:12.450489 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:27:12.450457    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:27:14.275241 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:27:14.275202    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:27:14.373669 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:27:14.373642    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:27:14.386931 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:27:14.386891    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b1e95d9e-6fc9bd7c55-fvghc"]
Jul 20 19:27:14.387223 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:27:14.387211    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="273fc7b9-4d9f-446e-914d-da174703936a" containerName="manager"
Jul 20 19:27:14.387271 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:27:14.387224    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="273fc7b9-4d9f-446e-914d-da174703936a" containerName="manager"
Jul 20 19:27:14.387306 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:27:14.387288    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="273fc7b9-4d9f-446e-914d-da174703936a" containerName="manager"
Jul 20 19:27:14.390098 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:27:14.390083    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b1e95d9e-6fc9bd7c55-fvghc"
Jul 20 19:27:14.394909 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:27:14.394891    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-b1e95d9e-serving-cert\""
Jul 20 19:27:14.406597 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:27:14.406574    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b1e95d9e-6fc9bd7c55-fvghc"]
Jul 20 19:27:14.504527 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:27:14.504502    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b9f63050-0350-4902-b0bd-401a44cd00ff-openshift-service-ca\") pod \"maas-api-e2e-ait-b1e95d9e-6fc9bd7c55-fvghc\" (UID: \"b9f63050-0350-4902-b0bd-401a44cd00ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b1e95d9e-6fc9bd7c55-fvghc"
Jul 20 19:27:14.504646 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:27:14.504582    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b9f63050-0350-4902-b0bd-401a44cd00ff-maas-api-tls\") pod \"maas-api-e2e-ait-b1e95d9e-6fc9bd7c55-fvghc\" (UID: \"b9f63050-0350-4902-b0bd-401a44cd00ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b1e95d9e-6fc9bd7c55-fvghc"
Jul 20 19:27:14.504646 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:27:14.504613    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-565tk\" (UniqueName: \"kubernetes.io/projected/b9f63050-0350-4902-b0bd-401a44cd00ff-kube-api-access-565tk\") pod \"maas-api-e2e-ait-b1e95d9e-6fc9bd7c55-fvghc\" (UID: \"b9f63050-0350-4902-b0bd-401a44cd00ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b1e95d9e-6fc9bd7c55-fvghc"
Jul 20 19:27:14.524278 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:27:14.524250    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:27:14.605390 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:27:14.605321    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b9f63050-0350-4902-b0bd-401a44cd00ff-openshift-service-ca\") pod \"maas-api-e2e-ait-b1e95d9e-6fc9bd7c55-fvghc\" (UID: \"b9f63050-0350-4902-b0bd-401a44cd00ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b1e95d9e-6fc9bd7c55-fvghc"
Jul 20 19:27:14.605390 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:27:14.605383    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b9f63050-0350-4902-b0bd-401a44cd00ff-maas-api-tls\") pod \"maas-api-e2e-ait-b1e95d9e-6fc9bd7c55-fvghc\" (UID: \"b9f63050-0350-4902-b0bd-401a44cd00ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b1e95d9e-6fc9bd7c55-fvghc"
Jul 20 19:27:14.605516 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:27:14.605402    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-565tk\" (UniqueName: \"kubernetes.io/projected/b9f63050-0350-4902-b0bd-401a44cd00ff-kube-api-access-565tk\") pod \"maas-api-e2e-ait-b1e95d9e-6fc9bd7c55-fvghc\" (UID: \"b9f63050-0350-4902-b0bd-401a44cd00ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b1e95d9e-6fc9bd7c55-fvghc"
Jul 20 19:27:14.605905 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:27:14.605889    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b9f63050-0350-4902-b0bd-401a44cd00ff-openshift-service-ca\") pod \"maas-api-e2e-ait-b1e95d9e-6fc9bd7c55-fvghc\" (UID: \"b9f63050-0350-4902-b0bd-401a44cd00ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b1e95d9e-6fc9bd7c55-fvghc"
Jul 20 19:27:14.607914 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:27:14.607898    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b9f63050-0350-4902-b0bd-401a44cd00ff-maas-api-tls\") pod \"maas-api-e2e-ait-b1e95d9e-6fc9bd7c55-fvghc\" (UID: \"b9f63050-0350-4902-b0bd-401a44cd00ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b1e95d9e-6fc9bd7c55-fvghc"
Jul 20 19:27:14.620798 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:27:14.620771    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-565tk\" (UniqueName: \"kubernetes.io/projected/b9f63050-0350-4902-b0bd-401a44cd00ff-kube-api-access-565tk\") pod \"maas-api-e2e-ait-b1e95d9e-6fc9bd7c55-fvghc\" (UID: \"b9f63050-0350-4902-b0bd-401a44cd00ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b1e95d9e-6fc9bd7c55-fvghc"
Jul 20 19:27:14.654213 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:27:14.654185    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:27:14.699776 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:27:14.699753    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b1e95d9e-6fc9bd7c55-fvghc"
Jul 20 19:27:14.841777 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:27:14.841744    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b1e95d9e-6fc9bd7c55-fvghc"]
Jul 20 19:27:14.845958 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:27:14.845920    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9f63050_0350_4902_b0bd_401a44cd00ff.slice/crio-22aa0ceaecdc199b1c3796910dd183471be257441096ebb44000b1d7fe400a3f WatchSource:0}: Error finding container 22aa0ceaecdc199b1c3796910dd183471be257441096ebb44000b1d7fe400a3f: Status 404 returned error can't find the container with id 22aa0ceaecdc199b1c3796910dd183471be257441096ebb44000b1d7fe400a3f
Jul 20 19:27:14.847213 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:27:14.847191    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 19:27:15.057249 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:27:15.057216    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:27:15.168466 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:27:15.168436    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:27:15.568199 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:27:15.568165    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b1e95d9e-6fc9bd7c55-fvghc" event={"ID":"b9f63050-0350-4902-b0bd-401a44cd00ff","Type":"ContainerStarted","Data":"22aa0ceaecdc199b1c3796910dd183471be257441096ebb44000b1d7fe400a3f"}
Jul 20 19:27:16.573878 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:27:16.573843    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b1e95d9e-6fc9bd7c55-fvghc" event={"ID":"b9f63050-0350-4902-b0bd-401a44cd00ff","Type":"ContainerStarted","Data":"a71bb28ae21f6efa9d997d3f39b88e879504d572f690f72f26bbce730b4d3703"}
Jul 20 19:27:16.574243 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:27:16.573985    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b1e95d9e-6fc9bd7c55-fvghc"
Jul 20 19:27:16.596423 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:27:16.596375    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b1e95d9e-6fc9bd7c55-fvghc" podStartSLOduration=1.665469933 podStartE2EDuration="2.596343911s" totalImagesPullingTime="930.873978ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:27:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:27:16.59447795 +0000 UTC m=+1596.278005983" watchObservedRunningTime="2026-07-20 19:27:16.596343911 +0000 UTC m=+1596.279871970"
Jul 20 19:27:22.587486 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:27:22.587459    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b1e95d9e-6fc9bd7c55-fvghc"
Jul 20 19:27:50.402866 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:27:50.402834    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b1e95d9e-6fc9bd7c55-fvghc"]
Jul 20 19:27:50.405276 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:27:50.403045    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b1e95d9e-6fc9bd7c55-fvghc" podUID="b9f63050-0350-4902-b0bd-401a44cd00ff" containerName="maas-api" containerID="cri-o://a71bb28ae21f6efa9d997d3f39b88e879504d572f690f72f26bbce730b4d3703" gracePeriod=30
Jul 20 19:27:50.432784 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:27:50.432749    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:27:50.648985 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:27:50.648960    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b1e95d9e-6fc9bd7c55-fvghc"
Jul 20 19:27:50.709884 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:27:50.709852    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-565tk\" (UniqueName: \"kubernetes.io/projected/b9f63050-0350-4902-b0bd-401a44cd00ff-kube-api-access-565tk\") pod \"b9f63050-0350-4902-b0bd-401a44cd00ff\" (UID: \"b9f63050-0350-4902-b0bd-401a44cd00ff\") "
Jul 20 19:27:50.710049 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:27:50.709950    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b9f63050-0350-4902-b0bd-401a44cd00ff-openshift-service-ca\") pod \"b9f63050-0350-4902-b0bd-401a44cd00ff\" (UID: \"b9f63050-0350-4902-b0bd-401a44cd00ff\") "
Jul 20 19:27:50.710049 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:27:50.709978    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b9f63050-0350-4902-b0bd-401a44cd00ff-maas-api-tls\") pod \"b9f63050-0350-4902-b0bd-401a44cd00ff\" (UID: \"b9f63050-0350-4902-b0bd-401a44cd00ff\") "
Jul 20 19:27:50.710305 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:27:50.710276    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b9f63050-0350-4902-b0bd-401a44cd00ff-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b9f63050-0350-4902-b0bd-401a44cd00ff" (UID: "b9f63050-0350-4902-b0bd-401a44cd00ff"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 19:27:50.712230 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:27:50.712208    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9f63050-0350-4902-b0bd-401a44cd00ff-kube-api-access-565tk" (OuterVolumeSpecName: "kube-api-access-565tk") pod "b9f63050-0350-4902-b0bd-401a44cd00ff" (UID: "b9f63050-0350-4902-b0bd-401a44cd00ff"). InnerVolumeSpecName "kube-api-access-565tk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:27:50.712305 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:27:50.712226    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9f63050-0350-4902-b0bd-401a44cd00ff-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b9f63050-0350-4902-b0bd-401a44cd00ff" (UID: "b9f63050-0350-4902-b0bd-401a44cd00ff"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 19:27:50.730195 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:27:50.730164    2563 generic.go:356] "Generic (PLEG): container finished" podID="b9f63050-0350-4902-b0bd-401a44cd00ff" containerID="a71bb28ae21f6efa9d997d3f39b88e879504d572f690f72f26bbce730b4d3703" exitCode=0
Jul 20 19:27:50.730299 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:27:50.730211    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b1e95d9e-6fc9bd7c55-fvghc"
Jul 20 19:27:50.730299 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:27:50.730221    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b1e95d9e-6fc9bd7c55-fvghc" event={"ID":"b9f63050-0350-4902-b0bd-401a44cd00ff","Type":"ContainerDied","Data":"a71bb28ae21f6efa9d997d3f39b88e879504d572f690f72f26bbce730b4d3703"}
Jul 20 19:27:50.730299 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:27:50.730272    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b1e95d9e-6fc9bd7c55-fvghc" event={"ID":"b9f63050-0350-4902-b0bd-401a44cd00ff","Type":"ContainerDied","Data":"22aa0ceaecdc199b1c3796910dd183471be257441096ebb44000b1d7fe400a3f"}
Jul 20 19:27:50.730467 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:27:50.730302    2563 scope.go:117] "RemoveContainer" containerID="a71bb28ae21f6efa9d997d3f39b88e879504d572f690f72f26bbce730b4d3703"
Jul 20 19:27:50.738747 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:27:50.738728    2563 scope.go:117] "RemoveContainer" containerID="a71bb28ae21f6efa9d997d3f39b88e879504d572f690f72f26bbce730b4d3703"
Jul 20 19:27:50.739010 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:27:50.738990    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a71bb28ae21f6efa9d997d3f39b88e879504d572f690f72f26bbce730b4d3703\": container with ID starting with a71bb28ae21f6efa9d997d3f39b88e879504d572f690f72f26bbce730b4d3703 not found: ID does not exist" containerID="a71bb28ae21f6efa9d997d3f39b88e879504d572f690f72f26bbce730b4d3703"
Jul 20 19:27:50.739052 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:27:50.739019    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a71bb28ae21f6efa9d997d3f39b88e879504d572f690f72f26bbce730b4d3703"} err="failed to get container status \"a71bb28ae21f6efa9d997d3f39b88e879504d572f690f72f26bbce730b4d3703\": rpc error: code = NotFound desc = could not find container \"a71bb28ae21f6efa9d997d3f39b88e879504d572f690f72f26bbce730b4d3703\": container with ID starting with a71bb28ae21f6efa9d997d3f39b88e879504d572f690f72f26bbce730b4d3703 not found: ID does not exist"
Jul 20 19:27:50.751938 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:27:50.751917    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b1e95d9e-6fc9bd7c55-fvghc"]
Jul 20 19:27:50.755335 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:27:50.755314    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b1e95d9e-6fc9bd7c55-fvghc"]
Jul 20 19:27:50.811188 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:27:50.811163    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-565tk\" (UniqueName: \"kubernetes.io/projected/b9f63050-0350-4902-b0bd-401a44cd00ff-kube-api-access-565tk\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\""
Jul 20 19:27:50.811188 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:27:50.811186    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b9f63050-0350-4902-b0bd-401a44cd00ff-openshift-service-ca\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\""
Jul 20 19:27:50.811320 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:27:50.811196    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b9f63050-0350-4902-b0bd-401a44cd00ff-maas-api-tls\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\""
Jul 20 19:27:50.892071 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:27:50.892039    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b9f63050-0350-4902-b0bd-401a44cd00ff" path="/var/lib/kubelet/pods/b9f63050-0350-4902-b0bd-401a44cd00ff/volumes"
Jul 20 19:27:55.008714 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:27:55.008666    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:27:55.210467 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:27:55.210431    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:27:55.459851 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:27:55.459821    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:27:55.701127 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:27:55.701093    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:27:55.839312 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:27:55.839241    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:27:55.968517 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:27:55.968485    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:27:56.330582 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:27:56.330549    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:27:56.902331 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:27:56.902303    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:27:58.874697 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:27:58.874659    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:27:58.880032 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:27:58.880007    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-8c4bb01a-7cbf65f66f-l5xzt"]
Jul 20 19:27:58.880514 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:27:58.880499    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9f63050-0350-4902-b0bd-401a44cd00ff" containerName="maas-api"
Jul 20 19:27:58.880562 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:27:58.880518    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9f63050-0350-4902-b0bd-401a44cd00ff" containerName="maas-api"
Jul 20 19:27:58.880627 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:27:58.880615    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9f63050-0350-4902-b0bd-401a44cd00ff" containerName="maas-api"
Jul 20 19:27:58.885303 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:27:58.885284    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8c4bb01a-7cbf65f66f-l5xzt"
Jul 20 19:27:58.887602 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:27:58.887584    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-8c4bb01a-serving-cert\""
Jul 20 19:27:58.894852 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:27:58.894828    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-8c4bb01a-7cbf65f66f-l5xzt"]
Jul 20 19:27:58.967296 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:27:58.967270    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:27:58.976372 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:27:58.976319    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7e031f41-1042-4ba4-88fc-d362f63f1f2d-maas-api-tls\") pod \"maas-api-e2e-migrate-8c4bb01a-7cbf65f66f-l5xzt\" (UID: \"7e031f41-1042-4ba4-88fc-d362f63f1f2d\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8c4bb01a-7cbf65f66f-l5xzt"
Jul 20 19:27:58.976496 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:27:58.976447    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hf6lb\" (UniqueName: \"kubernetes.io/projected/7e031f41-1042-4ba4-88fc-d362f63f1f2d-kube-api-access-hf6lb\") pod \"maas-api-e2e-migrate-8c4bb01a-7cbf65f66f-l5xzt\" (UID: \"7e031f41-1042-4ba4-88fc-d362f63f1f2d\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8c4bb01a-7cbf65f66f-l5xzt"
Jul 20 19:27:58.976544 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:27:58.976499    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7e031f41-1042-4ba4-88fc-d362f63f1f2d-openshift-service-ca\") pod \"maas-api-e2e-migrate-8c4bb01a-7cbf65f66f-l5xzt\" (UID: \"7e031f41-1042-4ba4-88fc-d362f63f1f2d\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8c4bb01a-7cbf65f66f-l5xzt"
Jul 20 19:27:59.077746 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:27:59.077720    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hf6lb\" (UniqueName: \"kubernetes.io/projected/7e031f41-1042-4ba4-88fc-d362f63f1f2d-kube-api-access-hf6lb\") pod \"maas-api-e2e-migrate-8c4bb01a-7cbf65f66f-l5xzt\" (UID: \"7e031f41-1042-4ba4-88fc-d362f63f1f2d\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8c4bb01a-7cbf65f66f-l5xzt"
Jul 20 19:27:59.077877 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:27:59.077771    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7e031f41-1042-4ba4-88fc-d362f63f1f2d-openshift-service-ca\") pod \"maas-api-e2e-migrate-8c4bb01a-7cbf65f66f-l5xzt\" (UID: \"7e031f41-1042-4ba4-88fc-d362f63f1f2d\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8c4bb01a-7cbf65f66f-l5xzt"
Jul 20 19:27:59.077877 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:27:59.077806    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7e031f41-1042-4ba4-88fc-d362f63f1f2d-maas-api-tls\") pod \"maas-api-e2e-migrate-8c4bb01a-7cbf65f66f-l5xzt\" (UID: \"7e031f41-1042-4ba4-88fc-d362f63f1f2d\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8c4bb01a-7cbf65f66f-l5xzt"
Jul 20 19:27:59.077975 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:27:59.077916    2563 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-8c4bb01a-serving-cert: secret "maas-api-e2e-migrate-8c4bb01a-serving-cert" not found
Jul 20 19:27:59.078010 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:27:59.077981    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e031f41-1042-4ba4-88fc-d362f63f1f2d-maas-api-tls podName:7e031f41-1042-4ba4-88fc-d362f63f1f2d nodeName:}" failed. No retries permitted until 2026-07-20 19:27:59.577964841 +0000 UTC m=+1639.261492843 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/7e031f41-1042-4ba4-88fc-d362f63f1f2d-maas-api-tls") pod "maas-api-e2e-migrate-8c4bb01a-7cbf65f66f-l5xzt" (UID: "7e031f41-1042-4ba4-88fc-d362f63f1f2d") : secret "maas-api-e2e-migrate-8c4bb01a-serving-cert" not found
Jul 20 19:27:59.078439 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:27:59.078416    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7e031f41-1042-4ba4-88fc-d362f63f1f2d-openshift-service-ca\") pod \"maas-api-e2e-migrate-8c4bb01a-7cbf65f66f-l5xzt\" (UID: \"7e031f41-1042-4ba4-88fc-d362f63f1f2d\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8c4bb01a-7cbf65f66f-l5xzt"
Jul 20 19:27:59.086854 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:27:59.086833    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hf6lb\" (UniqueName: \"kubernetes.io/projected/7e031f41-1042-4ba4-88fc-d362f63f1f2d-kube-api-access-hf6lb\") pod \"maas-api-e2e-migrate-8c4bb01a-7cbf65f66f-l5xzt\" (UID: \"7e031f41-1042-4ba4-88fc-d362f63f1f2d\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8c4bb01a-7cbf65f66f-l5xzt"
Jul 20 19:27:59.145625 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:27:59.145541    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:27:59.501397 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:27:59.501340    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:27:59.582868 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:27:59.582843    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7e031f41-1042-4ba4-88fc-d362f63f1f2d-maas-api-tls\") pod \"maas-api-e2e-migrate-8c4bb01a-7cbf65f66f-l5xzt\" (UID: \"7e031f41-1042-4ba4-88fc-d362f63f1f2d\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8c4bb01a-7cbf65f66f-l5xzt"
Jul 20 19:27:59.585330 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:27:59.585304    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7e031f41-1042-4ba4-88fc-d362f63f1f2d-maas-api-tls\") pod \"maas-api-e2e-migrate-8c4bb01a-7cbf65f66f-l5xzt\" (UID: \"7e031f41-1042-4ba4-88fc-d362f63f1f2d\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8c4bb01a-7cbf65f66f-l5xzt"
Jul 20 19:27:59.599879 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:27:59.599855    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:27:59.797151 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:27:59.797080    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8c4bb01a-7cbf65f66f-l5xzt"
Jul 20 19:27:59.932596 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:27:59.932574    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-8c4bb01a-7cbf65f66f-l5xzt"]
Jul 20 19:27:59.934756 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:27:59.934726    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e031f41_1042_4ba4_88fc_d362f63f1f2d.slice/crio-85fb34d1f3b2dd469b6c08f564eabc342da0f83042121aaf10285839aa9d424b WatchSource:0}: Error finding container 85fb34d1f3b2dd469b6c08f564eabc342da0f83042121aaf10285839aa9d424b: Status 404 returned error can't find the container with id 85fb34d1f3b2dd469b6c08f564eabc342da0f83042121aaf10285839aa9d424b
Jul 20 19:28:00.776729 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:28:00.776697    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8c4bb01a-7cbf65f66f-l5xzt" event={"ID":"7e031f41-1042-4ba4-88fc-d362f63f1f2d","Type":"ContainerStarted","Data":"de6c062034d3d59c480f6d339161440f1a8faaaf8cc1ada76bf169ae6045a383"}
Jul 20 19:28:00.776889 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:28:00.776745    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8c4bb01a-7cbf65f66f-l5xzt" event={"ID":"7e031f41-1042-4ba4-88fc-d362f63f1f2d","Type":"ContainerStarted","Data":"85fb34d1f3b2dd469b6c08f564eabc342da0f83042121aaf10285839aa9d424b"}
Jul 20 19:28:00.776889 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:28:00.776834    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8c4bb01a-7cbf65f66f-l5xzt"
Jul 20 19:28:00.799510 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:28:00.794503    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8c4bb01a-7cbf65f66f-l5xzt" podStartSLOduration=2.379414245 podStartE2EDuration="2.794486517s" totalImagesPullingTime="415.072272ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:27:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:28:00.792468397 +0000 UTC m=+1640.475996419" watchObservedRunningTime="2026-07-20 19:28:00.794486517 +0000 UTC m=+1640.478014542"
Jul 20 19:28:06.787409 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:28:06.787377    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8c4bb01a-7cbf65f66f-l5xzt"
Jul 20 19:28:34.377701 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:28:34.377662    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-8c4bb01a-7cbf65f66f-l5xzt"]
Jul 20 19:28:34.378108 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:28:34.377862    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8c4bb01a-7cbf65f66f-l5xzt" podUID="7e031f41-1042-4ba4-88fc-d362f63f1f2d" containerName="maas-api" containerID="cri-o://de6c062034d3d59c480f6d339161440f1a8faaaf8cc1ada76bf169ae6045a383" gracePeriod=30
Jul 20 19:28:34.418633 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:28:34.418599    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:28:34.619926 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:28:34.619904    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8c4bb01a-7cbf65f66f-l5xzt"
Jul 20 19:28:34.686572 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:28:34.686494    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7e031f41-1042-4ba4-88fc-d362f63f1f2d-maas-api-tls\") pod \"7e031f41-1042-4ba4-88fc-d362f63f1f2d\" (UID: \"7e031f41-1042-4ba4-88fc-d362f63f1f2d\") "
Jul 20 19:28:34.686572 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:28:34.686541    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hf6lb\" (UniqueName: \"kubernetes.io/projected/7e031f41-1042-4ba4-88fc-d362f63f1f2d-kube-api-access-hf6lb\") pod \"7e031f41-1042-4ba4-88fc-d362f63f1f2d\" (UID: \"7e031f41-1042-4ba4-88fc-d362f63f1f2d\") "
Jul 20 19:28:34.686788 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:28:34.686580    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7e031f41-1042-4ba4-88fc-d362f63f1f2d-openshift-service-ca\") pod \"7e031f41-1042-4ba4-88fc-d362f63f1f2d\" (UID: \"7e031f41-1042-4ba4-88fc-d362f63f1f2d\") "
Jul 20 19:28:34.687017 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:28:34.686993    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7e031f41-1042-4ba4-88fc-d362f63f1f2d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7e031f41-1042-4ba4-88fc-d362f63f1f2d" (UID: "7e031f41-1042-4ba4-88fc-d362f63f1f2d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 19:28:34.688642 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:28:34.688614    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e031f41-1042-4ba4-88fc-d362f63f1f2d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7e031f41-1042-4ba4-88fc-d362f63f1f2d" (UID: "7e031f41-1042-4ba4-88fc-d362f63f1f2d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 19:28:34.688767 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:28:34.688689    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e031f41-1042-4ba4-88fc-d362f63f1f2d-kube-api-access-hf6lb" (OuterVolumeSpecName: "kube-api-access-hf6lb") pod "7e031f41-1042-4ba4-88fc-d362f63f1f2d" (UID: "7e031f41-1042-4ba4-88fc-d362f63f1f2d"). InnerVolumeSpecName "kube-api-access-hf6lb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:28:34.787545 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:28:34.787526    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7e031f41-1042-4ba4-88fc-d362f63f1f2d-maas-api-tls\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\""
Jul 20 19:28:34.787545 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:28:34.787546    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hf6lb\" (UniqueName: \"kubernetes.io/projected/7e031f41-1042-4ba4-88fc-d362f63f1f2d-kube-api-access-hf6lb\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\""
Jul 20 19:28:34.787668 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:28:34.787556    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7e031f41-1042-4ba4-88fc-d362f63f1f2d-openshift-service-ca\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\""
Jul 20 19:28:34.926093 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:28:34.926059    2563 generic.go:356] "Generic (PLEG): container finished" podID="7e031f41-1042-4ba4-88fc-d362f63f1f2d" containerID="de6c062034d3d59c480f6d339161440f1a8faaaf8cc1ada76bf169ae6045a383" exitCode=0
Jul 20 19:28:34.926213 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:28:34.926103    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8c4bb01a-7cbf65f66f-l5xzt"
Jul 20 19:28:34.926213 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:28:34.926142    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8c4bb01a-7cbf65f66f-l5xzt" event={"ID":"7e031f41-1042-4ba4-88fc-d362f63f1f2d","Type":"ContainerDied","Data":"de6c062034d3d59c480f6d339161440f1a8faaaf8cc1ada76bf169ae6045a383"}
Jul 20 19:28:34.926213 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:28:34.926191    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8c4bb01a-7cbf65f66f-l5xzt" event={"ID":"7e031f41-1042-4ba4-88fc-d362f63f1f2d","Type":"ContainerDied","Data":"85fb34d1f3b2dd469b6c08f564eabc342da0f83042121aaf10285839aa9d424b"}
Jul 20 19:28:34.926213 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:28:34.926212    2563 scope.go:117] "RemoveContainer" containerID="de6c062034d3d59c480f6d339161440f1a8faaaf8cc1ada76bf169ae6045a383"
Jul 20 19:28:34.934760 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:28:34.934742    2563 scope.go:117] "RemoveContainer" containerID="de6c062034d3d59c480f6d339161440f1a8faaaf8cc1ada76bf169ae6045a383"
Jul 20 19:28:34.935022 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:28:34.935004    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"de6c062034d3d59c480f6d339161440f1a8faaaf8cc1ada76bf169ae6045a383\": container with ID starting with de6c062034d3d59c480f6d339161440f1a8faaaf8cc1ada76bf169ae6045a383 not found: ID does not exist" containerID="de6c062034d3d59c480f6d339161440f1a8faaaf8cc1ada76bf169ae6045a383"
Jul 20 19:28:34.935066 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:28:34.935030    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de6c062034d3d59c480f6d339161440f1a8faaaf8cc1ada76bf169ae6045a383"} err="failed to get container status \"de6c062034d3d59c480f6d339161440f1a8faaaf8cc1ada76bf169ae6045a383\": rpc error: code = NotFound desc = could not find container \"de6c062034d3d59c480f6d339161440f1a8faaaf8cc1ada76bf169ae6045a383\": container with ID starting with de6c062034d3d59c480f6d339161440f1a8faaaf8cc1ada76bf169ae6045a383 not found: ID does not exist"
Jul 20 19:28:34.943780 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:28:34.943732    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-8c4bb01a-7cbf65f66f-l5xzt"]
Jul 20 19:28:34.947966 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:28:34.947946    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-8c4bb01a-7cbf65f66f-l5xzt"]
Jul 20 19:28:36.891628 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:28:36.891599    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7e031f41-1042-4ba4-88fc-d362f63f1f2d" path="/var/lib/kubelet/pods/7e031f41-1042-4ba4-88fc-d362f63f1f2d/volumes"
Jul 20 19:28:38.837662 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:28:38.837627    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:28:38.994679 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:28:38.994648    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:28:39.225231 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:28:39.225199    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:28:39.471316 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:28:39.471287    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:28:39.851145 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:28:39.851114    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:28:39.977063 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:28:39.977033    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:28:41.804534 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:28:41.804497    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:28:41.909405 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:28:41.909376    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c0f5505a-75959b8d86-dpsqh"]
Jul 20 19:28:41.909761 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:28:41.909744    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e031f41-1042-4ba4-88fc-d362f63f1f2d" containerName="maas-api"
Jul 20 19:28:41.909840 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:28:41.909764    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e031f41-1042-4ba4-88fc-d362f63f1f2d" containerName="maas-api"
Jul 20 19:28:41.909906 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:28:41.909894    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="7e031f41-1042-4ba4-88fc-d362f63f1f2d" containerName="maas-api"
Jul 20 19:28:41.914264 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:28:41.914245    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c0f5505a-75959b8d86-dpsqh"
Jul 20 19:28:41.919779 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:28:41.919755    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-c0f5505a-serving-cert\""
Jul 20 19:28:41.921808 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:28:41.921788    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:28:41.928419 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:28:41.928396    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c0f5505a-75959b8d86-dpsqh"]
Jul 20 19:28:42.008534 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:28:42.008504    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:28:42.053587 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:28:42.053561    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bb9bfd9b-fac8-4fad-8383-079366cf4098-maas-api-tls\") pod \"maas-api-e2e-ait-c0f5505a-75959b8d86-dpsqh\" (UID: \"bb9bfd9b-fac8-4fad-8383-079366cf4098\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c0f5505a-75959b8d86-dpsqh"
Jul 20 19:28:42.053736 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:28:42.053599    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9tmd4\" (UniqueName: \"kubernetes.io/projected/bb9bfd9b-fac8-4fad-8383-079366cf4098-kube-api-access-9tmd4\") pod \"maas-api-e2e-ait-c0f5505a-75959b8d86-dpsqh\" (UID: \"bb9bfd9b-fac8-4fad-8383-079366cf4098\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c0f5505a-75959b8d86-dpsqh"
Jul 20 19:28:42.053736 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:28:42.053628    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb9bfd9b-fac8-4fad-8383-079366cf4098-openshift-service-ca\") pod \"maas-api-e2e-ait-c0f5505a-75959b8d86-dpsqh\" (UID: \"bb9bfd9b-fac8-4fad-8383-079366cf4098\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c0f5505a-75959b8d86-dpsqh"
Jul 20 19:28:42.154428 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:28:42.154337    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bb9bfd9b-fac8-4fad-8383-079366cf4098-maas-api-tls\") pod \"maas-api-e2e-ait-c0f5505a-75959b8d86-dpsqh\" (UID: \"bb9bfd9b-fac8-4fad-8383-079366cf4098\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c0f5505a-75959b8d86-dpsqh"
Jul 20 19:28:42.154428 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:28:42.154405    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9tmd4\" (UniqueName: \"kubernetes.io/projected/bb9bfd9b-fac8-4fad-8383-079366cf4098-kube-api-access-9tmd4\") pod \"maas-api-e2e-ait-c0f5505a-75959b8d86-dpsqh\" (UID: \"bb9bfd9b-fac8-4fad-8383-079366cf4098\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c0f5505a-75959b8d86-dpsqh"
Jul 20 19:28:42.154592 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:28:42.154438    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb9bfd9b-fac8-4fad-8383-079366cf4098-openshift-service-ca\") pod \"maas-api-e2e-ait-c0f5505a-75959b8d86-dpsqh\" (UID: \"bb9bfd9b-fac8-4fad-8383-079366cf4098\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c0f5505a-75959b8d86-dpsqh"
Jul 20 19:28:42.154592 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:28:42.154459    2563 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-c0f5505a-serving-cert: secret "maas-api-e2e-ait-c0f5505a-serving-cert" not found
Jul 20 19:28:42.154592 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:28:42.154528    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb9bfd9b-fac8-4fad-8383-079366cf4098-maas-api-tls podName:bb9bfd9b-fac8-4fad-8383-079366cf4098 nodeName:}" failed. No retries permitted until 2026-07-20 19:28:42.654509975 +0000 UTC m=+1682.338037978 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/bb9bfd9b-fac8-4fad-8383-079366cf4098-maas-api-tls") pod "maas-api-e2e-ait-c0f5505a-75959b8d86-dpsqh" (UID: "bb9bfd9b-fac8-4fad-8383-079366cf4098") : secret "maas-api-e2e-ait-c0f5505a-serving-cert" not found
Jul 20 19:28:42.155005 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:28:42.154987    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb9bfd9b-fac8-4fad-8383-079366cf4098-openshift-service-ca\") pod \"maas-api-e2e-ait-c0f5505a-75959b8d86-dpsqh\" (UID: \"bb9bfd9b-fac8-4fad-8383-079366cf4098\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c0f5505a-75959b8d86-dpsqh"
Jul 20 19:28:42.163239 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:28:42.163219    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9tmd4\" (UniqueName: \"kubernetes.io/projected/bb9bfd9b-fac8-4fad-8383-079366cf4098-kube-api-access-9tmd4\") pod \"maas-api-e2e-ait-c0f5505a-75959b8d86-dpsqh\" (UID: \"bb9bfd9b-fac8-4fad-8383-079366cf4098\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c0f5505a-75959b8d86-dpsqh"
Jul 20 19:28:42.318218 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:28:42.318181    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:28:42.638489 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:28:42.638455    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:28:42.659081 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:28:42.659055    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bb9bfd9b-fac8-4fad-8383-079366cf4098-maas-api-tls\") pod \"maas-api-e2e-ait-c0f5505a-75959b8d86-dpsqh\" (UID: \"bb9bfd9b-fac8-4fad-8383-079366cf4098\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c0f5505a-75959b8d86-dpsqh"
Jul 20 19:28:42.661682 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:28:42.661651    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bb9bfd9b-fac8-4fad-8383-079366cf4098-maas-api-tls\") pod \"maas-api-e2e-ait-c0f5505a-75959b8d86-dpsqh\" (UID: \"bb9bfd9b-fac8-4fad-8383-079366cf4098\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c0f5505a-75959b8d86-dpsqh"
Jul 20 19:28:42.747639 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:28:42.747612    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:28:42.824932 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:28:42.824906    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c0f5505a-75959b8d86-dpsqh"
Jul 20 19:28:42.955127 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:28:42.955103    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c0f5505a-75959b8d86-dpsqh"]
Jul 20 19:28:42.957253 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:28:42.957220    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb9bfd9b_fac8_4fad_8383_079366cf4098.slice/crio-07e5a2c87c704b1e4da7bed26e7a0780b5f8546298d482b4cc61751c085426c4 WatchSource:0}: Error finding container 07e5a2c87c704b1e4da7bed26e7a0780b5f8546298d482b4cc61751c085426c4: Status 404 returned error can't find the container with id 07e5a2c87c704b1e4da7bed26e7a0780b5f8546298d482b4cc61751c085426c4
Jul 20 19:28:43.968014 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:28:43.967981    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c0f5505a-75959b8d86-dpsqh" event={"ID":"bb9bfd9b-fac8-4fad-8383-079366cf4098","Type":"ContainerStarted","Data":"13556e3104889dc7049a785d918fadbb3120377915e4cdd4de0bc99eb3317ca6"}
Jul 20 19:28:43.968411 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:28:43.968059    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c0f5505a-75959b8d86-dpsqh" event={"ID":"bb9bfd9b-fac8-4fad-8383-079366cf4098","Type":"ContainerStarted","Data":"07e5a2c87c704b1e4da7bed26e7a0780b5f8546298d482b4cc61751c085426c4"}
Jul 20 19:28:43.968411 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:28:43.968094    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c0f5505a-75959b8d86-dpsqh"
Jul 20 19:28:43.988512 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:28:43.988465    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c0f5505a-75959b8d86-dpsqh" podStartSLOduration=2.615914337 podStartE2EDuration="2.988451208s" totalImagesPullingTime="372.536871ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:28:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:28:43.986963114 +0000 UTC m=+1683.670491127" watchObservedRunningTime="2026-07-20 19:28:43.988451208 +0000 UTC m=+1683.671979230"
Jul 20 19:28:48.049906 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:28:48.049870    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:28:49.978226 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:28:49.978199    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c0f5505a-75959b8d86-dpsqh"
Jul 20 19:29:18.320302 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:29:18.320270    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c0f5505a-75959b8d86-dpsqh"]
Jul 20 19:29:18.320843 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:29:18.320561    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c0f5505a-75959b8d86-dpsqh" podUID="bb9bfd9b-fac8-4fad-8383-079366cf4098" containerName="maas-api" containerID="cri-o://13556e3104889dc7049a785d918fadbb3120377915e4cdd4de0bc99eb3317ca6" gracePeriod=30
Jul 20 19:29:18.350844 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:29:18.350817    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:29:18.570173 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:29:18.570147    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c0f5505a-75959b8d86-dpsqh"
Jul 20 19:29:18.674159 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:29:18.674079    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb9bfd9b-fac8-4fad-8383-079366cf4098-openshift-service-ca\") pod \"bb9bfd9b-fac8-4fad-8383-079366cf4098\" (UID: \"bb9bfd9b-fac8-4fad-8383-079366cf4098\") "
Jul 20 19:29:18.674159 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:29:18.674144    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9tmd4\" (UniqueName: \"kubernetes.io/projected/bb9bfd9b-fac8-4fad-8383-079366cf4098-kube-api-access-9tmd4\") pod \"bb9bfd9b-fac8-4fad-8383-079366cf4098\" (UID: \"bb9bfd9b-fac8-4fad-8383-079366cf4098\") "
Jul 20 19:29:18.674332 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:29:18.674207    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bb9bfd9b-fac8-4fad-8383-079366cf4098-maas-api-tls\") pod \"bb9bfd9b-fac8-4fad-8383-079366cf4098\" (UID: \"bb9bfd9b-fac8-4fad-8383-079366cf4098\") "
Jul 20 19:29:18.674462 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:29:18.674441    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bb9bfd9b-fac8-4fad-8383-079366cf4098-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "bb9bfd9b-fac8-4fad-8383-079366cf4098" (UID: "bb9bfd9b-fac8-4fad-8383-079366cf4098"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 19:29:18.676473 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:29:18.676449    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bb9bfd9b-fac8-4fad-8383-079366cf4098-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "bb9bfd9b-fac8-4fad-8383-079366cf4098" (UID: "bb9bfd9b-fac8-4fad-8383-079366cf4098"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 19:29:18.676584 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:29:18.676483    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb9bfd9b-fac8-4fad-8383-079366cf4098-kube-api-access-9tmd4" (OuterVolumeSpecName: "kube-api-access-9tmd4") pod "bb9bfd9b-fac8-4fad-8383-079366cf4098" (UID: "bb9bfd9b-fac8-4fad-8383-079366cf4098"). InnerVolumeSpecName "kube-api-access-9tmd4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:29:18.775661 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:29:18.775628    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bb9bfd9b-fac8-4fad-8383-079366cf4098-maas-api-tls\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\""
Jul 20 19:29:18.775661 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:29:18.775656    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb9bfd9b-fac8-4fad-8383-079366cf4098-openshift-service-ca\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\""
Jul 20 19:29:18.775661 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:29:18.775666    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9tmd4\" (UniqueName: \"kubernetes.io/projected/bb9bfd9b-fac8-4fad-8383-079366cf4098-kube-api-access-9tmd4\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\""
Jul 20 19:29:19.120619 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:29:19.120584    2563 generic.go:356] "Generic (PLEG): container finished" podID="bb9bfd9b-fac8-4fad-8383-079366cf4098" containerID="13556e3104889dc7049a785d918fadbb3120377915e4cdd4de0bc99eb3317ca6" exitCode=0
Jul 20 19:29:19.120824 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:29:19.120635    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c0f5505a-75959b8d86-dpsqh"
Jul 20 19:29:19.120824 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:29:19.120678    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c0f5505a-75959b8d86-dpsqh" event={"ID":"bb9bfd9b-fac8-4fad-8383-079366cf4098","Type":"ContainerDied","Data":"13556e3104889dc7049a785d918fadbb3120377915e4cdd4de0bc99eb3317ca6"}
Jul 20 19:29:19.120824 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:29:19.120735    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c0f5505a-75959b8d86-dpsqh" event={"ID":"bb9bfd9b-fac8-4fad-8383-079366cf4098","Type":"ContainerDied","Data":"07e5a2c87c704b1e4da7bed26e7a0780b5f8546298d482b4cc61751c085426c4"}
Jul 20 19:29:19.120824 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:29:19.120763    2563 scope.go:117] "RemoveContainer" containerID="13556e3104889dc7049a785d918fadbb3120377915e4cdd4de0bc99eb3317ca6"
Jul 20 19:29:19.128912 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:29:19.128889    2563 scope.go:117] "RemoveContainer" containerID="13556e3104889dc7049a785d918fadbb3120377915e4cdd4de0bc99eb3317ca6"
Jul 20 19:29:19.129161 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:29:19.129146    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"13556e3104889dc7049a785d918fadbb3120377915e4cdd4de0bc99eb3317ca6\": container with ID starting with 13556e3104889dc7049a785d918fadbb3120377915e4cdd4de0bc99eb3317ca6 not found: ID does not exist" containerID="13556e3104889dc7049a785d918fadbb3120377915e4cdd4de0bc99eb3317ca6"
Jul 20 19:29:19.129224 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:29:19.129171    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13556e3104889dc7049a785d918fadbb3120377915e4cdd4de0bc99eb3317ca6"} err="failed to get container status \"13556e3104889dc7049a785d918fadbb3120377915e4cdd4de0bc99eb3317ca6\": rpc error: code = NotFound desc = could not find container \"13556e3104889dc7049a785d918fadbb3120377915e4cdd4de0bc99eb3317ca6\": container with ID starting with 13556e3104889dc7049a785d918fadbb3120377915e4cdd4de0bc99eb3317ca6 not found: ID does not exist"
Jul 20 19:29:19.155074 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:29:19.155047    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c0f5505a-75959b8d86-dpsqh"]
Jul 20 19:29:19.158463 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:29:19.158442    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c0f5505a-75959b8d86-dpsqh"]
Jul 20 19:29:20.898407 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:29:20.898338    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bb9bfd9b-fac8-4fad-8383-079366cf4098" path="/var/lib/kubelet/pods/bb9bfd9b-fac8-4fad-8383-079366cf4098/volumes"
Jul 20 19:29:22.751154 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:29:22.751105    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:29:24.072038 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:29:24.071994    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:29:24.307301 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:29:24.307260    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:29:24.566865 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:29:24.566831    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:29:25.015042 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:29:25.015005    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:29:25.509769 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:29:25.509735    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:29:27.080004 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:29:27.079973    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:29:27.182691 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:29:27.182654    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:29:27.190927 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:29:27.190900    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-1e283793-6fccff56f4-c5bd8"]
Jul 20 19:29:27.191242 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:29:27.191230    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb9bfd9b-fac8-4fad-8383-079366cf4098" containerName="maas-api"
Jul 20 19:29:27.191305 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:29:27.191245    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb9bfd9b-fac8-4fad-8383-079366cf4098" containerName="maas-api"
Jul 20 19:29:27.191344 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:29:27.191315    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb9bfd9b-fac8-4fad-8383-079366cf4098" containerName="maas-api"
Jul 20 19:29:27.195513 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:29:27.195497    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-1e283793-6fccff56f4-c5bd8"
Jul 20 19:29:27.203046 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:29:27.203029    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-1e283793-serving-cert\""
Jul 20 19:29:27.213731 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:29:27.213711    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-1e283793-6fccff56f4-c5bd8"]
Jul 20 19:29:27.251296 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:29:27.251272    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5s5sj\" (UniqueName: \"kubernetes.io/projected/c20ecac2-e716-4822-a119-76e4b6380165-kube-api-access-5s5sj\") pod \"maas-api-e2e-derive-1e283793-6fccff56f4-c5bd8\" (UID: \"c20ecac2-e716-4822-a119-76e4b6380165\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-1e283793-6fccff56f4-c5bd8"
Jul 20 19:29:27.251420 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:29:27.251320    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c20ecac2-e716-4822-a119-76e4b6380165-openshift-service-ca\") pod \"maas-api-e2e-derive-1e283793-6fccff56f4-c5bd8\" (UID: \"c20ecac2-e716-4822-a119-76e4b6380165\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-1e283793-6fccff56f4-c5bd8"
Jul 20 19:29:27.251420 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:29:27.251345    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c20ecac2-e716-4822-a119-76e4b6380165-maas-api-tls\") pod \"maas-api-e2e-derive-1e283793-6fccff56f4-c5bd8\" (UID: \"c20ecac2-e716-4822-a119-76e4b6380165\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-1e283793-6fccff56f4-c5bd8"
Jul 20 19:29:27.284034 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:29:27.284014    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:29:27.351969 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:29:27.351901    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c20ecac2-e716-4822-a119-76e4b6380165-openshift-service-ca\") pod \"maas-api-e2e-derive-1e283793-6fccff56f4-c5bd8\" (UID: \"c20ecac2-e716-4822-a119-76e4b6380165\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-1e283793-6fccff56f4-c5bd8"
Jul 20 19:29:27.351969 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:29:27.351944    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c20ecac2-e716-4822-a119-76e4b6380165-maas-api-tls\") pod \"maas-api-e2e-derive-1e283793-6fccff56f4-c5bd8\" (UID: \"c20ecac2-e716-4822-a119-76e4b6380165\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-1e283793-6fccff56f4-c5bd8"
Jul 20 19:29:27.352122 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:29:27.352025    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5s5sj\" (UniqueName: \"kubernetes.io/projected/c20ecac2-e716-4822-a119-76e4b6380165-kube-api-access-5s5sj\") pod \"maas-api-e2e-derive-1e283793-6fccff56f4-c5bd8\" (UID: \"c20ecac2-e716-4822-a119-76e4b6380165\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-1e283793-6fccff56f4-c5bd8"
Jul 20 19:29:27.352122 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:29:27.352114    2563 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-1e283793-serving-cert: secret "maas-api-e2e-derive-1e283793-serving-cert" not found
Jul 20 19:29:27.352227 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:29:27.352183    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c20ecac2-e716-4822-a119-76e4b6380165-maas-api-tls podName:c20ecac2-e716-4822-a119-76e4b6380165 nodeName:}" failed. No retries permitted until 2026-07-20 19:29:27.852167055 +0000 UTC m=+1727.535695055 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c20ecac2-e716-4822-a119-76e4b6380165-maas-api-tls") pod "maas-api-e2e-derive-1e283793-6fccff56f4-c5bd8" (UID: "c20ecac2-e716-4822-a119-76e4b6380165") : secret "maas-api-e2e-derive-1e283793-serving-cert" not found
Jul 20 19:29:27.352591 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:29:27.352574    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c20ecac2-e716-4822-a119-76e4b6380165-openshift-service-ca\") pod \"maas-api-e2e-derive-1e283793-6fccff56f4-c5bd8\" (UID: \"c20ecac2-e716-4822-a119-76e4b6380165\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-1e283793-6fccff56f4-c5bd8"
Jul 20 19:29:27.362699 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:29:27.362672    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5s5sj\" (UniqueName: \"kubernetes.io/projected/c20ecac2-e716-4822-a119-76e4b6380165-kube-api-access-5s5sj\") pod \"maas-api-e2e-derive-1e283793-6fccff56f4-c5bd8\" (UID: \"c20ecac2-e716-4822-a119-76e4b6380165\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-1e283793-6fccff56f4-c5bd8"
Jul 20 19:29:27.618415 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:29:27.618307    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:29:27.828236 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:29:27.828204    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:29:27.856991 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:29:27.856963    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c20ecac2-e716-4822-a119-76e4b6380165-maas-api-tls\") pod \"maas-api-e2e-derive-1e283793-6fccff56f4-c5bd8\" (UID: \"c20ecac2-e716-4822-a119-76e4b6380165\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-1e283793-6fccff56f4-c5bd8"
Jul 20 19:29:27.859558 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:29:27.859530    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c20ecac2-e716-4822-a119-76e4b6380165-maas-api-tls\") pod \"maas-api-e2e-derive-1e283793-6fccff56f4-c5bd8\" (UID: \"c20ecac2-e716-4822-a119-76e4b6380165\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-1e283793-6fccff56f4-c5bd8"
Jul 20 19:29:27.941672 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:29:27.941606    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:29:28.105531 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:29:28.105499    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-1e283793-6fccff56f4-c5bd8"
Jul 20 19:29:28.241595 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:29:28.241570    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-1e283793-6fccff56f4-c5bd8"]
Jul 20 19:29:28.243950 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:29:28.243923    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc20ecac2_e716_4822_a119_76e4b6380165.slice/crio-75927e2ccd3ac01d98c0a02bed512e9d509789cab02d008987f3f4796342678b WatchSource:0}: Error finding container 75927e2ccd3ac01d98c0a02bed512e9d509789cab02d008987f3f4796342678b: Status 404 returned error can't find the container with id 75927e2ccd3ac01d98c0a02bed512e9d509789cab02d008987f3f4796342678b
Jul 20 19:29:29.165003 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:29:29.164967    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-1e283793-6fccff56f4-c5bd8" event={"ID":"c20ecac2-e716-4822-a119-76e4b6380165","Type":"ContainerStarted","Data":"68cd2300d73df15f808b6ee9d77f03ea9a87b134b089d29f7b0b8dd7eb08c533"}
Jul 20 19:29:29.165500 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:29:29.165017    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-1e283793-6fccff56f4-c5bd8" event={"ID":"c20ecac2-e716-4822-a119-76e4b6380165","Type":"ContainerStarted","Data":"75927e2ccd3ac01d98c0a02bed512e9d509789cab02d008987f3f4796342678b"}
Jul 20 19:29:29.165500 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:29:29.165094    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-1e283793-6fccff56f4-c5bd8"
Jul 20 19:29:29.184769 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:29:29.184728    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-1e283793-6fccff56f4-c5bd8" podStartSLOduration=1.830335477 podStartE2EDuration="2.184713939s" totalImagesPullingTime="354.378462ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:29:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:29:29.184190634 +0000 UTC m=+1728.867718656" watchObservedRunningTime="2026-07-20 19:29:29.184713939 +0000 UTC m=+1728.868241961"
Jul 20 19:29:32.719918 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:29:32.719877    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:29:32.821395 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:29:32.821335    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:29:35.178750 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:29:35.178720    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-1e283793-6fccff56f4-c5bd8"
Jul 20 19:29:49.121489 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:29:49.121456    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:29:49.232568 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:29:49.232538    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:30:02.640404 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:30:02.640371    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-1e283793-6fccff56f4-c5bd8"]
Jul 20 19:30:02.640885 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:30:02.640584    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-1e283793-6fccff56f4-c5bd8" podUID="c20ecac2-e716-4822-a119-76e4b6380165" containerName="maas-api" containerID="cri-o://68cd2300d73df15f808b6ee9d77f03ea9a87b134b089d29f7b0b8dd7eb08c533" gracePeriod=30
Jul 20 19:30:02.734729 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:30:02.734702    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:30:02.883643 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:30:02.883616    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-1e283793-6fccff56f4-c5bd8"
Jul 20 19:30:02.933486 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:30:02.933419    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5s5sj\" (UniqueName: \"kubernetes.io/projected/c20ecac2-e716-4822-a119-76e4b6380165-kube-api-access-5s5sj\") pod \"c20ecac2-e716-4822-a119-76e4b6380165\" (UID: \"c20ecac2-e716-4822-a119-76e4b6380165\") "
Jul 20 19:30:02.933486 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:30:02.933465    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c20ecac2-e716-4822-a119-76e4b6380165-maas-api-tls\") pod \"c20ecac2-e716-4822-a119-76e4b6380165\" (UID: \"c20ecac2-e716-4822-a119-76e4b6380165\") "
Jul 20 19:30:02.933655 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:30:02.933489    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c20ecac2-e716-4822-a119-76e4b6380165-openshift-service-ca\") pod \"c20ecac2-e716-4822-a119-76e4b6380165\" (UID: \"c20ecac2-e716-4822-a119-76e4b6380165\") "
Jul 20 19:30:02.933850 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:30:02.933820    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c20ecac2-e716-4822-a119-76e4b6380165-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c20ecac2-e716-4822-a119-76e4b6380165" (UID: "c20ecac2-e716-4822-a119-76e4b6380165"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 19:30:02.935689 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:30:02.935662    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c20ecac2-e716-4822-a119-76e4b6380165-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c20ecac2-e716-4822-a119-76e4b6380165" (UID: "c20ecac2-e716-4822-a119-76e4b6380165"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 19:30:02.935774 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:30:02.935663    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c20ecac2-e716-4822-a119-76e4b6380165-kube-api-access-5s5sj" (OuterVolumeSpecName: "kube-api-access-5s5sj") pod "c20ecac2-e716-4822-a119-76e4b6380165" (UID: "c20ecac2-e716-4822-a119-76e4b6380165"). InnerVolumeSpecName "kube-api-access-5s5sj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:30:03.034239 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:30:03.034213    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5s5sj\" (UniqueName: \"kubernetes.io/projected/c20ecac2-e716-4822-a119-76e4b6380165-kube-api-access-5s5sj\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\""
Jul 20 19:30:03.034239 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:30:03.034238    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c20ecac2-e716-4822-a119-76e4b6380165-maas-api-tls\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\""
Jul 20 19:30:03.034393 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:30:03.034247    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c20ecac2-e716-4822-a119-76e4b6380165-openshift-service-ca\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\""
Jul 20 19:30:03.310364 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:30:03.310320    2563 generic.go:356] "Generic (PLEG): container finished" podID="c20ecac2-e716-4822-a119-76e4b6380165" containerID="68cd2300d73df15f808b6ee9d77f03ea9a87b134b089d29f7b0b8dd7eb08c533" exitCode=0
Jul 20 19:30:03.310509 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:30:03.310387    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-1e283793-6fccff56f4-c5bd8"
Jul 20 19:30:03.310509 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:30:03.310400    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-1e283793-6fccff56f4-c5bd8" event={"ID":"c20ecac2-e716-4822-a119-76e4b6380165","Type":"ContainerDied","Data":"68cd2300d73df15f808b6ee9d77f03ea9a87b134b089d29f7b0b8dd7eb08c533"}
Jul 20 19:30:03.310509 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:30:03.310454    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-1e283793-6fccff56f4-c5bd8" event={"ID":"c20ecac2-e716-4822-a119-76e4b6380165","Type":"ContainerDied","Data":"75927e2ccd3ac01d98c0a02bed512e9d509789cab02d008987f3f4796342678b"}
Jul 20 19:30:03.310509 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:30:03.310476    2563 scope.go:117] "RemoveContainer" containerID="68cd2300d73df15f808b6ee9d77f03ea9a87b134b089d29f7b0b8dd7eb08c533"
Jul 20 19:30:03.318971 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:30:03.318953    2563 scope.go:117] "RemoveContainer" containerID="68cd2300d73df15f808b6ee9d77f03ea9a87b134b089d29f7b0b8dd7eb08c533"
Jul 20 19:30:03.319207 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:30:03.319191    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"68cd2300d73df15f808b6ee9d77f03ea9a87b134b089d29f7b0b8dd7eb08c533\": container with ID starting with 68cd2300d73df15f808b6ee9d77f03ea9a87b134b089d29f7b0b8dd7eb08c533 not found: ID does not exist" containerID="68cd2300d73df15f808b6ee9d77f03ea9a87b134b089d29f7b0b8dd7eb08c533"
Jul 20 19:30:03.319260 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:30:03.319215    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"68cd2300d73df15f808b6ee9d77f03ea9a87b134b089d29f7b0b8dd7eb08c533"} err="failed to get container status \"68cd2300d73df15f808b6ee9d77f03ea9a87b134b089d29f7b0b8dd7eb08c533\": rpc error: code = NotFound desc = could not find container \"68cd2300d73df15f808b6ee9d77f03ea9a87b134b089d29f7b0b8dd7eb08c533\": container with ID starting with 68cd2300d73df15f808b6ee9d77f03ea9a87b134b089d29f7b0b8dd7eb08c533 not found: ID does not exist"
Jul 20 19:30:03.335331 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:30:03.335305    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-1e283793-6fccff56f4-c5bd8"]
Jul 20 19:30:03.341832 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:30:03.341810    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-1e283793-6fccff56f4-c5bd8"]
Jul 20 19:30:04.892383 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:30:04.892333    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c20ecac2-e716-4822-a119-76e4b6380165" path="/var/lib/kubelet/pods/c20ecac2-e716-4822-a119-76e4b6380165/volumes"
Jul 20 19:30:07.089289 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:30:07.089248    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:30:07.275008 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:30:07.274978    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:30:07.532162 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:30:07.532121    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:30:08.046403 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:30:08.046364    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:30:08.142309 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:30:08.142279    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:30:08.245094 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:30:08.245065    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:30:09.854025 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:30:09.853993    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:30:16.897030 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:30:16.896991    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:30:17.006801 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:30:17.006752    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:30:17.126408 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:30:17.126333    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:30:17.251433 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:30:17.251406    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:30:17.717457 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:30:17.717419    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:30:43.685299 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:30:43.685261    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:30:50.075780 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:30:50.075749    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:30:50.176215 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:30:50.176175    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:30:50.274663 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:30:50.274634    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:31:06.214340 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:31:06.214306    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:31:12.051632 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:31:12.051583    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:31:12.190608 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:31:12.190553    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:31:12.293934 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:31:12.293901    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:31:22.789607 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:31:22.789575    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:31:23.663371 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:31:23.663328    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:31:30.516808 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:31:30.516765    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:31:30.625741 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:31:30.625708    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:31:30.727421 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:31:30.727388    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:31:30.823158 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:31:30.823080    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:31:31.658828 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:31:31.658759    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:31:31.783230 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:31:31.783201    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:31:31.902726 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:31:31.902675    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:31:33.579118 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:31:33.579088    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:31:40.030128 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:31:40.030091    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:31:40.130673 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:31:40.130626    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:31:40.776294 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:31:40.776264    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:31:47.153251 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:31:47.153219    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:31:47.255751 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:31:47.255720    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:31:47.405332 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:31:47.405260    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:31:47.761268 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:31:47.761233    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:31:48.057148 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:31:48.057026    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:31:50.563085 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:31:50.563053    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:31:50.658302 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:31:50.658276    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-088e4681-f4845465b-5trbc"]
Jul 20 19:31:50.658645 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:31:50.658632    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c20ecac2-e716-4822-a119-76e4b6380165" containerName="maas-api"
Jul 20 19:31:50.658708 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:31:50.658649    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c20ecac2-e716-4822-a119-76e4b6380165" containerName="maas-api"
Jul 20 19:31:50.658744 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:31:50.658717    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="c20ecac2-e716-4822-a119-76e4b6380165" containerName="maas-api"
Jul 20 19:31:50.661685 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:31:50.661670    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-088e4681-f4845465b-5trbc"
Jul 20 19:31:50.666295 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:31:50.666273    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-088e4681-serving-cert\""
Jul 20 19:31:50.672952 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:31:50.672928    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-088e4681-f4845465b-5trbc"]
Jul 20 19:31:50.679143 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:31:50.679118    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:31:50.742846 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:31:50.742821    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/37c738ff-437c-44ef-a2f4-516e085c8c17-maas-api-tls\") pod \"maas-api-e2e-mt-088e4681-f4845465b-5trbc\" (UID: \"37c738ff-437c-44ef-a2f4-516e085c8c17\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-088e4681-f4845465b-5trbc"
Jul 20 19:31:50.742993 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:31:50.742862    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bz8zj\" (UniqueName: \"kubernetes.io/projected/37c738ff-437c-44ef-a2f4-516e085c8c17-kube-api-access-bz8zj\") pod \"maas-api-e2e-mt-088e4681-f4845465b-5trbc\" (UID: \"37c738ff-437c-44ef-a2f4-516e085c8c17\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-088e4681-f4845465b-5trbc"
Jul 20 19:31:50.742993 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:31:50.742895    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/37c738ff-437c-44ef-a2f4-516e085c8c17-openshift-service-ca\") pod \"maas-api-e2e-mt-088e4681-f4845465b-5trbc\" (UID: \"37c738ff-437c-44ef-a2f4-516e085c8c17\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-088e4681-f4845465b-5trbc"
Jul 20 19:31:50.765180 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:31:50.765153    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:31:50.843603 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:31:50.843526    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/37c738ff-437c-44ef-a2f4-516e085c8c17-openshift-service-ca\") pod \"maas-api-e2e-mt-088e4681-f4845465b-5trbc\" (UID: \"37c738ff-437c-44ef-a2f4-516e085c8c17\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-088e4681-f4845465b-5trbc"
Jul 20 19:31:50.843750 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:31:50.843606    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/37c738ff-437c-44ef-a2f4-516e085c8c17-maas-api-tls\") pod \"maas-api-e2e-mt-088e4681-f4845465b-5trbc\" (UID: \"37c738ff-437c-44ef-a2f4-516e085c8c17\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-088e4681-f4845465b-5trbc"
Jul 20 19:31:50.843750 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:31:50.843640    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bz8zj\" (UniqueName: \"kubernetes.io/projected/37c738ff-437c-44ef-a2f4-516e085c8c17-kube-api-access-bz8zj\") pod \"maas-api-e2e-mt-088e4681-f4845465b-5trbc\" (UID: \"37c738ff-437c-44ef-a2f4-516e085c8c17\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-088e4681-f4845465b-5trbc"
Jul 20 19:31:50.844139 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:31:50.844120    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/37c738ff-437c-44ef-a2f4-516e085c8c17-openshift-service-ca\") pod \"maas-api-e2e-mt-088e4681-f4845465b-5trbc\" (UID: \"37c738ff-437c-44ef-a2f4-516e085c8c17\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-088e4681-f4845465b-5trbc"
Jul 20 19:31:50.846126 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:31:50.846103    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/37c738ff-437c-44ef-a2f4-516e085c8c17-maas-api-tls\") pod \"maas-api-e2e-mt-088e4681-f4845465b-5trbc\" (UID: \"37c738ff-437c-44ef-a2f4-516e085c8c17\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-088e4681-f4845465b-5trbc"
Jul 20 19:31:50.852967 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:31:50.852937    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bz8zj\" (UniqueName: \"kubernetes.io/projected/37c738ff-437c-44ef-a2f4-516e085c8c17-kube-api-access-bz8zj\") pod \"maas-api-e2e-mt-088e4681-f4845465b-5trbc\" (UID: \"37c738ff-437c-44ef-a2f4-516e085c8c17\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-088e4681-f4845465b-5trbc"
Jul 20 19:31:50.867564 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:31:50.867533    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:31:50.971986 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:31:50.971953    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-088e4681-f4845465b-5trbc"
Jul 20 19:31:51.118582 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:31:51.118561    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-088e4681-f4845465b-5trbc"]
Jul 20 19:31:51.120963 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:31:51.120931    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37c738ff_437c_44ef_a2f4_516e085c8c17.slice/crio-96d0e94ad8ef89650ea0b36793c2f1dbf95c7cc97de34f70adbeab64a6fc3bfc WatchSource:0}: Error finding container 96d0e94ad8ef89650ea0b36793c2f1dbf95c7cc97de34f70adbeab64a6fc3bfc: Status 404 returned error can't find the container with id 96d0e94ad8ef89650ea0b36793c2f1dbf95c7cc97de34f70adbeab64a6fc3bfc
Jul 20 19:31:51.410232 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:31:51.410120    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:31:51.522445 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:31:51.522395    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:31:51.780177 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:31:51.780138    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-088e4681-f4845465b-5trbc" event={"ID":"37c738ff-437c-44ef-a2f4-516e085c8c17","Type":"ContainerStarted","Data":"f20a935aecdfbe36a13b4ab0976b98152f743edc92f02686da3cb0a8c604247d"}
Jul 20 19:31:51.780563 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:31:51.780229    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-088e4681-f4845465b-5trbc" event={"ID":"37c738ff-437c-44ef-a2f4-516e085c8c17","Type":"ContainerStarted","Data":"96d0e94ad8ef89650ea0b36793c2f1dbf95c7cc97de34f70adbeab64a6fc3bfc"}
Jul 20 19:31:51.780563 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:31:51.780255    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-088e4681-f4845465b-5trbc"
Jul 20 19:31:51.803841 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:31:51.803791    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-088e4681-f4845465b-5trbc" podStartSLOduration=1.332135959 podStartE2EDuration="1.803776435s" totalImagesPullingTime="471.640476ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:31:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:31:51.802075352 +0000 UTC m=+1871.485603377" watchObservedRunningTime="2026-07-20 19:31:51.803776435 +0000 UTC m=+1871.487304457"
Jul 20 19:31:55.054836 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:31:55.054764    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:31:55.722487 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:31:55.722453    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:31:55.816295 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:31:55.816263    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:31:56.167647 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:31:56.167545    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:31:57.790866 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:31:57.790837    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-088e4681-f4845465b-5trbc"
Jul 20 19:32:01.897421 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:32:01.897329    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:32:01.997857 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:32:01.997817    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:32:10.515543 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:32:10.515503    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:32:10.579272 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:32:10.579237    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:32:12.766512 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:32:12.766478    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-088e4681-f4845465b-5trbc"]
Jul 20 19:32:12.766967 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:32:12.766720    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-088e4681-f4845465b-5trbc" podUID="37c738ff-437c-44ef-a2f4-516e085c8c17" containerName="maas-api" containerID="cri-o://f20a935aecdfbe36a13b4ab0976b98152f743edc92f02686da3cb0a8c604247d" gracePeriod=30
Jul 20 19:32:12.784982 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:32:12.784953    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-mt-088e4681-f4845465b-5trbc" podUID="37c738ff-437c-44ef-a2f4-516e085c8c17" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jul 20 19:32:12.798152 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:32:12.798128    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:32:13.011386 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:32:13.011336    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-088e4681-f4845465b-5trbc"
Jul 20 19:32:13.136759 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:32:13.136697    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bz8zj\" (UniqueName: \"kubernetes.io/projected/37c738ff-437c-44ef-a2f4-516e085c8c17-kube-api-access-bz8zj\") pod \"37c738ff-437c-44ef-a2f4-516e085c8c17\" (UID: \"37c738ff-437c-44ef-a2f4-516e085c8c17\") "
Jul 20 19:32:13.136759 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:32:13.136730    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/37c738ff-437c-44ef-a2f4-516e085c8c17-maas-api-tls\") pod \"37c738ff-437c-44ef-a2f4-516e085c8c17\" (UID: \"37c738ff-437c-44ef-a2f4-516e085c8c17\") "
Jul 20 19:32:13.136970 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:32:13.136838    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/37c738ff-437c-44ef-a2f4-516e085c8c17-openshift-service-ca\") pod \"37c738ff-437c-44ef-a2f4-516e085c8c17\" (UID: \"37c738ff-437c-44ef-a2f4-516e085c8c17\") "
Jul 20 19:32:13.137208 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:32:13.137180    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37c738ff-437c-44ef-a2f4-516e085c8c17-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "37c738ff-437c-44ef-a2f4-516e085c8c17" (UID: "37c738ff-437c-44ef-a2f4-516e085c8c17"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 19:32:13.139040 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:32:13.139018    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37c738ff-437c-44ef-a2f4-516e085c8c17-kube-api-access-bz8zj" (OuterVolumeSpecName: "kube-api-access-bz8zj") pod "37c738ff-437c-44ef-a2f4-516e085c8c17" (UID: "37c738ff-437c-44ef-a2f4-516e085c8c17"). InnerVolumeSpecName "kube-api-access-bz8zj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:32:13.139040 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:32:13.139024    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/37c738ff-437c-44ef-a2f4-516e085c8c17-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "37c738ff-437c-44ef-a2f4-516e085c8c17" (UID: "37c738ff-437c-44ef-a2f4-516e085c8c17"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 19:32:13.238515 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:32:13.238486    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/37c738ff-437c-44ef-a2f4-516e085c8c17-openshift-service-ca\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\""
Jul 20 19:32:13.238515 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:32:13.238514    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bz8zj\" (UniqueName: \"kubernetes.io/projected/37c738ff-437c-44ef-a2f4-516e085c8c17-kube-api-access-bz8zj\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\""
Jul 20 19:32:13.238671 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:32:13.238525    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/37c738ff-437c-44ef-a2f4-516e085c8c17-maas-api-tls\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\""
Jul 20 19:32:13.879413 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:32:13.879377    2563 generic.go:356] "Generic (PLEG): container finished" podID="37c738ff-437c-44ef-a2f4-516e085c8c17" containerID="f20a935aecdfbe36a13b4ab0976b98152f743edc92f02686da3cb0a8c604247d" exitCode=0
Jul 20 19:32:13.879910 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:32:13.879421    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-088e4681-f4845465b-5trbc"
Jul 20 19:32:13.879910 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:32:13.879449    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-088e4681-f4845465b-5trbc" event={"ID":"37c738ff-437c-44ef-a2f4-516e085c8c17","Type":"ContainerDied","Data":"f20a935aecdfbe36a13b4ab0976b98152f743edc92f02686da3cb0a8c604247d"}
Jul 20 19:32:13.879910 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:32:13.879489    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-088e4681-f4845465b-5trbc" event={"ID":"37c738ff-437c-44ef-a2f4-516e085c8c17","Type":"ContainerDied","Data":"96d0e94ad8ef89650ea0b36793c2f1dbf95c7cc97de34f70adbeab64a6fc3bfc"}
Jul 20 19:32:13.879910 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:32:13.879510    2563 scope.go:117] "RemoveContainer" containerID="f20a935aecdfbe36a13b4ab0976b98152f743edc92f02686da3cb0a8c604247d"
Jul 20 19:32:13.888619 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:32:13.888594    2563 scope.go:117] "RemoveContainer" containerID="f20a935aecdfbe36a13b4ab0976b98152f743edc92f02686da3cb0a8c604247d"
Jul 20 19:32:13.888885 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:32:13.888862    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f20a935aecdfbe36a13b4ab0976b98152f743edc92f02686da3cb0a8c604247d\": container with ID starting with f20a935aecdfbe36a13b4ab0976b98152f743edc92f02686da3cb0a8c604247d not found: ID does not exist" containerID="f20a935aecdfbe36a13b4ab0976b98152f743edc92f02686da3cb0a8c604247d"
Jul 20 19:32:13.888957 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:32:13.888895    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f20a935aecdfbe36a13b4ab0976b98152f743edc92f02686da3cb0a8c604247d"} err="failed to get container status \"f20a935aecdfbe36a13b4ab0976b98152f743edc92f02686da3cb0a8c604247d\": rpc error: code = NotFound desc = could not find container \"f20a935aecdfbe36a13b4ab0976b98152f743edc92f02686da3cb0a8c604247d\": container with ID starting with f20a935aecdfbe36a13b4ab0976b98152f743edc92f02686da3cb0a8c604247d not found: ID does not exist"
Jul 20 19:32:13.901126 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:32:13.901098    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-088e4681-f4845465b-5trbc"]
Jul 20 19:32:13.905403 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:32:13.905382    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-088e4681-f4845465b-5trbc"]
Jul 20 19:32:14.890744 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:32:14.890709    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="37c738ff-437c-44ef-a2f4-516e085c8c17" path="/var/lib/kubelet/pods/37c738ff-437c-44ef-a2f4-516e085c8c17/volumes"
Jul 20 19:32:17.432674 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:32:17.432629    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:32:17.888309 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:32:17.888270    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:32:23.903629 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:32:23.903582    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:32:23.962886 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:32:23.962832    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:32:24.194606 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:32:24.194519    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:32:24.416989 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:32:24.416953    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:32:24.580958 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:32:24.580926    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:32:24.678247 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:32:24.678218    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:32:24.788669 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:32:24.788627    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:32:30.652035 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:32:30.651995    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:32:30.756746 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:32:30.756712    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:32:31.222967 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:32:31.222930    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:32:31.295418 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:32:31.295389    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:32:33.046164 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:32:33.046130    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:32:36.881801 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:32:36.881766    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:32:36.981150 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:32:36.981124    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:32:43.794495 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:32:43.794446    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:32:44.163885 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:32:44.163771    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:32:44.754138 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:32:44.754105    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:32:46.911660 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:32:46.911619    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:32:47.074243 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:32:47.074207    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:32:47.083187 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:32:47.083162    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-18f84c7f-56c9f9b885-m4pqg"]
Jul 20 19:32:47.083504 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:32:47.083492    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37c738ff-437c-44ef-a2f4-516e085c8c17" containerName="maas-api"
Jul 20 19:32:47.083550 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:32:47.083506    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="37c738ff-437c-44ef-a2f4-516e085c8c17" containerName="maas-api"
Jul 20 19:32:47.083589 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:32:47.083571    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="37c738ff-437c-44ef-a2f4-516e085c8c17" containerName="maas-api"
Jul 20 19:32:47.087515 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:32:47.087498    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-18f84c7f-56c9f9b885-m4pqg"
Jul 20 19:32:47.090924 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:32:47.090896    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-18f84c7f-serving-cert\""
Jul 20 19:32:47.118044 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:32:47.118020    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-18f84c7f-56c9f9b885-m4pqg"]
Jul 20 19:32:47.201406 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:32:47.201373    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:32:47.215601 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:32:47.215580    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5d6bd38f-6a7e-4112-8112-c27ffba93ab3-maas-api-tls\") pod \"maas-api-e2e-mt-18f84c7f-56c9f9b885-m4pqg\" (UID: \"5d6bd38f-6a7e-4112-8112-c27ffba93ab3\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-18f84c7f-56c9f9b885-m4pqg"
Jul 20 19:32:47.215668 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:32:47.215642    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5d6bd38f-6a7e-4112-8112-c27ffba93ab3-openshift-service-ca\") pod \"maas-api-e2e-mt-18f84c7f-56c9f9b885-m4pqg\" (UID: \"5d6bd38f-6a7e-4112-8112-c27ffba93ab3\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-18f84c7f-56c9f9b885-m4pqg"
Jul 20 19:32:47.215715 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:32:47.215684    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49md6\" (UniqueName: \"kubernetes.io/projected/5d6bd38f-6a7e-4112-8112-c27ffba93ab3-kube-api-access-49md6\") pod \"maas-api-e2e-mt-18f84c7f-56c9f9b885-m4pqg\" (UID: \"5d6bd38f-6a7e-4112-8112-c27ffba93ab3\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-18f84c7f-56c9f9b885-m4pqg"
Jul 20 19:32:47.316666 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:32:47.316634    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5d6bd38f-6a7e-4112-8112-c27ffba93ab3-openshift-service-ca\") pod \"maas-api-e2e-mt-18f84c7f-56c9f9b885-m4pqg\" (UID: \"5d6bd38f-6a7e-4112-8112-c27ffba93ab3\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-18f84c7f-56c9f9b885-m4pqg"
Jul 20 19:32:47.316780 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:32:47.316681    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49md6\" (UniqueName: \"kubernetes.io/projected/5d6bd38f-6a7e-4112-8112-c27ffba93ab3-kube-api-access-49md6\") pod \"maas-api-e2e-mt-18f84c7f-56c9f9b885-m4pqg\" (UID: \"5d6bd38f-6a7e-4112-8112-c27ffba93ab3\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-18f84c7f-56c9f9b885-m4pqg"
Jul 20 19:32:47.316780 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:32:47.316740    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5d6bd38f-6a7e-4112-8112-c27ffba93ab3-maas-api-tls\") pod \"maas-api-e2e-mt-18f84c7f-56c9f9b885-m4pqg\" (UID: \"5d6bd38f-6a7e-4112-8112-c27ffba93ab3\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-18f84c7f-56c9f9b885-m4pqg"
Jul 20 19:32:47.317198 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:32:47.317176    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5d6bd38f-6a7e-4112-8112-c27ffba93ab3-openshift-service-ca\") pod \"maas-api-e2e-mt-18f84c7f-56c9f9b885-m4pqg\" (UID: \"5d6bd38f-6a7e-4112-8112-c27ffba93ab3\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-18f84c7f-56c9f9b885-m4pqg"
Jul 20 19:32:47.319243 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:32:47.319214    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5d6bd38f-6a7e-4112-8112-c27ffba93ab3-maas-api-tls\") pod \"maas-api-e2e-mt-18f84c7f-56c9f9b885-m4pqg\" (UID: \"5d6bd38f-6a7e-4112-8112-c27ffba93ab3\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-18f84c7f-56c9f9b885-m4pqg"
Jul 20 19:32:47.324767 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:32:47.324745    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-49md6\" (UniqueName: \"kubernetes.io/projected/5d6bd38f-6a7e-4112-8112-c27ffba93ab3-kube-api-access-49md6\") pod \"maas-api-e2e-mt-18f84c7f-56c9f9b885-m4pqg\" (UID: \"5d6bd38f-6a7e-4112-8112-c27ffba93ab3\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-18f84c7f-56c9f9b885-m4pqg"
Jul 20 19:32:47.386773 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:32:47.386736    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:32:47.399829 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:32:47.399810    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-18f84c7f-56c9f9b885-m4pqg"
Jul 20 19:32:47.535846 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:32:47.535808    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-18f84c7f-56c9f9b885-m4pqg"]
Jul 20 19:32:47.538867 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:32:47.538842    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d6bd38f_6a7e_4112_8112_c27ffba93ab3.slice/crio-aa23b7034dd0bca0275e8d2fed26bcf361e000e0c74504ee88cb61ae20ab28d9 WatchSource:0}: Error finding container aa23b7034dd0bca0275e8d2fed26bcf361e000e0c74504ee88cb61ae20ab28d9: Status 404 returned error can't find the container with id aa23b7034dd0bca0275e8d2fed26bcf361e000e0c74504ee88cb61ae20ab28d9
Jul 20 19:32:47.540471 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:32:47.540455    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 19:32:47.769926 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:32:47.769841    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:32:47.872298 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:32:47.872267    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:32:48.017655 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:32:48.017621    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-18f84c7f-56c9f9b885-m4pqg" event={"ID":"5d6bd38f-6a7e-4112-8112-c27ffba93ab3","Type":"ContainerStarted","Data":"aa23b7034dd0bca0275e8d2fed26bcf361e000e0c74504ee88cb61ae20ab28d9"}
Jul 20 19:32:49.022828 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:32:49.022793    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-18f84c7f-56c9f9b885-m4pqg" event={"ID":"5d6bd38f-6a7e-4112-8112-c27ffba93ab3","Type":"ContainerStarted","Data":"820cc282a50bab1db0b24bdb40efeb18396519babd9788e5689fa9f738490d79"}
Jul 20 19:32:49.023283 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:32:49.022905    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-18f84c7f-56c9f9b885-m4pqg"
Jul 20 19:32:49.043403 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:32:49.043338    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-18f84c7f-56c9f9b885-m4pqg" podStartSLOduration=1.444212722 podStartE2EDuration="2.043325132s" totalImagesPullingTime="599.11241ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:32:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:32:49.041415592 +0000 UTC m=+1928.724943613" watchObservedRunningTime="2026-07-20 19:32:49.043325132 +0000 UTC m=+1928.726853155"
Jul 20 19:32:51.307804 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:32:51.307774    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:32:55.032131 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:32:55.032099    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-18f84c7f-56c9f9b885-m4pqg"
Jul 20 19:32:56.052615 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:32:56.052575    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:33:12.037810 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:33:12.037774    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:33:35.308477 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:33:35.308401    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-18f84c7f-56c9f9b885-m4pqg"]
Jul 20 19:33:35.308986 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:33:35.308598    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-18f84c7f-56c9f9b885-m4pqg" podUID="5d6bd38f-6a7e-4112-8112-c27ffba93ab3" containerName="maas-api" containerID="cri-o://820cc282a50bab1db0b24bdb40efeb18396519babd9788e5689fa9f738490d79" gracePeriod=30
Jul 20 19:33:35.363560 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:33:35.363530    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:33:35.558769 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:33:35.558709    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-18f84c7f-56c9f9b885-m4pqg"
Jul 20 19:33:35.626154 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:33:35.626125    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5d6bd38f-6a7e-4112-8112-c27ffba93ab3-openshift-service-ca\") pod \"5d6bd38f-6a7e-4112-8112-c27ffba93ab3\" (UID: \"5d6bd38f-6a7e-4112-8112-c27ffba93ab3\") "
Jul 20 19:33:35.626287 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:33:35.626221    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5d6bd38f-6a7e-4112-8112-c27ffba93ab3-maas-api-tls\") pod \"5d6bd38f-6a7e-4112-8112-c27ffba93ab3\" (UID: \"5d6bd38f-6a7e-4112-8112-c27ffba93ab3\") "
Jul 20 19:33:35.626287 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:33:35.626242    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-49md6\" (UniqueName: \"kubernetes.io/projected/5d6bd38f-6a7e-4112-8112-c27ffba93ab3-kube-api-access-49md6\") pod \"5d6bd38f-6a7e-4112-8112-c27ffba93ab3\" (UID: \"5d6bd38f-6a7e-4112-8112-c27ffba93ab3\") "
Jul 20 19:33:35.626492 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:33:35.626472    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5d6bd38f-6a7e-4112-8112-c27ffba93ab3-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5d6bd38f-6a7e-4112-8112-c27ffba93ab3" (UID: "5d6bd38f-6a7e-4112-8112-c27ffba93ab3"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 19:33:35.628365 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:33:35.628317    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5d6bd38f-6a7e-4112-8112-c27ffba93ab3-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5d6bd38f-6a7e-4112-8112-c27ffba93ab3" (UID: "5d6bd38f-6a7e-4112-8112-c27ffba93ab3"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 19:33:35.628468 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:33:35.628451    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d6bd38f-6a7e-4112-8112-c27ffba93ab3-kube-api-access-49md6" (OuterVolumeSpecName: "kube-api-access-49md6") pod "5d6bd38f-6a7e-4112-8112-c27ffba93ab3" (UID: "5d6bd38f-6a7e-4112-8112-c27ffba93ab3"). InnerVolumeSpecName "kube-api-access-49md6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:33:35.727540 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:33:35.727506    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5d6bd38f-6a7e-4112-8112-c27ffba93ab3-maas-api-tls\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\""
Jul 20 19:33:35.727540 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:33:35.727536    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-49md6\" (UniqueName: \"kubernetes.io/projected/5d6bd38f-6a7e-4112-8112-c27ffba93ab3-kube-api-access-49md6\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\""
Jul 20 19:33:35.727540 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:33:35.727546    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5d6bd38f-6a7e-4112-8112-c27ffba93ab3-openshift-service-ca\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\""
Jul 20 19:33:36.222061 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:33:36.222025    2563 generic.go:356] "Generic (PLEG): container finished" podID="5d6bd38f-6a7e-4112-8112-c27ffba93ab3" containerID="820cc282a50bab1db0b24bdb40efeb18396519babd9788e5689fa9f738490d79" exitCode=0
Jul 20 19:33:36.222061 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:33:36.222074    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-18f84c7f-56c9f9b885-m4pqg"
Jul 20 19:33:36.222340 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:33:36.222074    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-18f84c7f-56c9f9b885-m4pqg" event={"ID":"5d6bd38f-6a7e-4112-8112-c27ffba93ab3","Type":"ContainerDied","Data":"820cc282a50bab1db0b24bdb40efeb18396519babd9788e5689fa9f738490d79"}
Jul 20 19:33:36.222340 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:33:36.222202    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-18f84c7f-56c9f9b885-m4pqg" event={"ID":"5d6bd38f-6a7e-4112-8112-c27ffba93ab3","Type":"ContainerDied","Data":"aa23b7034dd0bca0275e8d2fed26bcf361e000e0c74504ee88cb61ae20ab28d9"}
Jul 20 19:33:36.222340 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:33:36.222239    2563 scope.go:117] "RemoveContainer" containerID="820cc282a50bab1db0b24bdb40efeb18396519babd9788e5689fa9f738490d79"
Jul 20 19:33:36.230956 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:33:36.230936    2563 scope.go:117] "RemoveContainer" containerID="820cc282a50bab1db0b24bdb40efeb18396519babd9788e5689fa9f738490d79"
Jul 20 19:33:36.231216 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:33:36.231199    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"820cc282a50bab1db0b24bdb40efeb18396519babd9788e5689fa9f738490d79\": container with ID starting with 820cc282a50bab1db0b24bdb40efeb18396519babd9788e5689fa9f738490d79 not found: ID does not exist" containerID="820cc282a50bab1db0b24bdb40efeb18396519babd9788e5689fa9f738490d79"
Jul 20 19:33:36.231274 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:33:36.231225    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"820cc282a50bab1db0b24bdb40efeb18396519babd9788e5689fa9f738490d79"} err="failed to get container status \"820cc282a50bab1db0b24bdb40efeb18396519babd9788e5689fa9f738490d79\": rpc error: code = NotFound desc = could not find container \"820cc282a50bab1db0b24bdb40efeb18396519babd9788e5689fa9f738490d79\": container with ID starting with 820cc282a50bab1db0b24bdb40efeb18396519babd9788e5689fa9f738490d79 not found: ID does not exist"
Jul 20 19:33:36.242799 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:33:36.242772    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-18f84c7f-56c9f9b885-m4pqg"]
Jul 20 19:33:36.246332 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:33:36.246313    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-18f84c7f-56c9f9b885-m4pqg"]
Jul 20 19:33:36.891688 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:33:36.891654    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5d6bd38f-6a7e-4112-8112-c27ffba93ab3" path="/var/lib/kubelet/pods/5d6bd38f-6a7e-4112-8112-c27ffba93ab3/volumes"
Jul 20 19:33:39.820691 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:33:39.820654    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:33:42.153656 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:33:42.153617    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:33:47.216403 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:33:47.216364    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:34:23.513953 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:34:23.513920    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:34:24.434867 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:34:24.434835    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:34:30.185843 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:34:30.185801    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:34:33.707833 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:34:33.707784    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:34:33.906654 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:34:33.906612    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:34:35.911570 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:34:35.911525    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:34:35.981374 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:34:35.981325    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:34:36.198734 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:34:36.198700    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:34:36.445126 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:34:36.445097    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:34:37.526571 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:34:37.526537    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:34:37.628443 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:34:37.628410    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:34:37.727998 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:34:37.727969    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:34:38.519440 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:34:38.519411    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:34:38.619687 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:34:38.619660    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:34:38.717905 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:34:38.717872    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:34:40.277685 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:34:40.277654    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:34:46.250856 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:34:46.250819    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:34:46.351500 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:34:46.351466    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:34:46.976843 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:34:46.976810    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:34:53.034030 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:34:53.033987    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:34:53.144304 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:34:53.144264    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:34:53.234529 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:34:53.234504    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:35:03.801684 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:35:03.801582    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:35:04.151230 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:35:04.151122    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:35:25.152591 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:35:25.152555    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:35:31.500479 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:35:31.500444    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:35:31.598797 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:35:31.598771    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:35:31.883581 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:35:31.883495    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:35:32.355018 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:35:32.354986    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:35:32.589251 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:35:32.589218    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:35:35.817385 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:35:35.817338    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:35:35.915854 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:35:35.915805    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:35:36.022985 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:35:36.022953    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-bd0ca5-cb6f95c8c-46hxd"]
Jul 20 19:35:36.023267 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:35:36.023256    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d6bd38f-6a7e-4112-8112-c27ffba93ab3" containerName="maas-api"
Jul 20 19:35:36.023312 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:35:36.023269    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d6bd38f-6a7e-4112-8112-c27ffba93ab3" containerName="maas-api"
Jul 20 19:35:36.023377 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:35:36.023327    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d6bd38f-6a7e-4112-8112-c27ffba93ab3" containerName="maas-api"
Jul 20 19:35:36.026222 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:35:36.026198    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-bd0ca5-cb6f95c8c-46hxd"
Jul 20 19:35:36.028969 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:35:36.028952    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-bd0ca5-serving-cert\""
Jul 20 19:35:36.040294 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:35:36.040271    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-bd0ca5-cb6f95c8c-46hxd"]
Jul 20 19:35:36.060996 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:35:36.060963    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2xh6\" (UniqueName: \"kubernetes.io/projected/052523e8-7618-48a3-a5c6-da56d34f91d6-kube-api-access-f2xh6\") pod \"maas-api-e2e-inf-a-bd0ca5-cb6f95c8c-46hxd\" (UID: \"052523e8-7618-48a3-a5c6-da56d34f91d6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-bd0ca5-cb6f95c8c-46hxd"
Jul 20 19:35:36.061116 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:35:36.061099    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/052523e8-7618-48a3-a5c6-da56d34f91d6-maas-api-tls\") pod \"maas-api-e2e-inf-a-bd0ca5-cb6f95c8c-46hxd\" (UID: \"052523e8-7618-48a3-a5c6-da56d34f91d6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-bd0ca5-cb6f95c8c-46hxd"
Jul 20 19:35:36.061165 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:35:36.061131    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/052523e8-7618-48a3-a5c6-da56d34f91d6-openshift-service-ca\") pod \"maas-api-e2e-inf-a-bd0ca5-cb6f95c8c-46hxd\" (UID: \"052523e8-7618-48a3-a5c6-da56d34f91d6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-bd0ca5-cb6f95c8c-46hxd"
Jul 20 19:35:36.072382 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:35:36.072287    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:35:36.162015 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:35:36.161993    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/052523e8-7618-48a3-a5c6-da56d34f91d6-maas-api-tls\") pod \"maas-api-e2e-inf-a-bd0ca5-cb6f95c8c-46hxd\" (UID: \"052523e8-7618-48a3-a5c6-da56d34f91d6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-bd0ca5-cb6f95c8c-46hxd"
Jul 20 19:35:36.162144 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:35:36.162021    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/052523e8-7618-48a3-a5c6-da56d34f91d6-openshift-service-ca\") pod \"maas-api-e2e-inf-a-bd0ca5-cb6f95c8c-46hxd\" (UID: \"052523e8-7618-48a3-a5c6-da56d34f91d6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-bd0ca5-cb6f95c8c-46hxd"
Jul 20 19:35:36.162144 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:35:36.162067    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2xh6\" (UniqueName: \"kubernetes.io/projected/052523e8-7618-48a3-a5c6-da56d34f91d6-kube-api-access-f2xh6\") pod \"maas-api-e2e-inf-a-bd0ca5-cb6f95c8c-46hxd\" (UID: \"052523e8-7618-48a3-a5c6-da56d34f91d6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-bd0ca5-cb6f95c8c-46hxd"
Jul 20 19:35:36.162144 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:35:36.162092    2563 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-bd0ca5-serving-cert: secret "maas-api-e2e-inf-a-bd0ca5-serving-cert" not found
Jul 20 19:35:36.162307 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:35:36.162153    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/052523e8-7618-48a3-a5c6-da56d34f91d6-maas-api-tls podName:052523e8-7618-48a3-a5c6-da56d34f91d6 nodeName:}" failed. No retries permitted until 2026-07-20 19:35:36.662132784 +0000 UTC m=+2096.345660788 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/052523e8-7618-48a3-a5c6-da56d34f91d6-maas-api-tls") pod "maas-api-e2e-inf-a-bd0ca5-cb6f95c8c-46hxd" (UID: "052523e8-7618-48a3-a5c6-da56d34f91d6") : secret "maas-api-e2e-inf-a-bd0ca5-serving-cert" not found
Jul 20 19:35:36.162685 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:35:36.162668    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/052523e8-7618-48a3-a5c6-da56d34f91d6-openshift-service-ca\") pod \"maas-api-e2e-inf-a-bd0ca5-cb6f95c8c-46hxd\" (UID: \"052523e8-7618-48a3-a5c6-da56d34f91d6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-bd0ca5-cb6f95c8c-46hxd"
Jul 20 19:35:36.171901 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:35:36.171885    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2xh6\" (UniqueName: \"kubernetes.io/projected/052523e8-7618-48a3-a5c6-da56d34f91d6-kube-api-access-f2xh6\") pod \"maas-api-e2e-inf-a-bd0ca5-cb6f95c8c-46hxd\" (UID: \"052523e8-7618-48a3-a5c6-da56d34f91d6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-bd0ca5-cb6f95c8c-46hxd"
Jul 20 19:35:36.305724 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:35:36.305703    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:35:36.581179 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:35:36.581153    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:35:36.666374 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:35:36.666322    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/052523e8-7618-48a3-a5c6-da56d34f91d6-maas-api-tls\") pod \"maas-api-e2e-inf-a-bd0ca5-cb6f95c8c-46hxd\" (UID: \"052523e8-7618-48a3-a5c6-da56d34f91d6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-bd0ca5-cb6f95c8c-46hxd"
Jul 20 19:35:36.668798 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:35:36.668779    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/052523e8-7618-48a3-a5c6-da56d34f91d6-maas-api-tls\") pod \"maas-api-e2e-inf-a-bd0ca5-cb6f95c8c-46hxd\" (UID: \"052523e8-7618-48a3-a5c6-da56d34f91d6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-bd0ca5-cb6f95c8c-46hxd"
Jul 20 19:35:36.681312 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:35:36.681282    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:35:36.936856 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:35:36.936777    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-bd0ca5-cb6f95c8c-46hxd"
Jul 20 19:35:37.067399 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:35:37.067375    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-bd0ca5-cb6f95c8c-46hxd"]
Jul 20 19:35:37.069781 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:35:37.069752    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod052523e8_7618_48a3_a5c6_da56d34f91d6.slice/crio-116e4b7ca4ee7fd5184810e9803d11729baf85a4c3f64afb755be8050c37fe0d WatchSource:0}: Error finding container 116e4b7ca4ee7fd5184810e9803d11729baf85a4c3f64afb755be8050c37fe0d: Status 404 returned error can't find the container with id 116e4b7ca4ee7fd5184810e9803d11729baf85a4c3f64afb755be8050c37fe0d
Jul 20 19:35:37.731164 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:35:37.731132    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-bd0ca5-cb6f95c8c-46hxd" event={"ID":"052523e8-7618-48a3-a5c6-da56d34f91d6","Type":"ContainerStarted","Data":"f8fb865eb7b994f903a018b0446894ca3beaa3f2ee79d89e6cf6ca4540b6f916"}
Jul 20 19:35:37.731298 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:35:37.731179    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-bd0ca5-cb6f95c8c-46hxd" event={"ID":"052523e8-7618-48a3-a5c6-da56d34f91d6","Type":"ContainerStarted","Data":"116e4b7ca4ee7fd5184810e9803d11729baf85a4c3f64afb755be8050c37fe0d"}
Jul 20 19:35:37.731298 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:35:37.731267    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-bd0ca5-cb6f95c8c-46hxd"
Jul 20 19:35:37.749659 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:35:37.749623    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-bd0ca5-cb6f95c8c-46hxd" podStartSLOduration=1.212531408 podStartE2EDuration="1.749612125s" totalImagesPullingTime="537.080717ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:35:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:35:37.748678476 +0000 UTC m=+2097.432206519" watchObservedRunningTime="2026-07-20 19:35:37.749612125 +0000 UTC m=+2097.433140147"
Jul 20 19:35:40.345502 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:35:40.345467    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:35:40.717493 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:35:40.717462    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:35:41.053850 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:35:41.053770    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:35:41.490234 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:35:41.490198    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:35:43.741613 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:35:43.741588    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-bd0ca5-cb6f95c8c-46hxd"
Jul 20 19:35:43.818035 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:35:43.817999    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:35:43.918225 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:35:43.918190    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:35:44.182566 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:35:44.182493    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:35:44.704371 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:35:44.704316    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:35:44.806507 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:35:44.806478    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:35:44.906329 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:35:44.906293    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:35:48.295643 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:35:48.295610    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:35:57.662984 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:35:57.662946    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:35:57.768872 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:35:57.768839    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:36:04.601821 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:36:04.601784    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:36:05.617507 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:36:05.617468    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:36:05.718761 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:36:05.718728    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:36:36.313951 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:36:36.313869    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:36:51.635471 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:36:51.635432    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:36:51.689466 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:36:51.689434    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:37:19.140911 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:37:19.140873    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:37:20.097907 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:37:20.097878    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:37:20.742227 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:37:20.742190    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:37:20.845723 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:37:20.845690    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:37:30.685218 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:37:30.685184    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-bd0ca5-cb6f95c8c-46hxd"]
Jul 20 19:37:30.685629 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:37:30.685420    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-bd0ca5-cb6f95c8c-46hxd" podUID="052523e8-7618-48a3-a5c6-da56d34f91d6" containerName="maas-api" containerID="cri-o://f8fb865eb7b994f903a018b0446894ca3beaa3f2ee79d89e6cf6ca4540b6f916" gracePeriod=30
Jul 20 19:37:30.707462 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:37:30.707428    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:37:30.929096 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:37:30.929069    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-bd0ca5-cb6f95c8c-46hxd"
Jul 20 19:37:31.034839 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:37:31.034808    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/052523e8-7618-48a3-a5c6-da56d34f91d6-maas-api-tls\") pod \"052523e8-7618-48a3-a5c6-da56d34f91d6\" (UID: \"052523e8-7618-48a3-a5c6-da56d34f91d6\") "
Jul 20 19:37:31.034985 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:37:31.034893    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f2xh6\" (UniqueName: \"kubernetes.io/projected/052523e8-7618-48a3-a5c6-da56d34f91d6-kube-api-access-f2xh6\") pod \"052523e8-7618-48a3-a5c6-da56d34f91d6\" (UID: \"052523e8-7618-48a3-a5c6-da56d34f91d6\") "
Jul 20 19:37:31.034985 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:37:31.034920    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/052523e8-7618-48a3-a5c6-da56d34f91d6-openshift-service-ca\") pod \"052523e8-7618-48a3-a5c6-da56d34f91d6\" (UID: \"052523e8-7618-48a3-a5c6-da56d34f91d6\") "
Jul 20 19:37:31.035381 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:37:31.035331    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/052523e8-7618-48a3-a5c6-da56d34f91d6-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "052523e8-7618-48a3-a5c6-da56d34f91d6" (UID: "052523e8-7618-48a3-a5c6-da56d34f91d6"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 19:37:31.037136 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:37:31.037106    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/052523e8-7618-48a3-a5c6-da56d34f91d6-kube-api-access-f2xh6" (OuterVolumeSpecName: "kube-api-access-f2xh6") pod "052523e8-7618-48a3-a5c6-da56d34f91d6" (UID: "052523e8-7618-48a3-a5c6-da56d34f91d6"). InnerVolumeSpecName "kube-api-access-f2xh6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:37:31.037239 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:37:31.037132    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/052523e8-7618-48a3-a5c6-da56d34f91d6-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "052523e8-7618-48a3-a5c6-da56d34f91d6" (UID: "052523e8-7618-48a3-a5c6-da56d34f91d6"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 19:37:31.135876 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:37:31.135849    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/052523e8-7618-48a3-a5c6-da56d34f91d6-maas-api-tls\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\""
Jul 20 19:37:31.135876 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:37:31.135876    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f2xh6\" (UniqueName: \"kubernetes.io/projected/052523e8-7618-48a3-a5c6-da56d34f91d6-kube-api-access-f2xh6\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\""
Jul 20 19:37:31.136079 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:37:31.135888    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/052523e8-7618-48a3-a5c6-da56d34f91d6-openshift-service-ca\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\""
Jul 20 19:37:31.221018 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:37:31.220978    2563 generic.go:356] "Generic (PLEG): container finished" podID="052523e8-7618-48a3-a5c6-da56d34f91d6" containerID="f8fb865eb7b994f903a018b0446894ca3beaa3f2ee79d89e6cf6ca4540b6f916" exitCode=0
Jul 20 19:37:31.221173 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:37:31.221024    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-bd0ca5-cb6f95c8c-46hxd"
Jul 20 19:37:31.221173 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:37:31.221055    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-bd0ca5-cb6f95c8c-46hxd" event={"ID":"052523e8-7618-48a3-a5c6-da56d34f91d6","Type":"ContainerDied","Data":"f8fb865eb7b994f903a018b0446894ca3beaa3f2ee79d89e6cf6ca4540b6f916"}
Jul 20 19:37:31.221173 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:37:31.221105    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-bd0ca5-cb6f95c8c-46hxd" event={"ID":"052523e8-7618-48a3-a5c6-da56d34f91d6","Type":"ContainerDied","Data":"116e4b7ca4ee7fd5184810e9803d11729baf85a4c3f64afb755be8050c37fe0d"}
Jul 20 19:37:31.221173 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:37:31.221126    2563 scope.go:117] "RemoveContainer" containerID="f8fb865eb7b994f903a018b0446894ca3beaa3f2ee79d89e6cf6ca4540b6f916"
Jul 20 19:37:31.230237 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:37:31.230219    2563 scope.go:117] "RemoveContainer" containerID="f8fb865eb7b994f903a018b0446894ca3beaa3f2ee79d89e6cf6ca4540b6f916"
Jul 20 19:37:31.230506 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:37:31.230487    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f8fb865eb7b994f903a018b0446894ca3beaa3f2ee79d89e6cf6ca4540b6f916\": container with ID starting with f8fb865eb7b994f903a018b0446894ca3beaa3f2ee79d89e6cf6ca4540b6f916 not found: ID does not exist" containerID="f8fb865eb7b994f903a018b0446894ca3beaa3f2ee79d89e6cf6ca4540b6f916"
Jul 20 19:37:31.230572 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:37:31.230514    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8fb865eb7b994f903a018b0446894ca3beaa3f2ee79d89e6cf6ca4540b6f916"} err="failed to get container status \"f8fb865eb7b994f903a018b0446894ca3beaa3f2ee79d89e6cf6ca4540b6f916\": rpc error: code = NotFound desc = could not find container \"f8fb865eb7b994f903a018b0446894ca3beaa3f2ee79d89e6cf6ca4540b6f916\": container with ID starting with f8fb865eb7b994f903a018b0446894ca3beaa3f2ee79d89e6cf6ca4540b6f916 not found: ID does not exist"
Jul 20 19:37:31.241091 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:37:31.241065    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-bd0ca5-cb6f95c8c-46hxd"]
Jul 20 19:37:31.243404 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:37:31.243382    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-bd0ca5-cb6f95c8c-46hxd"]
Jul 20 19:37:32.891598 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:37:32.891561    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="052523e8-7618-48a3-a5c6-da56d34f91d6" path="/var/lib/kubelet/pods/052523e8-7618-48a3-a5c6-da56d34f91d6/volumes"
Jul 20 19:37:35.308156 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:37:35.308121    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:37:35.751907 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:37:35.751858    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:37:41.458295 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:37:41.458260    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:37:41.558944 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:37:41.558916    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:37:41.724011 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:37:41.723931    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:37:41.958913 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:37:41.958880    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:37:42.757703 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:37:42.757667    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:37:42.857619 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:37:42.857569    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:37:52.532939 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:37:52.532907    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:37:57.158862 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:37:57.158817    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:37:58.416250 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:37:58.416220    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:38:03.269660 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:38:03.269578    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:38:03.370622 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:38:03.370587    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:38:03.499627 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:38:03.499596    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:38:03.728060 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:38:03.728023    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:38:04.076320 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:38:04.076243    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:38:04.411517 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:38:04.411439    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:38:04.625238 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:38:04.625205    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:38:07.675626 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:38:07.675585    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:38:07.759596 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:38:07.759561    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:38:07.831203 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:38:07.831177    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:38:08.082550 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:38:08.082526    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:38:08.446235 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:38:08.446151    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:38:08.545789 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:38:08.545757    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:38:12.173844 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:38:12.173813    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:38:12.660988 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:38:12.660957    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:38:12.969847 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:38:12.969810    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:38:13.278640 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:38:13.278547    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:38:15.710210 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:38:15.710166    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:38:15.810071 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:38:15.810033    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:38:15.999342 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:38:15.999235    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:38:16.120546 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:38:16.120508    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:38:16.508983 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:38:16.508950    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:38:16.609935 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:38:16.609900    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:38:20.488483 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:38:20.488453    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:38:29.370288 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:38:29.370250    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:38:29.449223 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:38:29.449190    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:38:37.544798 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:38:37.544762    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:38:37.647919 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:38:37.647889    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:38:39.996766 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:38:39.996726    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:38:40.097022 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:38:40.096991    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:38:45.284365 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:38:45.284320    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:38:49.520887 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:38:49.520843    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:38:49.961907 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:38:49.961861    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:38:55.667866 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:38:55.667832    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:38:55.747169 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:38:55.747140    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:38:55.956421 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:38:55.956372    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:38:56.236764 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:38:56.236683    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:38:57.109072 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:38:57.109040    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:38:57.209312 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:38:57.209276    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:39:11.824764 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:39:11.824726    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:39:16.393800 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:39:16.393762    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:39:16.806649 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:39:16.806618    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:39:23.002438 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:39:23.002401    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:39:23.106298 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:39:23.106270    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:39:23.373368 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:39:23.373281    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:39:23.597944 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:39:23.597913    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:39:23.951160 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:39:23.951128    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:39:24.315617 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:39:24.315534    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:39:24.680147 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:39:24.680052    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:39:27.232937 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:39:27.232897    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:39:27.321544 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:39:27.321512    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:39:27.407797 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:39:27.407770    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:39:27.634113 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:39:27.634026    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:39:27.993138 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:39:27.993105    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:39:28.092837 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:39:28.092809    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:39:31.781212 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:39:31.781133    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:39:32.186787 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:39:32.186677    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:39:32.538299 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:39:32.538264    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:39:32.646916 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:39:32.646886    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:39:34.666614 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:39:34.666579    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:39:34.765530 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:39:34.765502    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:39:35.240909 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:39:35.240871    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:39:35.324543 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:39:35.324510    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:39:35.398470 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:39:35.398438    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:39:35.496432 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:39:35.496335    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:39:35.914415 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:39:35.914324    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:39:36.016484 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:39:36.016454    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:39:39.804788 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:39:39.804755    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:39:49.121753 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:39:49.121721    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:39:49.221973 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:39:49.221940    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:39:56.835585 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:39:56.835554    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:39:56.939107 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:39:56.939078    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:40:01.016683 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:40:01.016643    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-037874/auth-test-model-037874-kserve-6f765cd4cf-b7wb6"]
Jul 20 19:40:01.017098 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:40:01.016959    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="052523e8-7618-48a3-a5c6-da56d34f91d6" containerName="maas-api"
Jul 20 19:40:01.017098 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:40:01.016970    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="052523e8-7618-48a3-a5c6-da56d34f91d6" containerName="maas-api"
Jul 20 19:40:01.017098 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:40:01.017028    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="052523e8-7618-48a3-a5c6-da56d34f91d6" containerName="maas-api"
Jul 20 19:40:01.019898 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:40:01.019880    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-037874/auth-test-model-037874-kserve-6f765cd4cf-b7wb6"
Jul 20 19:40:01.022600 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:40:01.022576    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-037874\"/\"kube-root-ca.crt\""
Jul 20 19:40:01.023225 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:40:01.023207    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-037874\"/\"default-dockercfg-wcf7w\""
Jul 20 19:40:01.023410 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:40:01.023395    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-037874\"/\"openshift-service-ca.crt\""
Jul 20 19:40:01.023487 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:40:01.023448    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-037874\"/\"auth-test-model-037874-kserve-self-signed-certs\""
Jul 20 19:40:01.037102 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:40:01.037082    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-037874/auth-test-model-037874-kserve-6f765cd4cf-b7wb6"]
Jul 20 19:40:01.054945 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:40:01.054919    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:40:01.086686 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:40:01.086662    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/293c2e4f-cf4d-4100-b64d-e00c1aa77193-tmp-dir\") pod \"auth-test-model-037874-kserve-6f765cd4cf-b7wb6\" (UID: \"293c2e4f-cf4d-4100-b64d-e00c1aa77193\") " pod="ai-tenant-e2e-shared-a-037874/auth-test-model-037874-kserve-6f765cd4cf-b7wb6"
Jul 20 19:40:01.086779 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:40:01.086715    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/293c2e4f-cf4d-4100-b64d-e00c1aa77193-tls-certs\") pod \"auth-test-model-037874-kserve-6f765cd4cf-b7wb6\" (UID: \"293c2e4f-cf4d-4100-b64d-e00c1aa77193\") " pod="ai-tenant-e2e-shared-a-037874/auth-test-model-037874-kserve-6f765cd4cf-b7wb6"
Jul 20 19:40:01.086779 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:40:01.086767    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/293c2e4f-cf4d-4100-b64d-e00c1aa77193-model-cache\") pod \"auth-test-model-037874-kserve-6f765cd4cf-b7wb6\" (UID: \"293c2e4f-cf4d-4100-b64d-e00c1aa77193\") " pod="ai-tenant-e2e-shared-a-037874/auth-test-model-037874-kserve-6f765cd4cf-b7wb6"
Jul 20 19:40:01.086862 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:40:01.086800    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/293c2e4f-cf4d-4100-b64d-e00c1aa77193-dshm\") pod \"auth-test-model-037874-kserve-6f765cd4cf-b7wb6\" (UID: \"293c2e4f-cf4d-4100-b64d-e00c1aa77193\") " pod="ai-tenant-e2e-shared-a-037874/auth-test-model-037874-kserve-6f765cd4cf-b7wb6"
Jul 20 19:40:01.086900 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:40:01.086869    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/293c2e4f-cf4d-4100-b64d-e00c1aa77193-home\") pod \"auth-test-model-037874-kserve-6f765cd4cf-b7wb6\" (UID: \"293c2e4f-cf4d-4100-b64d-e00c1aa77193\") " pod="ai-tenant-e2e-shared-a-037874/auth-test-model-037874-kserve-6f765cd4cf-b7wb6"
Jul 20 19:40:01.086936 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:40:01.086904    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mlb6q\" (UniqueName: \"kubernetes.io/projected/293c2e4f-cf4d-4100-b64d-e00c1aa77193-kube-api-access-mlb6q\") pod \"auth-test-model-037874-kserve-6f765cd4cf-b7wb6\" (UID: \"293c2e4f-cf4d-4100-b64d-e00c1aa77193\") " pod="ai-tenant-e2e-shared-a-037874/auth-test-model-037874-kserve-6f765cd4cf-b7wb6"
Jul 20 19:40:01.188242 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:40:01.188215    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/293c2e4f-cf4d-4100-b64d-e00c1aa77193-tmp-dir\") pod \"auth-test-model-037874-kserve-6f765cd4cf-b7wb6\" (UID: \"293c2e4f-cf4d-4100-b64d-e00c1aa77193\") " pod="ai-tenant-e2e-shared-a-037874/auth-test-model-037874-kserve-6f765cd4cf-b7wb6"
Jul 20 19:40:01.188344 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:40:01.188256    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/293c2e4f-cf4d-4100-b64d-e00c1aa77193-tls-certs\") pod \"auth-test-model-037874-kserve-6f765cd4cf-b7wb6\" (UID: \"293c2e4f-cf4d-4100-b64d-e00c1aa77193\") " pod="ai-tenant-e2e-shared-a-037874/auth-test-model-037874-kserve-6f765cd4cf-b7wb6"
Jul 20 19:40:01.188344 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:40:01.188276    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/293c2e4f-cf4d-4100-b64d-e00c1aa77193-model-cache\") pod \"auth-test-model-037874-kserve-6f765cd4cf-b7wb6\" (UID: \"293c2e4f-cf4d-4100-b64d-e00c1aa77193\") " pod="ai-tenant-e2e-shared-a-037874/auth-test-model-037874-kserve-6f765cd4cf-b7wb6"
Jul 20 19:40:01.188344 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:40:01.188300    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/293c2e4f-cf4d-4100-b64d-e00c1aa77193-dshm\") pod \"auth-test-model-037874-kserve-6f765cd4cf-b7wb6\" (UID: \"293c2e4f-cf4d-4100-b64d-e00c1aa77193\") " pod="ai-tenant-e2e-shared-a-037874/auth-test-model-037874-kserve-6f765cd4cf-b7wb6"
Jul 20 19:40:01.188502 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:40:01.188370    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/293c2e4f-cf4d-4100-b64d-e00c1aa77193-home\") pod \"auth-test-model-037874-kserve-6f765cd4cf-b7wb6\" (UID: \"293c2e4f-cf4d-4100-b64d-e00c1aa77193\") " pod="ai-tenant-e2e-shared-a-037874/auth-test-model-037874-kserve-6f765cd4cf-b7wb6"
Jul 20 19:40:01.188502 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:40:01.188406    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mlb6q\" (UniqueName: \"kubernetes.io/projected/293c2e4f-cf4d-4100-b64d-e00c1aa77193-kube-api-access-mlb6q\") pod \"auth-test-model-037874-kserve-6f765cd4cf-b7wb6\" (UID: \"293c2e4f-cf4d-4100-b64d-e00c1aa77193\") " pod="ai-tenant-e2e-shared-a-037874/auth-test-model-037874-kserve-6f765cd4cf-b7wb6"
Jul 20 19:40:01.188682 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:40:01.188659    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/293c2e4f-cf4d-4100-b64d-e00c1aa77193-tmp-dir\") pod \"auth-test-model-037874-kserve-6f765cd4cf-b7wb6\" (UID: \"293c2e4f-cf4d-4100-b64d-e00c1aa77193\") " pod="ai-tenant-e2e-shared-a-037874/auth-test-model-037874-kserve-6f765cd4cf-b7wb6"
Jul 20 19:40:01.188756 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:40:01.188699    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/293c2e4f-cf4d-4100-b64d-e00c1aa77193-model-cache\") pod \"auth-test-model-037874-kserve-6f765cd4cf-b7wb6\" (UID: \"293c2e4f-cf4d-4100-b64d-e00c1aa77193\") " pod="ai-tenant-e2e-shared-a-037874/auth-test-model-037874-kserve-6f765cd4cf-b7wb6"
Jul 20 19:40:01.188808 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:40:01.188754    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/293c2e4f-cf4d-4100-b64d-e00c1aa77193-home\") pod \"auth-test-model-037874-kserve-6f765cd4cf-b7wb6\" (UID: \"293c2e4f-cf4d-4100-b64d-e00c1aa77193\") " pod="ai-tenant-e2e-shared-a-037874/auth-test-model-037874-kserve-6f765cd4cf-b7wb6"
Jul 20 19:40:01.190726 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:40:01.190711    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/293c2e4f-cf4d-4100-b64d-e00c1aa77193-dshm\") pod \"auth-test-model-037874-kserve-6f765cd4cf-b7wb6\" (UID: \"293c2e4f-cf4d-4100-b64d-e00c1aa77193\") " pod="ai-tenant-e2e-shared-a-037874/auth-test-model-037874-kserve-6f765cd4cf-b7wb6"
Jul 20 19:40:01.190901 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:40:01.190887    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/293c2e4f-cf4d-4100-b64d-e00c1aa77193-tls-certs\") pod \"auth-test-model-037874-kserve-6f765cd4cf-b7wb6\" (UID: \"293c2e4f-cf4d-4100-b64d-e00c1aa77193\") " pod="ai-tenant-e2e-shared-a-037874/auth-test-model-037874-kserve-6f765cd4cf-b7wb6"
Jul 20 19:40:01.200041 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:40:01.200018    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mlb6q\" (UniqueName: \"kubernetes.io/projected/293c2e4f-cf4d-4100-b64d-e00c1aa77193-kube-api-access-mlb6q\") pod \"auth-test-model-037874-kserve-6f765cd4cf-b7wb6\" (UID: \"293c2e4f-cf4d-4100-b64d-e00c1aa77193\") " pod="ai-tenant-e2e-shared-a-037874/auth-test-model-037874-kserve-6f765cd4cf-b7wb6"
Jul 20 19:40:01.329545 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:40:01.329478    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-037874/auth-test-model-037874-kserve-6f765cd4cf-b7wb6"
Jul 20 19:40:01.476333 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:40:01.476310    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-037874/auth-test-model-037874-kserve-6f765cd4cf-b7wb6"]
Jul 20 19:40:01.478867 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:40:01.478839    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod293c2e4f_cf4d_4100_b64d_e00c1aa77193.slice/crio-d0e102b5c0630143e7f879f3a5cb171bcb9e8d2a78c83962a67246565bb55a7f WatchSource:0}: Error finding container d0e102b5c0630143e7f879f3a5cb171bcb9e8d2a78c83962a67246565bb55a7f: Status 404 returned error can't find the container with id d0e102b5c0630143e7f879f3a5cb171bcb9e8d2a78c83962a67246565bb55a7f
Jul 20 19:40:01.870881 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:40:01.870847    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-037874/auth-test-model-037874-kserve-6f765cd4cf-b7wb6" event={"ID":"293c2e4f-cf4d-4100-b64d-e00c1aa77193","Type":"ContainerStarted","Data":"04b0051b877499bd78fc16265ee625d25c7ad5dd344dd3d370dc16f2b6cadf6f"}
Jul 20 19:40:01.871054 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:40:01.870890    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-037874/auth-test-model-037874-kserve-6f765cd4cf-b7wb6" event={"ID":"293c2e4f-cf4d-4100-b64d-e00c1aa77193","Type":"ContainerStarted","Data":"d0e102b5c0630143e7f879f3a5cb171bcb9e8d2a78c83962a67246565bb55a7f"}
Jul 20 19:40:01.896517 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:40:01.896464    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-037874/auth-test-model-037874-kserve-6f765cd4cf-b7wb6" podStartSLOduration=1.896448906 podStartE2EDuration="1.896448906s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:40:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:40:01.894068221 +0000 UTC m=+2361.577596243" watchObservedRunningTime="2026-07-20 19:40:01.896448906 +0000 UTC m=+2361.579976928"
Jul 20 19:40:11.330460 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:40:11.330425    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-037874/auth-test-model-037874-kserve-6f765cd4cf-b7wb6"
Jul 20 19:40:11.330872 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:40:11.330509    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-037874/auth-test-model-037874-kserve-6f765cd4cf-b7wb6"
Jul 20 19:40:11.344602 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:40:11.344577    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-037874/auth-test-model-037874-kserve-6f765cd4cf-b7wb6"
Jul 20 19:40:11.923433 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:40:11.923407    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-037874/auth-test-model-037874-kserve-6f765cd4cf-b7wb6"
Jul 20 19:40:29.566773 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:40:29.566739    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:40:31.028405 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:40:31.028361    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:40:44.598920 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:40:44.598885    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:40:46.127338 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:40:46.127306    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:42:42.695085 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:42:42.695005    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-037874/auth-test-model-037874-kserve-6f765cd4cf-b7wb6"]
Jul 20 19:42:42.739369 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:42:42.739309    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:42:43.626167 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:42:43.626131    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:42:51.037085 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:42:51.037053    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:42:57.715188 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:42:57.715124    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-037874/auth-test-model-037874-kserve-6f765cd4cf-b7wb6" podUID="293c2e4f-cf4d-4100-b64d-e00c1aa77193" containerName="main" containerID="cri-o://04b0051b877499bd78fc16265ee625d25c7ad5dd344dd3d370dc16f2b6cadf6f" gracePeriod=45
Jul 20 19:42:57.962992 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:42:57.962970    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-037874/auth-test-model-037874-kserve-6f765cd4cf-b7wb6"
Jul 20 19:42:58.033368 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:42:58.033279    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/293c2e4f-cf4d-4100-b64d-e00c1aa77193-model-cache\") pod \"293c2e4f-cf4d-4100-b64d-e00c1aa77193\" (UID: \"293c2e4f-cf4d-4100-b64d-e00c1aa77193\") "
Jul 20 19:42:58.033368 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:42:58.033315    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mlb6q\" (UniqueName: \"kubernetes.io/projected/293c2e4f-cf4d-4100-b64d-e00c1aa77193-kube-api-access-mlb6q\") pod \"293c2e4f-cf4d-4100-b64d-e00c1aa77193\" (UID: \"293c2e4f-cf4d-4100-b64d-e00c1aa77193\") "
Jul 20 19:42:58.033587 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:42:58.033432    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/293c2e4f-cf4d-4100-b64d-e00c1aa77193-tls-certs\") pod \"293c2e4f-cf4d-4100-b64d-e00c1aa77193\" (UID: \"293c2e4f-cf4d-4100-b64d-e00c1aa77193\") "
Jul 20 19:42:58.033587 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:42:58.033456    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/293c2e4f-cf4d-4100-b64d-e00c1aa77193-home\") pod \"293c2e4f-cf4d-4100-b64d-e00c1aa77193\" (UID: \"293c2e4f-cf4d-4100-b64d-e00c1aa77193\") "
Jul 20 19:42:58.033587 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:42:58.033490    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/293c2e4f-cf4d-4100-b64d-e00c1aa77193-dshm\") pod \"293c2e4f-cf4d-4100-b64d-e00c1aa77193\" (UID: \"293c2e4f-cf4d-4100-b64d-e00c1aa77193\") "
Jul 20 19:42:58.033587 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:42:58.033525    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/293c2e4f-cf4d-4100-b64d-e00c1aa77193-tmp-dir\") pod \"293c2e4f-cf4d-4100-b64d-e00c1aa77193\" (UID: \"293c2e4f-cf4d-4100-b64d-e00c1aa77193\") "
Jul 20 19:42:58.033587 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:42:58.033575    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/293c2e4f-cf4d-4100-b64d-e00c1aa77193-model-cache" (OuterVolumeSpecName: "model-cache") pod "293c2e4f-cf4d-4100-b64d-e00c1aa77193" (UID: "293c2e4f-cf4d-4100-b64d-e00c1aa77193"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:42:58.033829 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:42:58.033745    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/293c2e4f-cf4d-4100-b64d-e00c1aa77193-home" (OuterVolumeSpecName: "home") pod "293c2e4f-cf4d-4100-b64d-e00c1aa77193" (UID: "293c2e4f-cf4d-4100-b64d-e00c1aa77193"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:42:58.033829 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:42:58.033794    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/293c2e4f-cf4d-4100-b64d-e00c1aa77193-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "293c2e4f-cf4d-4100-b64d-e00c1aa77193" (UID: "293c2e4f-cf4d-4100-b64d-e00c1aa77193"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:42:58.033932 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:42:58.033874    2563 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/293c2e4f-cf4d-4100-b64d-e00c1aa77193-home\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\""
Jul 20 19:42:58.033932 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:42:58.033894    2563 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/293c2e4f-cf4d-4100-b64d-e00c1aa77193-tmp-dir\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\""
Jul 20 19:42:58.033932 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:42:58.033910    2563 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/293c2e4f-cf4d-4100-b64d-e00c1aa77193-model-cache\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\""
Jul 20 19:42:58.035761 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:42:58.035730    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/293c2e4f-cf4d-4100-b64d-e00c1aa77193-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "293c2e4f-cf4d-4100-b64d-e00c1aa77193" (UID: "293c2e4f-cf4d-4100-b64d-e00c1aa77193"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 19:42:58.035761 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:42:58.035746    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/293c2e4f-cf4d-4100-b64d-e00c1aa77193-dshm" (OuterVolumeSpecName: "dshm") pod "293c2e4f-cf4d-4100-b64d-e00c1aa77193" (UID: "293c2e4f-cf4d-4100-b64d-e00c1aa77193"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:42:58.035911 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:42:58.035797    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/293c2e4f-cf4d-4100-b64d-e00c1aa77193-kube-api-access-mlb6q" (OuterVolumeSpecName: "kube-api-access-mlb6q") pod "293c2e4f-cf4d-4100-b64d-e00c1aa77193" (UID: "293c2e4f-cf4d-4100-b64d-e00c1aa77193"). InnerVolumeSpecName "kube-api-access-mlb6q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:42:58.134286 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:42:58.134251    2563 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/293c2e4f-cf4d-4100-b64d-e00c1aa77193-dshm\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\""
Jul 20 19:42:58.134286 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:42:58.134283    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mlb6q\" (UniqueName: \"kubernetes.io/projected/293c2e4f-cf4d-4100-b64d-e00c1aa77193-kube-api-access-mlb6q\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\""
Jul 20 19:42:58.134481 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:42:58.134298    2563 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/293c2e4f-cf4d-4100-b64d-e00c1aa77193-tls-certs\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\""
Jul 20 19:42:58.631309 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:42:58.631280    2563 generic.go:356] "Generic (PLEG): container finished" podID="293c2e4f-cf4d-4100-b64d-e00c1aa77193" containerID="04b0051b877499bd78fc16265ee625d25c7ad5dd344dd3d370dc16f2b6cadf6f" exitCode=0
Jul 20 19:42:58.631509 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:42:58.631328    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-037874/auth-test-model-037874-kserve-6f765cd4cf-b7wb6"
Jul 20 19:42:58.631509 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:42:58.631334    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-037874/auth-test-model-037874-kserve-6f765cd4cf-b7wb6" event={"ID":"293c2e4f-cf4d-4100-b64d-e00c1aa77193","Type":"ContainerDied","Data":"04b0051b877499bd78fc16265ee625d25c7ad5dd344dd3d370dc16f2b6cadf6f"}
Jul 20 19:42:58.631509 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:42:58.631384    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-037874/auth-test-model-037874-kserve-6f765cd4cf-b7wb6" event={"ID":"293c2e4f-cf4d-4100-b64d-e00c1aa77193","Type":"ContainerDied","Data":"d0e102b5c0630143e7f879f3a5cb171bcb9e8d2a78c83962a67246565bb55a7f"}
Jul 20 19:42:58.631509 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:42:58.631407    2563 scope.go:117] "RemoveContainer" containerID="04b0051b877499bd78fc16265ee625d25c7ad5dd344dd3d370dc16f2b6cadf6f"
Jul 20 19:42:58.640831 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:42:58.640815    2563 scope.go:117] "RemoveContainer" containerID="04b0051b877499bd78fc16265ee625d25c7ad5dd344dd3d370dc16f2b6cadf6f"
Jul 20 19:42:58.641076 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:42:58.641061    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"04b0051b877499bd78fc16265ee625d25c7ad5dd344dd3d370dc16f2b6cadf6f\": container with ID starting with 04b0051b877499bd78fc16265ee625d25c7ad5dd344dd3d370dc16f2b6cadf6f not found: ID does not exist" containerID="04b0051b877499bd78fc16265ee625d25c7ad5dd344dd3d370dc16f2b6cadf6f"
Jul 20 19:42:58.641119 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:42:58.641084    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04b0051b877499bd78fc16265ee625d25c7ad5dd344dd3d370dc16f2b6cadf6f"} err="failed to get container status \"04b0051b877499bd78fc16265ee625d25c7ad5dd344dd3d370dc16f2b6cadf6f\": rpc error: code = NotFound desc = could not find container \"04b0051b877499bd78fc16265ee625d25c7ad5dd344dd3d370dc16f2b6cadf6f\": container with ID starting with 04b0051b877499bd78fc16265ee625d25c7ad5dd344dd3d370dc16f2b6cadf6f not found: ID does not exist"
Jul 20 19:42:58.652842 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:42:58.652820    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-037874/auth-test-model-037874-kserve-6f765cd4cf-b7wb6"]
Jul 20 19:42:58.657403 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:42:58.657384    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-037874/auth-test-model-037874-kserve-6f765cd4cf-b7wb6"]
Jul 20 19:42:58.891381 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:42:58.891284    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="293c2e4f-cf4d-4100-b64d-e00c1aa77193" path="/var/lib/kubelet/pods/293c2e4f-cf4d-4100-b64d-e00c1aa77193/volumes"
Jul 20 19:43:12.444330 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:43:12.444301    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:43:47.720035 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:43:47.719993    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:43:48.816185 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:43:48.816151    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:43:54.106969 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:43:54.106936    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-037874/rate-test-model-037874-kserve-7b78b485ff-zrjgm"]
Jul 20 19:43:54.107324 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:43:54.107252    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="293c2e4f-cf4d-4100-b64d-e00c1aa77193" containerName="main"
Jul 20 19:43:54.107324 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:43:54.107263    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="293c2e4f-cf4d-4100-b64d-e00c1aa77193" containerName="main"
Jul 20 19:43:54.107422 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:43:54.107327    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="293c2e4f-cf4d-4100-b64d-e00c1aa77193" containerName="main"
Jul 20 19:43:54.110287 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:43:54.110272    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-037874/rate-test-model-037874-kserve-7b78b485ff-zrjgm"
Jul 20 19:43:54.112903 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:43:54.112882    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-037874\"/\"kube-root-ca.crt\""
Jul 20 19:43:54.113769 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:43:54.113749    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-037874\"/\"rate-test-model-037874-kserve-self-signed-certs\""
Jul 20 19:43:54.113833 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:43:54.113789    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-037874\"/\"default-dockercfg-wcf7w\""
Jul 20 19:43:54.113833 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:43:54.113796    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-037874\"/\"openshift-service-ca.crt\""
Jul 20 19:43:54.120980 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:43:54.120957    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-037874/rate-test-model-037874-kserve-7b78b485ff-zrjgm"]
Jul 20 19:43:54.132980 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:43:54.132958    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:43:54.210195 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:43:54.210163    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c9314a03-d8cc-4efb-be32-89b4478784c2-model-cache\") pod \"rate-test-model-037874-kserve-7b78b485ff-zrjgm\" (UID: \"c9314a03-d8cc-4efb-be32-89b4478784c2\") " pod="ai-tenant-e2e-shared-a-037874/rate-test-model-037874-kserve-7b78b485ff-zrjgm"
Jul 20 19:43:54.210367 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:43:54.210209    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c9314a03-d8cc-4efb-be32-89b4478784c2-home\") pod \"rate-test-model-037874-kserve-7b78b485ff-zrjgm\" (UID: \"c9314a03-d8cc-4efb-be32-89b4478784c2\") " pod="ai-tenant-e2e-shared-a-037874/rate-test-model-037874-kserve-7b78b485ff-zrjgm"
Jul 20 19:43:54.210367 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:43:54.210332    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kg7x4\" (UniqueName: \"kubernetes.io/projected/c9314a03-d8cc-4efb-be32-89b4478784c2-kube-api-access-kg7x4\") pod \"rate-test-model-037874-kserve-7b78b485ff-zrjgm\" (UID: \"c9314a03-d8cc-4efb-be32-89b4478784c2\") " pod="ai-tenant-e2e-shared-a-037874/rate-test-model-037874-kserve-7b78b485ff-zrjgm"
Jul 20 19:43:54.210460 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:43:54.210439    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c9314a03-d8cc-4efb-be32-89b4478784c2-dshm\") pod \"rate-test-model-037874-kserve-7b78b485ff-zrjgm\" (UID: \"c9314a03-d8cc-4efb-be32-89b4478784c2\") " pod="ai-tenant-e2e-shared-a-037874/rate-test-model-037874-kserve-7b78b485ff-zrjgm"
Jul 20 19:43:54.210497 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:43:54.210470    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c9314a03-d8cc-4efb-be32-89b4478784c2-tmp-dir\") pod \"rate-test-model-037874-kserve-7b78b485ff-zrjgm\" (UID: \"c9314a03-d8cc-4efb-be32-89b4478784c2\") " pod="ai-tenant-e2e-shared-a-037874/rate-test-model-037874-kserve-7b78b485ff-zrjgm"
Jul 20 19:43:54.210497 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:43:54.210487    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c9314a03-d8cc-4efb-be32-89b4478784c2-tls-certs\") pod \"rate-test-model-037874-kserve-7b78b485ff-zrjgm\" (UID: \"c9314a03-d8cc-4efb-be32-89b4478784c2\") " pod="ai-tenant-e2e-shared-a-037874/rate-test-model-037874-kserve-7b78b485ff-zrjgm"
Jul 20 19:43:54.311599 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:43:54.311566    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c9314a03-d8cc-4efb-be32-89b4478784c2-dshm\") pod \"rate-test-model-037874-kserve-7b78b485ff-zrjgm\" (UID: \"c9314a03-d8cc-4efb-be32-89b4478784c2\") " pod="ai-tenant-e2e-shared-a-037874/rate-test-model-037874-kserve-7b78b485ff-zrjgm"
Jul 20 19:43:54.311599 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:43:54.311597    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c9314a03-d8cc-4efb-be32-89b4478784c2-tmp-dir\") pod \"rate-test-model-037874-kserve-7b78b485ff-zrjgm\" (UID: \"c9314a03-d8cc-4efb-be32-89b4478784c2\") " pod="ai-tenant-e2e-shared-a-037874/rate-test-model-037874-kserve-7b78b485ff-zrjgm"
Jul 20 19:43:54.311816 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:43:54.311612    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c9314a03-d8cc-4efb-be32-89b4478784c2-tls-certs\") pod \"rate-test-model-037874-kserve-7b78b485ff-zrjgm\" (UID: \"c9314a03-d8cc-4efb-be32-89b4478784c2\") " pod="ai-tenant-e2e-shared-a-037874/rate-test-model-037874-kserve-7b78b485ff-zrjgm"
Jul 20 19:43:54.311816 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:43:54.311649    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c9314a03-d8cc-4efb-be32-89b4478784c2-model-cache\") pod \"rate-test-model-037874-kserve-7b78b485ff-zrjgm\" (UID: \"c9314a03-d8cc-4efb-be32-89b4478784c2\") " pod="ai-tenant-e2e-shared-a-037874/rate-test-model-037874-kserve-7b78b485ff-zrjgm"
Jul 20 19:43:54.311816 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:43:54.311677    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c9314a03-d8cc-4efb-be32-89b4478784c2-home\") pod \"rate-test-model-037874-kserve-7b78b485ff-zrjgm\" (UID: \"c9314a03-d8cc-4efb-be32-89b4478784c2\") " pod="ai-tenant-e2e-shared-a-037874/rate-test-model-037874-kserve-7b78b485ff-zrjgm"
Jul 20 19:43:54.311816 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:43:54.311767    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kg7x4\" (UniqueName: \"kubernetes.io/projected/c9314a03-d8cc-4efb-be32-89b4478784c2-kube-api-access-kg7x4\") pod \"rate-test-model-037874-kserve-7b78b485ff-zrjgm\" (UID: \"c9314a03-d8cc-4efb-be32-89b4478784c2\") " pod="ai-tenant-e2e-shared-a-037874/rate-test-model-037874-kserve-7b78b485ff-zrjgm"
Jul 20 19:43:54.312105 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:43:54.312072    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c9314a03-d8cc-4efb-be32-89b4478784c2-tmp-dir\") pod \"rate-test-model-037874-kserve-7b78b485ff-zrjgm\" (UID: \"c9314a03-d8cc-4efb-be32-89b4478784c2\") " pod="ai-tenant-e2e-shared-a-037874/rate-test-model-037874-kserve-7b78b485ff-zrjgm"
Jul 20 19:43:54.312236 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:43:54.312088    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c9314a03-d8cc-4efb-be32-89b4478784c2-model-cache\") pod \"rate-test-model-037874-kserve-7b78b485ff-zrjgm\" (UID: \"c9314a03-d8cc-4efb-be32-89b4478784c2\") " pod="ai-tenant-e2e-shared-a-037874/rate-test-model-037874-kserve-7b78b485ff-zrjgm"
Jul 20 19:43:54.312236 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:43:54.312142    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c9314a03-d8cc-4efb-be32-89b4478784c2-home\") pod \"rate-test-model-037874-kserve-7b78b485ff-zrjgm\" (UID: \"c9314a03-d8cc-4efb-be32-89b4478784c2\") " pod="ai-tenant-e2e-shared-a-037874/rate-test-model-037874-kserve-7b78b485ff-zrjgm"
Jul 20 19:43:54.314445 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:43:54.314418    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c9314a03-d8cc-4efb-be32-89b4478784c2-dshm\") pod \"rate-test-model-037874-kserve-7b78b485ff-zrjgm\" (UID: \"c9314a03-d8cc-4efb-be32-89b4478784c2\") " pod="ai-tenant-e2e-shared-a-037874/rate-test-model-037874-kserve-7b78b485ff-zrjgm"
Jul 20 19:43:54.314827 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:43:54.314806    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c9314a03-d8cc-4efb-be32-89b4478784c2-tls-certs\") pod \"rate-test-model-037874-kserve-7b78b485ff-zrjgm\" (UID: \"c9314a03-d8cc-4efb-be32-89b4478784c2\") " pod="ai-tenant-e2e-shared-a-037874/rate-test-model-037874-kserve-7b78b485ff-zrjgm"
Jul 20 19:43:54.320299 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:43:54.320276    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kg7x4\" (UniqueName: \"kubernetes.io/projected/c9314a03-d8cc-4efb-be32-89b4478784c2-kube-api-access-kg7x4\") pod \"rate-test-model-037874-kserve-7b78b485ff-zrjgm\" (UID: \"c9314a03-d8cc-4efb-be32-89b4478784c2\") " pod="ai-tenant-e2e-shared-a-037874/rate-test-model-037874-kserve-7b78b485ff-zrjgm"
Jul 20 19:43:54.419444 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:43:54.419334    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-037874/rate-test-model-037874-kserve-7b78b485ff-zrjgm"
Jul 20 19:43:54.564330 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:43:54.564305    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-037874/rate-test-model-037874-kserve-7b78b485ff-zrjgm"]
Jul 20 19:43:54.566571 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:43:54.566544    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc9314a03_d8cc_4efb_be32_89b4478784c2.slice/crio-18c5972db85edbf9b570f1b92e2b186b3b3a9d37accff12f07b48357ffec61da WatchSource:0}: Error finding container 18c5972db85edbf9b570f1b92e2b186b3b3a9d37accff12f07b48357ffec61da: Status 404 returned error can't find the container with id 18c5972db85edbf9b570f1b92e2b186b3b3a9d37accff12f07b48357ffec61da
Jul 20 19:43:54.877419 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:43:54.877379    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-037874/rate-test-model-037874-kserve-7b78b485ff-zrjgm" event={"ID":"c9314a03-d8cc-4efb-be32-89b4478784c2","Type":"ContainerStarted","Data":"8fe08f878a99a7e4d83d295b7a61f50d75da50d4f67443638c4e5b07b965d5c1"}
Jul 20 19:43:54.877591 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:43:54.877428    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-037874/rate-test-model-037874-kserve-7b78b485ff-zrjgm" event={"ID":"c9314a03-d8cc-4efb-be32-89b4478784c2","Type":"ContainerStarted","Data":"18c5972db85edbf9b570f1b92e2b186b3b3a9d37accff12f07b48357ffec61da"}
Jul 20 19:43:54.895332 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:43:54.895281    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-037874/rate-test-model-037874-kserve-7b78b485ff-zrjgm" podStartSLOduration=0.895267083 podStartE2EDuration="895.267083ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:43:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:43:54.893402802 +0000 UTC m=+2594.576930827" watchObservedRunningTime="2026-07-20 19:43:54.895267083 +0000 UTC m=+2594.578795158"
Jul 20 19:44:04.419701 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:44:04.419598    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-037874/rate-test-model-037874-kserve-7b78b485ff-zrjgm"
Jul 20 19:44:04.419701 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:44:04.419689    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-037874/rate-test-model-037874-kserve-7b78b485ff-zrjgm"
Jul 20 19:44:04.431894 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:44:04.431866    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-037874/rate-test-model-037874-kserve-7b78b485ff-zrjgm"
Jul 20 19:44:04.928786 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:44:04.928758    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-037874/rate-test-model-037874-kserve-7b78b485ff-zrjgm"
Jul 20 19:44:17.850988 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:44:17.850955    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:44:35.444795 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:44:35.444754    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:44:35.545460 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:44:35.545431    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:44:48.185277 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:44:48.185239    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:44:48.285079 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:44:48.285048    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:44:50.100843 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:44:50.100808    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:44:50.201064 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:44:50.201011    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:44:57.684449 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:44:57.684413    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:44:57.786282 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:44:57.786249    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:45:06.295471 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:45:06.295436    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-037874/rate-test-model-037874-kserve-7b78b485ff-zrjgm"]
Jul 20 19:45:06.321671 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:45:06.321634    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:45:07.237316 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:45:07.237257    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:45:08.340794 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:45:08.340756    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:45:08.398691 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:45:08.398652    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:45:21.317163 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:45:21.317098    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-037874/rate-test-model-037874-kserve-7b78b485ff-zrjgm" podUID="c9314a03-d8cc-4efb-be32-89b4478784c2" containerName="main" containerID="cri-o://8fe08f878a99a7e4d83d295b7a61f50d75da50d4f67443638c4e5b07b965d5c1" gracePeriod=45
Jul 20 19:45:21.564674 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:45:21.564652    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-037874/rate-test-model-037874-kserve-7b78b485ff-zrjgm"
Jul 20 19:45:21.687368 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:45:21.687254    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kg7x4\" (UniqueName: \"kubernetes.io/projected/c9314a03-d8cc-4efb-be32-89b4478784c2-kube-api-access-kg7x4\") pod \"c9314a03-d8cc-4efb-be32-89b4478784c2\" (UID: \"c9314a03-d8cc-4efb-be32-89b4478784c2\") "
Jul 20 19:45:21.687368 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:45:21.687298    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c9314a03-d8cc-4efb-be32-89b4478784c2-tmp-dir\") pod \"c9314a03-d8cc-4efb-be32-89b4478784c2\" (UID: \"c9314a03-d8cc-4efb-be32-89b4478784c2\") "
Jul 20 19:45:21.687368 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:45:21.687315    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c9314a03-d8cc-4efb-be32-89b4478784c2-model-cache\") pod \"c9314a03-d8cc-4efb-be32-89b4478784c2\" (UID: \"c9314a03-d8cc-4efb-be32-89b4478784c2\") "
Jul 20 19:45:21.687368 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:45:21.687333    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c9314a03-d8cc-4efb-be32-89b4478784c2-tls-certs\") pod \"c9314a03-d8cc-4efb-be32-89b4478784c2\" (UID: \"c9314a03-d8cc-4efb-be32-89b4478784c2\") "
Jul 20 19:45:21.687728 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:45:21.687451    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c9314a03-d8cc-4efb-be32-89b4478784c2-home\") pod \"c9314a03-d8cc-4efb-be32-89b4478784c2\" (UID: \"c9314a03-d8cc-4efb-be32-89b4478784c2\") "
Jul 20 19:45:21.687728 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:45:21.687506    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c9314a03-d8cc-4efb-be32-89b4478784c2-dshm\") pod \"c9314a03-d8cc-4efb-be32-89b4478784c2\" (UID: \"c9314a03-d8cc-4efb-be32-89b4478784c2\") "
Jul 20 19:45:21.687728 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:45:21.687599    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c9314a03-d8cc-4efb-be32-89b4478784c2-model-cache" (OuterVolumeSpecName: "model-cache") pod "c9314a03-d8cc-4efb-be32-89b4478784c2" (UID: "c9314a03-d8cc-4efb-be32-89b4478784c2"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:45:21.687728 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:45:21.687616    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c9314a03-d8cc-4efb-be32-89b4478784c2-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c9314a03-d8cc-4efb-be32-89b4478784c2" (UID: "c9314a03-d8cc-4efb-be32-89b4478784c2"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:45:21.687901 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:45:21.687733    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c9314a03-d8cc-4efb-be32-89b4478784c2-home" (OuterVolumeSpecName: "home") pod "c9314a03-d8cc-4efb-be32-89b4478784c2" (UID: "c9314a03-d8cc-4efb-be32-89b4478784c2"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:45:21.687957 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:45:21.687911    2563 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c9314a03-d8cc-4efb-be32-89b4478784c2-tmp-dir\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\""
Jul 20 19:45:21.687957 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:45:21.687927    2563 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c9314a03-d8cc-4efb-be32-89b4478784c2-model-cache\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\""
Jul 20 19:45:21.687957 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:45:21.687936    2563 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c9314a03-d8cc-4efb-be32-89b4478784c2-home\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\""
Jul 20 19:45:21.689651 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:45:21.689631    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c9314a03-d8cc-4efb-be32-89b4478784c2-dshm" (OuterVolumeSpecName: "dshm") pod "c9314a03-d8cc-4efb-be32-89b4478784c2" (UID: "c9314a03-d8cc-4efb-be32-89b4478784c2"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:45:21.689756 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:45:21.689655    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c9314a03-d8cc-4efb-be32-89b4478784c2-kube-api-access-kg7x4" (OuterVolumeSpecName: "kube-api-access-kg7x4") pod "c9314a03-d8cc-4efb-be32-89b4478784c2" (UID: "c9314a03-d8cc-4efb-be32-89b4478784c2"). InnerVolumeSpecName "kube-api-access-kg7x4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:45:21.689756 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:45:21.689733    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c9314a03-d8cc-4efb-be32-89b4478784c2-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c9314a03-d8cc-4efb-be32-89b4478784c2" (UID: "c9314a03-d8cc-4efb-be32-89b4478784c2"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 19:45:21.789105 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:45:21.789056    2563 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c9314a03-d8cc-4efb-be32-89b4478784c2-dshm\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\""
Jul 20 19:45:21.789105 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:45:21.789101    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kg7x4\" (UniqueName: \"kubernetes.io/projected/c9314a03-d8cc-4efb-be32-89b4478784c2-kube-api-access-kg7x4\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\""
Jul 20 19:45:21.789105 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:45:21.789112    2563 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c9314a03-d8cc-4efb-be32-89b4478784c2-tls-certs\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\""
Jul 20 19:45:22.248295 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:45:22.248264    2563 generic.go:356] "Generic (PLEG): container finished" podID="c9314a03-d8cc-4efb-be32-89b4478784c2" containerID="8fe08f878a99a7e4d83d295b7a61f50d75da50d4f67443638c4e5b07b965d5c1" exitCode=0
Jul 20 19:45:22.248482 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:45:22.248307    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-037874/rate-test-model-037874-kserve-7b78b485ff-zrjgm"
Jul 20 19:45:22.248482 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:45:22.248341    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-037874/rate-test-model-037874-kserve-7b78b485ff-zrjgm" event={"ID":"c9314a03-d8cc-4efb-be32-89b4478784c2","Type":"ContainerDied","Data":"8fe08f878a99a7e4d83d295b7a61f50d75da50d4f67443638c4e5b07b965d5c1"}
Jul 20 19:45:22.248482 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:45:22.248406    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-037874/rate-test-model-037874-kserve-7b78b485ff-zrjgm" event={"ID":"c9314a03-d8cc-4efb-be32-89b4478784c2","Type":"ContainerDied","Data":"18c5972db85edbf9b570f1b92e2b186b3b3a9d37accff12f07b48357ffec61da"}
Jul 20 19:45:22.248482 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:45:22.248424    2563 scope.go:117] "RemoveContainer" containerID="8fe08f878a99a7e4d83d295b7a61f50d75da50d4f67443638c4e5b07b965d5c1"
Jul 20 19:45:22.256885 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:45:22.256867    2563 scope.go:117] "RemoveContainer" containerID="8fe08f878a99a7e4d83d295b7a61f50d75da50d4f67443638c4e5b07b965d5c1"
Jul 20 19:45:22.257123 ip-10-0-139-141 kubenswrapper[2563]: E0720 19:45:22.257107    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8fe08f878a99a7e4d83d295b7a61f50d75da50d4f67443638c4e5b07b965d5c1\": container with ID starting with 8fe08f878a99a7e4d83d295b7a61f50d75da50d4f67443638c4e5b07b965d5c1 not found: ID does not exist" containerID="8fe08f878a99a7e4d83d295b7a61f50d75da50d4f67443638c4e5b07b965d5c1"
Jul 20 19:45:22.257171 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:45:22.257133    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8fe08f878a99a7e4d83d295b7a61f50d75da50d4f67443638c4e5b07b965d5c1"} err="failed to get container status \"8fe08f878a99a7e4d83d295b7a61f50d75da50d4f67443638c4e5b07b965d5c1\": rpc error: code = NotFound desc = could not find container \"8fe08f878a99a7e4d83d295b7a61f50d75da50d4f67443638c4e5b07b965d5c1\": container with ID starting with 8fe08f878a99a7e4d83d295b7a61f50d75da50d4f67443638c4e5b07b965d5c1 not found: ID does not exist"
Jul 20 19:45:22.269213 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:45:22.269189    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-037874/rate-test-model-037874-kserve-7b78b485ff-zrjgm"]
Jul 20 19:45:22.275641 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:45:22.275622    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-037874/rate-test-model-037874-kserve-7b78b485ff-zrjgm"]
Jul 20 19:45:22.892702 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:45:22.892668    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c9314a03-d8cc-4efb-be32-89b4478784c2" path="/var/lib/kubelet/pods/c9314a03-d8cc-4efb-be32-89b4478784c2/volumes"
Jul 20 19:45:25.873177 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:45:25.873147    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:45:25.975916 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:45:25.975880    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:45:35.339972 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:45:35.339893    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:45:35.441539 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:45:35.441505    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:45:35.897110 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:45:35.897082    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:45:40.406135 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:45:40.406101    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:45:40.930470 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:45:40.930431    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:45:46.891470 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:45:46.891438    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:45:46.948512 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:45:46.948478    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:45:47.180230 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:45:47.180151    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:45:47.426940 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:45:47.426904    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:45:48.101801 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:45:48.101764    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:45:48.203399 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:45:48.203369    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:45:58.025299 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:45:58.025264    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:46:02.643538 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:46:02.643501    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:46:03.028913 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:46:03.028882    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:46:08.905455 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:46:08.905417    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:46:08.974276 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:46:08.974245    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:46:09.189767 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:46:09.189684    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:46:09.427512 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:46:09.427481    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:46:10.908294 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:46:10.908263    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:46:10.967445 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:46:10.967418    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:46:16.455461 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:46:16.455434    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6dc69fccc8-qqqqf_2d6f1300-3ae0-46be-8df6-0b996c694722/copy-manifests/0.log"
Jul 20 19:46:16.462509 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:46:16.462482    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6dc69fccc8-qqqqf_2d6f1300-3ae0-46be-8df6-0b996c694722/manager/0.log"
Jul 20 19:46:16.822660 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:46:16.822590    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-7c69fff5cb-lv7qw_e70508ad-5462-4ca0-ba7d-7e8649328dbc/maas-api/0.log"
Jul 20 19:46:17.325222 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:46:17.325198    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-zqlwr_784f297d-f341-495c-8caa-8e631796df30/postgres/0.log"
Jul 20 19:46:19.038141 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:46:19.038112    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-cttsp_6d0fdd39-b077-4c3a-ac25-e48e65221eba/kuadrant-console-plugin/0.log"
Jul 20 19:46:20.150686 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:46:20.150654    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-566bb86f76-76sh9_0f6d7218-88e0-45ab-a3fd-c0e89976d06a/kube-auth-proxy/0.log"
Jul 20 19:46:20.657307 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:46:20.657276    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-hscqk_711594ee-0175-47a4-91df-9aa8a4485a38/payload-processing/0.log"
Jul 20 19:46:21.140919 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:46:21.140895    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-chrgn_56b3816d-3935-4bfe-b607-e034dda951b5/main/0.log"
Jul 20 19:46:21.535607 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:46:21.535557    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7wg25_d191c70b-84da-4d1d-a503-dd0ad89e614a/main/0.log"
Jul 20 19:46:21.664762 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:46:21.664737    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-fxj2d_80f881a6-ddd9-4e36-9427-3a3d21fce54c/main/0.log"
Jul 20 19:46:21.787855 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:46:21.787781    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-h7p5h_e3210275-7413-40ab-8642-b34520406eb9/main/0.log"
Jul 20 19:46:27.653964 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:46:27.653928    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:46:27.754227 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:46:27.754192    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log" limit=1024
Jul 20 19:46:30.543428 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:46:30.543398    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-ng85c_08e8b8dd-1dde-4bb0-863b-1322d836d18c/global-pull-secret-syncer/0.log"
Jul 20 19:46:30.591669 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:46:30.591643    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-pkr2l_5ee65ed0-cd62-4933-9888-a6077bd14239/konnectivity-agent/0.log"
Jul 20 19:46:30.699104 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:46:30.699080    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-141.ec2.internal_508e3b649792abc37cafc631d8189428/haproxy/0.log"
Jul 20 19:46:35.236164 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:46:35.236133    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-cttsp_6d0fdd39-b077-4c3a-ac25-e48e65221eba/kuadrant-console-plugin/0.log"
Jul 20 19:46:37.429578 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:46:37.429554    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-7b7b7bc8bf-pqzvv_318006fd-48dd-4a24-9f66-2a6c0e958177/monitoring-plugin/0.log"
Jul 20 19:46:37.557399 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:46:37.557344    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-q6s9t_92f211d1-b875-45d0-8f3f-d28d298b97e7/node-exporter/0.log"
Jul 20 19:46:37.591191 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:46:37.591169    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-q6s9t_92f211d1-b875-45d0-8f3f-d28d298b97e7/kube-rbac-proxy/0.log"
Jul 20 19:46:37.612958 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:46:37.612941    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-q6s9t_92f211d1-b875-45d0-8f3f-d28d298b97e7/init-textfile/0.log"
Jul 20 19:46:37.814053 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:46:37.814032    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_80939d52-573a-4955-b069-3a5808d47fee/prometheus/0.log"
Jul 20 19:46:37.837870 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:46:37.837850    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_80939d52-573a-4955-b069-3a5808d47fee/config-reloader/0.log"
Jul 20 19:46:37.863558 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:46:37.863536    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_80939d52-573a-4955-b069-3a5808d47fee/thanos-sidecar/0.log"
Jul 20 19:46:37.890836 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:46:37.890817    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_80939d52-573a-4955-b069-3a5808d47fee/kube-rbac-proxy-web/0.log"
Jul 20 19:46:37.918832 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:46:37.918814    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_80939d52-573a-4955-b069-3a5808d47fee/kube-rbac-proxy/0.log"
Jul 20 19:46:37.943305 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:46:37.943283    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_80939d52-573a-4955-b069-3a5808d47fee/kube-rbac-proxy-thanos/0.log"
Jul 20 19:46:37.968051 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:46:37.968033    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_80939d52-573a-4955-b069-3a5808d47fee/init-config-reloader/0.log"
Jul 20 19:46:38.113316 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:46:38.113265    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-84c9498bf-x4bg2_96d1d05c-dd89-409f-b46d-08af47201282/telemeter-client/0.log"
Jul 20 19:46:38.136816 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:46:38.136797    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-84c9498bf-x4bg2_96d1d05c-dd89-409f-b46d-08af47201282/reload/0.log"
Jul 20 19:46:38.158343 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:46:38.158326    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-84c9498bf-x4bg2_96d1d05c-dd89-409f-b46d-08af47201282/kube-rbac-proxy/0.log"
Jul 20 19:46:40.625473 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:46:40.625441    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-wxb5l/perf-node-gather-daemonset-vsqzk"]
Jul 20 19:46:40.625847 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:46:40.625744    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9314a03-d8cc-4efb-be32-89b4478784c2" containerName="main"
Jul 20 19:46:40.625847 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:46:40.625755    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9314a03-d8cc-4efb-be32-89b4478784c2" containerName="main"
Jul 20 19:46:40.625847 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:46:40.625822    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="c9314a03-d8cc-4efb-be32-89b4478784c2" containerName="main"
Jul 20 19:46:40.628954 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:46:40.628938    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wxb5l/perf-node-gather-daemonset-vsqzk"
Jul 20 19:46:40.631405 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:46:40.631383    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-wxb5l\"/\"default-dockercfg-5rgks\""
Jul 20 19:46:40.632151 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:46:40.632134    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wxb5l\"/\"openshift-service-ca.crt\""
Jul 20 19:46:40.632284 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:46:40.632178    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wxb5l\"/\"kube-root-ca.crt\""
Jul 20 19:46:40.637272 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:46:40.637250    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wxb5l/perf-node-gather-daemonset-vsqzk"]
Jul 20 19:46:40.744806 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:46:40.744774    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8a0c618d-6d9b-4257-98b1-36a50532c20b-sys\") pod \"perf-node-gather-daemonset-vsqzk\" (UID: \"8a0c618d-6d9b-4257-98b1-36a50532c20b\") " pod="openshift-must-gather-wxb5l/perf-node-gather-daemonset-vsqzk"
Jul 20 19:46:40.744806 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:46:40.744804    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjxxw\" (UniqueName: \"kubernetes.io/projected/8a0c618d-6d9b-4257-98b1-36a50532c20b-kube-api-access-kjxxw\") pod \"perf-node-gather-daemonset-vsqzk\" (UID: \"8a0c618d-6d9b-4257-98b1-36a50532c20b\") " pod="openshift-must-gather-wxb5l/perf-node-gather-daemonset-vsqzk"
Jul 20 19:46:40.745019 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:46:40.744838    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8a0c618d-6d9b-4257-98b1-36a50532c20b-lib-modules\") pod \"perf-node-gather-daemonset-vsqzk\" (UID: \"8a0c618d-6d9b-4257-98b1-36a50532c20b\") " pod="openshift-must-gather-wxb5l/perf-node-gather-daemonset-vsqzk"
Jul 20 19:46:40.745019 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:46:40.744928    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8a0c618d-6d9b-4257-98b1-36a50532c20b-proc\") pod \"perf-node-gather-daemonset-vsqzk\" (UID: \"8a0c618d-6d9b-4257-98b1-36a50532c20b\") " pod="openshift-must-gather-wxb5l/perf-node-gather-daemonset-vsqzk"
Jul 20 19:46:40.745019 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:46:40.744981    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8a0c618d-6d9b-4257-98b1-36a50532c20b-podres\") pod \"perf-node-gather-daemonset-vsqzk\" (UID: \"8a0c618d-6d9b-4257-98b1-36a50532c20b\") " pod="openshift-must-gather-wxb5l/perf-node-gather-daemonset-vsqzk"
Jul 20 19:46:40.846126 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:46:40.846095    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8a0c618d-6d9b-4257-98b1-36a50532c20b-sys\") pod \"perf-node-gather-daemonset-vsqzk\" (UID: \"8a0c618d-6d9b-4257-98b1-36a50532c20b\") " pod="openshift-must-gather-wxb5l/perf-node-gather-daemonset-vsqzk"
Jul 20 19:46:40.846126 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:46:40.846128    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjxxw\" (UniqueName: \"kubernetes.io/projected/8a0c618d-6d9b-4257-98b1-36a50532c20b-kube-api-access-kjxxw\") pod \"perf-node-gather-daemonset-vsqzk\" (UID: \"8a0c618d-6d9b-4257-98b1-36a50532c20b\") " pod="openshift-must-gather-wxb5l/perf-node-gather-daemonset-vsqzk"
Jul 20 19:46:40.846334 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:46:40.846167    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8a0c618d-6d9b-4257-98b1-36a50532c20b-lib-modules\") pod \"perf-node-gather-daemonset-vsqzk\" (UID: \"8a0c618d-6d9b-4257-98b1-36a50532c20b\") " pod="openshift-must-gather-wxb5l/perf-node-gather-daemonset-vsqzk"
Jul 20 19:46:40.846334 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:46:40.846216    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8a0c618d-6d9b-4257-98b1-36a50532c20b-proc\") pod \"perf-node-gather-daemonset-vsqzk\" (UID: \"8a0c618d-6d9b-4257-98b1-36a50532c20b\") " pod="openshift-must-gather-wxb5l/perf-node-gather-daemonset-vsqzk"
Jul 20 19:46:40.846334 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:46:40.846233    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8a0c618d-6d9b-4257-98b1-36a50532c20b-sys\") pod \"perf-node-gather-daemonset-vsqzk\" (UID: \"8a0c618d-6d9b-4257-98b1-36a50532c20b\") " pod="openshift-must-gather-wxb5l/perf-node-gather-daemonset-vsqzk"
Jul 20 19:46:40.846334 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:46:40.846247    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8a0c618d-6d9b-4257-98b1-36a50532c20b-podres\") pod \"perf-node-gather-daemonset-vsqzk\" (UID: \"8a0c618d-6d9b-4257-98b1-36a50532c20b\") " pod="openshift-must-gather-wxb5l/perf-node-gather-daemonset-vsqzk"
Jul 20 19:46:40.846496 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:46:40.846397    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8a0c618d-6d9b-4257-98b1-36a50532c20b-podres\") pod \"perf-node-gather-daemonset-vsqzk\" (UID: \"8a0c618d-6d9b-4257-98b1-36a50532c20b\") " pod="openshift-must-gather-wxb5l/perf-node-gather-daemonset-vsqzk"
Jul 20 19:46:40.846496 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:46:40.846416    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8a0c618d-6d9b-4257-98b1-36a50532c20b-proc\") pod \"perf-node-gather-daemonset-vsqzk\" (UID: \"8a0c618d-6d9b-4257-98b1-36a50532c20b\") " pod="openshift-must-gather-wxb5l/perf-node-gather-daemonset-vsqzk"
Jul 20 19:46:40.846496 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:46:40.846442    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8a0c618d-6d9b-4257-98b1-36a50532c20b-lib-modules\") pod \"perf-node-gather-daemonset-vsqzk\" (UID: \"8a0c618d-6d9b-4257-98b1-36a50532c20b\") " pod="openshift-must-gather-wxb5l/perf-node-gather-daemonset-vsqzk"
Jul 20 19:46:40.853535 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:46:40.853520    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wxb5l\"/\"kube-root-ca.crt\""
Jul 20 19:46:40.863592 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:46:40.863576    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wxb5l\"/\"openshift-service-ca.crt\""
Jul 20 19:46:40.875807 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:46:40.875739    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjxxw\" (UniqueName: \"kubernetes.io/projected/8a0c618d-6d9b-4257-98b1-36a50532c20b-kube-api-access-kjxxw\") pod \"perf-node-gather-daemonset-vsqzk\" (UID: \"8a0c618d-6d9b-4257-98b1-36a50532c20b\") " pod="openshift-must-gather-wxb5l/perf-node-gather-daemonset-vsqzk"
Jul 20 19:46:40.942780 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:46:40.942756    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-wxb5l\"/\"default-dockercfg-5rgks\""
Jul 20 19:46:40.950772 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:46:40.950749    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wxb5l/perf-node-gather-daemonset-vsqzk"
Jul 20 19:46:41.082077 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:46:41.082047    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wxb5l/perf-node-gather-daemonset-vsqzk"]
Jul 20 19:46:41.085045 ip-10-0-139-141 kubenswrapper[2563]: W0720 19:46:41.085015    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod8a0c618d_6d9b_4257_98b1_36a50532c20b.slice/crio-ec73da55aa1e554a2708d6094c79074c755ac627908ba1353d9f6790f37ad6db WatchSource:0}: Error finding container ec73da55aa1e554a2708d6094c79074c755ac627908ba1353d9f6790f37ad6db: Status 404 returned error can't find the container with id ec73da55aa1e554a2708d6094c79074c755ac627908ba1353d9f6790f37ad6db
Jul 20 19:46:41.586292 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:46:41.586244    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wxb5l/perf-node-gather-daemonset-vsqzk" event={"ID":"8a0c618d-6d9b-4257-98b1-36a50532c20b","Type":"ContainerStarted","Data":"8768d61f693b2bea20f68215d69a20c0e8bf33da5552bf02ae32def7d0cda975"}
Jul 20 19:46:41.586486 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:46:41.586304    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wxb5l/perf-node-gather-daemonset-vsqzk" event={"ID":"8a0c618d-6d9b-4257-98b1-36a50532c20b","Type":"ContainerStarted","Data":"ec73da55aa1e554a2708d6094c79074c755ac627908ba1353d9f6790f37ad6db"}
Jul 20 19:46:41.586486 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:46:41.586368    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-wxb5l/perf-node-gather-daemonset-vsqzk"
Jul 20 19:46:41.604569 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:46:41.604520    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-wxb5l/perf-node-gather-daemonset-vsqzk" podStartSLOduration=1.604505525 podStartE2EDuration="1.604505525s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:46:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:46:41.602800306 +0000 UTC m=+2761.286328328" watchObservedRunningTime="2026-07-20 19:46:41.604505525 +0000 UTC m=+2761.288033551"
Jul 20 19:46:42.611859 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:46:42.611825    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-f9znr_056c4b09-fdec-4f12-bcb2-e1fe989dec49/dns/0.log"
Jul 20 19:46:42.631888 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:46:42.631865    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-f9znr_056c4b09-fdec-4f12-bcb2-e1fe989dec49/kube-rbac-proxy/0.log"
Jul 20 19:46:42.721474 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:46:42.721450    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-fz2dc_25f85dbe-c3b0-41a1-8c59-a68cc45c1306/dns-node-resolver/0.log"
Jul 20 19:46:43.341712 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:46:43.341678    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5bc96949dd-d2ptw_79a69811-c32f-42da-861d-cf144cc63105/registry/0.log"
Jul 20 19:46:43.422023 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:46:43.421989    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-dz7gc_c43a2dd8-3638-4e80-ba88-bc0d0ea5f866/node-ca/0.log"
Jul 20 19:46:44.565198 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:46:44.565168    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-566bb86f76-76sh9_0f6d7218-88e0-45ab-a3fd-c0e89976d06a/kube-auth-proxy/0.log"
Jul 20 19:46:44.722909 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:46:44.722873    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-hscqk_711594ee-0175-47a4-91df-9aa8a4485a38/payload-processing/0.log"
Jul 20 19:46:45.510749 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:46:45.510719    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-z8fvx_57f10f00-c288-4363-8126-1c278a8d249d/serve-healthcheck-canary/0.log"
Jul 20 19:46:46.084146 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:46:46.084117    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-h8vpg_7f6ea8d6-0900-4dde-8fd7-299e106bb611/kube-rbac-proxy/0.log"
Jul 20 19:46:46.105503 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:46:46.105474    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-h8vpg_7f6ea8d6-0900-4dde-8fd7-299e106bb611/exporter/0.log"
Jul 20 19:46:46.127883 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:46:46.127861    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-h8vpg_7f6ea8d6-0900-4dde-8fd7-299e106bb611/extractor/0.log"
Jul 20 19:46:47.600696 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:46:47.600666    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-wxb5l/perf-node-gather-daemonset-vsqzk"
Jul 20 19:46:49.072004 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:46:49.071975    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6dc69fccc8-qqqqf_2d6f1300-3ae0-46be-8df6-0b996c694722/manager/0.log"
Jul 20 19:46:49.090873 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:46:49.090853    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6dc69fccc8-qqqqf_2d6f1300-3ae0-46be-8df6-0b996c694722/copy-manifests/0.log"
Jul 20 19:46:50.304380 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:46:50.303428    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-569f4dcc7-mzsr8_b17eec12-8d7d-4b9f-8b85-15f5118aee60/manager/0.log"
Jul 20 19:46:50.536744 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:46:50.536714    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-566bb86f76-76sh9_0f6d7218-88e0-45ab-a3fd-c0e89976d06a/kube-auth-proxy/0.log"
Jul 20 19:46:50.664619 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:46:50.664593    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-hscqk_711594ee-0175-47a4-91df-9aa8a4485a38/payload-processing/0.log"
Jul 20 19:46:52.203698 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:46:52.203658    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-566bb86f76-76sh9_0f6d7218-88e0-45ab-a3fd-c0e89976d06a/kube-auth-proxy/0.log"
Jul 20 19:46:52.326881 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:46:52.326853    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-hscqk_711594ee-0175-47a4-91df-9aa8a4485a38/payload-processing/0.log"
Jul 20 19:46:56.968016 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:46:56.967987    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-j6vb4_af77ba01-d870-408b-badb-3910b3fc4e0e/kube-multus-additional-cni-plugins/0.log"
Jul 20 19:46:56.992436 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:46:56.992412    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-j6vb4_af77ba01-d870-408b-badb-3910b3fc4e0e/egress-router-binary-copy/0.log"
Jul 20 19:46:57.013660 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:46:57.013641    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-j6vb4_af77ba01-d870-408b-badb-3910b3fc4e0e/cni-plugins/0.log"
Jul 20 19:46:57.033956 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:46:57.033930    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-j6vb4_af77ba01-d870-408b-badb-3910b3fc4e0e/bond-cni-plugin/0.log"
Jul 20 19:46:57.053636 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:46:57.053610    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-j6vb4_af77ba01-d870-408b-badb-3910b3fc4e0e/routeoverride-cni/0.log"
Jul 20 19:46:57.076037 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:46:57.076020    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-j6vb4_af77ba01-d870-408b-badb-3910b3fc4e0e/whereabouts-cni-bincopy/0.log"
Jul 20 19:46:57.095917 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:46:57.095897    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-j6vb4_af77ba01-d870-408b-badb-3910b3fc4e0e/whereabouts-cni/0.log"
Jul 20 19:46:57.284615 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:46:57.284589    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-mpz54_0a1f8730-2c45-4088-a934-dd6cb2467293/kube-multus/0.log"
Jul 20 19:46:57.457644 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:46:57.457615    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-cd24s_073c7302-c5d7-4bfc-87fa-993163c6fd01/network-metrics-daemon/0.log"
Jul 20 19:46:57.477585 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:46:57.477504    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-cd24s_073c7302-c5d7-4bfc-87fa-993163c6fd01/kube-rbac-proxy/0.log"
Jul 20 19:46:58.278157 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:46:58.278109    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5j2qh_146cbab8-fe62-44fd-91c3-c25bd7d36c0c/ovn-controller/0.log"
Jul 20 19:46:58.295107 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:46:58.295064    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5j2qh_146cbab8-fe62-44fd-91c3-c25bd7d36c0c/ovn-acl-logging/0.log"
Jul 20 19:46:58.320398 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:46:58.320364    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5j2qh_146cbab8-fe62-44fd-91c3-c25bd7d36c0c/kube-rbac-proxy-node/0.log"
Jul 20 19:46:58.341443 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:46:58.341417    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5j2qh_146cbab8-fe62-44fd-91c3-c25bd7d36c0c/kube-rbac-proxy-ovn-metrics/0.log"
Jul 20 19:46:58.361078 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:46:58.361059    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5j2qh_146cbab8-fe62-44fd-91c3-c25bd7d36c0c/northd/0.log"
Jul 20 19:46:58.386420 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:46:58.386400    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5j2qh_146cbab8-fe62-44fd-91c3-c25bd7d36c0c/nbdb/0.log"
Jul 20 19:46:58.414430 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:46:58.414412    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5j2qh_146cbab8-fe62-44fd-91c3-c25bd7d36c0c/sbdb/0.log"
Jul 20 19:46:58.469274 ip-10-0-139-141 kubenswrapper[2563]: I0720 19:46:58.469244    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5j2qh_146cbab8-fe62-44fd-91c3-c25bd7d36c0c/ovnkube-controller/0.log"